koh1018 commited on
Commit
78fb2c7
·
1 Parent(s): ef707bc

모델 추가 양자화 및 발음 부분 프롬프트 변경

Browse files
Files changed (1) hide show
  1. app.py +3 -2
app.py CHANGED
@@ -19,7 +19,8 @@ app = FastAPI()
19
  # model_repo_id = "lmstudio-community/gemma-2-2b-it-GGUF"
20
  # model_filename = "gemma-2-2b-it-Q4_K_M.gguf"
21
  model_repo_id = "Qwen/Qwen2-0.5B-Instruct-GGUF"
22
- model_filename = "qwen2-0_5b-instruct-q4_k_m.gguf"
 
23
 
24
  # # 7B 모델인 Qwen 2.5로 변경하여 테스트
25
  # model_repo_id = "Triangle104/Qwen2.5-7B-Instruct-Q4_K_S-GGUF"
@@ -53,7 +54,7 @@ async def translate_all_in_one(request: TranslationRequest):
53
  Given the following Korean text, perform three tasks.
54
  1. Translate the text into natural, everyday English.
55
  2. Translate the text into natural, everyday Japanese.
56
- 3. Provide the Korean pronunciation (Hangul) for the generated Japanese translation.
57
 
58
  Format your response as a single, valid JSON object with the keys "english", "japanese", and "pronunciation".
59
 
 
19
  # model_repo_id = "lmstudio-community/gemma-2-2b-it-GGUF"
20
  # model_filename = "gemma-2-2b-it-Q4_K_M.gguf"
21
  model_repo_id = "Qwen/Qwen2-0.5B-Instruct-GGUF"
22
+ # model_filename = "qwen2-0_5b-instruct-q4_k_m.gguf"
23
+ model_filename = "qwen2-0_5b-instruct-q2_k.gguf"
24
 
25
  # # 7B 모델인 Qwen 2.5로 변경하여 테스트
26
  # model_repo_id = "Triangle104/Qwen2.5-7B-Instruct-Q4_K_S-GGUF"
 
54
  Given the following Korean text, perform three tasks.
55
  1. Translate the text into natural, everyday English.
56
  2. Translate the text into natural, everyday Japanese.
57
+ 3. Write the Japanese translation generated in 2 into Korean as it is pronounced.
58
 
59
  Format your response as a single, valid JSON object with the keys "english", "japanese", and "pronunciation".
60