INSAIT-Institute
/

MamayLM-Gemma-3-4B-IT-v1.0

Image-Text-to-Text

text-generation-inference

Model card Files Files and versions

hannayukhymenko commited on Sep 27

Commit

d412311

·

verified ·

1 Parent(s): 88b5162

fix eos token id

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -83,7 +83,7 @@ generation_params = GenerationConfig(
     top_k=25,
     top_p=1,
     repetition_penalty=1.1,
-    eos_token_id=[1,107],
     do_sample=True
 )
 ```
@@ -143,7 +143,7 @@ sampling_params = SamplingParams(
     top_k=25,
     top_p=1,
     repetition_penalty=1.1,
-    stop_token_ids=[1, 107],
 )
 llm = LLM(
     model="INSAIT-Institute/MamayLM-Gemma-3-4B-IT-v1.0",

     top_k=25,
     top_p=1,
     repetition_penalty=1.1,
+    # eos_token_id=[1,106],
     do_sample=True
 )
 ```
     top_k=25,
     top_p=1,
     repetition_penalty=1.1,
+    stop_token_ids=[1, 106],
 )
 llm = LLM(
     model="INSAIT-Institute/MamayLM-Gemma-3-4B-IT-v1.0",