krishnateja95 commited on
Commit
44050b0
·
verified ·
1 Parent(s): c1c4af9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -189,6 +189,19 @@ The model was evaluated on the OpenLLMv1 leaderboard task, using [lm-evaluation-
189
  --greedy
190
  ```
191
 
 
 
 
 
 
 
 
 
 
 
 
 
 
192
  </details>
193
 
194
 
 
189
  --greedy
190
  ```
191
 
192
+
193
+ **Multimodal Evaluation**
194
+ ```
195
+ lm_eval \
196
+ --model vllm-vlm \
197
+ --model_args pretrained="nm-testing/Llama-4-Scout-17B-16E-Instruct-BLOCK-FP8",dtype=auto,add_bos_token=False,max_model_len=1000000,tensor_parallel_size=8,gpu_memory_utilization=0.9,enable_chunked_prefill=True,trust_remote_code=True,max_images=10 \
198
+ --tasks mmlu \
199
+ --apply_chat_template \
200
+ --batch_size auto
201
+ ```
202
+
203
+
204
+
205
  </details>
206
 
207