Update README.md
Browse files
README.md
CHANGED
|
@@ -189,6 +189,19 @@ The model was evaluated on the OpenLLMv1 leaderboard task, using [lm-evaluation-
|
|
| 189 |
--greedy
|
| 190 |
```
|
| 191 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 192 |
</details>
|
| 193 |
|
| 194 |
|
|
|
|
| 189 |
--greedy
|
| 190 |
```
|
| 191 |
|
| 192 |
+
|
| 193 |
+
**Multimodal Evaluation**
|
| 194 |
+
```
|
| 195 |
+
lm_eval \
|
| 196 |
+
--model vllm-vlm \
|
| 197 |
+
--model_args pretrained="nm-testing/Llama-4-Scout-17B-16E-Instruct-BLOCK-FP8",dtype=auto,add_bos_token=False,max_model_len=1000000,tensor_parallel_size=8,gpu_memory_utilization=0.9,enable_chunked_prefill=True,trust_remote_code=True,max_images=10 \
|
| 198 |
+
--tasks mmlu \
|
| 199 |
+
--apply_chat_template \
|
| 200 |
+
--batch_size auto
|
| 201 |
+
```
|
| 202 |
+
|
| 203 |
+
|
| 204 |
+
|
| 205 |
</details>
|
| 206 |
|
| 207 |
|