Adding AWQ quants
#5
by
Suparious
- opened
README.md
CHANGED
|
@@ -365,6 +365,10 @@ model.generate(**gen_input)
|
|
| 365 |
|
| 366 |
- https://huggingface.co/bartowski/Einstein-v6-7B-exl2
|
| 367 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 368 |
# 🎯 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 369 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Weyaxi__Einstein-v6-7B)
|
| 370 |
|
|
|
|
| 365 |
|
| 366 |
- https://huggingface.co/bartowski/Einstein-v6-7B-exl2
|
| 367 |
|
| 368 |
+
## AWQ [@solidrust](https://huggingface.co/solidrust)
|
| 369 |
+
|
| 370 |
+
- https://huggingface.co/solidrust/Einstein-v6-7B-AWQ
|
| 371 |
+
|
| 372 |
# 🎯 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
| 373 |
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_Weyaxi__Einstein-v6-7B)
|
| 374 |
|