Add quant links
#1
by
bartowski
- opened
README.md
CHANGED
|
@@ -254,7 +254,9 @@ model.generate(**gen_input)
|
|
| 254 |
|
| 255 |
# 🔄 Quantizationed versions
|
| 256 |
|
| 257 |
-
|
|
|
|
|
|
|
| 258 |
|
| 259 |
|
| 260 |
# 🎯 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|
|
|
|
| 254 |
|
| 255 |
# 🔄 Quantizationed versions
|
| 256 |
|
| 257 |
+
GGUF: https://huggingface.co/bartowski/Einstein-v6-7B-GGUF
|
| 258 |
+
|
| 259 |
+
ExLlamaV2: https://huggingface.co/bartowski/Einstein-v6-7B-exl2
|
| 260 |
|
| 261 |
|
| 262 |
# 🎯 [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
|