Update README.md
Browse files
README.md
CHANGED
|
@@ -19,8 +19,13 @@ EXL3 quants of [moonshotai/Kimi-Dev-72B](https://huggingface.co/moonshotai/Kimi-
|
|
| 19 |
### Quants
|
| 20 |
| Quant(Revision) | Bits per Weight | Head Bits |
|
| 21 |
| -------- | ---------- | --------- |
|
|
|
|
|
|
|
| 22 |
| [3.5_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/3.5bpw_H6) | 3.5 | 6 |
|
|
|
|
|
|
|
| 23 |
| [5.0_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/5.0bpw_H6) | 5.0 | 6 |
|
|
|
|
| 24 |
| [8.0_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/8.0bpw_H6) | 8.0 | 6 |
|
| 25 |
| [8.0_H8](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/8.0bpw_H8) | 8.0 | 8 |
|
| 26 |
|
|
|
|
| 19 |
### Quants
|
| 20 |
| Quant(Revision) | Bits per Weight | Head Bits |
|
| 21 |
| -------- | ---------- | --------- |
|
| 22 |
+
| [2.5_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/2.5bpw_H6) | 2.5 | 6 |
|
| 23 |
+
| [3.35_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/3.35bpw_H6) | 3.35 | 6 |
|
| 24 |
| [3.5_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/3.5bpw_H6) | 3.5 | 6 |
|
| 25 |
+
| [4.0_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/4.0bpw_H6) | 4.0 | 6 |
|
| 26 |
+
| [4.25_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/4.25bpw_H6) | 4.25 | 6 |
|
| 27 |
| [5.0_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/5.0bpw_H6) | 5.0 | 6 |
|
| 28 |
+
| [6.0_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/6.0bpw_H6) | 6.0 | 6 |
|
| 29 |
| [8.0_H6](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/8.0bpw_H6) | 8.0 | 6 |
|
| 30 |
| [8.0_H8](https://huggingface.co/ArtusDev/moonshotai_Kimi-Dev-72B-EXL3/tree/8.0bpw_H8) | 8.0 | 8 |
|
| 31 |
|