marcelone
/

Llama-3.1-Swallow-8B-Instruct-v0.5-gguf

Model card Files Files and versions

marcelone commited on Jul 27

Commit

4c47f5f

·

verified ·

1 Parent(s): ec0410a

Update README.md

Files changed (1) hide show

README.md +7 -1

README.md CHANGED Viewed

@@ -12,4 +12,10 @@ base_model_relation: quantized
 * **Bits Per Weight (BPW)**: `8.01`
 # Swallow-8B-it-v05-gguf-q8_0-mixed-v2
 * **Quantization Type**: Mixed Precision (`bf16`, `q5_K`, `q6_K`, `q8_0`)
-* **Bits Per Weight (BPW)**: `9.31`

 * **Bits Per Weight (BPW)**: `8.01`
 # Swallow-8B-it-v05-gguf-q8_0-mixed-v2
 * **Quantization Type**: Mixed Precision (`bf16`, `q5_K`, `q6_K`, `q8_0`)
+* **Bits Per Weight (BPW)**: `9.31`
+# Swallow-8B-it-v05-gguf-q8_0-mixed-v3
+* **Quantization Type**: Mixed Precision (`bf16`, `q6_K`, `q8_0`)
+* **Bits Per Weight (BPW)**: `11.44`
+# Swallow-8B-it-v05-gguf-q8_0-mixed-v4
+* **Quantization Type**: Mixed Precision (`bf16`, `q8_0`)
+* **Bits Per Weight (BPW)**: `13.38`