Commit
·
f521753
1
Parent(s):
173fc8d
GGUF readme
Browse files- gguf/README.md +22 -0
gguf/README.md
CHANGED
|
@@ -0,0 +1,22 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Pony V7 GGUFs
|
| 2 |
+
|
| 3 |
+
Install the ComfyUI [GGUF nodes by City96](https://github.com/city96/ComfyUI-GGUF) before using these workflows.
|
| 4 |
+
|
| 5 |
+
We recommend Q8_0 for the best balance between quality and file size.
|
| 6 |
+
|
| 7 |
+
| VARIANT | MAX VRAM |
|
| 8 |
+
|---------|------|
|
| 9 |
+
| F16 | ~16GB |
|
| 10 |
+
| [Q8_0](base-v7-Q8_0.gguf) | ~10GB |
|
| 11 |
+
| Q6_K | ~8GB |
|
| 12 |
+
| Q5_K_M | ~7GB |
|
| 13 |
+
| [Q4_0](base-v7-Q4_0.gguf) | ~6.5GB |
|
| 14 |
+
| Q4_K_M | ~6.5GB |
|
| 15 |
+
| Q3_K_L | ~6GB |
|
| 16 |
+
| Q3_K_S | ~6GB |
|
| 17 |
+
| Q2_K | ~5GB |
|
| 18 |
+
|
| 19 |
+
Download ComfyUI workflow for GGUF [here](../workflows/poly-v7-gguf.png).
|
| 20 |
+
|
| 21 |
+
|
| 22 |
+
|