Update README.md
Browse files
README.md
CHANGED
|
@@ -17,9 +17,9 @@ main : 8bpw h8
|
|
| 17 |
|
| 18 |
Using [VMware/open-instruct](https://huggingface.co/datasets/VMware/open-instruct/viewer) as dataset
|
| 19 |
|
| 20 |
-
Quantization settings : ```python convert.py -i models/maywell_PiVoT-0.1-
|
| 21 |
-
```python convert.py -i models/maywell_PiVoT-0.1-
|
| 22 |
-
```python convert.py -i models/maywell_PiVoT-0.1-
|
| 23 |
|
| 24 |
### below this line is original readme
|
| 25 |
|
|
|
|
| 17 |
|
| 18 |
Using [VMware/open-instruct](https://huggingface.co/datasets/VMware/open-instruct/viewer) as dataset
|
| 19 |
|
| 20 |
+
Quantization settings : ```python convert.py -i models/maywell_PiVoT-0.1-early -o PiVoT-0.1-early-temp -cf PiVoT-0.1-early-8bpw-h8-exl2 -c 0000.parquet -l 4096 -b 8 -hb 8```
|
| 21 |
+
```python convert.py -i models/maywell_PiVoT-0.1-early -o PiVoT-0.1-early-temp2 -cf PiVoT-0.1-early-6bpw-h8-exl22 -c 0000.parquet -l 4096 -b 6 -hb 8 -m PiVoT-0.1-early-temp/measurement.json```
|
| 22 |
+
```python convert.py -i models/maywell_PiVoT-0.1-early -o PiVoT-0.1-early-temp3 -cf PiVoT-0.1-early-4bpw-h8-exl2 -c 0000.parquet -l 4096 -b 4 -hb 8 -m PiVoT-0.1-early-temp/measurement.json```
|
| 23 |
|
| 24 |
### below this line is original readme
|
| 25 |
|