RedHatAI
/

granite-3.1-2b-instruct-FP8-dynamic

Text Generation

compressed-tensors

Model card Files Files and versions

nm-research commited on Jan 20

Commit

34b5056

·

verified ·

1 Parent(s): c8b4ee2

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -67,7 +67,7 @@ This model was created with [llm-compressor](https://github.com/vllm-project/llm
 ```bash
-python quantize.py --model_id ibm-granite/granite-3.1-2b-base --save_path "output_dir/"
 ```
 ```python

 ```bash
+python quantize.py --model_id ibm-granite/granite-3.1-2b-instruct --save_path "output_dir/"
 ```
 ```python