Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
RedHatAI
/
granite-3.1-8b-instruct-quantized.w8a8
like
2
Follow
Red Hat AI
1.64k
Text Generation
Safetensors
English
granite
w8a8
int8
vllm
conversational
text-generation-inference
8-bit precision
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Deploy
Use this model
main
granite-3.1-8b-instruct-quantized.w8a8
8.78 GB
5 contributors
History:
23 commits
robgreenberg3
Update README.md
ad22f38
verified
about 2 months ago
.gitattributes
Safe
1.52 kB
initial commit
10 months ago
README.md
21.6 kB
Update README.md
about 2 months ago
added_tokens.json
Safe
87 Bytes
Add model files
10 months ago
config.json
Safe
1.91 kB
Add model files
10 months ago
generation_config.json
Safe
132 Bytes
Add model files
10 months ago
merges.txt
Safe
442 kB
Add model files
10 months ago
model-00001-of-00002.safetensors
Safe
4.99 GB
xet
Add model files
10 months ago
model-00002-of-00002.safetensors
Safe
3.79 GB
xet
Add model files
10 months ago
model.safetensors.index.json
Safe
54.3 kB
Add model files
10 months ago
recipe.yaml
Safe
723 Bytes
Add model files
10 months ago
special_tokens_map.json
Safe
701 Bytes
Add model files
10 months ago
tokenizer.json
Safe
3.48 MB
Add model files
10 months ago
tokenizer_config.json
Safe
8.07 kB
Add model files
10 months ago
vocab.json
Safe
777 kB
Add model files
10 months ago