Hugging Face's logo

abhinav-2k23
/
Llama-3-8B-AWQ-4bit_v4

Text Generation
Transformers
Safetensors
English
llama
conversational
text-generation-inference
4-bit precision
awq
Model card Files
xet
Community
README.md exists but content is empty.
Downloads last month
2
Safetensors
Model size
2B params
Tensor type
I32
·
F16
·
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for abhinav-2k23/Llama-3-8B-AWQ-4bit_v4

Base model

meta-llama/Meta-Llama-3-8B-Instruct
Quantized
(260)
this model