Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
skymizer
/
Llama-3.1-8B-Instruct-GGUF
like
0
Follow
skymizer
20
GGUF
llama
conversational
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
YAML Metadata Warning:
empty or missing yaml metadata in repo card (
https://huggingface.co/docs/hub/model-cards#model-card-metadata
)
quantized from
meta-llama/Llama-3.1-8B-Instruct
Downloads last month
89
GGUF
Model size
8B params
Architecture
llama
Chat template
Hardware compatibility
Log In
to view the estimation
3-bit
Q3_K_M
4.02 GB
4-bit
Q4_K_M
4.92 GB
5-bit
Q5_K_M
5.73 GB
6-bit
Q6_K
6.6 GB
8-bit
Q8_0
8.54 GB
16-bit
BF16
16.1 GB
F16
16.1 GB
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support
Collection including
skymizer/Llama-3.1-8B-Instruct-GGUF
GGUF models
Collection
17 items
โข
Updated
Aug 27