metadata
base_model:
- Guilherme34/Samantha-3b-beta0.1-model
language:
- en
library_name: transformers
license: llama3.2
tags:
- bnb-my-repo
- llama-3
- llama
- meta
- facebook
- unsloth
- transformers
- onnx
Guilherme34/Samantha-3b-beta0.1-model (Quantized)
Description
This model is a quantized version of the original model Guilherme34/Samantha-3b-beta0.1-model.
It's quantized using the BitsAndBytes library to 4-bit using the bnb-my-repo space.
Quantization Details
- Quantization Type: int4
- bnb_4bit_quant_type: nf4
- bnb_4bit_use_double_quant: True
- bnb_4bit_compute_dtype: bfloat16
- bnb_4bit_quant_storage: uint8
📄 Original Model Information
BETA MODEL, ITS NOT FINISHED
DOES NOT NEED ANY SYSTEM PROMPT, you can leave empty