brunopio
/

Qwen2.5-7B-Instruct-1M-nbits4-GS64-Axis1-HQQ-T

8-bit precision

Model card Files Files and versions

Use the latest transformers for this model.

Downloads last month: -

Safetensors

Model size

5B params

Tensor type

F16

·

I64

·

U8

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for brunopio/Qwen2.5-7B-Instruct-1M-nbits4-GS64-Axis1-HQQ-T

Base model

Qwen/Qwen2.5-7B

Finetuned

Qwen/Qwen2.5-7B-Instruct-1M

Quantized

(72)

this model