Edit Models filters

Apps

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

2,878

Full-text search

Active filters: 3-bit

mlx-community/granite-4.0-350m-3bit

Text Generation • 44.1M • Updated 21 days ago • 32

mlx-community/granite-4.0-350m-base-3bit

Text Generation • 44.1M • Updated 21 days ago • 17

NexVeridian/granite-4.0-h-1b-3bit

Text Generation • 0.2B • Updated 21 days ago • 17

NexVeridian/granite-4.0-h-350m-3bit

Text Generation • 42.8M • Updated 21 days ago • 16

NexVeridian/granite-4.0-1b-3bit

Text Generation • 0.2B • Updated 21 days ago • 23

NexVeridian/granite-4.0-350m-3bit

Text Generation • 44.1M • Updated 21 days ago • 18

Matt300209/3bit_dequant

1B • Updated 21 days ago • 10

Matt300209/3bit_dequant_new

1B • Updated 21 days ago • 13

catalystsec/MiniMax-M2-3bit-DWQ

Text Generation • 229B • Updated 19 days ago • 1.37k • 2

MaziyarPanahi/marin-32b-base-GGUF

Text Generation • 33B • Updated 18 days ago • 164

mlx-community/Kimi-Linear-48B-A3B-Instruct-3bit

Text Generation • 49B • Updated 17 days ago • 289

mlx-community/Ring-flash-linear-2.0-3bit

Text Generation • 104B • Updated 16 days ago • 14

mlx-community/Ring-flash-linear-2.0-128k-3bit

Text Generation • 104B • Updated 16 days ago • 35

NexVeridian/Kimi-Linear-48B-A3B-Instruct-3bit

Text Generation • 49B • Updated 12 days ago • 105

NexVeridian/zeta-3bit

Text Generation • 1.0B • Updated 12 days ago • 9

Hunor64/Dolphin-Mistral-24B-Venice-Edition-mlx-3Bit

Text Generation • 24B • Updated 10 days ago • 429

zerofata/MS3.2-PaintedFantasy-v3-24B-exl3-3bpw

Text Generation • 5B • Updated 8 days ago • 28

CallMcMargin/Qwen2.5-14B-Instruct-1M-abliterated-mlx-bf16-affine-qgroup32-q3

Text Generation • 15B • Updated 8 days ago • 17

trams1o/GLM-4-32B-0414-mlx-3Bit

Text Generation • 33B • Updated 7 days ago • 101

McG-221/Fallen-Command-A-111B-v1.1-mlx-3Bit

111B • Updated 4 days ago • 47

Omnico/gemma-3-27b-it-abliterated-mlx-3Bit

Image-Text-to-Text • 27B • Updated 4 days ago • 156

garrison/Precog-123B-v1-mlx-3Bit

123B • Updated 3 days ago • 30

garrison/Precog-24B-v1-mlx-3Bit

24B • Updated 3 days ago • 33

MaziyarPanahi/MiniCPM4.1-8B-GGUF

Text Generation • 8B • Updated 1 day ago • 24

MaziyarPanahi/MiroThinker-v1.0-8B-GGUF

Text Generation • 8B • Updated 1 day ago • 63

MaziyarPanahi/MiroThinker-v1.0-30B-GGUF

Text Generation • 31B • Updated 1 day ago • 40

MaziyarPanahi/Apertus-8B-Instruct-2509-GGUF

Text Generation • 8B • Updated 1 day ago • 35

garrison/GLM-4.5-Air-REAP-82B-A12B-mlx-3Bit

Text Generation • 82B • Updated about 8 hours ago