IBM Granite

ibm-granite's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

danielhanchen 

posted an update about 6 hours ago

view post

Post

214

You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: unsloth/Kimi-K2-Thinking-GGUF

We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.

We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰

Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally

See translation

• 

❤️

3

3

🔥

2

2

🚀

2

2

🤗

2

2

🤯

1

1

+

Reply

mrutkows 

updated a collection about 24 hours ago

Granite Quantized Models

Collection

Quantized versions of IBM Granite models. Licensed under the Apache 2.0 license. • 42 items • Updated about 24 hours ago • 24

gabegoodhart 

in ibm-granite/granite-vision-3.2-2b 1 day ago

Doesn't Work

3

#12 opened 1 day ago by

qpqpqpqpqpqp

gabegoodhart 

in ibm-granite/granite-vision-3.3-2b 1 day ago

Doesn't Work

2

#5 opened 1 day ago by

qpqpqpqpqpqp

gabegoodhart 

in ibm-granite/granite-4.0-micro 2 days ago

Why GraniteMoeHybridForCausalLM?

4

#4 opened 4 days ago by

liebedan

pawasthy 

in ibm-granite/granite-embedding-278m-multilingual 2 days ago

Onnx Support

1

#3 opened 8 months ago by

Florianoli

Adding ONNX file of this model

1

#4 opened 5 months ago by

kreysix

pawasthy 

in ibm-granite/granite-embedding-english-r2 2 days ago

Update pipeline tag to feature-extraction

1

#1 opened 2 months ago by

nielsr

pawasthy 

in ibm-granite/granite-embedding-reranker-english-r2 2 days ago

Add `text-embeddings-inference` tag and snippets

❤️ 3

1

#3 opened 3 days ago by

alvarobartt

gabegoodhart 

in ibm-granite/granite-4.0-350m 4 days ago

Uninitialized weights

3

#1 opened 7 days ago by

andito

stefanberger 

updated 2 models 5 days ago

ibm-granite/granite-4.0-tiny-preview

Text Generation • 7B • Updated 5 days ago • 56.2k • 178

ibm-granite/granite-4.0-tiny-base-preview

Text Generation • 7B • Updated 5 days ago • 292 • 31

ranarag 

updated 8 models 5 days ago

ibm-granite/granite-4.0-h-small-base

32B • Updated 5 days ago • 1.48k • 40

ibm-granite/granite-4.0-h-small

Text Generation • 32B • Updated 5 days ago • 20k • 264

ibm-granite/granite-4.0-h-tiny-base

Text Generation • 7B • Updated 5 days ago • 2.02k • 28

ibm-granite/granite-4.0-h-tiny

Text Generation • 7B • Updated 5 days ago • 22.9k • 155

ibm-granite/granite-4.0-h-micro-base

Text Generation • 3B • Updated 5 days ago • 3.61k • 30

ibm-granite/granite-4.0-h-micro

Text Generation • 3B • Updated 5 days ago • 11.3k • 114

ibm-granite/granite-4.0-micro-base

Text Generation • 3B • Updated 5 days ago • 2.22k • 35

ibm-granite/granite-4.0-micro

Text Generation • 3B • Updated 5 days ago • 33.2k • 224