shimmyshimmer/qwen3-8b-fp8-rowwise
8B
•
Updated
•
27
Michael Han
shimmyshimmer
AI & ML interests
None yet
Recent Activity
liked
a model
about 19 hours ago
zai-org/GLM-4.6
liked
a model
2 days ago
unsloth/Kimi-K2-Thinking-GGUF
reacted
to
danielhanchen's
post
with 🤗
2 days ago
You can now run Kimi K2 Thinking locally with our Dynamic 1-bit GGUFs: https://huggingface.co/unsloth/Kimi-K2-Thinking-GGUF
We shrank the 1T model to 245GB (-62%) & retained ~85% of accuracy on Aider Polyglot. Run on >247GB RAM for fast inference.
We also collaborated with the Moonshot AI Kimi team on a system prompt fix! 🥰
Guide + fix details: https://docs.unsloth.ai/models/kimi-k2-thinking-how-to-run-locally
Organizations
