Omkar Pangarkar

omkarenator's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted an article 1 day ago

view article

Article

Mixture of Experts Explained

• 

Dec 11, 2023

•

981

upvoted a collection 4 days ago

🤖 Agents

Collection

21 items • Updated Dec 31, 2024 • 168

upvoted an article 20 days ago

view article

Article

SmolLM3: smol, multilingual, long-context reasoner

• 

Jul 8

•

730

upvoted a paper 22 days ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 151

upvoted a collection 2 months ago

The Ultimate Collection of Code Classifiers

Collection

🔥 15 classifiers, 124M parameters, one per programming language— for assessing the educational value of GitHub code • 15 items • Updated May 5 • 15

upvoted a paper 4 months ago

Essential-Web v1.0: 24T tokens of organized web data

Paper • 2506.14111 • Published Jun 17 • 46

upvoted an article 4 months ago

view article

Article

nanoJAXGPT: A pedagogical introduction to JAX/Equinox

• 

Oct 23, 2024

•

6

upvoted a paper 7 months ago

CLIMB: CLustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training

Paper • 2504.13161 • Published Apr 17 • 94

upvoted an article 10 months ago

view article

Article

Open-R1: a fully open reproduction of DeepSeek-R1

• 

Jan 28

•

886

upvoted an article about 1 year ago

view article

Article

Scaling AI-based Data Processing with Hugging Face + Dask

• 

Oct 9, 2024

•

32

upvoted a paper about 1 year ago

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler

Paper • 2408.13359 • Published Aug 23, 2024 • 24

upvoted 6 papers almost 2 years ago

Neural Circuit Diagrams: Robust Diagrams for the Communication, Implementation, and Analysis of Deep Learning Architectures

Paper • 2402.05424 • Published Feb 8, 2024 • 16

Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling

Paper • 2401.16380 • Published Jan 29, 2024 • 50

Transformers are Multi-State RNNs

Paper • 2401.06104 • Published Jan 11, 2024 • 39

The Stack: 3 TB of permissively licensed source code

Paper • 2211.15533 • Published Nov 20, 2022 • 6

LLM Augmented LLMs: Expanding Capabilities through Composition

Paper • 2401.02412 • Published Jan 4, 2024 • 38

LLM in a flash: Efficient Large Language Model Inference with Limited Memory

Paper • 2312.11514 • Published Dec 12, 2023 • 260