Rush Tabesh's picture

1 7 2

Rush Tabesh

soroushtabesh

·

https://tabesh.me

AI & ML interests

None yet

Recent Activity

authored a paper 15 days ago

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training

upvoted a paper about 2 months ago

Bridging the Gap Between Promise and Performance for Microscaling FP4 Quantization

upvoted a paper 4 months ago

The Geometry of LLM Quantization: GPTQ as Babai's Nearest Plane Algorithm

View all activity

Organizations

authored a paper 15 days ago

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training

Paper • 2510.18784 • Published Oct 21

authored a paper 6 months ago

Quartet: Native FP4 Training Can Be Optimal for Large Language Models

Paper • 2505.14669 • Published May 20 • 78

authored 2 papers 10 months ago

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation

Paper • 2401.04679 • Published Jan 9, 2024 • 2

QuEST: Stable Training of LLMs with 1-Bit Weights and Activations

Paper • 2502.05003 • Published Feb 7 • 43

authored a paper 11 months ago

HALO: Hadamard-Assisted Lossless Optimization for Efficient Low-Precision LLM Training and Fine-Tuning

Paper • 2501.02625 • Published Jan 5 • 16