Pith. sign in

REVIEW 2 cited by

With Shared Microexponents, A Little Shifting Goes a Long Way

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2302.08007 v2 pith:6OZUPSJX submitted 2023-02-16 cs.LG cs.AIcs.AR

Bita Rouhani , Ritchie Zhao , Venmugil Elango , Rasoul Shafipour , Mathew Hall , Maral Mesmakhosroshahi , Ankit More , Levi Melnick
show 14 more authors
Maximilian Golub Girish Varatkar Lei Shao Gaurav Kolhe Dimitry Melts Jasmine Klar Renee L'Heureux Matt Perry Doug Burger Eric Chung Zhaoxia Deng Sam Naghshineh Jongsoo Park Maxim Naumov
This is my paper · ORCID
classification cs.LGcs.AIcs.AR
keywords microexponentsquantizationsharedblockfloating-pointformatsincludingnarrow-precision
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

This paper introduces Block Data Representations (BDR), a framework for exploring and evaluating a wide spectrum of narrow-precision formats for deep learning. It enables comparison of popular quantization standards, and through BDR, new formats based on shared microexponents (MX) are identified, which outperform other state-of-the-art quantization approaches, including narrow-precision floating-point and block floating-point. MX utilizes multiple levels of quantization scaling with ultra-fine scaling factors based on shared microexponents in the hardware. The effectiveness of MX is demonstrated on real-world models including large-scale generative pretraining and inferencing, and production-scale recommendation systems.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Recipes for Pre-training LLMs with MXFP8

    cs.LG 2025-05 conditional novelty 6.0 of 10

    MXFP8-E4M3 with round-up scale computation matches BF16 pre-training accuracy for LLMs up to 8B parameters, enabling 2x faster training on Blackwell.

  2. any4: Learned 4-bit Numeric Representation for LLMs

    cs.LG 2025-07 conditional novelty 5.0 of 10

    any4 learns a per-row 16-value codebook for 4-bit LLM weight quantization via activation-weighted k-means, beating int4/fp4/nf4 on perplexity and matching preprocessing methods like AWQ and GPTQ.

Pith tools