pith. sign in

Mixed citations

What makes good data for alignment? a comprehensive study of automatic data selection in instruction tuning

Mixed citation behavior. Most common role is background (40%).

9 Pith papers citing it
Background 40% of classified citations

citation-role summary

background 3 dataset 1 method 1

citation-polarity summary

clear filters

representative citing papers

Muon is Scalable for LLM Training

cs.LG · 2025-02-24 · unverdicted · novelty 6.0

Muon optimizer with weight decay and update scaling achieves ~2x efficiency over AdamW for large LLMs, shown via the Moonlight 3B/16B MoE model trained on 5.7T tokens.

Yi: Open Foundation Models by 01.AI

cs.CL · 2024-03-07 · unverdicted · novelty 4.0

Yi models are 6B and 34B open foundation models pretrained on 3.1T curated tokens that achieve strong benchmark results through data quality and targeted extensions like long context and vision alignment.

citing papers explorer

Showing 1 of 1 citing paper after filters.