REVIEW 20 cited by
O1 Replication Journey: A Strategic Progress Report -- Part 1
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
This paper introduces a pioneering approach to artificial intelligence research, embodied in our O1 Replication Journey. In response to the announcement of OpenAI's groundbreaking O1 model, we embark on a transparent, real-time exploration to replicate its capabilities while reimagining the process of conducting and communicating AI research. Our methodology addresses critical challenges in modern AI research, including the insularity of prolonged team-based projects, delayed information sharing, and the lack of recognition for diverse contributions. By providing comprehensive, real-time documentation of our replication efforts, including both successes and failures, we aim to foster open science, accelerate collective advancement, and lay the groundwork for AI-driven scientific discovery. Our research progress report diverges significantly from traditional research papers, offering continuous updates, full process transparency, and active community engagement throughout the research journey. Technologically, we proposed the journey learning paradigm, which encourages models to learn not just shortcuts, but the complete exploration process, including trial and error, reflection, and backtracking. With only 327 training samples and without any additional tricks, journey learning outperformed conventional supervised learning by over 8\% on the MATH dataset, demonstrating its extremely powerful potential. We believe this to be the most crucial component of O1 technology that we have successfully decoded. We share valuable resources including technical hypotheses and insights, cognitive exploration maps, custom-developed tools, etc at https://github.com/GAIR-NLP/O1-Journey.
Forward citations
Cited by 20 Pith papers
-
Answer-Conditioned Chains of Thought Degrade Verifiable-Reasoning Distillation in Large Language Models
Answer-conditioned chains of thought are harmful supervision for reasoning distillation—causing up to ~27-point accuracy drops—and the damage is invisible to correctness filters.
-
LAMDAS: LLM as an Implicit Classifier for Domain-specific Data Selection
LAMDAS selects domain-relevant training data via an LLM likelihood ratio with a learned domain prefix, beating full-data training and nine baselines on code and math.
-
Unlocking Recursive Thinking of LLMs: Alignment via Refinement
An offline alignment pipeline using reward-filtered self-refinement data and long chain-of-thought SFT raises an 8B model's AlpacaEval 2 win rate from 25.0% to 51.0% with roughly 14k training examples.
-
GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
A cue-tagging and rethinking training recipe lifts a 7B multimodal model to 81.5% on M3CoT, though the gain may reflect training on the same benchmark.
-
Discriminative Policy Optimization for Token-Level Reward Models
Q-RM learns token-level rewards from preference data via a discriminative policy and improves RL alignment on math, reading, and instruction-following benchmarks.
-
TAT-R1: Terminology-Aware Translation with Reinforcement Learning and Word Alignment
Word-alignment rewards for RL-trained translation raise terminology accuracy on RTT from 54.42 to 56.42 TA without hurting general translation quality.
-
Which Data Attributes Stimulate Math and Code Reasoning? An Investigation via Influence Functions
Influence-function attribution shows high-difficulty math and low-difficulty code training data best improve math and code reasoning, and difficulty-based reweighting improves benchmark performance.
-
Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learning
Tool-Star combines cold-start supervised fine-tuning with a multi-tool self-critic reinforcement learning algorithm and hierarchical rewards to improve LLM tool-use reasoning.
-
THOR-MoE: Hierarchical Task-Guided and Context-Responsive Routing for Neural Machine Translation
A hierarchical routing method that combines predicted task labels with context-aware token routing improves BLEU and reduces activated experts in translation MoE models.
-
DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models
DiagnosisArena, a 1,113-case benchmark from top journals, shows state-of-the-art LLMs achieve at most 51% top-1 diagnostic accuracy, far below clinical-level competence.
-
Typhoon T1: An Open Thai Reasoning Model
Structured long-thinking SFT turns a 3B Thai instruct model into a reasoning model that improves on several English benchmarks and can think in Thai, with a fully open recipe.
-
Cognitive Duality for Adaptive Web Agents
A web agent called CogniWeb reportedly reaches 43.96% success on WebArena with 75% fewer tokens by switching between fast and slow reasoning, but the supplied body is a different paper and the claims could not be checked.
-
Beyond Isolated Capabilities: Bridging Long CoT Reasoning and Long-Context Understanding
DeepSeek-R1-distilled models show higher multi-document QA accuracy than their base counterparts and flatter position-bias curves, especially with 50-80 documents.
-
How to Train a Leader: Hierarchical Reasoning in Multi-Agent LLMs
A leader LLM trained with a GRPO variant that conditions on frozen agent responses improves both collaborative and zero-shot accuracy on BBH, MATH, and MMLU.
-
Deciphering Trajectory-Aided LLM Reasoning: An Optimization Perspective
Reasoning trajectories are formalized as pseudo-gradient descent on LLM parameters, making LLM reasoning training a MAML-style meta-learning problem.
-
ManuSearch: Democratizing Deep Search in Large Language Models with a Transparent and Open Multi-Agent Framework
ManuSearch's three-agent design brings open-source LLMs to parity or better with proprietary web-search agents on three reasoning benchmarks, and ORION adds 310 long-tail EN/ZH questions for testing them.
-
A Comprehensive Survey on Trustworthiness in Reasoning with Large Language Models
A structured literature survey concluding that reasoning capabilities do not automatically make LLMs more trustworthy and can introduce new vulnerabilities in safety, robustness, and privacy.
-
A Survey on Model Extraction Attacks and Defenses for Large Language Models
A taxonomy of model extraction attacks and defenses for large language models, with proposed evaluation metrics and future research directions.
-
Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL
Medical QA accuracy improves substantially through reinforcement learning with a binary correct-answer reward alone, without supervised fine-tuning on distilled reasoning traces.
-
The Hitchhiker's Guide to Agentic AI: From Foundations to Systems
A survey-style reference book mapping the full agentic-AI stack from transformer internals to production deployment, with no new research result.
Discussion (0). Continue with ORCID to comment.