Pith. sign in

REVIEW 10 cited by

o1-Coder: an o1 Replication for Coding

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2412.00154 v2 pith:OV44D3WU submitted 2024-11-29 cs.SE cs.AI

Yuxiang Zhang , Shangxi Wu , Yuqi Yang , Jiangming Shu , Jinlin Xiao , Chao Kong , Jitao Sang This is my paper · ORCID
classification cs.SEcs.AI
keywords modelcodeo1-codercodinggeneratemctsmodelsreport
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The technical report introduces O1-CODER, an attempt to replicate OpenAI's o1 model with a focus on coding tasks. It integrates reinforcement learning (RL) and Monte Carlo Tree Search (MCTS) to enhance the model's System-2 thinking capabilities. The framework includes training a Test Case Generator (TCG) for standardized code testing, using MCTS to generate code data with reasoning processes, and iteratively fine-tuning the policy model to initially produce pseudocode and then generate the full code. The report also addresses the opportunities and challenges in deploying o1-like models in real-world applications, suggesting transitioning to the System-2 paradigm and highlighting the imperative for world model construction. Updated model progress and experimental results will be reported in subsequent versions. All source code, curated datasets, as well as the derived models are disclosed at https://github.com/ADaM-BJTU/O1-CODER .

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 10 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. SocietyBench: Forecasting Counterfactual Social-World Evolution

    cs.CL 2026-08 conditional novelty 7.0 of 10

    A new benchmark measures LLM social-world forecasting on anonymized real events, finding the best model reaches 75/100 and agent scaffolding does not help.

  2. VERIRL: Boosting the LLM-based Verilog Code Generation via Reinforcement Learning

    cs.LG 2025-08 unverdicted novelty 6.0 of 10

    VERIRL applies reinforcement learning with a trace-back rescore mechanism and sample-balanced weighting to achieve state-of-the-art Verilog code generation.

  3. VRAgent-R1: Boosting Video Recommendation with MLLM-based Agents via Reinforcement Learning

    cs.MM 2025-07 conditional novelty 6.0 of 10

    VRAgent-R1 uses an MLLM agent to summarize videos and a reinforcement-learned agent to simulate user choices, improving video recommendation and user-decision simulation on MicroLens-100K.

  4. Unlocking Recursive Thinking of LLMs: Alignment via Refinement

    cs.CL 2025-06 conditional novelty 6.0 of 10

    An offline alignment pipeline using reward-filtered self-refinement data and long chain-of-thought SFT raises an 8B model's AlpacaEval 2 win rate from 25.0% to 51.0% with roughly 14k training examples.

  5. TAT-R1: Terminology-Aware Translation with Reinforcement Learning and Word Alignment

    cs.CL 2025-05 conditional novelty 6.0 of 10

    Word-alignment rewards for RL-trained translation raise terminology accuracy on RTT from 54.42 to 56.42 TA without hurting general translation quality.

  6. DiagnosisArena: Benchmarking Diagnostic Reasoning for Large Language Models

    cs.CL 2025-05 conditional novelty 6.0 of 10

    DiagnosisArena, a 1,113-case benchmark from top journals, shows state-of-the-art LLMs achieve at most 51% top-1 diagnostic accuracy, far below clinical-level competence.

  7. One Missing Piece for Open-Source Reasoning Models: A Dataset to Mitigate Cold-Starting Short CoT LLMs in RL

    cs.CL 2025-06 conditional novelty 5.0 of 10

    A pipeline converts short-CoT LLM outputs into o1-style long chain-of-thought rationales using 1K seed reasoning flows, and SFT on the resulting dataset improves downstream RLVR cold-start.

  8. ManuSearch: Democratizing Deep Search in Large Language Models with a Transparent and Open Multi-Agent Framework

    cs.CL 2025-05 conditional novelty 5.0 of 10

    ManuSearch's three-agent design brings open-source LLMs to parity or better with proprietary web-search agents on three reasoning benchmarks, and ORION adds 310 long-tail EN/ZH questions for testing them.

  9. UniVG-R1: Reasoning Guided Universal Visual Grounding with Reinforcement Learning

    cs.CV 2025-05 conditional novelty 5.0 of 10

    UniVG-R1 uses CoT supervised fine-tuning plus GRPO with difficulty-aware reweighting to make Qwen2-VL substantially better at multi-image, reasoning-based visual grounding.

  10. Logical Reasoning in Large Language Models: A Survey

    cs.AI 2025-02 conditional novelty 4.0 of 10

    A survey of logical reasoning in large language models that organizes benchmarks, evaluations, and enhancement methods around formal and symbolic logic.

Pith tools