From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI

Ao Shen; Di Yin; Hai-Tao Zheng; Haojing Huang; Hao Wu; Jiaxuan Zhu; Jiayi Kuang; Junnan Dong; Philip S. Yu; Qian-Wen Zhang

REVIEW 3 major objections 5 minor 1 cited by

From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI

T0 review · 3 major / 5 minor · reviewed 2026-08-02 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Persistent workspaces and reusable skills are the mechanism that turns chatbots into durable digital colleagues.

desk verdict A useful synthesis of the agent-to-workspace trend, but the central causal claim — Workspace+Skill is the key leap — is asserted, not demonstrated. read the letter →

arxiv 2606.14502 v2 pith:WCZZYTPL submitted 2026-06-12 cs.AI

Yongheng Zhang , Ziang Liu , Jiaxuan Zhu , Shuai Wang , Xiangqi Chen , Haojing Huang , Jiayi Kuang , Siyu Chen

show 12 more authors

Ao Shen Hao Wu Qiufeng Wang Qian-Wen Zhang Junnan Dong Wenhao Jiang Ying Shen Hai-Tao Zheng Yinghui Li Di Yin Xing Sun Philip S. Yu

This is my paper

classification cs.AI

keywords LLMagentsdigitalcolleagueworkspaceskillstaskclosureautonomousAIthinkingLLMsagentevaluation

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This survey argues that the shift from chatbot to digital colleague is not primarily about smarter single-pass language models. The key leap, it claims, is combining a persistent Workspace—files, terminals, browsers, logs, permissions—with reusable Skills, packaged procedures that encode how to do a class of task. Together these provide state, memory, evidence, error recovery, and verification, turning isolated tool calls into closed, auditable work. The paper organizes the field along two dimensions: the cognitive core from fast response to deliberate reasoning, and tool execution from ad-hoc agents to workstation systems. If the thesis is right, progress on reliable autonomous AI depends as much on harness engineering, task-closure evaluation, and governance as on model scaling.

What carries the argument

The central mechanism is the pair Workspace + Skill. The Workspace supplies persistent state and evidence—files, terminals, browsers, logs, permissions, snapshots—so that actions have inspectable and recoverable consequences. The Skill supplies procedural memory—packaged instructions, scripts, validation checks, dependencies, and safety constraints—so that repeated work does not have to be rediscovered each time. The paper argues that only when both are present does an agent achieve task closure: reaching and verifying the intended final state under reproducible and safe conditions. Workstation-style agent systems are presented as the representative engineering form of this mechanism.

What would settle it

Run a controlled comparison of the same base model and agent loop on a long-horizon stateful benchmark (for example, desktop or web tasks with execution-based checks) under three conditions: stateless tool calls, a persistent workspace without skills, and persistent workspace plus a skill library. If task-closure rates do not improve materially when workspace state and skills are added—while the model is held fixed—the survey's central claim is falsified. A weaker disconfirmation would be showing that model scaling alone reproduces the same reliability gains without any workspace changes.

Watch

Extended reading notes

Core claim

The paper's central claim is that Workspace + Skill is the decisive architectural step. A Workspace is a persistent digital environment where files, terminals, browsers, repositories, logs, and permissions survive across a task; a Skill is a reusable, parameterizable procedure with instructions, scripts, checks, dependencies, and safety constraints. Together they convert episodic, best-effort tool use into persistent, inspectable work: the agent can load a procedure, operate on durable state, detect and repair failures, and leave a verified final workspace state. The authors assert that current agent failures—fragmented perception, ephemeral tool calls, brittleness under environmental noise,

Load-bearing premise

The load-bearing premise is that today's agent failures—fragmented perception, ephemeral tool calls, brittleness, missing task closure—are a fundamental architectural limitation of the environment-action-feedback loop, rather than simply a shortfall in model capability, training, or reasoning; if long-horizon unreliability is mostly a model-cognition problem, then persistent workspaces and skills are helpful scaffolding but not the decisive leap.

Editorial extensions

If this is right

If Workspace + Skill is the key leap, then the binding constraint on reliable autonomous AI is the execution substrate—state persistence, verification loops, permissions, rollback—alongside the model's reasoning ability.
Agent training data should be built from complete state-action-observation trajectories, including tool outputs, intermediate failures, and final-state evidence, rather than static instruction-response pairs.
Evaluation should move to task closure: final-state verification, repeated-run reliability, efficiency, reproducibility, and trajectory-level safety, instead of answer-level accuracy.
The main bottleneck in deploying agents shifts from prompt design to system operations: skill lifecycle management, workspace hygiene, sandboxing, audit trails, and governance.
Human-AI interaction shifts from instruction-following to delegation—users set objectives, constraints, permissions, and acceptance criteria, then audit the work episode.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

Editorial inference: If the architectural thesis is right, harness quality may matter more than model scale for practical long-horizon work; a well-instrumented workspace could let smaller, cheaper models compete with much larger ones on real tasks.
Testable extension: A controlled ablation—same base model and instruction set, run with and without persistent workspace state and a reusable skill library on a stateful benchmark—would isolate whether the gains attributed to Workspace + Skill are architectural or just extra context and tool access.
Neighbouring consequence: The skill-as-package view predicts that skill provenance, versioning, and dependency checking become as important as model safety, and that supply-chain attacks on skill libraries will be a primary failure mode.
The delegation framing implies that research on AI interfaces should focus on authority, escalation, and audit surfaces rather than chat alone; progress may be measured by how little human micro-management is needed at a given level of risk.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Worth reading as a map, not as a proof. The paper's contribution is synthetic: it organizes a large body of 2023–2026 agent and harness work under one framing and argues that persistent workspaces plus reusable skills are what turn chatbots into digital colleagues. That framing is genuinely useful. The survey is well structured, connects the data shift (from instruction pairs to state–action–observation trajectories) to the evaluation shift (from answer accuracy to task closure), and covers the recent OpenClaw ecosystem thoroughly. It also earns credit for honesty: Section 4.2.2 spells out the paradigm's own failure modes — skill brittleness, negative transfer, workspace contamination, supply-chain risk — which most position papers of this type skip.

The soft spot is the load-bearing claim, not the survey's internal coherence. The paper repeatedly calls the agent-era bottlenecks (fragmented perception, ephemeral tool calls, brittleness, no task closure) a “fundamental architectural limitation,” then asserts that Workspace+Skill is the key leap. That is a causal attribution, and it is untested. The same failure modes could largely reflect limited planning, reasoning, and self-correction in current models; persistent workspaces might be helpful scaffolding rather than the decisive mechanism. No controlled comparison is offered — same model, same task, varying only the workspace/skill substrate. Figure 2's exponential time-horizon plot is another weak spot: it is an external data visualization presented without a fitted trend or error bounds, so "exponential" is impressionistic. Also, many 2026 citations cannot be independently checked yet.

None of this kills the paper. For a survey, the evidence is mostly consistent with the sources it cites, and the authors are explicit about what their framework does and does not do. The problem is the strength of the language: "key leap" should be "hypothesis" or "proposed mechanism" unless they can point to ablation-style evidence that actually separates substrate from cognition.

This deserves a serious referee. It is an agenda-setting survey that will be widely cited, and a good reviewer can push the authors to soften the causal claim and add a section on what evidence would falsify it. I would bring it to a reading group focused on agent infrastructure, and I would cite it as a framing reference (not for the strong causal claim).

Referee Report

3 major / 5 minor

Summary. This paper is a broad survey and position paper that organizes recent LLM evolution along two dimensions: the cognitive core (Chatbot → Thinking LLM) and tool-augmented task execution (Agent → OpenClaw-style workstation systems). Its central claim, stated in the Introduction and developed in Part III, is that the combination of a persistent Workspace and reusable Skills is "the key leap" that transforms chatbot-style interaction into durable, task-closing "digital colleague" work. The paper reviews models, benchmarks, data regimes, and evaluation methods across four eras, and it discusses open challenges in reliability, governance, memory, and self-evolving ecosystems. It is explicitly a synthesis rather than a new experimental study: no experiments are run, and the framework is assembled from existing systems and benchmarks.

Significance. If the central thesis is accepted, the paper makes a useful conceptual contribution by shifting attention from model-scale and reasoning ability alone to the execution substrate, skill libraries, verification loops, and governance mechanisms that enable long-horizon task closure. The survey's strengths include its broad and current coverage of systems and benchmarks, the clear two-dimensional framing, the concrete taxonomy of data and evaluation stages (Tables 6–11), and a candid list of limitations of the Workspace + Skill paradigm in §4.2.2. It also usefully connects technical reliability with security, forensics, and organizational governance. The paper does not ship machine-checked proofs or code, but it does provide a falsifiable framing: the claim that persistent workspaces and reusable skills are causally important could, in principle, be tested by controlled comparisons. The main weakness is that the load-bearing causal attribution is asserted rather than evidenced.

major comments (3)

[§3.1.2 and Part III] The paper's central claim that "Workspace + Skill is the key leap" is a causal attribution that is not tested. §3.1.2 calls the four Agent-era bottlenecks "a fundamental architectural limitation" rather than a reflection of insufficient model capability, and Part III builds on this. However, no controlled comparison separates the effect of the workspace/skill substrate from model cognition: the cited benchmarks (WebArena, SWE-bench, OSWorld) compare different models or settings, and Table 4's Agent/OpenClaw boundary is a definitional dichotomy, not empirical evidence. The failure modes listed are equally consistent with limited planning, reasoning, and self-correction in the base model. To make the central claim defensible, the paper should either reframe it as a proposal/hypothesis with explicit testable predictions, or present the available evidence in a way that separates substrate ef
[Figure 2] The figure claims that "the time horizon of frontier AI agents has grown exponentially" and presents this as a key takeaway. Yet no fitted curve, confidence interval, or regression is shown, and the provenance of the underlying "50%-time horizon" data is only a footnote to an external website. Axis units are mixed (seconds in one label, minutes in another), and the methodology for computing the median task length is not described. If this exponential claim is load-bearing for the paper's narrative, the data points and fitting procedure should be reported; otherwise the claim should be softened to "approximately exponential in the observed period" or removed.
[§4.2.2 and Conclusion] The paper's own limitation list — skill brittleness, environmental drift, negative transfer, workspace contamination, security/supply-chain risk, and governance overhead — substantially weakens the "key leap" framing. These are not merely operational details; they show that the benefits of Workspace + Skill are conditional on an expensive governance and maintenance layer. The manuscript should state under which conditions the paradigm is decisive (e.g., bounded, versioned environments with strong verification) and where it acts only as scaffolding atop model capability. Without this, Part III's conclusion overreaches relative to the evidence the paper itself presents.

minor comments (5)

[Section 1] Typo: "the central question is thereforeno longer limited tohow can a model generate a better answer?Instead, it is howhow can an AI system reliably transform user intent into completed work?" — "howhow" should read "how".
[Figure 1] Several node labels contain typos or inconsistent formatting: "Qwen3-Instuct" should be "Qwen3-Instruct", "Dep2025" is likely "Dec2025", and the legend text about open/closed box styles is missing a glyph. Please also ensure the timeline dates are consistent between text and figure.
[Figure 2] The caption refers to a footnote for the data source, but the definition of "50%-time horizon" should be in the caption itself, along with the unit of measurement (seconds/minutes). The y-axis labels mix seconds and minutes, which makes the plot hard to read.
[Table 10 notes] The note "UI-TARS-2 scores marked with 'use the paper's extended GUI-SDK setting" has an unmatched quotation mark. Also, "Terminal 2.0" is used as a column heading but the text refers to "Terminal-Bench v2.0"; this shorthand should be defined in the table notes.
[§5.2.4 / Table 11] The selection rationale "retained columns were selected using Semantic Scholar citation-overlap" is not a transparent criterion. Either describe the exact selection procedure or report the full set of benchmark columns; otherwise the table may appear cherry-picked.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity: the Workspace+Skill thesis is a conceptual organizing claim, not a derived result, and the only self-citations are informational table entries.

full rationale

Walked the claimed derivation chain: the paper's central claim is that 'Workspace + Skill provides the mechanism that turns chatbot-style interaction into durable digital-colleague work' (Section 1). This is a survey thesis and organizing framework, not a formal derivation with fitted parameters or equations that reduce to its own inputs. The four Agent-era bottlenecks (§3.1.2) are attributed to external benchmarks and failure analyses (AgentBench, WebArena, SWE-bench, GAIA, LLM Agent Failure); the sentence calling them 'a fundamental architectural limitation' is a causal assertion, not a result derived within the paper, so it is a correctness-risk concern rather than a circularity. The paper's own §4.2.2 limitations paragraph explicitly concedes skill brittleness, environmental drift, negative transfer, workspace contamination, and supply-chain risk, which weakens the strength of the central claim but does not make it circular. The only author-affiliated items are Youtu-LLM and Youtu-VL in Table 1, which are purely informational timeline entries and are not cited anywhere in the load-bearing argument. The framework is assembled from external systems and benchmarks (OpenHands, SWE-agent, SWE-bench, WebArena, OSWorld, ClawsBench, etc.), and OpenClaw is used as a representative case study rather than as an input to a derivation. No circular step was found.

Assumptions & free parameters 0 free parameters · 3 assumptions · 2 invented entities

The paper does not fit parameters, but its narrative rests on three unproved premises: the four-era taxonomy, the causal priority of Workspace+Skill over model capability, and the trustworthiness of copied benchmark tables. The conceptual labels 'Digital Colleague' and 'Workspace+Skill paradigm' are introduced without falsifiable predictions.

assumptions (3)

domain assumption LLM evolution is separable into two dimensions (cognitive core; tool-augmented execution) and four eras (Chatbot, Thinking LLM, Agent, OpenClaw).
The entire survey structure and Figure 1 depend on this taxonomy, but no evidence shows these axes are natural or exhaustive (§1–§3).
ad hoc to paper Persistent state (Workspace) and reusable procedures (Skill) are the decisive mechanism—the 'key leap'—for reliable long-horizon task closure.
This is the paper's central thesis stated in §1 and Part III; it is asserted without a controlled comparison against model-scale or RL-based explanations.
domain assumption The benchmark scores and system facts in Tables 9–11 and Figure 2 are accurate and current as of submission.
The empirical grounding consists of external leaderboards and vendor reports; the paper ships no data, retrieval scripts, or verification.

invented entities (2)

Digital Colleague (the 'next paradigm' state)
purpose: Labels the target condition where AI systems perform persistent, governed work in shared workspaces.
Introduced as a framing construct in §1; no measurable prediction or testable property distinguishes a Digital Colleague from a capable agent.
Workspace + Skill paradigm
purpose: Proposed mechanism that supposedly converts episodic tool use into durable task closure.
Defined in §4 as the key leap; no falsifiable hypothesis or experiment is provided, so it functions as an organizing label rather than an empirically grounded entity.

how reviews work

0 comments

Cite this review

Pith. "Pith review of From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI." pith.science (2026). https://pith.science/paper/WCZZYTPL

@misc{pith2026260614502,
  author       = {Pith},
  title        = {Pith review of: From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AI},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/WCZZYTPL}},
  note         = {Machine review of arXiv:2606.14502}
}

read the original abstract

Large Language Models (LLMs) are undergoing a fundamental transformation from conversational generators into integrated AI systems capable of reasoning, action, memory, and self-improvement. We conceptualize this transition as a shift from Chatbot to Digital Colleague: from conversational answers to persistent work. We organize this transition along two tightly coupled dimensions. First, at the cognitive core level, LLMs are advancing from Chatbot-era "fast thinking" systems driven by next-token prediction toward Thinking LLMs that leverage inference-time computation, Chain-of-Thought reasoning, reflection, process supervision, and reinforcement learning to support more deliberate and reliable cognition. Second, at the tool-augmented task execution level, LLMs are progressing from tool-calling Agents that invoke external resources in an ad hoc manner toward OpenClaw-style workstation systems (OpenClaw) equipped with persistent Workspaces, skills, verification loops, and governance. The "Workspace + Skill" paradigm makes episodic tool use colleague-like via state persistence, reusable procedures, task closure, and experience reuse. We examine data construction shifts from instruction-response pairs to State-Action-Observation trajectories and evaluation from static benchmarks to sandboxed, auditable, self-evolving AI ecosystems.

Figures

Figures reproduced from arXiv: 2606.14502 by the authors.

**Figure 2.** Time horizon growth of frontier AI agents. Each point reports the 50%-time horizon, i.e., the median length of coding tasks that an agent can complete at release. The trend shows a transition from second-level fast-response models to slow-thinking models capable of sustaining increasingly long and complex tasks1 . 2.1 The Chatbot Era: Language Generation and Knowledge Compression Represented by ChatGPT During this s… view at source ↗

**Figure 3.** The Chatbot Era: a user inputs a natural-language question, the LLM performs fast, stateless, single-pass processing over compressed parametric knowledge, and immediately returns a fluent response. The figure highlights one-pass inference with no external loop, feedback-driven correction, or persistent memory. foundation for large-scale parallel training. Building on this architecture, the field established the foun… view at source ↗

Figures from the paper (9 more)

**Figure 4.** Figure 4: The Thinking LLM Era: the model allocates additional inference-time computation, generates long reasoning traces, explores alternatives, verifies intermediate steps, and then returns a more deliberate answer. The figure contrasts slow, reflective System-2-style reasoni…

**Figure 5.** Figure 5: The Agent Era: the model observes an external environment, plans the next step, invokes tools or actions, receives feedback, and iterates toward the task goal. The figure illustrates the observe–think–act– observe loop that gives LLMs an initial form of autonomy beyond…

**Figure 6.** Figure 6: The OpenClaw Era: the agent works inside a persistent workspace with files, terminals, browsers, logs, permissions, reusable skills, and verification loops. The figure illustrates how workspace state and skill-based execution turn fragmented tool use into inspectable, …

**Figure 7.** Figure 7: Simple tool invocation: the LLM can call external tools to handle local sub-tasks, but these calls remain limited when the task requires persistent files, terminal sessions, execution logs, intermediate artifacts, and recoverable state. The figure highlights why a work…

**Figure 8.** Figure 8: Workspace + Skill paradigm: persistent workspaces provide the stateful place where work happens, while skills package reusable procedures, scripts, checks, and safety constraints. The figure shows how agents combine workspace context with skill assets to produce verifi…

**Figure 9.** Figure 9: Data paradigm shift: training and evaluation data evolve from static prompt–response pairs to reasoning traces and state–action–observation trajectories. The figure shows why agentic and OpenClaw-style systems require tool outputs, UI states, workspace changes, and fin…

**Figure 10.** Figure 10: Evaluation paradigm shift: evaluation moves from final-answer correctness to process judgment and task closure. The figure summarizes how next-generation systems must be assessed by reasoning validity, environment state changes, reliability, efficiency, reproducibilit…

**Figure 11.** Figure 11: Open challenges for reliable autonomy: as agents move from answering to acting in workspaces, failures become longer-horizon, stateful, and harder to reverse. The figure summarizes key bottlenecks around task closure, safety and governance, memory, context management,…

**Figure 12.** Figure 12: Future directions toward self-evolving AI ecosystems: next-generation systems will combine models, contexts, tools, skills, workspaces, memories, evaluators, and governance mechanisms into an integrated learning loop. The figure illustrates the path from reactive chat…

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

Thinking in Video: Can Video Generators Really Reason About the Real World?
cs.CV 2026-07 conditional novelty 6.0 of 10

Video generators show a perception-prediction gap: they can generate plausible continuations while failing explicit visual reasoning tests.

Reference graph

Works this paper leans on

296 extracted references · 115 linked inside Pith · cited by 1 Pith paper

[1]

On the opportunities and risks of foundation models.arXiv preprint arXiv:2108.07258, 2021

Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. On the opportunities and risks of foundation models.arXiv preprint arXiv:2108.07258, 2021

arXiv 2021
[2]

Recent advances in natural language processing via large pre-trained language models: A survey.ACM Computing Surveys, 56(2): 1–40, 2023

Bonan Min, Hayley Ross, Elior Sulem, Amir Pouran Ben Veyseh, Thien Huu Nguyen, Oscar Sainz, Eneko Agirre, Ilana Heintz, and Dan Roth. Recent advances in natural language processing via large pre-trained language models: A survey.ACM Computing Surveys, 56(2): 1–40, 2023

2023
[3]

A comprehensive overview of large language models.ACM Transactions on Intelligent Systems and Technology, 16(5):1–72, 2025

Humza Naveed, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Naveed Akhtar, Nick Barnes, and Ajmal Mian. A comprehensive overview of large language models.ACM Transactions on Intelligent Systems and Technology, 16(5):1–72, 2025

2025
[4]

A survey on large language model based autonomous agents.Frontiers of Computer Science, 18(6), 2024

Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. A survey on large language model based autonomous agents.Frontiers of Computer Science, 18(6), 2024

2024
[5]

The rise and potential of large language model based agents: A survey.arXiv preprint arXiv:2309.07864, 2023

Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, et al. The rise and potential of large language model based agents: A survey.arXiv preprint arXiv:2309.07864, 2023

arXiv 2023
[6]

Libo Qin, Qiguang Chen, Xiachong Feng, Yang Wu, Yongheng Zhang, Yinghui Li, Min Li, Wanxiang Che, and Philip S. Yu. Large language models meet nlp: A survey, 2025. URL https://arxiv.org/abs/2405.12819

arXiv 2025
[7]

ReAct: Synergizing reasoning and acting in language models.arXiv preprint arXiv:2210.03629, 2022

Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. ReAct: Synergizing reasoning and acting in language models.arXiv preprint arXiv:2210.03629, 2022

arXiv 2022
[8]

Generative agents: Interactive simulacra of human behavior

Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive simulacra of human behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, pages 1–22, 2023

2023

Show all 296 references

[9]

A survey on the memory mechanism of large language model-based agents.ACM Transactions on Information Systems, 43(6):1–47, 2025

Zeyu Zhang, Quanyu Dai, Xiaohe Bo, Chen Ma, Rui Li, Xu Chen, Jieming Zhu, Zhenhua Dong, and Ji-Rong Wen. A survey on the memory mechanism of large language model-based agents.ACM Transactions on Information Systems, 43(6):1–47, 2025

2025
[10]

Attentionisallyouneed

Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, ŁukaszKaiser,andIlliaPolosukhin. Attentionisallyouneed. InAdvancesinNeuralInformation Processing Systems, pages 5998–6008, 2017

2017
[11]

Language models are few-shot learners.Advances in Neural Information Processing Systems, 33:1877–1901, 2020

TomBBrown,BenjaminMann,NickRyder,MelanieSubbiah,JaredKaplan,PrafullaDhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. Language models are few-shot learners.Advances in Neural Information Processing Systems, 33:1877–1901, 2020

1901
[12]

Scaling laws for neural language models.arXiv preprint arXiv:2001.08361, 2020

Jared Kaplan, Sam McCandlish, Tom Henighan, Tom B Brown, Benjamin Chess, Rewon Child, Scott Gray, Alec Radford, Jeffrey Wu, and Dario Amodei. Scaling laws for neural language models.arXiv preprint arXiv:2001.08361, 2020. 58 From Chatbot to Digital Colleague

2001 arXiv
[13]

Training compute-optimal large language models

Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch, Elena Buchatskaya, Trevor Cai, Eliza Rutherford, Diego de Las Casas, Lisa Anne Hendricks, Johannes Welbl, Aidan Clark, et al. Training compute-optimal large language models. InAdvances in Neural Information Processing Systems...

2022 arXiv
[14]

Gpt-4 technical report.arXiv preprint arXiv:2303.08774, 2023

Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Altenschmidt, Sam Altman, Shyamal Anadkat, et al. Gpt-4 technical report.arXiv preprint arXiv:2303.08774, 2023

2023 arXiv
[15]

Chain-of-thought prompting elicits reasoning in large language models

Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. Advances in neural information processing systems, 35:24824–24837, 2022

2022
[16]

Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Peiyi Wang, Qihao Zhu, Runxin Xu, Ruoyu Zhang, Shirong Ma, Xiao Bi, Xiaokang Zhang, Xingkai Yu, Yu Wu, Z. F. Wu, Zhibin Gou, Zhihong Shao, Zhuoshu Li, Ziyi Gao, Aixin Liu, Bing Xue, Bingxuan Wang, Bochao Wu, Bei Feng, Chengda ...

2025
[17]

Toolformer: Language models can teach themselves to use tools.Advances in Neural Information Processing Systems, 36, 2023

Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Eric Hambro, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom. Toolformer: Language models can teach themselves to use tools.Advances in Neural Information Processing Systems, 36, 2023. 59 From C...

2023
[18]

ToolLLM: Facilitating large language models to master 16000+ real-world APIs.arXiv preprint arXiv:2307.16789, 2023

Yujia Qin, Shihao Liang, Yining Ye, Kunlun Zhu, Lan Yan, Yaxi Lu, Yankai Lin, Xin Cong, Xiangru Tang, Bill Qian, et al. ToolLLM: Facilitating large language models to master 16000+ real-world APIs.arXiv preprint arXiv:2307.16789, 2023

2023 arXiv
[19]

AutoGen: Enabling next-gen LLM applications via multi-agent conversation.arXiv preprint arXiv:2308.08155, 2023

Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Jiale Liu, et al. AutoGen: Enabling next-gen LLM applications via multi-agent conversation.arXiv preprint arXiv:2308.08155, 2023

2023 arXiv
[20]

MetaGPT: Meta programming for multi-agent collaborative framework.arXiv preprint arXiv:2308.00352, 2023

Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, et al. MetaGPT: Meta programming for multi-agent collaborative framework.arXiv preprint arXiv:2308.00352, 2023

2023 arXiv
[21]

Introducing ChatGPT.https://openai.com/blog/chatgpt, 2022

OpenAI. Introducing ChatGPT.https://openai.com/blog/chatgpt, 2022

2022
[23]

Gemma 2: Improving open language models at a practical size, 2024

Gemma Team, Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa, Cassidy Hardin, Surya Bhupatiraju, Léonard Hussenot, Thomas Mesnard, Bobak Shahriari, Alexandre Ramé, et al. Gemma 2: Improving open language models at a practical size, 2024

2024
[24]

Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de Las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al

Albert Q. Jiang, Alexandre Sablayrolles, Arthur Mensch, Chris Bamford, Devendra Singh Chaplot, Diego de Las Casas, Florian Bressand, Gianna Lengyel, Guillaume Lample, Lucile Saulnier, et al. Mistral 7b.arXiv preprint arXiv:2310.06825, 2023. URLhttps://arxiv. org/abs/2310.06825

2023 arXiv
[25]

Pali-x: On scaling up a multilingual vision and language model.arXiv preprint arXiv:2305.18565, 2023

Xi Chen, Josip Djolonga, Piotr Padlewski, Basil Mustafa, Soravit Changpinyo, Jialin Wu, Carlos Riquelme Ruiz, Sebastian Goodman, Xiao Wang, Yi Tay, et al. Pali-x: On scaling up a multilingual vision and language model.arXiv preprint arXiv:2305.18565, 2023

2023 arXiv
[26]

Fabio Petroni, Tim Rocktäschel, Sebastian Riedel, Patrick Lewis, Anton Bakhtin, Yuxiang Wu, and Alexander Miller. Language models as knowledge bases? InProceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint confer...

2019
[27]

Towards reasoning in large language models: A survey

Jie Huang and Kevin Chen-Chuan Chang. Towards reasoning in large language models: A survey. InFindingsoftheassociationforcomputationallinguistics: ACL2023, pages1049–1065, 2023

2023
[28]

Faith and fate: Limits of transformers on compositionality.Advances in neural information processing systems, 36: 70293–70332, 2023

Nouha Dziri, Ximing Lu, Melanie Sclar, Xiang Lorraine Li, Liwei Jiang, Bill Yuchen Lin, Sean Welleck, Peter West, Chandra Bhagavatula, Ronan Le Bras, et al. Faith and fate: Limits of transformers on compositionality.Advances in neural information processing systems, 36: 70293–...

2023
[29]

Large language models still can’t plan (a benchmark for llms on planning and reasoning about change)

Karthik Valmeekam, Alberto Olmo, Sarath Sreedharan, and Subbarao Kambhampati. Large language models still can’t plan (a benchmark for llms on planning and reasoning about change). InNeurIPS 2022 Foundation Models for Decision Making Workshop, 2022

2022
[30]

Scaling LLM test-time compute optimally can be more effective than scaling model parameters, 2024

Charlie Snell, Jaehoon Lee, Kelvin Xu, and Aviral Kumar. Scaling LLM test-time compute optimally can be more effective than scaling model parameters, 2024. URLhttps:// arxiv.org/abs/2408.03314. 60 From Chatbot to Digital Colleague

2024 arXiv
[31]

Large language models are zero-shot reasoners.Ad- vances in Neural Information Processing Systems, 35:22199–22213, 2022

Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. Large language models are zero-shot reasoners.Ad- vances in Neural Information Processing Systems, 35:22199–22213, 2022. URL https://proceedings.neurips.cc/paper_files/paper/2022/hash/ 8bb0d291a...

2022
[32]

Self-refine: Iterative refinement with self- feedback.Advances in Neural Information Processing Systems, 36:46534–46594,

Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, Shrimai Prabhumoye, Yiming Yang, Shashank Gupta, Bodhisattwa Prasad Majumder, Katherine Hermann, Sean Welleck, Amir Yazdanbakhsh, and Peter Clark. Self-refine: Iterativ...
[33]

Re- flexion: Language agents with verbal reinforcement learning.Advances in neural information processing systems, 36:8634–8652, 2023

Noah Shinn, Federico Cassano, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. Re- flexion: Language agents with verbal reinforcement learning.Advances in neural information processing systems, 36:8634–8652, 2023

2023
[34]

Let’s verify step by step

Hunter Lightman, Vineet Kosaraju, Yuri Burda, Harrison Edwards, Bowen Baker, Teddy Lee, Jan Leike, John Schulman, Ilya Sutskever, and Karl Cobbe. Let’s verify step by step. In International Conference on Learning Representations, volume 2024, pages 39578–39601, 2024

2024
[35]

Xu, Jun-Mei Song, Mingchuan Zhang, Y

Zhihong Shao, Peiyi Wang, Qihao Zhu, R. Xu, Jun-Mei Song, Mingchuan Zhang, Y. K. Li, Yu Wu, and Daya Guo. Deepseekmath: Pushing the limits of mathematical reasoning in open language models.ArXiv, abs/2402.03300, 2024

2024 arXiv
[36]

Generative to agentic ai: Survey, conceptualization, and challenges

Johannes Schneider. Generative to agentic ai: Survey, conceptualization, and challenges. arXiv preprint arXiv:2504.18875, 2025

2025 arXiv
[37]

Agentic reasoning for large language models.arXiv preprint arXiv:2601.12538, 2026

Tianxin Wei, Ting-Wei Li, Zhining Liu, Xuying Ning, Ze Yang, Jiaru Zou, Zhichen Zeng, Ruizhong Qiu, Xiao Lin, Dongqi Fu, et al. Agentic reasoning for large language models.arXiv preprint arXiv:2601.12538, 2026

2026 arXiv
[38]

Advancing reasoning in large language models: Promising methods and approaches

Avinash Patil and Aryan Jadon. Advancing reasoning in large language models: Promising methods and approaches. InInternational Conference on Computational Intelligence and Soft Computing, pages 284–298. Springer, 2025

2025
[39]

Edge general intelligence through world models, large language models, and agentic ai: Fundamentals, solutions, and challenges

Changyuan Zhao, Guangyuan Liu, Ruichen Zhang, Yinqiu Liu, Jiacheng Wang, Jiawen Kang, Dusit Niyato, Zan Li, Xuemin Shen, Zhu Han, et al. Edge general intelligence through world models, large language models, and agentic ai: Fundamentals, solutions, and challenges. IEEE Transac...

2026
[40]

A survey on large language model-based game agents.arXiv preprint arXiv:2404.02039, 2024

Sihao Hu, Tiansheng Huang, Gaowen Liu, Ramana Rao Kompella, Fatih Ilhan, Selim Furkan Tekin, Yichang Xu, Zachary Yahn, and Ling Liu. A survey on large language model-based game agents.arXiv preprint arXiv:2404.02039, 2024

2024 arXiv
[41]

Toward large reasoning models: A survey of reinforced reasoning with large language models.Patterns, 6(10), 2025

Fengli Xu, Qianyue Hao, Chenyang Shao, Zefang Zong, Yu Li, Jingwei Wang, Yunke Zhang, Jingyi Wang, Xiaochong Lan, Jiahui Gong, et al. Toward large reasoning models: A survey of reinforced reasoning with large language models.Patterns, 6(10), 2025. 61 From Chatbot to Digital Colleague

2025
[42]

Large language model based multi-agents: A survey of progress and challenges.arXiv preprint arXiv:2402.01680, 2024

Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V Chawla, Olaf Wiest, and Xiangliang Zhang. Large language model based multi-agents: A survey of progress and challenges.arXiv preprint arXiv:2402.01680, 2024

2024 arXiv
[43]

Large language model agents: A comprehensive survey on architectures, capabilities, and applications

Yiming Lei, Jiawei Xu, Chia Xin Liang, Ziqian Bi, Xiaoming Li, Danyang Zhang, Junhao Song, and Zhenyu Yu. Large language model agents: A comprehensive survey on architectures, capabilities, and applications. 2025

2025
[44]

A survey of reasoning with foundation models: Concepts, methodologies, and outlook.ACM Computing Surveys, 57(11):1–43, 2025

Jiankai Sun, Chuanyang Zheng, Enze Xie, Zhengying Liu, Ruihang Chu, Jianing Qiu, Jiaqi Xu, Mingyu Ding, Hongyang Li, Mengzhe Geng, et al. A survey of reasoning with foundation models: Concepts, methodologies, and outlook.ACM Computing Surveys, 57(11):1–43, 2025

2025
[45]

Agentic large language models, a survey.Journal of Artificial Intelligence Research, 84, 2025

Aske Plaat, Max van Duijn, Niki Van Stein, Mike Preuss, Peter van der Putten, and Kees Joost Batenburg. Agentic large language models, a survey.Journal of Artificial Intelligence Research, 84, 2025

2025
[46]

Openhands: An open platform for ai software developers as generalist agents

Xingyao Wang, Boxuan Li, Yufan Song, Frank F Xu, Xiangru Tang, Mingchen Zhuge, Jiayi Pan, Yueqi Song, Bowen Li, Jaskirat Singh, et al. Openhands: An open platform for ai software developers as generalist agents. InInternational Conference on Learning Representations, volume 20...

2025
[47]

SWE-agent: Agent-computer interfaces enable automated software engineering

John Yang, Carlos E Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik R Narasimhan, and Ofir Press. SWE-agent: Agent-computer interfaces enable automated software engineering. InThe Thirty-eighth Annual Conference on Neural Information Process- ing Systems, 2024. U...

2024
[48]

Workarena: How capable are web agents at solving common knowledge work tasks?arXiv preprint arXiv:2403.07718, 2024

Alexandre Drouin, Maxime Gasse, Massimo Caccia, Issam H Laradji, Manuel Del Verme, Tom Marty, Léo Boisvert, Megh Thakkar, Quentin Cappart, David Vazquez, et al. Workarena: How capable are web agents at solving common knowledge work tasks?arXiv preprint arXiv:2403.07718, 2024

2024 arXiv
[49]

OSWorld: Benchmarking multimodal agents for open-ended tasks in real computer environments

Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh Jing Hua, Zhoujun Cheng, Dongchan Shin, Fangyu Lei, Yitao Liu, Yiheng Xu, Shuyan Zhou, Silvio Savarese, Caiming Xiong, Victor Zhong, and Tao Yu. OSWorld: Benchmarking multimodal agents for op...

2024
[50]

Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig

Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig. Webarena: A realistic web environment for building autonomous agents. InThe Twelfth International Conference on Learnin...

2024
[51]

Voyager: An open-ended embodied agent with large language models.Transactions on Machine Learning Research, 2024

Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. Voyager: An open-ended embodied agent with large language models.Transactions on Machine Learning Research, 2024. ISSN 2835-8856. URLhttps: //openreview.net/forum?id=...

2024
[52]

Large language model agent: A survey on methodology, applications and challenges.arXiv preprint arXiv:2503.21460, 2025

Junyu Luo, Weizhi Zhang, Ye Yuan, Yusheng Zhao, Junwei Yang, Yiyang Gu, Bohan Wu, Binqi Chen, Ziyue Qiao, Qingqing Long, et al. Large language model agent: A survey on methodology, applications and challenges.arXiv preprint arXiv:2503.21460, 2025

2025 arXiv
[53]

Beyondgenerativeartificial intelligence: Roadmap for natural language generation.arXiv preprint arXiv:2407.10554, 2024

María Miró Maestre, Iván Martínez-Murillo, Tania J Martin, Borja Navarro-Colorado, Antonio Ferrández, Armando Suárez Cueto, and Elena Lloret. Beyondgenerativeartificial intelligence: Roadmap for natural language generation.arXiv preprint arXiv:2407.10554, 2024

2024 arXiv
[54]

A survey on the optimization of large language model-based agents.ACM Computing Surveys, 58(9):1–37, 2026

Shangheng Du, Jiabao Zhao, Jinxin Shi, Zhentao Xie, Xin Jiang, Yanhong Bai, and Liang He. A survey on the optimization of large language model-based agents.ACM Computing Surveys, 58(9):1–37, 2026

2026
[55]

Exploring autonomous agents through the lens of large language models: A review.arXiv preprint arXiv:2404.04442, 2024

Saikat Barua. Exploring autonomous agents through the lens of large language models: A review.arXiv preprint arXiv:2404.04442, 2024

2024 arXiv
[56]

A survey on agentic multimodal large language models.arXiv preprint arXiv:2510.10991, 2025

Huanjin Yao, Ruifei Zhang, Jiaxing Huang, Jingyi Zhang, Yibo Wang, Bo Fang, Ruolin Zhu, Yongcheng Jing, Shunyu Liu, Guanbin Li, et al. A survey on agentic multimodal large language models.arXiv preprint arXiv:2510.10991, 2025

2025
[57]

AgentBench: Evaluating LLMs as agents.arXiv preprint arXiv:2308.03688, 2023

Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, et al. AgentBench: Evaluating LLMs as agents.arXiv preprint arXiv:2308.03688, 2023

2023 arXiv
[58]

Jimenez et al

Carlos E. Jimenez et al. Swe-bench: Can language models resolve real-world github issues? arXiv preprint arXiv:2310.06770, 2023. doi: 10.48550/arXiv.2310.06770. URLhttps: //arxiv.org/abs/2310.06770

2023 doi arXiv
[59]

A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions.arXiv preprint arXiv:2311.05232, 2023

Lei Huang, Weijiang Yu, Weitao Ma, Weihong Zhong, Zhangyin Feng, Haotian Wang, Qian- glong Chen, Weihua Peng, Xiaocheng Feng, Bing Qin, et al. A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions.arXiv preprint arXiv:2311.05232, 2023

2023 arXiv
[60]

Survey of hallucination in natural language generation

Ziwei Ji, Nayeon Lee, Rita Frieske, Tiezheng Yu, Dan Su, Yan Xu, Etsuko Ishii, Ye Jin Bang, Andrea Madotto, and Pascale Fung. Survey of hallucination in natural language generation. ACM Computing Surveys, 55(12):1–38, 2023

2023
[61]

Memgpt: towards llms as operating systems

Charles Packer, Vivian Fang, Shishir_G Patil, Kevin Lin, Sarah Wooders, and Joseph_E Gonzalez. Memgpt: towards llms as operating systems. 2023

2023
[62]

Identifying the risks of lm agents with an lm-emulated sandbox

Yangjun Ruan, Honghua Dong, Andrew Wang, Silviu Pitis, Yongchao Zhou, Jimmy Ba, Yann Dubois, Chris Maddison, and Tatsunori Hashimoto. Identifying the risks of lm agents with an lm-emulated sandbox. InInternational Conference on Learning Representations, volume 2024, pages 2703...

2024
[63]

Agentdojo: A dynamic environment to evaluate prompt injection attacks and defenses for llm agents.Advances in Neural Information Processing Systems, 37:82895–82920, 2024

Edoardo Debenedetti, Jie Zhang, Mislav Balunovic, Luca Beurer-Kellner, Marc Fischer, and Florian Tramèr. Agentdojo: A dynamic environment to evaluate prompt injection attacks and defenses for llm agents.Advances in Neural Information Processing Systems, 37:82895–82920, 2024

2024
[64]

Injecagent: Benchmarking indirect prompt injections in tool-integrated large language model agents

Qiusi Zhan, Zhixiang Liang, Zifan Ying, and Daniel Kang. Injecagent: Benchmarking indirect prompt injections in tool-integrated large language model agents. InFindings of the Association for Computational Linguistics: ACL 2024, pages 10471–10506, 2024. 63 From Chatbot to Digit...

2024
[65]

Openclaw prism: A zero-fork, defense-in-depth runtime security layer for tool- augmented llm agents.arXiv preprint arXiv:2603.11853, 2026

Frank Li. Openclaw prism: A zero-fork, defense-in-depth runtime security layer for tool- augmented llm agents.arXiv preprint arXiv:2603.11853, 2026. URL https://arxiv. org/abs/2603.11853

2026
[67]

Chameleon: Plug-and-play compositional reasoning with large language models.Advances in Neural Information Processing Systems, 36:43447–43478, 2023

Pan Lu, Baolin Peng, Hao Cheng, Michel Galley, Kai-Wei Chang, Ying Nian Wu, Song-Chun Zhu, and Jianfeng Gao. Chameleon: Plug-and-play compositional reasoning with large language models.Advances in Neural Information Processing Systems, 36:43447–43478, 2023

2023
[68]

Qwen3.6-27B non-thinking, April 2026

Qwen Team. Qwen3.6-27B non-thinking, April 2026. URLhttps://qwen.ai/blog?id= qwen3.6-27b

2026
[69]

Stateless yet not forgetful: Implicit memory as a hidden channel in llms.arXiv preprint arXiv:2602.08563, 2026

Ahmed Salem, Andrew Paverd, and Sahar Abdelnabi. Stateless yet not forgetful: Implicit memory as a hidden channel in llms.arXiv preprint arXiv:2602.08563, 2026

2026
[70]

Reasoning and planning with large language models in code development

Hao Ding, Ziwei Fan, Ingo Guehring, Gaurav Gupta, Wooseok Ha, Jun Huan, Linbo Liu, Behrooz Omidvar-Tehrani, Shiqi Wang, and Hao Zhou. Reasoning and planning with large language models in code development. InProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery a...

2024
[71]

Structured chain-of-thought prompting for code generation.ACM Transactions on Software Engineering and Methodology, 34(2):1–23, 2025

Jia Li, Ge Li, Yongmin Li, and Zhi Jin. Structured chain-of-thought prompting for code generation.ACM Transactions on Software Engineering and Methodology, 34(2):1–23, 2025

2025
[72]

A survey on large reasoning models with self-play deep reinforcement learning and chain-of-thought

Chunfang Ou, Lijuan Fan, Guobin Fu, Renzheng Liu, and Zhongzhi Li. A survey on large reasoning models with self-play deep reinforcement learning and chain-of-thought. In Proceedings of the 2025 2nd Symposium on Big Data, Neural Networks, and Deep Learning, pages 186–190, 2025

2025
[73]

Mul- timodal chain-of-thought reasoning in language models.arXiv preprint arXiv:2302.00923, 2023

Zhuosheng Zhang, Aston Zhang, Mu Li, Hai Zhao, George Karypis, and Alex Smola. Mul- timodal chain-of-thought reasoning in language models.arXiv preprint arXiv:2302.00923, 2023

2023 arXiv
[74]

Progco: Program helps self-correction of large language models

Xiaoshuai Song, Yanan Wu, Weixun Wang, Jiaheng Liu, Wenbo Su, and Bo Zheng. Progco: Program helps self-correction of large language models. InProceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), pages 944–959, 2025

2025
[75]

Thinking, fast and slow.Farrar, Straus and Giroux, 2011

Daniel Kahneman. Thinking, fast and slow.Farrar, Straus and Giroux, 2011

2011
[76]

A survey of large language models.arXiv preprint arXiv:2303.18223, 2023

Wayne Xin Zhao, Kun Zhou, Junyi Li, Tianyi Tang, Xia Wang, Yupeng Hou, Yingqian Min, Beichen Zhang, Junjie Zhang, Zican Dong, et al. A survey of large language models.arXiv preprint arXiv:2303.18223, 2023

2023 arXiv
[77]

Safechain: Safety of language models with long chain-of-thought reasoning capabilities

Fengqing Jiang, Zhangchen Xu, Yuetai Li, Luyao Niu, Zhen Xiang, Bo Li, Bill Yuchen Lin, and Radha Poovendran. Safechain: Safety of language models with long chain-of-thought reasoning capabilities. InFindings of the Association for Computational Linguistics: ACL 2025, pages 23...

2025
[78]

Yancheng He, Shilong Li, Jiaheng Liu, Weixun Wang, Xingyuan Bu, Ge Zhang, Zy Peng, Zhaoxiang Zhang, Zhicheng Zheng, Wenbo Su, et al. Can large language models detect errors in long chain-of-thought reasoning? InProceedings of the 63rd Annual Meeting of the Association for Comp...

2025
[79]

Interactive reasoning: Visualizing and controlling chain- of-thought reasoning in large language models

Rock Yuren Pang, KJ Kevin Feng, Shangbin Feng, Chu Li, Weijia Shi, Yulia Tsvetkov, Jeffrey Heer, and Katharina Reinecke. Interactive reasoning: Visualizing and controlling chain- of-thought reasoning in large language models. InProceedings of the 31st International Conference ...

2026
[80]

Chain-of-thought matters: improving long- context language models with reasoning path supervision.arXiv preprint arXiv:2502.20790, 2025

Dawei Zhu, Xiyu Wei, Guangxiang Zhao, Wenhao Wu, Haosheng Zou, Junfeng Ran, Xun Wang, Lin Sun, Xiangzheng Zhang, and Sujian Li. Chain-of-thought matters: improving long- context language models with reasoning path supervision.arXiv preprint arXiv:2502.20790, 2025

2025 arXiv
[81]

Aligning large and small language models via chain- of-thought reasoning

Leonardo Ranaldi and Andre Freitas. Aligning large and small language models via chain- of-thought reasoning. InProceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1812–1827, 2024

2024
[82]

Recot: Reflective self- correction training for mitigating confirmation bias in large vision-language models

Mengxue Qu, Yibo Hu, Kunyang Han, Yunchao Wei, and Yao Zhao. Recot: Reflective self- correction training for mitigating confirmation bias in large vision-language models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 9147–9157, 2025

2025
[83]

Reflexicoder: Teaching large language models to self-reflect on generated code and self- correct it via reinforcement learning.arXiv preprint arXiv:2603.05863, 2026

Juyong Jiang, Jiasi Shen, Sunghun Kim, Kang Min Yoo, Jeonghoon Kim, and Sungju Kim. Reflexicoder: Teaching large language models to self-reflect on generated code and self- correct it via reinforcement learning.arXiv preprint arXiv:2603.05863, 2026

2026 arXiv
[84]

Sherlock: Self-correcting reasoning in vision-language models

Yi Ding and Ruqi Zhang. Sherlock: Self-correcting reasoning in vision-language models. Advances in Neural Information Processing Systems, 38:101638–101672, 2026

2026
[85]

Enhancing self-correction in large language models through multi-perspective reflection.arXiv preprint arXiv:2601.07780, 2026

Mariana Costa, Alberlucia Rafael Soarez, Daniel Kim, and Camila Ferreira. Enhancing self-correction in large language models through multi-perspective reflection.arXiv preprint arXiv:2601.07780, 2026

2026
[86]

Can large language models self-correct in medical question answering? an exploratory study.arXiv preprint arXiv:2604.00261, 2026

Zaifu Zhan, Mengyuan Cui, and Rui Zhang. Can large language models self-correct in medical question answering? an exploratory study.arXiv preprint arXiv:2604.00261, 2026

2026
[87]

AutoCAP: Towards automatic cross-lingual alignment planning for zero-shot chain-of-thought

Yongheng Zhang, Qiguang Chen, Min Li, Wanxiang Che, and Libo Qin. AutoCAP: Towards automatic cross-lingual alignment planning for zero-shot chain-of-thought. In Lun-Wei Ku, Andre Martins, and Vivek Srikumar, editors,Findings of the Association for Computational Linguistics: AC...

2024 doi
[88]

Improving language understanding by generative pre-training

Alec Radford, Karthik Narasimhan, Tim Salimans, and Ilya Sutskever. Improving language understanding by generative pre-training. Technical report, OpenAI, 2018

2018
[89]

Language models are unsupervised multitask learners.OpenAI blog, 1(8):9, 2019

Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. Language models are unsupervised multitask learners.OpenAI blog, 1(8):9, 2019. 65 From Chatbot to Digital Colleague

2019
[90]

Unlocking general long chain-of-thought reasoning capabilities of large language models via representation engineering

Xinyu Tang, Xiaolei Wang, Zhihao Lv, Yingqian Min, Wayne Xin Zhao, Binbin Hu, Ziqi Liu, and Zhiqiang Zhang. Unlocking general long chain-of-thought reasoning capabilities of large language models via representation engineering. InProceedings of the 63rd Annual Meeting of the A...

2025
[91]

Active prompting with chain-of-thought for large language models

Shizhe Diao, Pengcheng Wang, Yong Lin, Rui Pan, Xiang Liu, and Tong Zhang. Active prompting with chain-of-thought for large language models. InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1330–1350, 2024

2024
[92]

On the (in) effectiveness of large language models for chinese text correction.arXiv preprint arXiv:2307.09007, 2023

Yinghui Li, Haojing Huang, Shirong Ma, Yong Jiang, Yangning Li, Feng Zhou, Hai-Tao Zheng, and Qingyu Zhou. On the (in) effectiveness of large language models for chinese text correction.arXiv preprint arXiv:2307.09007, 2023

2023 arXiv
[93]

Automatic chain of thought prompting in large language models.arXiv preprint arXiv:2210.03493, 2022

Zhuosheng Zhang, Aston Zhang, Mu Li, and Alex Smola. Automatic chain of thought prompting in large language models.arXiv preprint arXiv:2210.03493, 2022

2022 arXiv
[94]

Badthink: Triggered overthinking attacks on chain-of-thought reasoning in large language models

Shuaitong Liu, Renjue Li, Lijia Yu, Lijun Zhang, Zhiming Liu, and Gaojie Jin. Badthink: Triggered overthinking attacks on chain-of-thought reasoning in large language models. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 40, pages 32141–32149, 2026

2026
[95]

Plan-and-solve prompting: Improving zero-shot chain-of-thought reasoning by large languagemodels

Lei Wang, Wanyu Xu, Yihuai Lan, Zhiqiang Hu, Yunshi Lan, Roy Ka-Wei Lee, and Ee-Peng Lim. Plan-and-solve prompting: Improving zero-shot chain-of-thought reasoning by large languagemodels. InProceedingsofthe 61stannual meetingofthe associationforcomputational linguistics (volum...

2023
[96]

Reflectevo: Improving meta introspection of small llms by learning self-reflection

Jiaqi Li, Xinyi Dong, Yang Liu, Zhizhuo Yang, Quansen Wang, Xiaobo Wang, Song-Chun Zhu, Zixia Jia, and Zilong Zheng. Reflectevo: Improving meta introspection of small llms by learning self-reflection. InFindings of the Association for Computational Linguistics: ACL 2025, pages...

2025
[97]

Mirror: Multiple-perspective self-reflection method for knowledge-rich reasoning

Hanqi Yan, Qinglin Zhu, Xinyu Wang, Lin Gui, and Yulan He. Mirror: Multiple-perspective self-reflection method for knowledge-rich reasoning. InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7086–7103, 2024

2024
[98]

Reflexion: Language models that think twice for internalized self-correction

Ashim Dhor. Reflexion: Language models that think twice for internalized self-correction
[99]

Supercorrect: Supervising and correcting language models with error-driven insights.arXiv preprint arXiv:2410.09008, 9, 2024

Ling Yang, Zhaochen Yu, Tianjun Zhang, Minkai Xu, Joseph E Gonzalez, Bin Cui, and Shuicheng Yan. Supercorrect: Supervising and correcting language models with error-driven insights.arXiv preprint arXiv:2410.09008, 9, 2024

2024 arXiv
[100]

Closed-loop multi-round planning for large language model agents via self- reflection and error correction.Journal of Computer Technology and Software, 3(9), 2024

Haotian Zhu. Closed-loop multi-round planning for large language model agents via self- reflection and error correction.Journal of Computer Technology and Software, 3(9), 2024

2024
[101]

Yinghui Li, Jiayi Kuang, Peng Xing, Daixian Liu, Yongheng Zhang, Junnan Dong, Shu-Yu Guo, Yangning Li, Qingyu Zhou, Wenhao Jiang, Hai-Tao Zheng, Ying Shen, Liang Lin, and Philip S. Yu. Cognitive mismatch in multimodal large language models for discrete symbol understanding, 20...

2026 arXiv
[102]

ThinkNote: Enhancing knowledge integration and utilization of large language models via constructivist cognition modeling

Zhipeng Xu, Zhenghao Liu, Yukun Yan, Shuo Wang, Shi Yu, Zheni Zeng, Chaojun Xiao, Zhiyuan Liu, Ge Yu, and Chenyan Xiong. ThinkNote: Enhancing knowledge integration and utilization of large language models via constructivist cognition modeling. In Vera Demberg, Kentaro Inui, an...

2026 doi
[103]

Beyond chain-of-thought, effective graph-of-thought reasoning in language models.arXiv preprint arXiv:2305.16582, 2023

Yao Yao, Zuchao Li, and Hai Zhao. Beyond chain-of-thought, effective graph-of-thought reasoning in language models.arXiv preprint arXiv:2305.16582, 2023

2023 arXiv
[104]

Lateval: An interactive llms evaluation benchmark with incomplete informa- tion from lateral thinking puzzles

Shulin Huang, Shirong Ma, Yinghui Li, Mengzuo Huang, Wuhe Zou, Weidong Zhang, and Haitao Zheng. Lateval: An interactive llms evaluation benchmark with incomplete informa- tion from lateral thinking puzzles. InProceedings of the 2024 Joint International Conference on Computatio...

2024
[105]

When llms meet cunning texts: A fallacy understanding benchmark for large language models.Advances in Neural Information Processing Systems, 37:112433– 112458, 2024

Yinghui Li, Qingyu Zhou, Yuanzhen Luo, Shirong Ma, Yangning Li, Hai-Tao Zheng, Xuming Hu, and Philip S Yu. When llms meet cunning texts: A fallacy understanding benchmark for large language models.Advances in Neural Information Processing Systems, 37:112433– 112458, 2024

2024
[106]

URLhttps://aclanthology.org/2026.findings-eacl.12/

2026
[107]

Seqgpt: An out-of-the-box large language model for open domain sequence understanding

Tianyu Yu, Chengyue Jiang, Chao Lou, Shen Huang, Xiaobin Wang, Wei Liu, Jiong Cai, Yangning Li, Yinghui Li, Kewei Tu, et al. Seqgpt: An out-of-the-box large language model for open domain sequence understanding. InProceedings of the AAAI Conference on Artificial Intelligence, ...

2024
[108]

Long-short chain-of-thought mixture supervised fine-tuning eliciting efficient reasoning in large language models.arXiv preprint arXiv:2505.03469, 2025

Bin Yu, Hang Yuan, Haotian Li, Xueyin Xu, Yuliang Wei, Bailing Wang, Weizhen Qi, and Kai Chen. Long-short chain-of-thought mixture supervised fine-tuning eliciting efficient reasoning in large language models.arXiv preprint arXiv:2505.03469, 2025

2025 arXiv
[109]

Think-as-you-see: Streaming chain-of-thought reasoning for large vision-language models

Jialiang Zhang, Junlong Tong, Junyan Lin, Hao Wu, Yirong Sun, Yunpu Ma, and Xiaoyu Shen. Think-as-you-see: Streaming chain-of-thought reasoning for large vision-language models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11998–12...

2026
[110]

Rethinking the roles of large language models in chinese grammatical error correction

Yinghui Li, Shang Qin, Jingheng Ye, Haojing Huang, Yangning Li, Shu-Yu Guo, Libo Qin, Xuming Hu, Wenhao Jiang, Hai-Tao Zheng, et al. Rethinking the roles of large language models in chinese grammatical error correction. InProceedings of the 63rd Annual Meeting of the Associati...

2025
[111]

Enhancing zero-shot chain-of-thought reasoning in large language models through logic

Xufeng Zhao, Mengdi Li, Wenhao Lu, Cornelius Weber, Jae-Hee Lee, Kun Chu, and Stefan Wermter. Enhancing zero-shot chain-of-thought reasoning in large language models through logic. InProceedings of the 2024 Joint International Conference on Computational Linguistics, Language ...

2024
[112]

Evaluating large language models through role-guide and self-reflection: A comparative study

Lili Zhao, Yang Wang, Qi Liu, Mengyun Wang, Wei Chen, Zhichao Sheng, and Shijin Wang. Evaluating large language models through role-guide and self-reflection: A comparative study. InThe Thirteenth International Conference on Learning Representations, 2025

2025
[113]

Teaching large reasoning models effective reflection.arXiv preprint arXiv:2601.12720, 2026

HanbinWang,JingweiSong,JinpengLi,QiZhu,FeiMi,GanquCui,YashengWang,andLifeng Shang. Teaching large reasoning models effective reflection.arXiv preprint arXiv:2601.12720, 2026

2026
[114]

Corvid: Improving multimodal large language models towards chain-of-thought reasoning

Jingjing Jiang, Chao Ma, Xurui Song, Hanwang Zhang, and Jun Luo. Corvid: Improving multimodal large language models towards chain-of-thought reasoning. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 3034–3046, 2025

2025
[115]

Automatically correcting large language models: Surveying the landscape of diverse self-correction strategies.arXiv preprint arXiv:2308.03188, 2023

Liangming Pan, Michael Saxon, Wenda Xu, Deepak Nathani, Xinyi Wang, and William Yang Wang. Automatically correcting large language models: Surveying the landscape of diverse self-correction strategies.arXiv preprint arXiv:2308.03188, 2023

2023 arXiv
[116]

Multi-layer grpo: Enhancing reasoning and self-correction in large language models.arXiv preprint arXiv:2506.04746, 2025

Fei Ding, Baiqiao Wang, Zijian Zeng, and Youwei Wang. Multi-layer grpo: Enhancing reasoning and self-correction in large language models.arXiv preprint arXiv:2506.04746, 2025

2025 arXiv
[117]

Scaling language models: Methods, analysis & insights from training gopher.arXiv preprint arXiv:2112.11446, 2021

Jack W Rae, Sebastian Borgeaud, Trevor Cai, Katie Millican, Jordan Hoffmann, Francis Song, John Aslanides, Sarah Henderson, Roman Ring, Susannah Young, et al. Scaling language models: Methods, analysis & insights from training gopher.arXiv preprint arXiv:2112.11446, 2021

2021 arXiv
[118]

Small language models need strong verifiers to self-correct reasoning

Yunxiang Zhang, Muhammad Khalifa, Lajanugen Logeswaran, Jaekyeom Kim, Moontae Lee, Honglak Lee, and Lu Wang. Small language models need strong verifiers to self-correct reasoning. InFindings of the Association for Computational Linguistics: ACL 2024, pages 15637–15653, 2024

2024
[119]

Beyond surface reasoning: Unveiling the true long chain-of-thought capacity of diffusion large language models.arXiv preprint arXiv:2510.09544, 2025

Qiguang Chen, Hanjing Li, Libo Qin, Dengyun Peng, Jinhao Liu, Jiangyi Wang, Chengyue Wu, Xie Chen, Yantao Du, and Wanxiang Che. Beyond surface reasoning: Unveiling the true long chain-of-thought capacity of diffusion large language models.arXiv preprint arXiv:2510.09544, 2025

2025
[120]

Reinforcement learning with verifiable rewards implicitly incentivizes correct reasoning in base llms.arXiv preprint arXiv:2506.14245, 2025

Xumeng Wen, Zihan Liu, Shun Zheng, Shengyu Ye, Zhirong Wu, Yang Wang, Zhijian Xu, Xiao Liang, Junjie Li, Ziming Miao, et al. Reinforcement learning with verifiable rewards implicitly incentivizes correct reasoning in base llms.arXiv preprint arXiv:2506.14245, 2025

2025 arXiv
[121]

Reinforcement learning for reasoning in large language models with one training example.Advances in Neural Information Processing Systems, 38:122721–122764, 2026

Yiping Wang, Qing Yang, Zhiyuan Zeng, Liliang Ren, Liyuan Liu, Baolin Peng, Hao Cheng, Xuehai He, Kuan Wang, Jianfeng Gao, et al. Reinforcement learning for reasoning in large language models with one training example.Advances in Neural Information Processing Systems, 38:12272...

2026
[122]

Ddcot: Duty-distinct chain-of-thought prompting for multimodal reasoning in language models.Advances in Neural Information Processing Systems, 36:5168–5191, 2023

Ge Zheng, Bin Yang, Jiajin Tang, Hong-Yu Zhou, and Sibei Yang. Ddcot: Duty-distinct chain-of-thought prompting for multimodal reasoning in language models.Advances in Neural Information Processing Systems, 36:5168–5191, 2023

2023
[123]

Self-debias: Self-correcting for debiasing large language models.arXiv preprint arXiv:2604.08243, 2026

Xuan Feng, Shuai Zhao, Luwei Xiao, Tianlong Gu, and Bo An. Self-debias: Self-correcting for debiasing large language models.arXiv preprint arXiv:2604.08243, 2026

2026 arXiv
[124]

Internalized self-correction for large language models.arXiv preprint arXiv:2412.16653, 2024

Nishanth Upadhyaya and Raghavendra Sridharamurthy. Internalized self-correction for large language models.arXiv preprint arXiv:2412.16653, 2024. 68 From Chatbot to Digital Colleague

2024 arXiv
[125]

A theoretical understandingofself-correctionthroughin-contextalignment.AdvancesinNeuralInformation Processing Systems, 37:89869–89912, 2024

Yifei Wang, Yuyang Wu, Zeming Wei, Stefanie Jegelka, and Yisen Wang. A theoretical understandingofself-correctionthroughin-contextalignment.AdvancesinNeuralInformation Processing Systems, 37:89869–89912, 2024

2024
[126]

Beyond verifiable rewards: Scaling reinforcement learning in language models to unverifiable data.Advances in Neural Information Processing Systems, 38:74421–74448, 2026

Yunhao Tang, Sid Wang, Lovish Madaan, and Rémi Munos. Beyond verifiable rewards: Scaling reinforcement learning in language models to unverifiable data.Advances in Neural Information Processing Systems, 38:74421–74448, 2026

2026
[127]

Interpretable contrastive monte carlo tree search reasoning.arXiv preprint arXiv:2410.01707, 2024

Zitian Gao, Boye Niu, Xuzheng He, Haotian Xu, Hongzhang Liu, Aiwei Liu, Xuming Hu, and Lijie Wen. Interpretable contrastive monte carlo tree search reasoning.arXiv preprint arXiv:2410.01707, 2024

2024 arXiv
[128]

PaLM: Scaling language modeling with pathways.arXiv preprint arXiv:2204.02311, 2022

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al. PaLM: Scaling language modeling with pathways.arXiv preprint arXiv:2204.02311, 2022. URL https://arxiv.org/abs...

2022 arXiv
[129]

Opt: Open pre-trained transformer language models.arXiv preprint arXiv:2205.01068, 2022

Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, et al. Opt: Open pre-trained transformer language models.arXiv preprint arXiv:2205.01068, 2022

2022 arXiv
[130]

Monte carlo tree search for graph reasoning in large language model agents

Lihui Liu. Monte carlo tree search for graph reasoning in large language model agents. InProceedings of the 34th ACM International Conference on Information and Knowledge Management, pages 4966–4970, 2025

2025
[131]

Maniplvm-r1: Reinforcement learning for reasoning in embodied manipulation with large vision-language models

Zirui Song, Guangxian Ouyang, Mingzhe Li, Yuheng Ji, Chenxi Wang, Zixiang Xu, Zeyu Zhang, Xiaoqing Zhang, Qian Jiang, Fengxian Ji, et al. Maniplvm-r1: Reinforcement learning for reasoning in embodied manipulation with large vision-language models. InProceedings of the AAAI Con...

2026
[132]

Trust, but verify: A self-verification approach to reinforcement learning with verifiable rewards.Advances in Neural Information Processing Systems, 38: 130475–130501, 2026

Xiaoyuan Liu, Tian Liang, Zhiwei He, Jiahao Xu, Wenxuan Wang, Pinjia He, Zhaopeng Tu, Haitao Mi, and Dong Yu. Trust, but verify: A self-verification approach to reinforcement learning with verifiable rewards.Advances in Neural Information Processing Systems, 38: 130475–130501, 2026

2026
[133]

A survey of reinforcement learning for large reasoning models.arXiv preprint arXiv:2509.08827, 2025

Kaiyan Zhang, Yuxin Zuo, Bingxiang He, Youbang Sun, Runze Liu, Che Jiang, Yuchen Fan, Kai Tian, Guoli Jia, Pengfei Li, et al. A survey of reinforcement learning for large reasoning models.arXiv preprint arXiv:2509.08827, 2025

2025 arXiv
[134]

Llama: Open and efficient foundation language models.arXiv preprint arXiv:2302.13971, 2023

Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timo- thée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, et al. Llama: Open and efficient foundation language models.arXiv preprint arXiv:2302.13971, 2023

2023 arXiv
[135]

Reasoning gym: Reasoning environments for reinforcement learning with verifiable rewards.Advances in Neural Information Processing Systems, 38, 2026

Zafir Stojanovski, Oliver Stanley, Joe Sharratt, Richard Jones, Abdulhakeem Adefioye, Jean Kaddour, and Andreas Köpf. Reasoning gym: Reasoning environments for reinforcement learning with verifiable rewards.Advances in Neural Information Processing Systems, 38, 2026

2026
[136]

Bridging visual representation and reinforcement learning from verifiable rewards in large vision-language models.arXiv preprint arXiv:2603.27375, 2026

Yuhang Han, Yuyang Wu, Zhengbo Jiao, Yiyu Wang, Xuyang Liu, Shaobo Wang, Hanlin Xu, Xuming Hu, and Linfeng Zhang. Bridging visual representation and reinforcement learning from verifiable rewards in large vision-language models.arXiv preprint arXiv:2603.27375, 2026. 69 From Ch...

2026
[137]

Prorl: Prolonged reinforcement learning expands reasoning boundaries in large language models.Advances in Neural Information Processing Systems, 38:17998–18031, 2026

Mingjie Liu, Shizhe Diao, Ximing Lu, Jian Hu, Xin Dong, Yejin Choi, Jan Kautz, and Yi Dong. Prorl: Prolonged reinforcement learning expands reasoning boundaries in large language models.Advances in Neural Information Processing Systems, 38:17998–18031, 2026

2026
[138]

Enhancing large language model reasoning with reward models: An analytical survey.arXiv preprint arXiv:2510.01925, 2025

Qiyuan Liu, Hao Xu, Xuhong Chen, Wei Chen, Yee Whye Teh, and Ning Miao. Enhancing large language model reasoning with reward models: An analytical survey.arXiv preprint arXiv:2510.01925, 2025

2025
[139]

Teaching large language models to reason with reinforcement learning.arXiv preprint arXiv:2403.04642, 2024

Alex Havrilla, Yuqing Du, Sharath Chandra Raparthy, Christoforos Nalmpantis, Jane Dwivedi- Yu, Maksym Zhuravinskyi, Eric Hambro, Sainbayar Sukhbaatar, and Roberta Raileanu. Teaching large language models to reason with reinforcement learning.arXiv preprint arXiv:2403.04642, 2024

2024 arXiv
[140]

Reward modeling for reinforcement learning-based llm reasoning: Design, challenges, and evaluation.arXiv preprint arXiv:2602.09305, 2026

Pei-Chi Pan, Yingbin Liang, and Sen Lin. Reward modeling for reinforcement learning-based llm reasoning: Design, challenges, and evaluation.arXiv preprint arXiv:2602.09305, 2026

2026 arXiv
[141]

Mixtral of experts.arXiv preprint arXiv:2401.04088, 2024

Albert Q Jiang, Alexandre Sablayrolles, Antoine Roux, Arthur Mensch, Blanche Savary, Chris Bamford, Devendra Singh Chaplot, Diego de las Casas, Emma Bou Hanna, Florian Bressand, et al. Mixtral of experts.arXiv preprint arXiv:2401.04088, 2024

2024 arXiv
[142]

Specializing large language models for process modeling via reinforcement learning with verifiable and universal rewards.Process Science, 2(1):26, 2025

Alessandro Berti, Xiaoting Wang, Humam Kourani, and Wil MP Van der Aalst. Specializing large language models for process modeling via reinforcement learning with verifiable and universal rewards.Process Science, 2(1):26, 2025

2025
[143]

Zhang, Han Bao, Hanwei Xu, Haocheng Wang, Haowei Zhang, Honghui Ding, Huajian Xin, Huazuo Gao, Hui Li, Hui Qu, J

DeepSeek-AI, Aixin Liu, Bei Feng, Bing Xue, Bingxuan Wang, Bochao Wu, Chengda Lu, Chenggang Zhao, Chengqi Deng, Chenyu Zhang, Chong Ruan, Damai Dai, Daya Guo, Dejian Yang, Deli Chen, Dongjie Ji, Erhang Li, Fangyun Lin, Fucong Dai, Fuli Luo, Guangbo Hao, Guanting Chen, Guowei L...

2025 arXiv
[144]

Gpt-4o system card.arXiv preprint arXiv:2410.21276, 2024

Aaron Hurst, Adam Lerer, Adam P Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, et al. Gpt-4o system card.arXiv preprint arXiv:2410.21276, 2024

2024 arXiv
[145]

Qwen3 technical report, 2025

Qwen Team. Qwen3 technical report, 2025. URL https://arxiv.org/abs/2505. 09388

2025
[146]

Zhang, Hanwei Xu, Hao Yang, Haowei Zhang, Honghui Ding, Huajian Xin, Huazuo Gao, Hui Li, Hui Qu, J

DeepSeek-AI, Aixin Liu, Bei Feng, Bin Wang, Bingxuan Wang, Bo Liu, Chenggang Zhao, Chengqi Dengr, Chong Ruan, Damai Dai, Daya Guo, Dejian Yang, Deli Chen, Dongjie Ji, Erhang Li, Fangyun Lin, Fuli Luo, Guangbo Hao, Guanting Chen, Guowei Li, H. Zhang, Hanwei Xu, Hao Yang, Haowei...

2024 arXiv
[147]

Gpt-4.5 system card, 2025

OpenAI. Gpt-4.5 system card, 2025. URLhttps://openai.com/index/gpt-4-5/

2025
[148]

Grok 4 fast non-reasoning model card, 2025

xAI. Grok 4 fast non-reasoning model card, 2025. 71 From Chatbot to Digital Colleague

2025
[149]

A technical survey of reinforcement learning techniques for large language models.arXiv preprint arXiv:2507.04136, 2025

Saksham Sahai Srivastava and Vaneet Aggarwal. A technical survey of reinforcement learning techniques for large language models.arXiv preprint arXiv:2507.04136, 2025

2025 arXiv
[150]

Minimax-01: Scaling foundation models with lightning attention, 2025

MiniMax, Aonian Li, Bangwei Gong, Bo Yang, Boji Shan, Chang Liu, Cheng Zhu, Chunhao Zhang, Congchao Guo, Da Chen, Dong Li, Enwei Jiao, Gengxin Li, Guojun Zhang, Haohai Sun, Houze Dong, Jiadai Zhu, Jiaqi Zhuang, Jiayuan Song, Jin Zhu, Jingtao Han, Jingyang Li, Junbin Xie, Junha...

2025 arXiv
[151]

A relative- budget theory for reinforcement learning with verifiable rewards in large language model reasoning.arXiv preprint arXiv:2602.01523, 2026

Akifumi Wachi, Hirota Kinoshita, Shokichi Takakura, Rei Higuchi, and Taiji Suzuki. A relative- budget theory for reinforcement learning with verifiable rewards in large language model reasoning.arXiv preprint arXiv:2602.01523, 2026

2026
[152]

Admtree: Compressing lengthy context with adaptive semantic trees

Yangning Li, Shaoshen Chen, Yinghui Li, Yankai Chen, Hai-Tao Zheng, Hui Wang, Wenhao Jiang, and Philip S Yu. Admtree: Compressing lengthy context with adaptive semantic trees. Advances in Neural Information Processing Systems, 38:40389–40415, 2026

2026
[153]

Does reinforcement learning really incentivize reasoning capacity in llms beyond the base model?Advances in Neural Information Processing Systems, 38:57654–57689, 2026

Zhiqi Chen, Rui Lu, Andrew Zhao, Zhaokai Wang, Yang Yue, Shiji Song, and Gao Huang. Does reinforcement learning really incentivize reasoning capacity in llms beyond the base model?Advances in Neural Information Processing Systems, 38:57654–57689, 2026

2026
[154]

Dast: Context-aware compression in llms via dynamic allocation of soft tokens

Shaoshen Chen, Yangning Li, Zishan Xu, Yongqin Zeng, Shunlong Wu, Xinshuo Hu, Zifei Shan, Xin Su, Jiwei Tang, Yinghui Li, et al. Dast: Context-aware compression in llms via dynamic allocation of soft tokens. InFindings of the Association for Computational Linguistics: ACL 2025...

2025
[155]

From verifiable dot to reward chain: Harnessing verifiable reference-based rewards for reinforcement learning of open-ended generation.arXiv preprint arXiv:2601.18533, 2026

Yuxin Jiang, Yufei Wang, Qiyuan Zhang, Xingshan Zeng, Liangyou Li, Jierun Chen, Chaofan Tao, Haoli Bai, and Lifeng Shang. From verifiable dot to reward chain: Harnessing verifiable reference-based rewards for reinforcement learning of open-ended generation.arXiv preprint arXiv...

2026
[156]

Locating and editing factual associations in gpt.Advances in neural information processing systems, 35:17359–17372, 2022

Kevin Meng, David Bau, Alex Andonian, and Yonatan Belinkov. Locating and editing factual associations in gpt.Advances in neural information processing systems, 35:17359–17372, 2022

2022
[157]

Knowledgeneurons in pretrained transformers

DamaiDai,LiDong,YaruHao,ZhifangSui,BaobaoChang,andFuruWei. Knowledgeneurons in pretrained transformers. InProceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 8493–8502, 2022

2022
[158]

Cooper: Co-optimizing policy and reward models in reinforcement learning for large language models.arXiv preprint arXiv:2508.05613, 2025

Haitao Hong, Yuchen Yan, Xingyu Wu, Guiyang Hou, Wenqi Zhang, Weiming Lu, Yongliang Shen, and Jun Xiao. Cooper: Co-optimizing policy and reward models in reinforcement learning for large language models.arXiv preprint arXiv:2508.05613, 2025

2025 arXiv
[159]

Rubrics as rewards: Reinforcement learning beyond verifiable domains.arXiv preprint arXiv:2507.17746, 2025

Anisha Gunjal, Anthony Wang, Elaine Lau, Vaskar Nath, Yunzhong He, Bing Liu, and Sean Hendryx. Rubrics as rewards: Reinforcement learning beyond verifiable domains.arXiv preprint arXiv:2507.17746, 2025

2025 arXiv
[160]

A survey on test-time scaling in large language models: What, how, where, and how well?arXiv preprint arXiv:2503.24235, 2025

Qiyuan Zhang, Fuyuan Lyu, Zexu Sun, Lei Wang, Weixu Zhang, Wenyue Hua, Haolun Wu, Zhihan Guo, Yufei Wang, Niklas Muennighoff, et al. A survey on test-time scaling in large language models: What, how, where, and how well?arXiv preprint arXiv:2503.24235, 2025

2025 arXiv
[161]

Fasttts: Accelerating test-time scaling for edge llm reasoning

Hao Mark Chen, Zhiwen Mo, Guanxi Lu, Shuang Liang, Lingxiao Ma, Wayne Luk, and Hongxiang Fan. Fasttts: Accelerating test-time scaling for edge llm reasoning. InProceedings 72 From Chatbot to Digital Colleague of the 31st ACM International Conference on Architectural Support fo...

2026
[162]

Retrieval-augmented generation for knowledge-intensive nlp tasks.Advances in Neural Information Processing Systems, 33:9459–9474, 2020

Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal,HeinrichKüttler,MikeLewis,Wen-tauYih,TimRocktäschel,etal. Retrieval-augmented generation for knowledge-intensive nlp tasks.Advances in Neural Information Processing Systems, 33:9459–9...

2020
[163]

The art of scaling test-time compute for large language models.arXiv preprint arXiv:2512.02008, 2025

Aradhye Agarwal, Ayan Sengupta, and Tanmoy Chakraborty. The art of scaling test-time compute for large language models.arXiv preprint arXiv:2512.02008, 2025

2025
[164]

Emergent abilities of large language models.arXiv preprint arXiv:2206.07682, 2022

Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, et al. Emergent abilities of large language models.arXiv preprint arXiv:2206.07682, 2022

2022 arXiv
[165]

Are emergent abilities of large language models a mirage?Advances in neural information processing systems, 36:55565–55581, 2023

Rylan Schaeffer, Brando Miranda, and Sanmi Koyejo. Are emergent abilities of large language models a mirage?Advances in neural information processing systems, 36:55565–55581, 2023

2023
[166]

Scaling llm test-time compute optimally can be more effective than scaling parameters for reasoning

Charlie Snell, Jaehoon Lee, Kelvin Xu, and Aviral Kumar. Scaling llm test-time compute optimally can be more effective than scaling parameters for reasoning. InInternational Conference on Learning Representations, volume 2025, pages 10131–10165, 2025

2025
[167]

Agenttts: Large language model agent for test-time compute-optimal scaling strategy in complex tasks.Advances in Neural Information Processing Systems, 38:98396–98433, 2026

Fali Wang, Hui Liu, Zhenwei Dai, Jingying Zeng, Zhiwei Zhang, Zongyu Wu, Chen Luo, Zhen Li, Xianfeng Tang, Qi He, et al. Agenttts: Large language model agent for test-time compute-optimal scaling strategy in complex tasks.Advances in Neural Information Processing Systems, 38:9...

2026
[168]

A survey of test-time compute: From intuitive inference to deliberate reasoning

Yixin Ji, Juntao Li, Yang Xiang, Hai Ye, Kaixin Wu, Kai Yao, Jia Xu, Linjian Mo, and Min Zhang. A survey of test-time compute: From intuitive inference to deliberate reasoning. Computational Linguistics, pages 1–51, 2026

2026
[169]

m1: Unleash the potentialoftest-timescalingformedicalreasoningwithlargelanguagemodels.arXivpreprint arXiv:2504.00869, 2025

Xiaoke Huang, Juncheng Wu, Hui Liu, Xianfeng Tang, and Yuyin Zhou. m1: Unleash the potentialoftest-timescalingformedicalreasoningwithlargelanguagemodels.arXivpreprint arXiv:2504.00869, 2025

2025
[170]

From system 1 to system 2: A survey of reasoning large language models,

Zhong-Zhi Li, Duzhen Zhang, Ming-Liang Zhang, Jiaxin Zhang, Zengyan Liu, Yuxuan Yao, Haotian Xu, Junhao Zheng, Pei-Jie Wang, Xiuyi Chen, Yingying Zhang, Fei Yin, Jiahua Dong, Zhiwei Li, Bao-Long Bi, Ling-Rui Mei, Junfeng Fang, Xiao Liang, Zhijiang Guo, Le Song, and Cheng-Lin L...
[171]

Think deep, think fast: Investigating efficiency of verifier-free inference-time-scaling methods.arXiv preprint arXiv:2504.14047, 2025

Junlin Wang, Shang Zhu, Jon Saad-Falcon, Ben Athiwaratkun, Qingyang Wu, Jue Wang, Shuaiwen Leon Song, Ce Zhang, Bhuwan Dhingra, and James Zou. Think deep, think fast: Investigating efficiency of verifier-free inference-time-scaling methods.arXiv preprint arXiv:2504.14047, 2025

2025 arXiv
[172]

Orca: Progressive learning from complex explanation traces of gpt-4,

Subhabrata Mukherjee, Arindam Mitra, Ganesh Jawahar, Sahaj Agarwal, Hamid Palangi, and Ahmed Awadallah. Orca: Progressive learning from complex explanation traces of gpt-4,
[173]

Gpt-2: 1.5b release.https://openai.com/index/gpt-2-1-5b-release/, 2019

OpenAI. Gpt-2: 1.5b release.https://openai.com/index/gpt-2-1-5b-release/, 2019. 73 From Chatbot to Digital Colleague

2019
[174]

Llama 2: Open foundation and fine-tuned chat models.arXiv preprint arXiv:2307.09288, 2023

Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models.arXiv preprint arXiv:2307.09288, 2023. URL https://arxiv.org/a...

2023 arXiv
[175]

Towards thinking-optimal scaling of test-time compute for llm reasoning.Advances in Neural Information Processing Systems, 38: 43605–43631, 2026

Wenkai Yang, Shuming Ma, Yankai Lin, and Furu Wei. Towards thinking-optimal scaling of test-time compute for llm reasoning.Advances in Neural Information Processing Systems, 38: 43605–43631, 2026

2026
[176]

InternLM: A multilingual language model with progressively enhanced capabilities.https://github.com/InternLM/InternLM-techreport, 2023

InternLM Team. InternLM: A multilingual language model with progressively enhanced capabilities.https://github.com/InternLM/InternLM-techreport, 2023

2023
[177]

Exploring the limits of transfer learning with a unified text-to-text transformer.Journal of machine learning research, 21(140):1–67, 2020

Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learning with a unified text-to-text transformer.Journal of machine learning research, 21(140):1–67, 2020

2020
[178]

URLhttps://arxiv.org/abs/2306.02707

arXiv
[179]

Dialogpt: Large-scale generative pre-training for conversational response generation

Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, and William B Dolan. Dialogpt: Large-scale generative pre-training for conversational response generation. InProceedings of the 58th annual meeting of the association fo...

2020
[180]

Wizardlm: Empowering large language models to follow complex instructions

Can Xu, Qingfeng Sun, Kai Zheng, Xiubo Geng, Pu Zhao, Jiazhan Feng, Chongyang Tao, and Daxin Jiang. Wizardlm: Empowering large language models to follow complex instructions. arXiv preprint arXiv:2304.12244, 2023

2023 arXiv
[181]

Plato: Pre-trained dialogue generation model with discrete latent variable

Siqi Bao, Huang He, Fan Wang, Hua Wu, and Haifeng Wang. Plato: Pre-trained dialogue generation model with discrete latent variable. InProceedings of the 58th annual meeting of the association for computational linguistics, pages 85–96, 2020

2020
[182]

Qwen technical report.arXiv preprint arXiv:2309.16609, 2023

Jinze Bai, Shuai Bai, Yunfei Chu, Zeyu Cui, Kai Dang, Xiaodong Deng, Yang Fan, Wenbin Ge, Yu Han, Fei Huang, et al. Qwen technical report.arXiv preprint arXiv:2309.16609, 2023. URLhttps://arxiv.org/abs/2309.16609

2023 arXiv
[183]

Recipes for building an open-domain chatbot

Stephen Roller, Emily Dinan, Naman Goyal, Da Ju, Mary Williamson, Yinhan Liu, Jing Xu, Myle Ott, Eric Michael Smith, Y-Lan Boureau, et al. Recipes for building an open-domain chatbot. InProceedings of the 16th Conference of the European Chapter of the Association for Computati...

2021
[184]

Introducing the next generation of claude.https://www.anthropic.com/ news/claude-2, 2023

Anthropic. Introducing the next generation of claude.https://www.anthropic.com/ news/claude-2, 2023

2023
[185]

OpenFlamingo: An open- source framework for training large autoregressive vision-language models.arXiv preprint arXiv:2308.01390, 2023

Anas Awadalla, Irena Gao, Josh Gardner, Jack Hessel, Yusuf Hanafy, Wanrong Zhu, Kalyani Marathe, Yonatan Bitton, Samir Gadre, Shiori Sagawa, et al. OpenFlamingo: An open- source framework for training large autoregressive vision-language models.arXiv preprint arXiv:2308.01390,...

2023 arXiv
[186]

Plato-2: Towards building an open-domain chatbot via curriculum learning

Siqi Bao, Huang He, Fan Wang, Hua Wu, Haifeng Wang, Wenquan Wu, Zhen Guo, Zhibin Liu, and Xinchao Xu. Plato-2: Towards building an open-domain chatbot via curriculum learning. InFindings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 2513–2525, 2021

2021
[187]

Towards a human-like open-domain chatbot.arXiv preprint arXiv:2001.09977, 2020

Daniel Adiwardana, Minh-Thang Luong, David R So, Jamie Hall, Noah Fiedel, Romal Thoppi- lan, Zi Yang, Apoorv Kulshreshtha, Gaurav Nemade, Yifeng Lu, et al. Towards a human-like open-domain chatbot.arXiv preprint arXiv:2001.09977, 2020

2001 arXiv
[188]

BlenderBot 2.0: An open source chatbot that builds long-term memory and searches the internet.https://parl.ai/projects/blenderbot2/, July 2021

ParlAI. BlenderBot 2.0: An open source chatbot that builds long-term memory and searches the internet.https://parl.ai/projects/blenderbot2/, July 2021

2021
[189]

Wizardmath: Empowering mathematical reasoning for large language models via reinforced evol-instruct, 2023

Haipeng Luo, Qingfeng Sun, Can Xu, Pu Zhao, Jianguang Lou, Chongyang Tao, Xiubo Geng, Qingwei Lin, Shifeng Chen, and Dongmei Zhang. Wizardmath: Empowering mathematical reasoning for large language models via reinforced evol-instruct, 2023. URLhttps:// arxiv.org/abs/2308.09583

2023 arXiv
[190]

Qwen-VL: A versatile vision-language model for understanding, localization, text reading, and beyond.arXiv preprint arXiv:2308.12966, 2023

JinzeBai, ShuaiBai, ShushengYang, ShijieWang, SinanTan, PengWang, JunyangLin, Chang Zhou, and Jingren Zhou. Qwen-VL: A versatile vision-language model for understanding, localization, text reading, and beyond.arXiv preprint arXiv:2308.12966, 2023. URLhttps: //arxiv.org/abs/2308.12966

2023 arXiv
[191]

WizardCoder: Empowering code large language models with evol-instruct

Ziyang Luo, Can Xu, Pu Zhao, Qingfeng Sun, Xiubo Geng, Wenxiang Hu, Chongyang Tao, Jing Ma, Qingwei Lin, and Daxin Jiang. WizardCoder: Empowering code large language models with evol-instruct. InInternational Conference on Learning Representations, volume 2024, pages 27168–27188, 2024

2024
[192]

Evaluating large language models trained on code.arXiv preprint arXiv:2107.03374, 2021

Mark Chen, Jerry Tworek, Heewoo Jun, Qiming Yuan, Henrique Ponde De Oliveira Pinto, Jared Kaplan, Harri Edwards, Yuri Burda, Nicholas Joseph, Greg Brockman, et al. Evaluating large language models trained on code.arXiv preprint arXiv:2107.03374, 2021

2021 arXiv
[193]

Code Llama: Open foundation models for code.arXiv preprint arXiv:2308.12950, 2023

Baptiste Roziere, Jonas Gehring, Fabian Gloeckle, Sten Sootla, Itai Gat, Xiaoqing Ellen Tan, Yossi Adi, Jingyu Liu, Romain Sauvestre, Tal Remez, et al. Code Llama: Open foundation models for code.arXiv preprint arXiv:2308.12950, 2023. URLhttps://arxiv.org/abs/ 2308.12950

2023 arXiv
[194]

What changes can large-scale language models bring? intensive study on HyperCLOVA.arXiv preprint arXiv:2109.04650, 2021

Boseop Kim, HyoungSeok Kim, Sang-Woo Lee, Gichang Lee, Donghyun Kwak, Dong Hyeon Jeon, Sunghyun Park, Sungju Kim, Seonhoon Kim, Dongpil Seo, et al. What changes can large-scale language models bring? intensive study on HyperCLOVA.arXiv preprint arXiv:2109.04650, 2021. URLhttps...

2021 arXiv
[195]

Textbooks are all you need II: phi-1.5 technical report.arXiv preprint arXiv:2309.05463, 2023

Yuanzhi Li, Sébastien Bubeck, Ronen Eldan, Allie Del Giorno, Suriya Gunasekar, and Yin Tat Lee. Textbooks are all you need II: phi-1.5 technical report.arXiv preprint arXiv:2309.05463, 2023

2023 arXiv
[196]

Jurassic-1: Tech- nical details and evaluation

Opher Lieber, Or Sharir, Barak Lenz, and Yoav Shoham. Jurassic-1: Tech- nical details and evaluation. https://www.ai21.com/blog/research/ jurassic-1-technical-details-evaluation/, 2021

2021
[197]

Baichuan 2: Open large-scale language models.arXiv preprint arXiv:2309.10305, 2023

Aiyuan Yang, Bin Xiao, Bingning Wang, Borong Zhang, Ce Bian, Chao Yin, Chenxu Lv, Da Pan, Dian Wang, Dong Yan, et al. Baichuan 2: Open large-scale language models.arXiv preprint arXiv:2309.10305, 2023. URLhttps://arxiv.org/abs/2309.10305. 75 From Chatbot to Digital Colleague

2023 arXiv
[198]

Gpt-4v(ision) system card

OpenAI. Gpt-4v(ision) system card. https://openai.com/index/ gpt-4v-system-card/, 2023

2023
[199]

Obelics: An open web-scale filtered dataset of interleaved image-text documents.Advances in Neural Information Processing Systems, 36:71683–71702, 2023

Hugo Laurençon, Lucile Saulnier, Léo Tronchon, Stas Bekman, Amanpreet Singh, Anton Lozhkov, Thomas Wang, Siddharth Karamcheti, Alexander Rush, Douwe Kiela, et al. Obelics: An open web-scale filtered dataset of interleaved image-text documents.Advances in Neural Information Pro...

2023
[200]

Glam: Efficient scaling of language models with mixture-of-experts

Nan Du, Yanping Huang, Andrew M Dai, Simon Tong, Dmitry Lepikhin, Yuanzhong Xu, Maxim Krikun, Yanqi Zhou, Adams Wei Yu, Orhan Firat, et al. Glam: Efficient scaling of language models with mixture-of-experts. InInternational conference on machine learning, pages 5547–5569. PMLR, 2022

2022
[201]

Lamda: Language models for dialog applications.arXiv preprint arXiv:2201.08239, 2022

Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng- Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, et al. Lamda: Language models for dialog applications.arXiv preprint arXiv:2201.08239, 2022

2022 arXiv
[202]

Plato-xl: Exploring the large-scale pre-training of dialogue generation

Siqi Bao, Huang He, Fan Wang, Hua Wu, Haifeng Wang, Wenquan Wu, Zhihua Wu, Zhen Guo, Hua Lu, Xinxian Huang, et al. Plato-xl: Exploring the large-scale pre-training of dialogue generation. InFindings of the Association for Computational Linguistics: AACL-IJCNLP 2022, pages 107–...

2022
[203]

Competition-level code generation with alphacode.Science, 378(6624):1092–1097, 2022

Yujia Li, David Choi, Junyoung Chung, Nate Kushman, Julian Schrittwieser, Rémi Leblond, Tom Eccles, James Keeling, Felix Gimeno, Agustin Dal Lago, et al. Competition-level code generation with alphacode.Science, 378(6624):1092–1097, 2022

2022
[204]

ERNIE 4.0 product information.https://yiyan.baidu.com/, 2023

Baidu. ERNIE 4.0 product information.https://yiyan.baidu.com/, 2023

2023
[205]

ERNIE 3.0 titan: Exploring larger-scale knowledge enhanced pre-training for language understanding and generation.arXiv preprint arXiv:2112.12731, 2021

Shuohuan Wang, Yu Sun, Yang Xiang, Zhihua Wu, Siyu Ding, Weibao Gong, Shikun Feng, Junyuan Shang, Yanbin Zhao, Chao Pang, et al. ERNIE 3.0 titan: Exploring larger-scale knowledge enhanced pre-training for language understanding and generation.arXiv preprint arXiv:2112.12731, 2...

2021 arXiv
[206]

Fuyu-8b: A multimodal architecture for AI agents.https://www.adept.ai/ blog/fuyu-8b, 2023

Adept AI. Fuyu-8b: A multimodal architecture for AI agents.https://www.adept.ai/ blog/fuyu-8b, 2023

2023
[207]

Rush, and Thomas Wolf

Lewis Tunstall, Edward Beeching, Nathan Lambert, Nazneen Rajani, Kashif Rasul, Younes Belkada, Shengyi Huang, Leandro von Werra, Clémentine Fourrier, Nathan Habib, Nathan Sarrazin, Omar Sanseviero, Alexander M. Rush, and Thomas Wolf. Zephyr: Direct distillation of LM alignment...

2023 arXiv
[208]

Kimi / Moonshot AI product documentation.https://platform.kimi

Moonshot AI. Kimi / Moonshot AI product documentation.https://platform.kimi. ai/docs, 2024

2024
[209]

Chatglm3-6b repository and model card.https://github.com/zai-org/ ChatGLM3, 2023

THUDM. Chatglm3-6b repository and model card.https://github.com/zai-org/ ChatGLM3, 2023

2023
[210]

Skywork: A more open bilingual foundation model.arXiv preprint arXiv:2310.19341, 2023

Tianwen Wei, Liang Zhao, Lichang Zhang, Bo Zhu, Lijie Wang, Haihua Yang, Biye Li, Cheng Cheng, Weiwei Lü, Rui Hu, et al. Skywork: A more open bilingual foundation model.arXiv preprint arXiv:2310.19341, 2023

2023 arXiv
[211]

Training language models to follow instructions with human feedback.Advances in neural information processing systems, 35:27730–27744, 2022

Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. Training language models to follow instructions with human feedback.Advances in neural information processing systems, 35:27730...

2022
[212]

New models and developer products announced at devday.https://openai

OpenAI. New models and developer products announced at devday.https://openai. com/index/new-models-and-developer-products-announced-at-devday/ , 2023

2023
[213]

Gpt-4 turbo model documentation.https://platform.openai.com/docs/ models/gpt-4-turbo, 2024

OpenAI. Gpt-4 turbo model documentation.https://platform.openai.com/docs/ models/gpt-4-turbo, 2024

2024
[214]

A conversational paradigm for program synthesis.arXiv preprint arXiv:2203.13474, 30, 2022

Erik Nijkamp, Bo Pang, Hiroaki Hayashi, Lifu Tu, Huan Wang, Yingbo Zhou, Silvio Savarese, and Caiming Xiong. A conversational paradigm for program synthesis.arXiv preprint arXiv:2203.13474, 30, 2022

2022 arXiv
[215]

Godel: Large-scale pre-training for goal-directed dialog.arXiv preprint arXiv:2206.11309, 2022

Baolin Peng, Michel Galley, Pengcheng He, Chris Brockett, Lars Liden, Elnaz Nouri, Zhou Yu, Bill Dolan, and Jianfeng Gao. Godel: Large-scale pre-training for goal-directed dialog.arXiv preprint arXiv:2206.11309, 2022

2022 arXiv
[216]

Yi: Open foundation models by 01.AI

Alex Young, Bei Chen, Chao Li, Chengen Huang, Ge Zhang, Guanwei Zhang, Heng Li, Jiangcheng Zhu, Jianqun Chen, Jing Chang, et al. Yi: Open foundation models by 01.AI. arXiv preprint arXiv:2403.04652, 2024. URLhttps://arxiv.org/abs/2403.04652

2024 arXiv
[217]

Flamingo: a visual language model for few-shot learning, 2022

Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc, Antoine Miech, Iain Barr, Yana Has- son, Karel Lenc, Arthur Mensch, Katie Millican, Malcolm Reynolds, Roman Ring, Eliza 76 From Chatbot to Digital Colleague Rutherford, Serkan Cabi, Tengda Han, Zhitao Gong, Sina Samangooei, Mar...

2022 arXiv
[218]

Blenderbot 3: a deployed conversational agent that continually learns to responsibly engage.arXiv preprint arXiv:2208.03188, 2022

Kurt Shuster, Jing Xu, Mojtaba Komeili, Da Ju, Eric Michael Smith, Stephen Roller, Megan Ung, Moya Chen, Kushal Arora, Joshua Lane, et al. Blenderbot 3: a deployed conversational agent that continually learns to responsibly engage.arXiv preprint arXiv:2208.03188, 2022

2022 arXiv
[219]

Introducing claude 2.1

Anthropic. Introducing claude 2.1. https://www.anthropic.com/news/ claude-2-1, November 2023

2023
[220]

Grok-1 open release.https://x.ai/news/grok-os, 2024

xAI. Grok-1 open release.https://x.ai/news/grok-os, 2024

2024
[221]

Inflection-2: The next step up

Inflection AI. Inflection-2: The next step up. https://inflection.ai/blog/ inflection-2, November 2023

2023
[222]

Improving alignment of dialogue agents via targeted human judgements.arXiv preprint arXiv:2209.14375, 2022

Amelia Glaese, Nat McAleese, Maja Trębacz, John Aslanides, Vlad Firoiu, Timo Ewalds, Mari- beth Rauh, Laura Weidinger, Martin Chadwick, Phoebe Thacker, et al. Improving alignment of dialogue agents via targeted human judgements.arXiv preprint arXiv:2209.14375, 2022

2022 arXiv
[223]

CogVLM: Visual expert for pretrained language models

Weihan Wang, Qingsong Lv, Wenmeng Yu, Wenyi Hong, Ji Qi, Yan Wang, Junhui Ji, Zhuoyi Yang, Lei Zhao, Xixuan Song, et al. CogVLM: Visual expert for pretrained language models. arXiv preprint arXiv:2311.03079, 2023. URLhttps://arxiv.org/abs/2311.03079

2023 arXiv
[224]

Codegeex: A pre-trained model for code generation with multilingual benchmarking on humaneval-x

Qinkai Zheng, Xiao Xia, Xu Zou, Yuxiao Dong, Shan Wang, Yufei Xue, Lei Shen, Zihan Wang, Andi Wang, Yang Li, et al. Codegeex: A pre-trained model for code generation with multilingual benchmarking on humaneval-x. InProceedings of the 29th ACM SIGKDD conference on knowledge dis...

2023
[225]

Openchat: Advancing open-source language models with mixed-quality data

Guan Wang, Sijie Cheng, Xianyuan Zhan, Xiangang Li, Sen Song, and Yang Liu. Openchat: Advancing open-source language models with mixed-quality data. InInternational Conference on Learning Representations, volume 2024, pages 57021–57040, 2024

2024
[226]

PaLI: A jointly-scaled multilingual language-image model

Xi Chen, Xiao Wang, Soravit Changpinyo, AJ Piergiovanni, Piotr Padlewski, Daniel Salz, Sebastian Goodman, Adam Grycner, Basil Mustafa, Lucas Beyer, et al. PaLI: A jointly-scaled multilingual language-image model. InInternational Conference on Learning Representations (ICLR), 2...

2023 arXiv
[227]

Deepseek llm: Scaling open-source language models with longtermism.arXiv preprint arXiv:2401.02954, 2024

Xiao Bi, Deli Chen, Guanting Chen, Shanhuang Chen, Damai Dai, Chengqi Deng, Honghui Ding, Kai Dong, Qiushi Du, Zhe Fu, et al. Deepseek llm: Scaling open-source language models with longtermism.arXiv preprint arXiv:2401.02954, 2024

2024 arXiv
[228]

Galactica: A large language model for science.arXiv preprint arXiv:2211.09085, 2022

Ross Taylor, Marcin Kardas, Guillem Cucurull, Thomas Scialom, Anthony Hartshorn, Elvis Saravia, Andrew Poulton, Viktor Kerkez, and Robert Stojnic. Galactica: A large language model for science.arXiv preprint arXiv:2211.09085, 2022. URLhttps://arxiv.org/ abs/2211.09085

2022 arXiv
[229]

DeepSeek Coder: Let the code write itself

DeepSeek-AI. DeepSeek Coder: Let the code write itself. https://github.com/ deepseek-ai/deepseek-coder, November 2023

2023
[230]

Blip-2: Bootstrapping language- image pre-training with frozen image encoders and large language models

Junnan Li, Dongxu Li, Silvio Savarese, and Steven Hoi. Blip-2: Bootstrapping language- image pre-training with frozen image encoders and large language models. InInternational conference on machine learning, pages 19730–19742. PMLR, 2023

2023
[231]

Phi-2: The surprising power of small language mod- els

Microsoft. Phi-2: The surprising power of small language mod- els. https://www.microsoft.com/en-us/research/blog/ phi-2-the-surprising-power-of-small-language-models/, 2023

2023
[232]

GLM-130B: An open bilingual pre-trained model

Aohan Zeng, Xiao Liu, Zhengxiao Du, Zihan Wang, Hanyu Lai, Ming Ding, Zhuoyi Yang, Yifan Xu, Wendi Zheng, Xiao Xia, et al. GLM-130B: An open bilingual pre-trained model. In International Conference on Learning Representations (ICLR), 2023. URLhttps://arxiv. org/abs/2210.02414

2023 arXiv
[233]

Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy Lil...

2023 arXiv
[234]

Introducing claude

Anthropic. Introducing claude. https://www.anthropic.com/news/ introducing-claude, 2023

2023
[235]

Orca 2: Teaching small language models how to reason.arXiv preprint arXiv:2311.11045, 2023

Arindam Mitra, Luciano Del Corro, Shweti Mahajan, Andres Codas, Clarisse Simoes, Sahaj Agarwal, Xuxi Chen, Anastasia Razdaibiedina, Erik Jones, Kriti Aggarwal, et al. Orca 2: Teaching small language models how to reason.arXiv preprint arXiv:2311.11045, 2023

2023 arXiv
[236]

InternVL: Scaling up vision foundation models and aligning for generic visual-linguistic tasks

Zhe Chen, Jiannan Wu, Wenhai Wang, Weijie Su, Guo Chen, Sen Xing, Muyan Zhong, Qinglong Zhang, Xizhou Zhu, Lewei Lu, et al. InternVL: Scaling up vision foundation models and aligning for generic visual-linguistic tasks. InIEEE/CVF Conference on Computer Vision and Pattern Reco...

2024 arXiv
[237]

Pangu-Σ: Towards trillion parameter language model with sparse heterogeneous computing.arXiv preprint arXiv:2303.10845, 2023

Xiaozhe Ren, Pingyi Zhou, Xinfan Meng, Xinjing Huang, Yadao Wang, Weichao Wang, Pengfei Li, Xiaoda Zhang, Alexander Podolskiy, Grigory Arshinov, et al. Pangu-Σ: Towards trillion parameter language model with sparse heterogeneous computing.arXiv preprint arXiv:2303.10845, 2023

2023 arXiv
[238]

Hashimoto

Rohan Taori, Ishaan Gulrajani, Tianyi Zhang, Yann Dubois, Xuechen Li, Carlos Guestrin, Percy Liang, and Tatsunori B. Hashimoto. Alpaca: A strong, replicable instruction-following model. https://crfm.stanford.edu/2023/03/13/alpaca.html, mar 2023. Blog post

2023
[239]

BloombergGPT:Alargelanguage model for finance.arXiv preprint arXiv:2303.17564, 2023

Shijie Wu, Ozan Irsoy, Steven Lu, Vadim Dabravolski, Mark Dredze, Sebastian Gehrmann, PrabhanjanKambadur,DavidRosenberg,andGideonMann. BloombergGPT:Alargelanguage model for finance.arXiv preprint arXiv:2303.17564, 2023. URLhttps://arxiv.org/ abs/2303.17564

2023 arXiv
[240]

GLM-4 product and model documentation.https://open.bigmodel.cn/ dev/howuse/model, 2024

Zhipu AI. GLM-4 product and model documentation.https://open.bigmodel.cn/ dev/howuse/model, 2024

2024
[241]

Constitutional ai: Harmlessness from ai feedback.arXiv preprint arXiv:2212.08073, 2022

Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, Azalia Mirhoseini, Cameron McKinnon, et al. Constitutional ai: Harmlessness from ai feedback.arXiv preprint arXiv:2212.08073, 2022

2022 arXiv
[242]

LLaVA-NeXT: Improved reasoning, OCR, and world knowledge.https://llava-vl

Haotian Liu, Chunyuan Li, Yuheng Li, Bo Li, Yuanhan Zhang, Sheng Shen, and Yong Jae Lee. LLaVA-NeXT: Improved reasoning, OCR, and world knowledge.https://llava-vl. github.io/blog/2024-01-30-llava-next/, 2024

2024
[243]

Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint...

2023
[244]

Solar 10.7 b: Scaling large language models with simple yet effective depth up-scaling

Sanghoon Kim, Dahyun Kim, Chanjun Park, Wonsung Lee, Wonho Song, Yunsu Kim, Hyeon- woo Kim, Yungi Kim, Hyeonju Lee, Jihoo Kim, et al. Solar 10.7 b: Scaling large language models with simple yet effective depth up-scaling. InProceedings of the 2024 Conference of the North Ameri...

2024
[245]

Gonzalez, Ion Stoica, and Eric P

Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. Vicuna: An open-source chatbot impressing GPT-4 with 90%* ChatGPT quality.https: //lmsys.org/blog/2023-03-30-...

2023
[246]

Introducing apis for GPT-3.5 Turbo and whisper.https://openai.com/index/ introducing-chatgpt-and-whisper-apis/, 2023

OpenAI. Introducing apis for GPT-3.5 Turbo and whisper.https://openai.com/index/ introducing-chatgpt-and-whisper-apis/, 2023

2023
[247]

Chatglm-6b repository and model card

THUDM. Chatglm-6b repository and model card. https://github.com/THUDM/ ChatGLM-6B, 2023

2023
[248]

Pythia: A suite for analyzing large language models across training and scaling

Stella Biderman, Hailey Schoelkopf, Quentin Gregory Anthony, Herbie Bradley, Kyle O’Brien, Eric Hallahan, Mohammad Aflah Khan, Shivanshu Purohit, USVSN Sai Prashanth, Edward Raff, et al. Pythia: A suite for analyzing large language models across training and scaling. In Intern...

2023 arXiv
[249]

Qwen1.5-moe: Matching 7b model performance with 1/3 activated parameters

Qwen Team. Qwen1.5-moe: Matching 7b model performance with 1/3 activated parameters. https://qwenlm.github.io/blog/qwen-moe/, 2024

2024
[250]

Stable lm 2 1.6 b technical report.arXiv preprint arXiv:2402.17834, 2024

MarcoBellagente,JonathanTow,DakotaMahan,DuyPhung,MaksymZhuravinskyi, Reshinth Adithyan, James Baicoianu, Ben Brooks, Nathan Cooper, Ashish Datta, et al. Stable lm 2 1.6 b technical report.arXiv preprint arXiv:2402.17834, 2024

2024 arXiv
[251]

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context.arXiv preprint arXiv:2403.05530, 2024

Gemini Team, Petko Georgiev, Ving Ian Lei, Ryan Burnell, Libin Bai, Anmol Gulati, Garrett Tanzer, Damien Vincent, Zhufeng Pan, Shibo Wang, Soroosh Mariooryad, Yifan Ding, Xinyang Geng, Fred Alcober, Roy Frostig, Mark Omernick, Lexi Walker, Cosmin Paduraru, Christina Sorokin, A...

2024 arXiv
[252]

Minigpt-4: Enhanc- ing vision-language understanding with advanced large language models.arXiv preprint arXiv:2304.10592, 2023

Deyao Zhu, Jun Chen, Xiaoqian Shen, Xiang Li, and Mohamed Elhoseiny. Minigpt-4: Enhanc- ing vision-language understanding with advanced large language models.arXiv preprint arXiv:2304.10592, 2023. URLhttps://arxiv.org/abs/2304.10592. 80 From Chatbot to Digital Colleague

2023 arXiv
[253]

Mistral large.https://mistral.ai/news/mistral-large, 2024

Mistral AI. Mistral large.https://mistral.ai/news/mistral-large, 2024

2024
[254]

Free dolly: Introducing the world’s first truly open instruction- tuned llm

Databricks. Free dolly: Introducing the world’s first truly open instruction- tuned llm. https://www.databricks.com/blog/2023/04/12/ dolly-first-open-commercially-viable-instruction-tuned-llm , apr

2023
[255]

Starcoder 2 and the stack v2: The next generation.arXiv preprint arXiv:2402.19173, 2024

Anton Lozhkov, Raymond Li, Loubna Ben Allal, Federico Cassano, Joel Lamy-Poirier, Noua- mane Tazi, Ao Tang, Dmytro Pykhtar, Jiawei Liu, Yuxiang Wei, et al. Starcoder 2 and the stack v2: The next generation.arXiv preprint arXiv:2402.19173, 2024

2024 arXiv
[256]

Visual instruction tuning

Haotian Liu, Chunyuan Li, Qingyang Wu, and Yong Jae Lee. Visual instruction tuning. In Advances in Neural Information Processing Systems (NeurIPS), 2023. URLhttps://arxiv. org/abs/2304.08485

2023 arXiv
[257]

Reka Flash, February 2024

Reka AI. Reka Flash, February 2024. URL https://reka.ai/news/ reka-flash-efficient-and-capable-multimodal-language-models

2024
[259]

Olmo: Accelerating the science of language models

Dirk Groeneveld, Iz Beltagy, Evan Walsh, Akshita Bhagia, Rodney Kinney, Oyvind Tafjord, Ananya Jha, Hamish Ivison, Ian Magnusson, Yizhong Wang, et al. Olmo: Accelerating the science of language models. InProceedings of the 62nd Annual Meeting of the Association for Computation...

2024
[261]

Blog post and dataset release
[262]

Mpt-30b: Raising the bar for open-source foundation models.https://www

MosaicML. Mpt-30b: Raising the bar for open-source foundation models.https://www. databricks.com/blog/mpt-30b, 2023

2023
[263]

Stable LM, April 2023

Stability AI. Stable LM, April 2023. URL https://github.com/stability-AI/ stableLM/

2023
[264]

Introducing DBRX: A new state-of-the-art open LLM

Databricks. Introducing DBRX: A new state-of-the-art open LLM. https://www. databricks.com/blog/introducing-dbrx-new-state-art-open-llm, 2024

2024
[265]

Redpajama-INCITE model family

Together AI. Redpajama-INCITE model family. https://www.together.ai/blog/ redpajama-models-v1, 2023. 81 From Chatbot to Digital Colleague

2023
[266]

URLhttps://arxiv.org/abs/2311.16867

arXiv
[267]

TheRefined- WebdatasetforfalconLLM:Outperformingcuratedcorporawithwebdata,andwebdataonly

Guilherme Penedo, Quentin Malartic, Daniel Hesslow, Ruxandra Cojocaru, Alessandro Cap- pelli,HamzaAlobeidli,BaptistePannier,EbtesamAlmazrouei,andJulienLaunay. TheRefined- WebdatasetforfalconLLM:Outperformingcuratedcorporawithwebdata,andwebdataonly. arXiv preprint arXiv:2306.01...

2023 arXiv
[268]

The claude 3 model family: Opus, sonnet, haiku.https://www.anthropic

Anthropic. The claude 3 model family: Opus, sonnet, haiku.https://www.anthropic. com/news/claude-3-family, 2024

2024
[269]

Palm 2 technical report

Rohan Anil, Andrew M Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, et al. Palm 2 technical report. arXiv preprint arXiv:2305.10403, 2023

2023 arXiv
[270]

Introducing mpt-7b: A new standard for open-source, commercially usable LLMs

MosaicML. Introducing mpt-7b: A new standard for open-source, commercially usable LLMs. https://www.databricks.com/blog/mpt-7b, 2023

2023
[271]

Codet5+: Open code large language models for code understanding and generation

Yue Wang, Hung Le, Akhilesh Gotmare, Nghi Bui, Junnan Li, and Steven Hoi. Codet5+: Open code large language models for code understanding and generation. InProceedings of the 2023 conference on empirical methods in natural language processing, pages 1069–1088, 2023

2023
[272]

Starcoder: May the source be with you!arXiv preprint arXiv:2305.06161, 2023

Raymond Li, Loubna Ben Allal, Yangtian Zi, Niklas Muennighoff, Denis Kocetkov, Chenghao Mou, Marc Marone, Christopher Akiki, Jia Li, Jenny Chim, et al. Starcoder: May the source be with you!arXiv preprint arXiv:2305.06161, 2023. URLhttps://arxiv.org/abs/ 2305.06161

2023 arXiv
[273]

Inflection-1: Pi’s best-in-class LLM

Inflection AI. Inflection-1: Pi’s best-in-class LLM. https://inflection.ai/blog/ inflection-1, June 2023

2023
[274]

Deepseek-vl: Towards real-world vision-language understanding, 2024

Haoyu Lu, Wen Liu, Bo Zhang, Bingxuan Wang, Kai Dong, Bo Liu, Jingxiang Sun, Tongzheng Ren, Zhuoshu Li, Hao Yang, Yaofeng Sun, Chengqi Deng, Hanwei Xu, Zhenda Xie, and Chong Ruan. Deepseek-vl: Towards real-world vision-language understanding, 2024. URL https://arxiv.org/abs/2403.05525

2024 arXiv
[275]

Jamba: A hybrid transformer-mamba language model.arXiv preprint arXiv:2403.19887, 2024

Opher Lieber, Barak Lenz, Hofit Bata, Gal Cohen, Jhonathan Osin, Itay Dalmedigos, Erez Safahi, Shaked Meirom, Yonatan Belinkov, Shai Shalev-Shwartz, et al. Jamba: A hybrid transformer-mamba language model.arXiv preprint arXiv:2403.19887, 2024. URLhttps: //arxiv.org/abs/2403.19887

2024 arXiv
[276]

InstructBLIP: Towards general-purpose vision-language models with instruction tuning

Wenliang Dai, Junnan Li, Dongxu Li, Anthony Meng Huat Tiong, Junqi Zhao, Weisheng Wang, Boyang Li, Pascale Fung, and Steven Hoi. InstructBLIP: Towards general-purpose vision-language models with instruction tuning. InAdvances in Neural Information Processing Systems (NeurIPS),...

2023 arXiv
[277]

Aquila language model series.https://github.com/FlagAI-Open/FlagAI/ tree/master/examples/Aquila, 2023

BAAI. Aquila language model series.https://github.com/FlagAI-Open/FlagAI/ tree/master/examples/Aquila, 2023

2023
[278]

Mm1: methods, analysis and insights from multimodal llm pre-training

Brandon McKinzie, Zhe Gan, Jean-Philippe Fauconnier, Sam Dodge, Bowen Zhang, Philipp Dufter, Dhruti Shah, Xianzhi Du, Futang Peng, Anton Belyi, et al. Mm1: methods, analysis and insights from multimodal llm pre-training. InEuropean Conference on Computer Vision, pages 304–323....

2024
[279]

Command r: Retrieval-augmented generation at production scale

Cohere. Command r: Retrieval-augmented generation at production scale. https:// cohere.com/blog/command-r, March 2024

2024
[280]

Baichuan-7B

Baichuan Inc. Baichuan-7B. https://github.com/baichuan-inc/baichuan-7B, 2023

2023
[281]

Inflection-2.5: Meet the world’s best personal AI.https://inflection

Inflection AI. Inflection-2.5: Meet the world’s best personal AI.https://inflection. ai/blog/inflection-2-5, March 2024

2024
[282]

Phi-3 technical report: A highly capable language model locally on your phone.arXiv preprint arXiv:2404.14219, 2024

Marah Abdin, Sam Ade Jacobs, Ammar Ahmad Awan, Jyoti Aneja, Ahmed Awadallah, Hany Awadalla, Nguyen Bach, Amit Bahree, Arash Bakhtiari, Harkirat Behl, et al. Phi-3 technical report: A highly capable language model locally on your phone.arXiv preprint arXiv:2404.14219, 2024. URL...

2024 arXiv
[283]

Xgen-7b technical report.arXiv preprint arXiv:2309.03450, 2023

Erik Nijkamp, Tian Xie, Hiroaki Hayashi, Bo Pang, Congying Xia, Chen Xing, Jesse Vig, Semih Yavuz, Philippe Laban, Ben Krause, et al. Xgen-7b technical report.arXiv preprint arXiv:2309.03450, 2023

2023 arXiv
[284]

Textbooks are all you need.arXiv preprint arXiv:2306.11644, 2023

Suriya Gunasekar, Yi Zhang, Jyoti Aneja, Caio César Teodoro Mendes, Allie Del Giorno, Sivakanth Gopi, Mojan Javaheripi, Piero Kauffmann, Gustavo de Rosa, Olli Saarikivi, Adil Salim, Shital Shah, Harkirat Singh Behl, Xin Wang, Sébastien Bubeck, Ronen Eldan, Adam Tauman Kalai, Y...

2023 arXiv
[285]

Grok-1.5, March 2024

xAI. Grok-1.5, March 2024. URLhttps://x.ai/news/grok-1.5

2024
[286]

Hunyuan-large: An open-source moe model with 52 billion activated parameters by tencent.arXiv preprint arXiv:2411.02265, 2024

Xingwu Sun, Yanfeng Chen, Yiqing Huang, Ruobing Xie, Jiaqi Zhu, Kai Zhang, Shuaipeng Li, Zhen Yang, Jonny Han, Xiaobo Shu, et al. Hunyuan-large: An open-source moe model with 52 billion activated parameters by tencent.arXiv preprint arXiv:2411.02265, 2024

2024 arXiv
[287]

Introducing command r+: A scalable LLM built for business.https://cohere

Cohere. Introducing command r+: A scalable LLM built for business.https://cohere. com/blog/command-r-plus-microsoft-azure, 2024

2024
[288]

Chatglm2-6b repository and model card.https://github.com/zai-org/ ChatGLM2-6B, 2023

THUDM. Chatglm2-6b repository and model card.https://github.com/zai-org/ ChatGLM2-6B, 2023

2023
[289]

How far are we to gpt-4v? closing the gap to commercial multimodal models with open-source suites.Science China Information Sciences, 67(12):220101, 2024

Zhe Chen, Weiyun Wang, Hao Tian, Shenglong Ye, Zhangwei Gao, Erfei Cui, Wenwen Tong, Kongzhi Hu, Jiapeng Luo, Zheng Ma, et al. How far are we to gpt-4v? closing the gap to commercial multimodal models with open-source suites.Science China Information Sciences, 67(12):220101, 2024

2024
[290]

Baichuan-13B.https://github.com/baichuan-inc/baichuan-13B, 2023

Baichuan Inc. Baichuan-13B.https://github.com/baichuan-inc/baichuan-13B, 2023

2023
[291]

Reka Core, April 2024

Reka AI. Reka Core, April 2024. URL https://reka.ai/news/ reka-core-our-frontier-class-multimodal-language-model

2024
[293]

Cheaper, better, faster, stronger

Mistral AI. Cheaper, better, faster, stronger. https://mistral.ai/news/ mixtral-8x22b, 2024

2024
[294]

Introducing meta llama 3

Meta. Introducing meta llama 3. https://ai.meta.com/blog/meta-llama-3/, 2024

2024
[297]

2 olmo 2 furious.arXiv preprint arXiv:2501.00656, 2024

Team OLMo, Pete Walsh, Luca Soldaini, Dirk Groeneveld, Kyle Lo, Shane Arora, Akshita Bhagia, Yuling Gu, Shengyi Huang, Matt Jordan, et al. 2 olmo 2 furious.arXiv preprint arXiv:2501.00656, 2024

2024 arXiv
[299]

Pixtral Large, November 2024

Mistral AI. Pixtral Large, November 2024. URL https://mistral.ai/news/ pixtral-large/

2024
[2022]

URLhttps://arxiv.org/abs/2211.05100

arXiv
[2023]

URL https://proceedings.neurips.cc/paper_files/paper/2023/ hash/91edff07232fb1b55a505a9e9f6c0ff3-Abstract-Conference.html

2023
[2024]

URLhttps://arxiv.org/abs/2403.08295

arXiv
[2025]

URLhttps://arxiv.org/abs/2502.17419

arXiv
[2026]

URLhttps://arxiv.org/abs/2604.11790

arXiv

Pith tools

Reviewed August 2, 2026 · model on record in the stance chip above.

[1] [1]

On the opportunities and risks of foundation models.arXiv preprint arXiv:2108.07258, 2021

Rishi Bommasani, Drew A Hudson, Ehsan Adeli, Russ Altman, Simran Arora, Sydney von Arx, Michael S Bernstein, Jeannette Bohg, Antoine Bosselut, Emma Brunskill, et al. On the opportunities and risks of foundation models.arXiv preprint arXiv:2108.07258, 2021

arXiv 2021

[2] [2]

Recent advances in natural language processing via large pre-trained language models: A survey.ACM Computing Surveys, 56(2): 1–40, 2023

Bonan Min, Hayley Ross, Elior Sulem, Amir Pouran Ben Veyseh, Thien Huu Nguyen, Oscar Sainz, Eneko Agirre, Ilana Heintz, and Dan Roth. Recent advances in natural language processing via large pre-trained language models: A survey.ACM Computing Surveys, 56(2): 1–40, 2023

2023

[3] [3]

A comprehensive overview of large language models.ACM Transactions on Intelligent Systems and Technology, 16(5):1–72, 2025

Humza Naveed, Asad Ullah Khan, Shi Qiu, Muhammad Saqib, Saeed Anwar, Muhammad Usman, Naveed Akhtar, Nick Barnes, and Ajmal Mian. A comprehensive overview of large language models.ACM Transactions on Intelligent Systems and Technology, 16(5):1–72, 2025

2025

[4] [4]

A survey on large language model based autonomous agents.Frontiers of Computer Science, 18(6), 2024

Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, et al. A survey on large language model based autonomous agents.Frontiers of Computer Science, 18(6), 2024

2024

[5] [5]

The rise and potential of large language model based agents: A survey.arXiv preprint arXiv:2309.07864, 2023

Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, et al. The rise and potential of large language model based agents: A survey.arXiv preprint arXiv:2309.07864, 2023

arXiv 2023

[6] [6]

Libo Qin, Qiguang Chen, Xiachong Feng, Yang Wu, Yongheng Zhang, Yinghui Li, Min Li, Wanxiang Che, and Philip S. Yu. Large language models meet nlp: A survey, 2025. URL https://arxiv.org/abs/2405.12819

arXiv 2025

[7] [7]

ReAct: Synergizing reasoning and acting in language models.arXiv preprint arXiv:2210.03629, 2022

Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. ReAct: Synergizing reasoning and acting in language models.arXiv preprint arXiv:2210.03629, 2022

arXiv 2022

[8] [8]

Generative agents: Interactive simulacra of human behavior

Joon Sung Park, Joseph O’Brien, Carrie Jun Cai, Meredith Ringel Morris, Percy Liang, and Michael S Bernstein. Generative agents: Interactive simulacra of human behavior. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology, pages 1–22, 2023

2023