Pith. sign in

REVIEW 3 major objections 4 minor 226 references

Quo Vadis, World Modeling?

T0 review · 3 major / 4 minor · reviewed 2026-08-07 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read World modeling for agents should be redefined as building environment-grounded world proxies that return agent-usable information transitions — execution results, retrieved memories or skills, verification signals — rather than only…

desk verdict Agent-centric world proxy taxonomy is a useful vocabulary for the agents/world-model community, but the formal unification in Eq. 2 is too loose to carry the paradigm-shift claim. read the letter →

arxiv 2608.02713 v1 pith:ZVMJQVFB submitted 2026-08-03 cs.CV cs.AIcs.RO

Yu Yang , Xuemeng Yang , Licheng Wen , Lingdong Kong , Xiaobin Hu , Dongyue Lu , Wei Chow , Xiyan Huang
show 12 more authors
Yuxiang Feng Yue Liao Jianbiao Mei Daocheng Fu Rong Wu Pinlong Cai Ran Yi Ying Tai Jiangning Zhang Botian Shi Yong Liu Shuicheng Yan
This is my paper
classification cs.CVcs.AIcs.RO
keywords worldmodelproxyagent-centricinformationtransitioncontinualimprovementfeedbackmodalitiesinference-timeguidanceco-evolution
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Continually improving agents need feedback they can act on, but real-environment interaction is expensive, slow, unsafe, and hard to parallelize. This paper argues that world modeling, classically a predictor of the next physical state, should be recast as an Agent-Centric World Proxy: an environment-grounded mechanism that answers agent-initiated queries with information transitions, such as execution outcomes, retrieved experiences or skills, and reward or verification signals. It organizes the design space into six proxy functions (dynamics, spatial, execution, memory/experience, skill, reward/verification) and three levels of empowerment for the agent (inference-time guidance, training-time optimization, and agent-proxy co-evolution). The payoff, if the framing holds, is a common language and roadmap for building proxies that make agents plan better, learn faster, and improve continually, with evaluation shifted from visual realism to actionable information gain.

What carries the argument

The load-bearing object is the formal proxy map $\hat{s}_{\ell+1} = \mathcal{WP}(s_\ell, u^\mathcal{F}_\ell)$ together with its two generalizations: the interaction step $\ell$ replaces the physical time step $t$, and the information state space $\mathcal{S}$ replaces the physical state. The proxy function $\mathcal{F}$ indexes six concrete instantiations — dynamics, spatial, execution, memory/experience, skill, and reward/verification — each answering a different question for the agent but all expressible in the same transition form. This single map is what lets the paper treat retrieval, simulation, and evaluation as one unified mechanism, and it supplies the "information gain" criterion that separates a useful proxy from a mere simulator or database.

What would settle it

Build an agent-centric benchmark where the same world proxy is either available or withheld during an agent's planning and training, with all else fixed; if agents with proxy access do not show measurable gains in decision quality, learning speed, or final performance, the claim that world proxies provide actionable information gain is falsified. A more structural test: find two proxy functions, such as execution simulation and reward verification, that cannot be represented by a single shared information state without losing modality-specific structure, which would show the unifying equation is nominal.

Watch

Extended reading notes

Core claim

The paper's central claim is that the unit of world modeling should change from a physical state transition to an agent-usable information transition. Where a classical world model predicts $\hat{s}_{t+1} = \mathcal{WM}(s_t, a_t)$, an Agent-Centric World Proxy is defined as $\hat{s}_{\ell+1} = \mathcal{WP}(s_\ell, u^\mathcal{F}_\ell)$, with $\ell$ an interaction step (not necessarily physical time), $s_\ell$ an information state in a space that "may include physical state, observation, memory, knowledge, execution result, verification, guidance, and more", and $u^\mathcal{F}_\ell$ an agent-initiated query under proxy function $\mathcal{F}$. Under this definition, a memory lookup, a code execution, and a reward estimate become moves of the same game: each delivers information the agent did not possess an instant earlier. The paper claims this shift broadens world modeling from future-state prediction to six functional forms and shows how they empower agents at three progressive levels, culminating in a closed loop where real-environment evidence updates both proxy and agent.

Load-bearing premise

The framework assumes that a single information state space $\mathcal{S}$ — meant to hold physical states, observations, memories, execution results, verification, and guidance — can coherently support one transition map $\hat{s}_{\ell+1} = \mathcal{WP}(s_\ell, u^\mathcal{F}_\ell)$ across all six proxy functions; if those feedback modalities do not share compatible structure, the unified formalism is a label rather than a model.

Editorial extensions

If this is right

  • Evaluation of world models should measure agent-centric information gain — whether feedback improved planning, learning, or verification — rather than realism or prediction accuracy alone.
  • Research areas now studied separately (video prediction, novel-view synthesis, browser and GUI simulation, memory retrieval, skill libraries, reward modeling and verification) can be described as instances of one design space and compared across proxy functions and levels.
  • A single proxy function can deepen its role over time: the paper walks one execution proxy from L.1 advisor that imagines a webpage before a click, to L.2 teacher that scores simulated rollouts into training data, to L.3 partner that is retrained from the agent's real deployments.
  • Sparse cells of the functions-by-levels map, notably spatial and reward/verification proxies at the co-evolution level, are flagged as largely open territory for future work.
  • The L3 loop, where real-environment evidence updates the proxy and distilled proxy knowledge updates the agent, is presented as both a learning mechanism and a safety mechanism that keeps proxy and policy aligned.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the unified formalism is to be more than a label, a natural stress test is to train a single transition operator that jointly serves two structurally distant proxy functions, say execution simulation and reward verification, and see whether one shared information state can carry both.
  • The L1-L3 ladder suggests a concrete deployment recipe: ship cheap reversible inference-time guidance first, upgrade to training-signal generation once trust is established, then close the co-evolution loop — a sequencing the paper motivates but does not prescribe.
  • The framework implies a specific benchmark design: hold the proxy fixed, vary access to its feedback, and measure downstream agent performance; this "information gain" metric is the natural operationalization of the paper's core criterion and would make different proxy functions comparable.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 4 minor

Summary. This position paper argues that world modeling for continually improving agents should be broadened from physical next-state prediction to agent-usable information transitions. It defines an Agent-Centric World Proxy by Eq. (2), organizes the design space into six proxy functions (dynamics, spatial, execution, memory/experience, skill, reward/verification) and three empowerment levels (L1 inference-time guidance, L2 training-time optimization, L3 agent-proxy co-evolution), and maps representative systems onto a functions-by-levels table. The paper closes with open challenges on fidelity, trust, safety, and evaluation. It is explicitly a roadmap rather than an experimental study; Table 6 is labeled illustrative.

Significance. The main contribution is a useful organizing framework: the six-function taxonomy and the L1-L3 ladder clarify how heterogeneous mechanisms (video prediction, NeRF rendering, code execution predictors, memory retrieval, skill libraries, reward models) can all serve as agent-facing feedback modules, and the functions-by-levels map highlights underexplored cells. The paper is honest about its status, explicitly marking Table 6 as illustrative and listing open challenges on fidelity, trust, safety, and evaluation. However, the claimed formal unification in Eq. (2) is currently a notational schema rather than a model; the paper's value rests on the taxonomy and agenda, not on the formalism. If the formal claims are tightened or reframed, the roadmap is a potentially influential contribution to the world-modeling and agent-learning communities.

major comments (3)
  1. [§2.3, Eq. (2)] The formal definition states ŝ_{ℓ+1} = WP(sℓ, u^F_ℓ) with S described as 'may include physical state, observation, memory, knowledge, execution result, verification, guidance, and more,' but imposes no update rule, no composition principle, and no consistency constraint on WP. As written, any query-answer system—an LLM-as-judge, a hash table, even a constant function returning a fixed string—satisfies Eq. (2) if S is taken to include the relevant output type. Since the abstract and Section 2.3 present this equation as the basis for treating all six proxy types as instances of a single information-transition mechanism, the formalism is load-bearing; the paper should either supply a typed state space with an explicit update/composition rule or explicitly reposition Eq. (2) as a conceptual schema rather than a formal model.
  2. [§3.1–3.3] The L1–L3 equations define how the agent side is modified (⊕, Train, CoEvolve), but they never specify how the proxy's internal state or sℓ evolves when the loop is iterated. Consequently the three levels are descriptions of how proxies are used in practice, not consequences of the formal definition; in particular, the CoEvolve(·) symbol in Section 3.3 is a placeholder for an unspecified joint-update process. The paper should either give a concrete iteration semantics for the closed loop or explicitly state that L1–L3 are empirical usage categories rather than formal consequences.
  3. [§4.2, §4.4, §4.7] The per-function formulas produce type-heterogeneous outputs: dynamics returns a state-reward pair (ŝ, r̂), execution returns a post-execution state plus feedback (ŝ_exec, ŷ_exec), and reward/verification returns a single evaluation value (v̂_eval). Without a typing or composition rule that embeds these outputs into a common information state space S, the claim that all six forms are instances of one transition map ŝ_{ℓ+1}=WP(sℓ,u^F_ℓ) is a labeling rather than a derivation.
minor comments (4)
  1. [Figures 1–10] The figures contain numerous OCR artifacts (for example, '%FTJHO4QBDF' and '"HFOU' in Figure 1); the final version needs a pass to restore readable text in captions and inline labels.
  2. [Table 6] The Reward / Verification row marks the L3 cell as 'emerging' but provides no representative citation; either add one or state explicitly that the cell is currently empty.
  3. [§2.3 and §4.2] The relationship between the interaction step ℓ and physical time t should be stated more carefully; Section 4.2 says the dynamics proxy reduces to classical prediction when ℓ aligns with t, but interactions can also be nested within a physical step, so the alignment condition is not just equality of indices.
  4. [Notation] The world proxy symbol is rendered in inconsistent calligraphic forms across equations and text; unify the notation for WP.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the paper is a conceptual taxonomy whose central equation is a definition, and its only self-citation is a non-load-bearing label reuse.

full rationale

The paper makes no fitted predictions, trains no models, and invokes no uniqueness theorem. Its central claim is definitional: Section 2.3 defines an Agent-Centric World Proxy as one that models information transitions conditioned on agent-initiated interactions, and Section 4.1 explicitly says the single symbol ℱ 'quietly stands in for a whole family of proxy functions' that are then unpacked into the six forms. The six Section 4 formulas are direct instantiations of Eq. 2 with different output types, not independently derived results, so there is no reduction of a predicted quantity to a fitted input. The only self-referential element is the reuse of the L1-L3 labels from the authors' related work [31], but the paper explicitly states this reuse is deliberate, that its agent-centric axis is orthogonal to Chu et al.'s intrinsic-capability axis, and that the two scales 'rhyme without being identical.' That label borrowing is not load-bearing for the taxonomy's content. The skeptical concern that Eq. 2 is too unconstrained to be a model is a rigor and precision critique, not circularity: the paper does not claim to derive the six-feedback-modality broadening from the equation; it proposes the broadening by defining the proxy space to include those modalities. The paper's own open challenges (trust, evaluation measuring information gain, reward hacking) are acknowledged limitations rather than hidden circular dependencies.

Assumptions & free parameters 0 free parameters · 4 assumptions · 3 invented entities

The formal claim rests on the domain assumption that continual improvement requires interactive feedback, the domain assumption that real interaction is too costly/risky/slow, and the ad hoc assumptions that heterogeneous feedback modalities share a common information-state representation and that six functional forms are sufficient. The paper introduces one invented conceptual entity, the Agent-Centric World Proxy, plus the 'information transition' formalism and the information state space S, none of which has an externally falsifiable handle.

assumptions (4)
  • domain assumption Continually improving agents require dynamic interaction feedback beyond static supervision
    Motivating premise of the entire paper, stated in Sec. 1.1; if static supervision sufficed, the world proxy framework would be unnecessary.
  • domain assumption Real-environment interaction is costly, slow, unsafe, and hard to parallelize
    Sec. 1.2 (Table 1) states this as fact with examples but no measurements; the proxy approach is only motivated if this holds.
  • ad hoc to paper All agent-usable feedback modalities can be represented by a single information state space S and a unified transition map s_hat(l+1) = WP(s_l, u_l^F)
    Sec. 2.3 defines S broadly enough to include physical state, memory, knowledge, execution results, verification, and guidance; this is the formal unification that the taxonomy depends on.
  • ad hoc to paper The six functional forms (dynamics, spatial, execution, memory/experience, skill, reward/verification) are sufficient to characterize the primary ways world modeling serves agent improvement
    Stated in the abstract and Section 4.1; no proof of completeness is given, and the paper acknowledges sparse cells but not missing categories.
invented entities (3)
  • Agent-Centric World Proxy
    purpose: Unified concept for any environment-grounded mechanism that returns agent-usable feedback, replacing the narrower 'world model' notion
    Introduced in Section 2.3 as a new umbrella term; it is a conceptual category, not an observable object, and it carries no falsifiable prediction on its own.
  • Information transition
    purpose: Formal replacement for 'state transition' in the proxy equation; output can be a future state, execution result, memory, skill, reward, or verification
    Introduced in Section 2.2; an abstract formalism that is defined by the paper and not anchored to a measured quantity.
  • Information state space S
    purpose: Generalized space that may include physical state, observation, memory, knowledge, execution results, verification, and guidance
    Defined in Section 2.3; its breadth is what makes Eq. (2) applicable to all six proxy functions, but the paper does not show that this space has a well-defined structure.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Quo Vadis, World Modeling?." pith.science (2026). https://pith.science/paper/ZVMJQVFB

@misc{pith2026260802713,
  author       = {Pith},
  title        = {Pith review of: Quo Vadis, World Modeling?},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/ZVMJQVFB}},
  note         = {Machine review of arXiv:2608.02713}
}
read the original abstract

Continually improving agents require dynamic interaction feedback beyond static supervision, yet direct real-environment interaction is costly, slow, unsafe, and hard to parallelize. World modeling offers a natural intermediate proxy that allows agents to query lower-cost, more controllable feedback before committing to real actions. Classical world models instantiate this proxy primarily through future physical-state prediction, a formulation useful yet narrow for agents that require actionable feedback beyond raw state transitions. In this work, we conceptualize Agent-Centric Interactive World Proxies, shifting the fundamental paradigm from physical state transitions to agent-usable information transitions, such as execution outcomes, retrieved experiences or skills, and verification signals, broadening the scope of world modeling to provide versatile feedback for continually improving agents. To systematically map this design space, we organize world proxies into six functional forms based on their feedback modalities: dynamics, spatial, execution, memory/experience, skill, and reward/verification proxies, which together characterize the primary ways world modeling serves agent improvement. We further analyze how these proxies empower agents across three progressive levels: L.1 Inference-Time Guidance, where proxy outputs enrich in-context information for superior decisions; L.2 Training-Time Optimization, where proxy outputs yield rewards, critiques, or synthetic rollouts for policy learning; and L.3 Agent-Proxy Co-Evolution, where real-environment evidence continuously updates both the proxy and the agent for co-evolution. Ultimately, this work recasts world modeling into an agent-centric paradigm, establishing a roadmap for building world proxies that empower agents to plan better, learn faster, and evolve continually.

Figures

Figures reproduced from arXiv: 2608.02713 by the authors.

Figure 1
Figure 1. Conceptual shift and design space of Agent-Centric World Proxies. We shift from world models for physical state prediction to interactive world proxies for information transition prediction, enabling continual agent improvement through six proxy functions and three empowerment levels: L.1 inference-time guidance, L.2 training-time optimization, and L.3 Agent-Proxy co-evolution. arXiv:2608.02713v1 [cs.CV] 3 Aug 2026 … view at source ↗
Figure 2
Figure 2. Basic Agent-Environment Interaction Loop. [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Agent-Centric World Modeling as an Intermediate Proxy. [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (7 more)
Figure 4
Figure 4. Figure 4: From World Model to World Proxy [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]
Figure 5
Figure 5. Figure 5: Agent-in-the-Loop World Proxy. The agent queries the World Proxy, which predicts, simulates, retrieves, or verifies the resulting information transition and returns feedback for agent improvement. At the ℓ-th interaction step, this loop can be divided into four steps: …
Figure 6
Figure 6. Figure 6: L1 to L3 World Proxies for Agent Improvement. [PITH_FULL_IMAGE:figures/full_fig_p010_6.png]
Figure 7
Figure 7. Figure 7: L1 Inference-Time Guidance via World Proxy. [PITH_FULL_IMAGE:figures/full_fig_p011_7.png]
Figure 8
Figure 8. Figure 8: L2 Training-Time Optimization Driven by World Proxy. [PITH_FULL_IMAGE:figures/full_fig_p013_8.png]
Figure 9
Figure 9. Figure 9: L3 Agent-Proxy Co-Evolution. Real-environment evidence updates the World Proxy, while useful proxy knowledge is distilled back into the Agent policy for continual improvement. L3 completes the arc by closing a continual loop among the Agent, the World Proxy, and the re…
Figure 10
Figure 10. Figure 10: Functional forms of Agent-Centric World Proxies. [PITH_FULL_IMAGE:figures/full_fig_p016_10.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

226 extracted references · 4 canonical work pages

  1. [1]

    Cosmos world foundation model platform for physical AI.arXiv preprint arXiv:2501.03575, 2025

    Niket Agarwal, Arslan Ali, Maciej Bala, Yogesh Balaji, et al. Cosmos world foundation model platform for physical AI.arXiv preprint arXiv:2501.03575, 2025. URLhttps://arxiv.org/abs/2501.03575

    arXiv 2025

  2. [2]

    Do as i can, not as i say: Grounding language in robotic affordances

    Michael Ahn, Anthony Brohan, Noah Brown, Yevgen Chebotar, Omar Cortes, Byron David, Chelsea Finn, Chuyuan Fu, et al. Do as i can, not as i say: Grounding language in robotic affordances. InConf. Robot Learn., 2022. URLhttps://arxiv.org/abs/2204.01691

    arXiv 2022

  3. [3]

    ComAct: Reframing professional software manipulation via COM-as- Action paradigm.arXiv preprint arXiv:2606.13239, 2026

    Jiaxin Ai, Tao Hu, Xuemeng Yang, Shu Zou, Hairong Zhang, Daocheng Fu, Yu Yang, Hongbin Zhou, Nianchen Deng, Pinlong Cai, et al. ComAct: Reframing professional software manipulation via COM-as- Action paradigm.arXiv preprint arXiv:2606.13239, 2026. URLhttps://arxiv.org/abs/2606.13239

    arXiv 2026

  4. [4]

    Diffusion for world modeling: Visual details matter in Atari

    Eloi Alonso, Adam Jelley, Vincent Micheli, Anssi Kanervisto, Amos Storkey, Tim Pearce, and François Fleuret. Diffusion for world modeling: Visual details matter in Atari. InAdv. Neural Inf. Process. Syst., volume 37, 2024. URLhttps://arxiv.org/abs/2405.12399

    arXiv 2024

  5. [5]

    Self-supervised learning from images with a joint-embedding predictive architecture

    Mahmoud Assran, Quentin Duval, Ishan Misra, Piotr Bojanowski, Pascal Vincent, Michael Rabbat, Yann LeCun, and Nicolas Ballas. Self-supervised learning from images with a joint-embedding predictive architecture. InIEEE/CVF Conf. Comput. Vis. Pattern Recog., 2023. URLhttps://arxiv.org/abs/2301. 08243

    2023

  6. [6]

    V-JEPA2: Self-supervisedvideomodelsenableunderstanding, prediction and planning.arXiv preprint arXiv:2506.09985, 2025

    Mido Assran, Adrien Bardes, David Fan, Quentin Garrido, Russell Howes, Matthew Muckley, Ammar Rizvi,ClaireRoberts,KoustuvSinha,etal. V-JEPA2: Self-supervisedvideomodelsenableunderstanding, prediction and planning.arXiv preprint arXiv:2506.09985, 2025. URL https://arxiv.org/abs/2506. 09985

    arXiv 2025

  7. [7]

    A general theoretical paradigm to understand learning from human preferences

    Mohammad Gheshlaghi Azar, Mark Rowland, Bilal Piot, Daniel Guo, Daniele Calandriello, Michal Valko, and Rémi Munos. A general theoretical paradigm to understand learning from human preferences. In Int. Conf. Artif. Intell. Stat., 2024. URLhttps://arxiv.org/abs/2310.12036

    arXiv 2024

  8. [8]

    FitVid: Overfitting in pixel-level video prediction.arXiv preprint arXiv:2106.13195, 2021

    Mohammad Babaeizadeh, Mohammad Taghi Saffar, Suraj Nair, Sergey Levine, Chelsea Finn, and Du- mitru Erhan. FitVid: Overfitting in pixel-level video prediction.arXiv preprint arXiv:2106.13195, 2021. URL https://arxiv.org/abs/2106.13195

    arXiv 2021

Show all 226 references
  1. [9]

    ReCamMaster: Camera-controlled generative rendering from a single video.arXiv preprint arXiv:2503.11647, 2025

    Jianhong Bai, Menghan Xia, Xiao Fu, Xintao Wang, Lianrui Mu, Jinwen Cao, Zuozhu Liu, Haoji Hu, Xiang Bai, Pengfei Wan, and Di Zhang. ReCamMaster: Camera-controlled generative rendering from a single video.arXiv preprint arXiv:2503.11647, 2025. URLhttps://arxiv.org/abs/2503.11647

    2025 arXiv

  2. [10]

    Training a helpful and harmless assistant with reinforcement learning from human feedback

    Yuntao Bai, Andy Jones, Kamal Ndousse, Amanda Askell, Anna Chen, Nova DasSarma, Dawn Drain, Stanislav Fort, et al. Training a helpful and harmless assistant with reinforcement learning from human feedback. arXiv preprint arXiv:2204.05862, 2022. URLhttps://arxiv.org/abs/2204.05862

    2022 arXiv

  3. [11]

    Constitutional AI: Harmlessness from AI feedback

    Yuntao Bai, Saurav Kadavath, Sandipan Kundu, Amanda Askell, Jackson Kernion, Andy Jones, Anna Chen, Anna Goldie, et al. Constitutional AI: Harmlessness from AI feedback. arXiv preprint arXiv:2212.08073, 2022. URLhttps://arxiv.org/abs/2212.08073

    2022 arXiv

  4. [12]

    Navigation world models

    Amir Bar, Gaoyue Zhou, Danny Tran, Trevor Darrell, and Yann LeCun. Navigation world models. In IEEE/CVF Conf. Comput. Vis. Pattern Recog., pages 15791–15801, 2025. URLhttps://arxiv.org/abs/ 2412.03572

    2025 arXiv

  5. [13]

    Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul P

    Jonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul P. Srinivasan. Mip-NeRF: A multiscale representation for anti-aliasing neural radiance fields. In IEEE/CVF Int. Conf. Comput. Vis., pages 5835–5844, 2021. URLhttps://arxiv.org/...

    2021 arXiv

  6. [14]

    Barron, Ben Mildenhall, Dor Verbin, Pratul P

    Jonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan, and Peter Hedman. Mip-NeRF 360: Unbounded anti-aliased neural radiance fields. In IEEE/CVF Conf. Comput. Vis. Pattern Recog., pages 5470–5479, 2022. URLhttps://arxiv.org/abs/2111.12077. 24

    2022 arXiv

  7. [15]

    DynamicCity: Large- scale 4D occupancy generation from dynamic scenes

    Hengwei Bian, Lingdong Kong, Haozhe Xie, Liang Pan, Yu Qiao, and Ziwei Liu. DynamicCity: Large- scale 4D occupancy generation from dynamic scenes. InInt. Conf. Learn. Represent., 2025. URLhttps: //arxiv.org/abs/2410.18084

    2025

  8. [16]

    RT-2: Vision-language-action models transfer web knowledge to robotic control

    Anthony Brohan, Noah Brown, Justice Carbajal, Yevgen Chebotar, Xi Chen, Krzysztof Choromanski, Tianli Ding, Danny Driess, Avinava Dubey, Chelsea Finn, Pete Florence, Chuyuan Fu, Karol Hausman, Alex Herzog, Jasmine Hsu, Brian Ichter, Sergey Levine, Yao Lu, Igor Mordatch, Pierre...

    2023 arXiv

  9. [17]

    RT-1: Robotics transformer for real-world control at scale

    AnthonyBrohan,NoahBrown,JusticeCarbajal,YevgenChebotar,JosephDabis,ChelseaFinn,Keerthana Gopalakrishnan, Karol Hausman, Alex Herzog, Jasmine Hsu, Brian Ichter, Sergey Levine, Yao Lu, Igor Mordatch, Ofir Nachum, Carolina Parada, Pierre Sermanet, Ted Xiao, Peng Xu, Tianhe Yu, Br...

    2023 arXiv

  10. [18]

    Video generation models as world simulators

    Tim Brooks, Bill Peebles, Connor Holmes, Will DePue, Yufei Guo, Li Jing, David Schnurr, Joe Taylor, et al. Video generation models as world simulators. Technical report, OpenAI, 2024. URL https: //openai.com/research/video-generation-models-as-world-simulators

    2024

  11. [19]

    Genie: Generative interactive environments

    Jake Bruce, Michael Dennis, Ashley Edwards, Jack Parker-Holder, Yuge Shi, Edward Hughes, Matthew Lai, Aditi Mavalankar, et al. Genie: Generative interactive environments. InInt. Conf. Mach. Learn., pages 4603–4623, 2024. URLhttps://arxiv.org/abs/2402.15391

    2024 arXiv

  12. [20]

    Zhang, Michaël Defferrard, and Taco Cohen

    Natasha Butt, Blazej Manczak, Auke Wiggers, Corrado Rainone, David W. Zhang, Michaël Defferrard, and Taco Cohen. CodeIt: Self-improving language models with prioritized hindsight replay. InInt. Conf. Mach. Learn., pages 5013–5034, 2024. URLhttps://arxiv.org/abs/2402.04858

    2024 arXiv

  13. [21]

    MobileDreamer: Generative sketch world model for GUI agent

    Yilin Cao, Yufeng Zhong, Zhixiong Zeng, Liming Zheng, Jing Huang, Haibo Qiu, Peng Shi, Wenji Mao, and Guanglu Wan. MobileDreamer: Generative sketch world model for GUI agent. arXiv preprint arXiv:2601.04035, 2026. URLhttps://arxiv.org/abs/2601.04035

    2026

  14. [22]

    PhysX-Anything: Simulation-ready physical3Dassetsfromsingleimage

    Ziang Cao, Fangzhou Hong, Zhaoxi Chen, Liang Pan, and Ziwei Liu. PhysX-Anything: Simulation-ready physical3Dassetsfromsingleimage. arXivpreprintarXiv:2511.13648 , 2025. URLhttps://arxiv.org/ abs/2511.13648

    2025

  15. [23]

    Web agents with world models: Learning and leverag- ing environment dynamics in web navigation

    Hyungjoo Chae, Namyoung Kim, Kai Tzu-iunn Ong, Minju Gwak, Gwanwoo Song, Jihoon Kim, Sungh- wan Kim, Dongha Lee, and Jinyoung Yeo. Web agents with world models: Learning and leverag- ing environment dynamics in web navigation. In Int. Conf. Learn. Represent., 2025. URL https: ...

    2025 arXiv

  16. [24]

    GAF: Gaussian action field as a 4D representation for dynamic world modeling in robotic manipulation.arXiv preprint arXiv:2506.14135, 2025

    Ying Chai, Litao Deng, Ruizhi Shao, Jiajun Zhang, Kangchen Lv, Liangjun Xing, Xiang Li, Hongwen Zhang, and Yebin Liu. GAF: Gaussian action field as a 4D representation for dynamic world modeling in robotic manipulation.arXiv preprint arXiv:2506.14135, 2025. URL https://arxiv.o...

    2025 arXiv

  17. [25]

    GameGen-X: Interactive open- world game video generation

    Haoxuan Che, Xuanhua He, Quande Liu, Cheng Jin, and Hao Chen. GameGen-X: Interactive open- world game video generation. InInt. Conf. Learn. Represent., 2025. URLhttps://arxiv.org/abs/2411. 00769

    2025

  18. [26]

    TensoRF: Tensorial radiance fields

    Anpei Chen, Zexiang Xu, Andreas Geiger, Jingyi Yu, and Hao Su. TensoRF: Tensorial radiance fields. In Eur. Conf. Comput. Vis., pages 333–350, 2022. URLhttps://arxiv.org/abs/2203.09517

    2022 arXiv

  19. [27]

    A survey on 3D gaussian splatting.ACM Comput

    Guikun Chen and Wenguan Wang. A survey on 3D gaussian splatting.ACM Comput. Surv., 2024. URL https://arxiv.org/abs/2401.03890

    2024 arXiv

  20. [28]

    Scaling agent learning via experience synthesis.arXiv preprint arXiv:2511.03773, 2025

    Zhaorun Chen, Zhuokai Zhao, Kai Zhang, Bo Liu, Qi Qi, Yifan Wu, Tarun Kalluri, Sara Cao, et al. Scaling agent learning via experience synthesis.arXiv preprint arXiv:2511.03773, 2025. URL https://arxiv. org/abs/2511.03773. 25

    2025

  21. [29]

    SceneDreamer: Unbounded 3D scene generation from 2D imagecollections.IEEE Trans.PatternAnal.Mach

    Zhaoxi Chen, Guangcong Wang, and Ziwei Liu. SceneDreamer: Unbounded 3D scene generation from 2D imagecollections.IEEE Trans.PatternAnal.Mach. Intell., 2023. URLhttps://arxiv.org/abs/2302. 01330

    2023

  22. [30]

    Christiano, Jan Leike, Tom B

    Paul F. Christiano, Jan Leike, Tom B. Brown, Miljan Martic, Shane Legg, and Dario Amodei. Deep reinforcement learning from human preferences. InAdv. Neural Inf. Process. Syst., 2017. URL https: //arxiv.org/abs/1706.03741

    2017 arXiv

  23. [31]

    Agentic world modeling: Foundations, capabilities, laws, and beyond.arXiv preprint arXiv:2604.22748, 2026

    Meng Chu, Xuan Billy Zhang, Kevin Qinghong Lin, Lingdong Kong, Jize Zhang, Teng Tu, Weijian Ma, Ziqi Huang, et al. Agentic world modeling: Foundations, capabilities, laws, and beyond.arXiv preprint arXiv:2604.22748, 2026. URLhttps://arxiv.org/abs/2604.22748

    2026 arXiv

  24. [32]

    URL https://arxiv

    Karl Cobbe, Vineet Kosaraju, Mohammad Bavarian, Mark Chen, Heewoo Jun, Lukasz Kaiser, Matthias Plappert,JerryTworek,JacobHilton,ReiichiroNakano,ChristopherHesse,andJohnSchulman.Training verifiers to solve math word problems.arXiv preprint arXiv:2110.14168, 2021. URL https://ar...

    arXiv

  25. [33]

    CWM: An open-weights LLM for research on code generation with world models.arXiv preprint arXiv:2510.02387, 2025

    Jade Copet, Quentin Carbonneaux, Gal Cohen, Jonas Gehring, Jacob Kahn, Jannik Kossen, Felix Kreuk, Emily McMilin, Michel Meyer, Yuxiang Wei, David Zhang, Kunhao Zheng, Jordi Armengol-Estapé, Pe- dram Bashiri, Maximilian Beck, et al. CWM: An open-weights LLM for research on cod...

  26. [34]

    Generating code world mod- els with large language models guided by Monte Carlo tree search

    Nicola Dainese, Matteo Merler, Minttu Alakuijala, and Pekka Marttinen. Generating code world mod- els with large language models guided by Monte Carlo tree search. InAdv. Neural Inf. Process. Syst., volume 37, 2024. URLhttps://arxiv.org/abs/2405.15383

    2024 arXiv

  27. [35]

    Oasis: A universe in a transformer

    Decart, Julian Quevedo, Quinn McIntyre, Spruce Campbell, Xinlei Chen, and Robert Wachen. Oasis: A universe in a transformer. Blog post, 2024. URLhttps://oasis-model.github.io

    2024

  28. [36]

    Understanding world or predicting future? A comprehensive survey of world models.ACM Comput

    Jingtao Ding, Yunke Zhang, Yu Shang, Jie Feng, Yuheng Zhang, Zefang Zong, Yuan Yuan, Hongyuan Su, et al. Understanding world or predicting future? A comprehensive survey of world models.ACM Comput. Surv., 2025. URLhttps://arxiv.org/abs/2411.14499

    2025

  29. [39]

    Length-controlledAlpacaEval: A simple way to debias automatic evaluators

    YannDubois,BalázsGalambosi,PercyLiang, andTatsunoriB.Hashimoto. Length-controlledAlpacaEval: A simple way to debias automatic evaluators. InConf. Lang. Model., 2024. URL https://arxiv.org/ abs/2404.04475

    2024 arXiv

  30. [40]

    KTO: Model align- ment as prospect theoretic optimization

    Kawin Ethayarajh, Winnie Xu, Niklas Muennighoff, Dan Jurafsky, and Douwe Kiela. KTO: Model align- ment as prospect theoretic optimization. InInt. Conf. Mach. Learn., 2024. URL https://arxiv.org/ abs/2402.01306

    2024 arXiv

  31. [41]

    WebEvolver: Enhancing web agent self-improvement with coevolving world model

    Tianqing Fang, Hongming Zhang, Zhisong Zhang, Kaixin Ma, Wenhao Yu, Haitao Mi, and Dong Yu. WebEvolver: Enhancing web agent self-improvement with coevolving world model. InProc. Conf. Empir. Methods Nat. Lang. Process., pages 8959–8975, 2025. URLhttps://arxiv.org/abs/2504.21024

    2025 arXiv

  32. [42]

    3D gaussian as a new era: A survey.IEEE Trans

    Ben Fei, Jingyi Xu, Rui Zhang, Qingyuan Zhou, Weidong Yang, and Ying He. 3D gaussian as a new era: A survey.IEEE Trans. Vis. Comput. Graph., 2024. URLhttps://arxiv.org/abs/2402.07181

    2024 arXiv

  33. [43]

    Webworldmodels

    JichenFeng,YifanZhang,ChenggongZhang,YifuLu,ShilongLiu,andMengdiWang. Webworldmodels. arXiv preprint arXiv:2512.23676, 2025. URLhttps://arxiv.org/abs/2512.23676. 26

    2025

  34. [44]

    Asurveyofworldmodelsforautonomousdriving

    TuoFeng,WenguanWang,andYiYang. Asurveyofworldmodelsforautonomousdriving. arXivpreprint arXiv:2501.11260, 2025. URLhttps://arxiv.org/abs/2501.11260

    2025 arXiv

  35. [45]

    SceneScape: Text-driven consistent scene generation

    Rafail Fridman, Amit Abecasis, Yoni Kasten, and Tali Dekel. SceneScape: Text-driven consistent scene generation. InAdv. Neural Inf. Process. Syst., 2023. URLhttps://arxiv.org/abs/2302.01133

    2023 arXiv

  36. [46]

    MCP-Cosmos: World model-augmented agents for complex taskexecutioninMCPenvironments

    Giridhar Ganapavarapu and Dhaval Patel. MCP-Cosmos: World model-augmented agents for complex taskexecutioninMCPenvironments. arXivpreprintarXiv:2605.09131 ,2026. URL https://arxiv.org/ abs/2605.09131

    2026 arXiv

  37. [47]

    Vista: A generalizable driving world model with high fidelity and versatile controllability

    Shenyuan Gao, Jiazhi Yang, Li Chen, Kashyap Chitta, Yihang Qiu, Andreas Geiger, Jun Zhang, and Hongyang Li. Vista: A generalizable driving world model with high fidelity and versatile controllability. In Adv. Neural Inf. Process. Syst., volume 37, 2024. URLhttps://arxiv.org/ab...

    2024 arXiv

  38. [48]

    WebSynthesis: World-model-guided MCTS for ef- ficient WebUI-trajectory synthesis.arXiv preprint arXiv:2507.04370, 2025

    Yifei Gao, Junhong Ye, Jiaqi Wang, and Jitao Sang. WebSynthesis: World-model-guided MCTS for ef- ficient WebUI-trajectory synthesis.arXiv preprint arXiv:2507.04370, 2025. URL https://arxiv.org/ abs/2507.04370

    2025 arXiv

  39. [49]

    Advancing open-source world models.arXiv preprint arXiv:2601.20540, 2026

    Zelin Gao, Qiuyu Wang, Yanhong Zeng, Jiapeng Zhu, Ka Leong Cheng, Yixuan Li, Hanlin Wang, Yinghao Xu, et al. Advancing open-source world models.arXiv preprint arXiv:2601.20540, 2026. URL https: //arxiv.org/abs/2601.20540

    2026 arXiv

  40. [50]

    Genie 3: A new frontier for world models

    Google DeepMind. Genie 3: A new frontier for world models. DeepMind Technical Blog, 2025. URL https://deepmind.google/discover/blog/genie-3-a-new-frontier-for-world-models/

    2025

  41. [51]

    A survey on LLM-as-a-judge.arXiv preprint arXiv:2411.15594, 2024

    Jiawei Gu, Xuhui Jiang, Zhichao Shi, Hexiang Tan, Xuehao Zhai, Chengjin Xu, Wei Li, Yinghan Shen, et al. A survey on LLM-as-a-judge.arXiv preprint arXiv:2411.15594, 2024. URL https://arxiv.org/ abs/2411.15594

    2024 arXiv

  42. [52]

    Is your LLM secretly a world model of the internet? Model- based planning for web agents.Trans

    Yu Gu, Kai Zhang, Yuting Ning, Boyuan Zheng, Boyu Gou, Tianci Xue, Cheng Chang, Sanjari Srivastava, Yanan Xie, Peng Qi, Huan Sun, and Yu Su. Is your LLM secretly a world model of the internet? Model- based planning for web agents.Trans. Mach. Learn. Res., 2025. URL https://arx...

    2025

  43. [53]

    Computer- using world model.arXiv preprint arXiv:2602.17365, 2026

    Yiming Guan, Rui Yu, John Zhang, Lu Wang, Chaoyun Zhang, Liqun Li, Bo Qiao, Si Qin, et al. Computer- using world model.arXiv preprint arXiv:2602.17365, 2026. URLhttps://arxiv.org/abs/2602.17365

    2026

  44. [54]

    MineWorld: a real-timeand open-sourceinteractiveworldmodelonminecraft

    Junliang Guo, Yang Ye, Tianyu He, Haoyu Wu, Yushu Jiang, Tim Pearce, and Jiang Bian. MineWorld: a real-timeand open-sourceinteractiveworldmodelonminecraft. arXiv preprint arXiv:2504.08388, 2025. URL https://arxiv.org/abs/2504.08388

    2025 arXiv

  45. [55]

    World modelling improves language model agents.arXiv preprint arXiv:2506.02918, 2025

    Shangmin Guo, Omar Darwiche Domingues, Raphaël Avalos, Aaron Courville, and Florian Strub. World modelling improves language model agents.arXiv preprint arXiv:2506.02918, 2025. URL https:// arxiv.org/abs/2506.02918

    2025

  46. [56]

    When world models dream wrong: Physical-conditioned adversarial attacks against world models

    ZhixiangGuo,SiyuanLiang,AndrásBalogh,NoahLunberry,Rong-ChengTu,MárkJelasity,andDacheng Tao. When world models dream wrong: Physical-conditioned adversarial attacks against world models. arXiv preprint arXiv:2602.18739, 2026. URLhttps://arxiv.org/abs/2602.18739

    2026

  47. [57]

    Recurrent world models facilitate policy evolution

    David Ha and Jürgen Schmidhuber. Recurrent world models facilitate policy evolution. InAdv. Neural Inf. Process. Syst., volume 31, 2018. URLhttps://arxiv.org/abs/1803.10122

    2018 arXiv

  48. [58]

    Learning latent dynamics for planning from pixels

    Danijar Hafner, Timothy Lillicrap, Ian Fischer, Ruben Villegas, David Ha, Honglak Lee, and James David- son. Learning latent dynamics for planning from pixels. InInt. Conf. Mach. Learn., pages 2555–2565,

  49. [59]

    Dream to control: Learning behaviors by latent imagination

    Danijar Hafner, Timothy Lillicrap, Jimmy Ba, and Mohammad Norouzi. Dream to control: Learning behaviors by latent imagination. InInt. Conf. Learn. Represent., 2020. URL https://arxiv.org/abs/ 1912.01603. 27

    2020 arXiv

  50. [60]

    Mastering diverse control tasks through world models.Nature, 640(8059):647–653, 2025

    Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, and Timothy Lillicrap. Mastering diverse control tasks through world models.Nature, 640(8059):647–653, 2025. URLhttps://arxiv.org/abs/2301.04104

    2025 arXiv

  51. [61]

    TD-MPC2: Scalable, robust world models for continuous control

    Nicklas Hansen, Hao Su, and Xiaolong Wang. TD-MPC2: Scalable, robust world models for continuous control. InInt. Conf. Learn. Represent., 2024. URLhttps://arxiv.org/abs/2310.16828

    2024 arXiv

  52. [62]

    Rea- soning with language model is planning with world model

    Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, and Zhiting Hu. Rea- soning with language model is planning with world model. InProc. Conf. Empir. Methods Nat. Lang. Process., pages 8154–8173, 2023. URLhttps://arxiv.org/abs/2305.14992

    2023 arXiv

  53. [63]

    Jonathan Ho, Tim Salimans, Alexey Gritsenko, William Chan, Mohammad Norouzi, and David J. Fleet. Video diffusion models. InAdv. Neural Inf. Process. Syst., volume 35, 2022. URLhttps://arxiv.org/ abs/2204.03458

    2022 arXiv

  54. [64]

    Text2Room: Extracting textured 3D meshes from 2D text-to-image models

    Lukas Höllein, Ang Cao, Andrew Owens, Justin Johnson, and Matthias Nießner. Text2Room: Extracting textured 3D meshes from 2D text-to-image models. InIEEE/CVF Int. Conf. Comput. Vis., 2023. URL https://arxiv.org/abs/2303.11989

    2023 arXiv

  55. [65]

    ORPO:Monolithicpreferenceoptimizationwithoutreference model

    JiwooHong, NoahLee, andJamesThorne. ORPO:Monolithicpreferenceoptimizationwithoutreference model. In Proc. Conf. Empir. Methods Nat. Lang. Process., 2024. URL https://arxiv.org/abs/2403. 07691

    2024

  56. [66]

    Diffusion models for video prediction and infilling

    Tobias Höppe, Arash Mehrjou, Stefan Bauer, Didrik Nielsen, and Andrea Dittadi. Diffusion models for video prediction and infilling. Trans. Mach. Learn. Res., 2022. URL https://arxiv.org/abs/2206. 07696

    2022

  57. [67]

    GAIA-1: A generative world model for autonomous driving

    Anthony Hu, Lloyd Russell, Hudson Yeo, Zak Murez, George Fedoseev, Alex Kendall, Jamie Shotton, and Gianluca Corrado. GAIA-1: A generative world model for autonomous driving. arXiv preprint arXiv:2309.17080, 2023. URLhttps://arxiv.org/abs/2309.17080

    2023 arXiv

  58. [68]

    IterCAD: An iterative multimodal agent for visually-grounded CAD generation and editing

    Tao Hu, Jiaxin Ai, Licheng Wen, Xueheng Li, Shu Zou, Siqi Li, Nianchen Deng, Xinyu Cai, Hongbin Zhou, Pinlong Cai, et al. IterCAD: An iterative multimodal agent for visually-grounded CAD generation and editing. arXiv preprint arXiv:2606.13368, 2026. URLhttps://arxiv.org/abs/2606.13368

    2026 arXiv

  59. [69]

    NavThinker: Action-conditioned world models for coupled prediction and planning in social navigation.arXiv preprint arXiv:2603.15359, 2026

    Tianshuai Hu, Zeying Gong, Lingdong Kong, Xiaodong Mei, Yiyi Ding, Qi Zeng, Ao Liang, Rong Li, Yangyi Zhong, and Junwei Liang. NavThinker: Action-conditioned world models for coupled prediction and planning in social navigation.arXiv preprint arXiv:2603.15359, 2026. URL https:...

    2026

  60. [70]

    OccuBench: Evaluating AI agents on real-world professional tasks via language world models.arXiv preprint arXiv:2604.10866, 2026

    Xiaomeng Hu, Yinger Zhang, Fei Huang, Jianhong Tu, Yang Su, Lianghao Deng, Yuxuan Liu, Yantao Liu, Dayiheng Liu, and Tsung-Yi Ho. OccuBench: Evaluating AI agents on real-world professional tasks via language world models.arXiv preprint arXiv:2604.10866, 2026. URL https://arxiv...

    2026 arXiv

  61. [71]

    ParticleFormer: A 3D point cloud world model for multi-object, multi-material robotic manipulation.arXiv preprint arXiv:2506.23126, 2025

    Suning Huang, Qianzhong Chen, Xiaohan Zhang, Jiankai Sun, and Mac Schwager. ParticleFormer: A 3D point cloud world model for multi-object, multi-material robotic manipulation.arXiv preprint arXiv:2506.23126, 2025. URLhttps://arxiv.org/abs/2506.23126

    2025 arXiv

  62. [72]

    Inner monologue: Embodied reasoning through planning with language models

    Wenlong Huang, Fei Xia, Ted Xiao, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tomp- son, et al. Inner monologue: Embodied reasoning through planning with language models. InConf. Robot Learn., 2022. URLhttps://arxiv.org/abs/2207.05608

    2022 arXiv

  63. [73]

    VoxPoser: Compos- able 3D value maps for robotic manipulation with language models

    Wenlong Huang, Chen Wang, Ruohan Zhang, Yunzhu Li, Jiajun Wu, and Li Fei-Fei. VoxPoser: Compos- able 3D value maps for robotic manipulation with language models. InConf. Robot Learn., 2023. URL https://arxiv.org/abs/2307.05973

    2023 arXiv

  64. [74]

    PointWorld: Scaling 3D world models for in-the-wild robotic manipulation

    Wenlong Huang, Yu-Wei Chao, Arsalan Mousavian, Ming-Yu Liu, Dieter Fox, Kaichun Mo, and Li Fei- Fei. PointWorld: Scaling 3D world models for in-the-wild robotic manipulation. arXiv preprint arXiv:2601.03782, 2026. URLhttps://arxiv.org/abs/2601.03782. 28

    2026

  65. [75]

    CAS- CADE: Cumulative agentic skill creation through autonomous development and evolution.arXiv preprint arXiv:2512.23880, 2025

    Xu Huang, Junwu Chen, Yuxing Fei, Zhuohan Li, Philippe Schwaller, and Gerbrand Ceder. CAS- CADE: Cumulative agentic skill creation through autonomous development and evolution.arXiv preprint arXiv:2512.23880, 2025. URLhttps://arxiv.org/abs/2512.23880

    2025

  66. [76]

    When to trust your model: Model-based policy optimization

    Michael Janner, Justin Fu, Marvin Zhang, and Sergey Levine. When to trust your model: Model-based policy optimization. InAdv. Neural Inf. Process. Syst., volume 32, 2019. URLhttps://arxiv.org/abs/ 1906.08253

    2019 arXiv

  67. [77]

    Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan

    Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, and Karthik Narasimhan. SWE-bench: Can language models resolve real-world GitHub issues? InInt. Conf. Learn. Represent., 2024. URLhttps://arxiv.org/abs/2310.06770

    2024 arXiv

  68. [79]

    Campbell, K

    Lukasz Kaiser, Mohammad Babaeizadeh, Piotr Milos, Blazej Osinski, Roy H. Campbell, K. Czechowski, D.Erhan,ChelseaFinn,etal.Model-basedreinforcementlearningforAtari.In Int.Conf.Learn.Represent. ,

  69. [80]

    How far is video generation from world model: A physical law perspective

    Bingyi Kang, Yang Yue, Rui Lu, Zhijie Lin, Yang Zhao, Kaixin Wang, Gao Huang, and Jiashi Feng. How far is video generation from world model: A physical law perspective. InInt. Conf. Mach. Learn., 2025. URL https://arxiv.org/abs/2411.02385

    2025 arXiv

  70. [81]

    3D Gaussian splatting for real-time radiance field rendering.ACM Trans

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, and George Drettakis. 3D Gaussian splatting for real-time radiance field rendering.ACM Trans. Graph., 42(4), 2023. URLhttps://arxiv.org/abs/ 2308.04079

    2023 arXiv

  71. [82]

    URL https://arxiv.org/abs/2603.21104

  72. [83]

    PathDreamer: A world model for indoor navigation

    Jing Yu Koh, Honglak Lee, Yinfei Yang, Jason Baldridge, and Peter Anderson. PathDreamer: A world model for indoor navigation. In IEEE/CVF Int. Conf. Comput. Vis., pages 14738–14748, 2021. URL https://arxiv.org/abs/2105.08756

    2021 arXiv

  73. [84]

    Generative visual code mobile world models.arXiv preprint arXiv:2602.01576, 2026

    Woosung Koh, Sungjun Han, Segyu Lee, Se-Young Yun, and Jamin Shin. Generative visual code mobile world models.arXiv preprint arXiv:2602.01576, 2026. URLhttps://arxiv.org/abs/2602.01576

    2026 arXiv

  74. [85]

    Large language models are zero-shot reasoners

    Takeshi Kojima, Shixiang Shane Gu, Machel Reid, Yutaka Matsuo, and Yusuke Iwasawa. Large language models are zero-shot reasoners. InAdv. Neural Inf. Process. Syst., 2022. URLhttps://arxiv.org/abs/ 2205.11916

    2022 arXiv

  75. [86]

    3D and 4D world modeling: A survey

    Lingdong Kong, Wesley Yang, Jianbiao Mei, Youquan Liu, Ao Liang, Dekai Zhu, Dongyue Lu, Wei Yin, et al. 3D and 4D world modeling: A survey. arXiv preprint arXiv:2509.07996, 2025. URL https: //arxiv.org/abs/2509.07996

    2025 arXiv

  76. [87]

    Prometheus: Inducing fine-grained evaluation capability in language models

    Seungone Kim, Jamin Shin, Yejin Cho, Joel Jang, Shayne Longpre, Hwaran Lee, Sangdoo Yun, Seongjin Shin, Sungdong Kim, James Thorne, and Minjoon Seo. Prometheus: Inducing fine-grained evaluation capability in language models. InInt. Conf. Learn. Represent., 2024. URL https://ar...

    2024 arXiv

  77. [88]

    A path towards autonomous machine intelligence.OpenReview preprint, 2022

    Yann LeCun. A path towards autonomous machine intelligence.OpenReview preprint, 2022. URLhttps: //openreview.net/pdf?id=BZ5a1r-kVsf

    2022

  78. [89]

    Grounding image matching in 3D with MASt3R

    Vincent Leroy, Yohann Cabon, and Jerome Revaud. Grounding image matching in 3D with MASt3R. In Eur. Conf. Comput. Vis., 2024. URLhttps://arxiv.org/abs/2406.09756. 29

    2024 arXiv

  79. [90]

    BEHAVIOR-1K: A human-centered, embodied AI benchmark with 1,000 everyday activities and realistic simulation.arXiv preprint arXiv:2403.09227, 2024

    Chengshu Li, Ruohan Zhang, Josiah Wong, Cem Gokmen, Sanjana Srivastava, Roberto Martín-Martín, Chen Wang, Gabrael Levine, et al. BEHAVIOR-1K: A human-centered, embodied AI benchmark with 1,000 everyday activities and realistic simulation.arXiv preprint arXiv:2403.09227, 2024. ...

    2024 arXiv

  80. [91]

    WorldModelBench: Judging video generation models as world models

    Dacheng Li, Yunhao Fang, Yukang Chen, Shuo Yang, Shiyi Cao, Justin Wong, Michael Luo, Xiaolong Wang, et al. WorldModelBench: Judging video generation models as world models. arXiv preprint arXiv:2502.20694, 2025. URLhttps://arxiv.org/abs/2502.20694

    2025 arXiv

  81. [92]

    Is your driving world model an all-around player? InIEEE/CVF Conf

    Lingdong Kong, Ao Liang, Tianyi Yan, Hongsi Liu, Wesley Yang, Ziqi Huang, Xian Sun, Wei Yin, et al. Is your driving world model an all-around player? InIEEE/CVF Conf. Comput. Vis. Pattern Recog., pages 36385–36399, 2026. URLhttps://arxiv.org/abs/2605.10858

    2026 arXiv

  82. [94]

    SafetyinembodiedAI:Asurvey of risks, attacks, and defenses.arXiv preprint arXiv:2605.02900, 2026

    XiaoLi,XiangZheng,YifengGao,XinyuXia,YixuWang,XinWang,etal. SafetyinembodiedAI:Asurvey of risks, attacks, and defenses.arXiv preprint arXiv:2605.02900, 2026. URLhttps://arxiv.org/abs/ 2605.02900

    2026 arXiv

  83. [95]

    A comprehensive survey on world models for embodied AI.arXiv preprint arXiv:2510.16732, 2025

    Xinqing Li, Xin He, Le Zhang, Min Wu, Xiaoli Li, and Yun Liu. A comprehensive survey on world models for embodied AI.arXiv preprint arXiv:2510.16732, 2025. URLhttps://arxiv.org/abs/2510.16732

    2025 arXiv

  84. [96]

    MegaSaM: Accurate, fast, and robust structure and motion from casual dynamic videos

    Zhengqi Li, Richard Tucker, Forrester Cole, Qianqian Wang, Linyi Jin, Vickie Ye, Angjoo Kanazawa, Aleksander Holynski, and Noah Snavely. MegaSaM: Accurate, fast, and robust structure and motion from casual dynamic videos. InIEEE/CVF Conf. Comput. Vis. Pattern Recog., 2025. URL...

    2025 arXiv

  85. [97]

    DreamScene: 3D gaussian-based text-to-3D scene generation via formation pattern sampling

    Haoran Li, Haolin Shi, Wenli Zhang, Wenjun Wu, Yong Liao, Lin Wang, Lik-Hang Lee, and Pengyuan Zhou. DreamScene: 3D gaussian-based text-to-3D scene generation via formation pattern sampling. In Eur. Conf. Comput. Vis., 2024. URLhttps://arxiv.org/abs/2404.03575

    2024 arXiv

  86. [98]

    Codeaspolicies: Languagemodelprogramsforembodiedcontrol

    Jacky Liang, Wenlong Huang, Fei Xia, Peng Xu, Karol Hausman, Brian Ichter, Pete Florence, and Andy Zeng. Codeaspolicies: Languagemodelprogramsforembodiedcontrol. In IEEEInt.Conf.Robot.Autom. ,

  87. [99]

    URL https://arxiv.org/abs/2512.14014

  88. [101]

    JailWAM: Jailbreaking world action models in robot control

    Hanqing Liu, Songping Wang, Jiahuan Long, Jiacheng Hou, Jialiang Sun, Chao Li, Yang Yang, Wei Peng, Xu Liu, Tingsong Jiang, Wen Yao, and Yao Mu. JailWAM: Jailbreaking world action models in robot control. arXiv preprint arXiv:2604.05498, 2026. URLhttps://arxiv.org/abs/2604.05498

    2026 arXiv

  89. [102]

    World model on million-length video and lan- guage with blockwise RingAttention

    Hao Liu, Wilson Yan, Matei Zaharia, and Pieter Abbeel. World model on million-length video and lan- guage with blockwise RingAttention. InInt. Conf. Learn. Represent., 2025. URL https://arxiv.org/ abs/2402.08268

    2025 arXiv

  90. [103]

    LiDARCrafter: Dynamic 4D world modeling from LiDAR sequences

    Ao Liang, Youquan Liu, Yu Yang, Dongyue Lu, Linfeng Li, Lingdong Kong, Huaici Zhao, and Wei Tsang Ooi. LiDARCrafter: Dynamic 4D world modeling from LiDAR sequences. InAAAI Conf. Artif. Intell., volume 40, pages 18406–18414, 2026. URLhttps://arxiv.org/abs/2508.03692

    2026

  91. [104]

    G-Eval: NLG evalu- ation using GPT-4 with better human alignment

    Yang Liu, Dan Iter, Yichong Xu, Shuohang Wang, Ruochen Xu, and Chenguang Zhu. G-Eval: NLG evalu- ation using GPT-4 with better human alignment. InProc. Conf. Empir. Methods Nat. Lang. Process., 2023. URL https://arxiv.org/abs/2303.16634. 30

    2023 arXiv

  92. [105]

    GWM: Towards scalable gaussian world models for robotic manipulation

    Guanxing Lu, Baoxiong Jia, Puhao Li, YixinChen, ZiweiWang, YansongTang, and Siyuan Huang. GWM: Towards scalable gaussian world models for robotic manipulation. InIEEE/CVF Int. Conf. Comput. Vis., pages 9263–9274, 2025. URLhttps://arxiv.org/abs/2508.17600

    2025

  93. [106]

    Let’s verify step by step

    HunterLightman,VineetKosaraju,YuraBurda,HarriEdwards,BowenBaker,TeddyLee,JanLeike,John Schulman, Ilya Sutskever, and Karl Cobbe. Let’s verify step by step. InInt. Conf. Learn. Represent., 2024. URL https://arxiv.org/abs/2305.20050

    2024 arXiv

  94. [107]

    Scaffold-GS: Struc- tured 3D gaussians for view-adaptive rendering

    Tao Lu, Mulin Yu, Linning Xu, Yuanbo Xiangli, Limin Wang, Dahua Lin, and Bo Dai. Scaffold-GS: Struc- tured 3D gaussians for view-adaptive rendering. InIEEE/CVF Conf. Comput. Vis. Pattern Recog., 2024. URL https://arxiv.org/abs/2312.00109

    2024 arXiv

  95. [108]

    URL https://arxiv.org/abs/2511.15567

  96. [109]

    Self-Refine: Iterative refinement with self-feedback

    Aman Madaan, Niket Tandon, Prakhar Gupta, Skyler Hallinan, Luyu Gao, Sarah Wiegreffe, Uri Alon, Nouha Dziri, et al. Self-Refine: Iterative refinement with self-feedback. InAdv. Neural Inf. Process. Syst.,

  97. [110]

    Self- execution simulation improves coding models

    Gallil Maimon, Ori Yoran, Felix Kreuk, Michael Hassid, Gal Cohen, Pierre Chambon, and Yossi Adi. Self- execution simulation improves coding models. arXiv preprint arXiv:2604.03253, 2026. URL https: //arxiv.org/abs/2604.03253

    2026 arXiv

  98. [111]

    AgentBench: Evaluat- ing LLMs as agents

    Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, et al. AgentBench: Evaluat- ing LLMs as agents. InInt. Conf. Learn. Represent., 2024. URLhttps://arxiv.org/abs/2308.03688

    2024 arXiv

  99. [112]

    LLM critics help catch LLM bugs.arXiv preprint arXiv:2407.00215, 2024

    Nat McAleese, Rai Michael Pokorny, Juan Felipe Ceron Uribe, Evgenia Nitishinskaya, Maja Trebacz, and Jan Leike. LLM critics help catch LLM bugs.arXiv preprint arXiv:2407.00215, 2024. URL https:// arxiv.org/abs/2407.00215

    2024 arXiv

  100. [113]

    Dreamforge: Motion-aware autoregressive video generation for multi-view driving scenes

    Jianbiao Mei, Tao Hu, Xuemeng Yang, Licheng Wen, Yu Yang, Tiantian Wei, Yukai Ma, Min Dou, Botian Shi, and Yong Liu. Dreamforge: Motion-aware autoregressive video generation for multi-view driving scenes. arXiv preprint arXiv:2409.04003, 2024. URLhttps://arxiv.org/abs/2409.04003

    2024 arXiv

  101. [114]

    ToolSandbox: A stateful, conversational, interactive evaluation benchmark for LLM tool use capabilities

    Jiarui Lu, Thomas Holleis, Yizhe Zhang, Bernhard Aumayer, Feng Nan, Felix Bai, Shuang Ma, Shen Ma, Mengyu Li, Guoli Yin, Zirui Wang, and Ruoming Pang. ToolSandbox: A stateful, conversational, interactive evaluation benchmark for LLM tool use capabilities. InProc. Conf. N. Am. ...

    2025 arXiv

  102. [115]

    SimPO: Simple preference optimization with a reference-free reward

    Yu Meng, Mengzhou Xia, and Danqi Chen. SimPO: Simple preference optimization with a reference-free reward. InAdv. Neural Inf. Process. Syst., 2024. URLhttps://arxiv.org/abs/2405.14734

    2024 arXiv

  103. [116]

    ViMo: A generative visual GUI world model for app agents

    Dezhao Luo, Bohan Tang, Kang Li, Georgios Papoudakis, Jifei Song, Shaogang Gong, Jianye Hao, Jun Wang, and Kun Shao. ViMo: A generative visual GUI world model for app agents. arXiv preprint arXiv:2504.13936, 2025. URLhttps://arxiv.org/abs/2504.13936

    2025 arXiv

  104. [117]

    Srinivasan, Matthew Tancik, Jonathan T

    Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, and Ren Ng. NeRF: Representing scenes as neural radiance fields for view synthesis. InEur. Conf. Comput. Vis.,

  105. [118]

    URL https://arxiv.org/abs/2303.17651

    arXiv

  106. [119]

    Moerland, Joost Broekens, Aske Plaat, and Catholijn M

    Thomas M. Moerland, Joost Broekens, Aske Plaat, and Catholijn M. Jonker. Model-based reinforcement learning: A survey. Found. Trends Mach. Learn., 16(1), 2023. URL https://arxiv.org/abs/2006. 16712. 31

    2023

  107. [120]

    Isaac Gym: High performance GPU-based physics simulation for robot learning

    Viktor Makoviychuk, Lukasz Wawrzyniak, Yunrong Guo, Michelle Lu, Kier Storey, Miles Macklin, David Hoeller, Nikita Rudin, Arthur Allshire, Ankur Handa, and Gavriel State. Isaac Gym: High performance GPU-based physics simulation for robot learning. InAdv. Neural Inf. Process. S...

    2021 arXiv

  108. [121]

    RoboCasa: Large-scale simulation of everyday tasks for generalist robots

    Soroush Nasiriany, Abhiram Maddukuri, Lance Zhang, Adeet Parikh, Aaron Lo, Abhishek Joshi, Ajay Mandlekar, and Yuke Zhu. RoboCasa: Large-scale simulation of everyday tasks for generalist robots. In Robot. Sci. Syst., 2024. URLhttps://arxiv.org/abs/2406.02523

    2024 arXiv

  109. [122]

    Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, et al

    Long Ouyang, Jeff Wu, Xu Jiang, Diogo Almeida, Carroll L. Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, et al. Training language models to follow instructions with human feedback. InAdv. Neural Inf. Process. Syst., 2022. URLhttps://arxiv.org/abs/2203.02155

    2022 arXiv

  110. [123]

    Vision- centric 4D occupancy forecasting and planning via implicit residual world models

    Jianbiao Mei, Yu Yang, Xuemeng Yang, Licheng Wen, Jiajun Lv, Botian Shi, and Yong Liu. Vision- centric 4D occupancy forecasting and planning via implicit residual world models. arXiv preprint arXiv:2510.16729, 2025. URLhttps://arxiv.org/abs/2510.16729

    2025

  111. [124]

    O’Brien, Carrie J

    Joon Sung Park, Joseph C. O’Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. Generative agents: Interactive simulacra of human behavior. InAnnu. ACM Symp. User Inter- face Softw. Technol., pages 1–22, 2023. URLhttps://arxiv.org/abs/2304.03442

    2023 arXiv

  112. [125]

    Transformers are sample-efficient world models

    Vincent Micheli, Eloi Alonso, and François Fleuret. Transformers are sample-efficient world models. In Int. Conf. Learn. Represent., 2023. URLhttps://arxiv.org/abs/2209.00588

    2023 arXiv

  113. [126]

    Agent planning with world knowledge model

    Shuofei Qiao, Runnan Fang, Ningyu Zhang, Yuqi Zhu, Xiang Chen, Shumin Deng, Yong Jiang, Pengjun Xie, Fei Huang, and Huajun Chen. Agent planning with world knowledge model. InAdv. Neural Inf. Process. Syst., volume 37, 2024. URLhttps://arxiv.org/abs/2405.14205

    2024 arXiv

  114. [127]

    URL https://arxiv.org/abs/2003.08934

    2003 arXiv

  115. [128]

    DriveWorld: 4Dpre-trainedsceneunderstandingviaworldmodelsforautonomousdriving

    ChenMin,DaweiZhao,LiangXiao,JianZhao,XinliXu,ZhengZhu,LeiJin,JianshuLi,etal. DriveWorld: 4Dpre-trainedsceneunderstandingviaworldmodelsforautonomousdriving. In IEEE/CVFConf.Comput. Vis. Pattern Recog., pages 15522–15533, 2024. URLhttps://arxiv.org/abs/2405.04390

    2024 arXiv

  116. [129]

    Debugging code world models.arXiv preprint arXiv:2602.07672, 2026

    Babak Rahmani. Debugging code world models.arXiv preprint arXiv:2602.07672, 2026. URL https: //arxiv.org/abs/2602.07672

    2026

  117. [130]

    Instant neural graphics primitives with a multiresolution hash encoding.ACM Trans

    Thomas Müller, Alex Evans, Christoph Schied, and Alexander Keller. Instant neural graphics primitives with a multiresolution hash encoding.ACM Trans. Graph., 41(4), 2022. URLhttps://arxiv.org/abs/ 2201.05989

    2022 arXiv

  118. [131]

    GTM: SimulatingtheworldoftoolsforAIagents

    Zhenzhen Ren, Xinpeng Zhang, Zhenxing Qian, Yan Gao, Yu Shi, Shuxin Zheng, and Jiyan He. GTM: SimulatingtheworldoftoolsforAIagents. arXivpreprintarXiv:2512.04535 ,2025. URL https://arxiv. org/abs/2512.04535

    2025

  119. [132]

    NeuralOS: Towards simulating operating systems via neural generative models

    Luke Rivard, Sun Sun, Hongyu Guo, Wenhu Chen, and Yuntian Deng. NeuralOS: Towards simulating operating systems via neural generative models. In Int. Conf. Learn. Represent., 2026. URL https: //arxiv.org/abs/2507.08800

    2026

  120. [133]

    Patil, Ion Stoica, and Joseph E

    Charles Packer, Sarah Wooders, Kevin Lin, Vivian Fang, Shishir G. Patil, Ion Stoica, and Joseph E. Gon- zalez. MemGPT: Towards LLMs as operating systems. arXiv preprint arXiv:2310.08560, 2023. URL https://arxiv.org/abs/2310.08560

    2023 arXiv

  121. [134]

    Habitat: A platform for embodied AI research

    Manolis Savva, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu, Vladlen Koltun, Jitendra Malik, Devi Parikh, and Dhruv Batra. Habitat: A platform for embodied AI research. InIEEE/CVF Int. Conf. Comput. Vis., pages 9339–9347, ...

    2019 arXiv

  122. [135]

    Current agents fail to leverage world model as tool for foresight.arXiv preprint arXiv:2601.03905, 2026

    Cheng Qian, Emre Can Acikgoz, Bingxuan Li, Xiusi Chen, Yuji Zhang, Bingxiang He, Qinyu Luo, Dilek Hakkani-Tür, Gokhan Tur, Yunzhu Li, and Heng Ji. Current agents fail to leverage world model as tool for foresight.arXiv preprint arXiv:2601.03905, 2026. URLhttps://arxiv.org/abs/...

    2026

  123. [136]

    MasteringAtari, Go, chessandshogibyplanningwithalearnedmodel

    Julian Schrittwieser, Ioannis Antonoglou, Thomas Hubert, Karen Simonyan, Laurent Sifre, Simon Schmitt, Arthur Guez, Edward Lockhart, Demis Hassabis, Thore Graepel, Timothy Lillicrap, and David Silver. MasteringAtari, Go, chessandshogibyplanningwithalearnedmodel. Nature, 588(78...

    2020 arXiv

  124. [138]

    Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, Y. K. Li, Y. Wu, and Daya Guo. DeepSeekMath: Pushing the limits of mathematical reasoning in open language models.arXiv preprint arXiv:2402.03300, 2024. URLhttps://arxiv.org/a...

    2024 arXiv

  125. [139]

    Manning, and Chelsea Finn

    Rafael Rafailov, Archit Sharma, Eric Mitchell, Stefano Ermon, Christopher D. Manning, and Chelsea Finn. Direct preference optimization: Your language model is secretly a reward model. InAdv. Neural Inf. Process. Syst., 2023. URLhttps://arxiv.org/abs/2305.18290

    2023 arXiv

  126. [140]

    Reflexion: Language agents with verbal reinforcement learning

    Noah Shinn, Federico Cassano, Edward Berman, Ashwin Gopinath, Karthik Narasimhan, and Shunyu Yao. Reflexion: Language agents with verbal reinforcement learning. InAdv. Neural Inf. Process. Syst.,

  127. [141]

    Aligning agentic world models via knowledgeable experience learning.arXiv preprint arXiv:2601.13247, 2026

    Baochang Ren, Yunzhi Yao, Rui Sun, Shuofei Qiao, Ningyu Zhang, and Huajun Chen. Aligning agentic world models via knowledgeable experience learning.arXiv preprint arXiv:2601.13247, 2026. URL https://arxiv.org/abs/2601.13247

    2026

  128. [142]

    Perceiver-actor: A multi-task transformer for robotic manipulation

    Mohit Shridhar, Lucas Manuelli, and Dieter Fox. Perceiver-actor: A multi-task transformer for robotic manipulation. InConf. Robot Learn., 2022. URLhttps://arxiv.org/abs/2209.05451

    2022 arXiv

  129. [143]

    Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul Christiano

    Nisan Stiennon, Long Ouyang, Jeff Wu, Daniel M. Ziegler, Ryan Lowe, Chelsea Voss, Alec Radford, Dario Amodei, and Paul Christiano. Learning to summarize from human feedback. InAdv. Neural Inf. Process. Syst., 2020. URLhttps://arxiv.org/abs/2009.01325

    2020 arXiv

  130. [144]

    GAIA-2: A controllable multi-view generative world model for autonomous driving.arXiv preprint arXiv:2503.20523, 2025

    LloydRussell,AnthonyHu,LorenzoBertoni,GeorgeFedoseev,JamieShotton,ElaheArani,andGianluca Corrado. GAIA-2: A controllable multi-view generative world model for autonomous driving.arXiv preprint arXiv:2503.20523, 2025. URLhttps://arxiv.org/abs/2503.20523

    2025 arXiv

  131. [145]

    Dimen- sionX: Create any 3D and 4D scenes from a single image with controllable video diffusion.arXiv preprint arXiv:2411.04928, 2024

    Wenqiang Sun, Shuo Chen, Fangfu Liu, Zilong Chen, Yueqi Duan, Jun Zhang, and Yikai Wang. Dimen- sionX: Create any 3D and 4D scenes from a single image with controllable video diffusion.arXiv preprint arXiv:2411.04928, 2024. URLhttps://arxiv.org/abs/2411.04928

    2024 arXiv

  132. [146]

    Toolformer: Language models can teach themselves to use tools

    Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom. Toolformer: Language models can teach themselves to use tools. In Adv. Neural Inf. Process. Syst., 2023. URLhttps://arxiv.org/abs/2302.04761

    2023 arXiv

  133. [147]

    Nerfstudio: A modular framework for neural radiance field development

    Matthew Tancik, Ethan Weber, Evonne Ng, Ruilong Li, Brent Yi, Justin Kerr, Terrance Wang, Alexander Kristoffersen, et al. Nerfstudio: A modular framework for neural radiance field development. InProc. ACM SIGGRAPH Asia Conf., 2023. URLhttps://arxiv.org/abs/2302.04264

    2023 arXiv

  134. [148]

    Proximal policy op- timization algorithms

    John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. Proximal policy op- timization algorithms. arXiv preprint arXiv:1707.06347, 2017. URL https://arxiv.org/abs/1707. 06347

    2017 arXiv

  135. [149]

    ManiSkill3: GPU parallelized robotics simulation and rendering for generalizable embodied AI

    Stone Tao, Fanbo Xiang, Arth Shukla, Yuzhe Qin, Xander Hinrichsen, Xiaodi Yuan, Chen Bao, Xinsong Lin, et al. ManiSkill3: GPU parallelized robotics simulation and rendering for generalizable embodied AI. arXiv preprint arXiv:2410.00425, 2024. URLhttps://arxiv.org/abs/2410.00425

    arXiv

  136. [150]

    World-model- augmented web agents with action correction.arXiv preprint arXiv:2602.15384, 2026

    Zhouzhou Shen, Xueyu Hu, Xiyun Li, Tianqing Fang, Juncheng Li, and Shengyu Zhang. World-model- augmented web agents with action correction.arXiv preprint arXiv:2602.15384, 2026. URL https: //arxiv.org/abs/2602.15384

    2026

  137. [152]

    URL https://arxiv.org/abs/2303.11366

    arXiv

  138. [153]

    CLIPort: What and where pathways for robotic manip- ulation

    Mohit Shridhar, Lucas Manuelli, and Dieter Fox. CLIPort: What and where pathways for robotic manip- ulation. InConf. Robot Learn., 2021. URLhttps://arxiv.org/abs/2109.12098

    2021 arXiv

  139. [154]

    Diffusion models are real-time game engines

    Dani Valevski, Yaniv Leviathan, Moab Arar, and Shlomi Fruchter. Diffusion models are real-time game engines. InInt. Conf. Learn. Represent., 2025. URLhttps://arxiv.org/abs/2408.14837

    2025 arXiv

  140. [155]

    van de Ven, Nicholas Soures, and Dhireesha Kudithipudi

    Gido M. van de Ven, Nicholas Soures, and Dhireesha Kudithipudi. Continual learning and catastrophic forgetting. In Learning and Memory: A Comprehensive Reference. Academic Press, 2025. URL https: //arxiv.org/abs/2403.05175

    2025 arXiv

  141. [156]

    Sumers, Shunyu Yao, Karthik Narasimhan, and Thomas L

    Theodore R. Sumers, Shunyu Yao, Karthik Narasimhan, and Thomas L. Griffiths. Cognitive architectures for language agents.Trans. Mach. Learn. Res., 2024. URLhttps://arxiv.org/abs/2309.02427

    2024 arXiv

  142. [157]

    Voyager: Anopen-endedembodiedagentwithlargelanguagemodels

    Guanzhi Wang, Yuqi Xie, Yunfan Jiang, Ajay Mandlekar, Chaowei Xiao, Yuke Zhu, Linxi Fan, and Anima Anandkumar. Voyager: Anopen-endedembodiedagentwithlargelanguagemodels. Trans.Mach.Learn. Res., 2024. URLhttps://arxiv.org/abs/2305.16291

    2024 arXiv

  143. [158]

    Richard S. Sutton. Dyna, an integrated architecture for learning, planning, and reacting.ACM SIGART Bull., 2(4):160–163, 1991. URLhttps://dl.acm.org/doi/10.1145/122344.122377

    1991

  144. [159]

    VGGT: Visual geometry grounded transformer.arXiv preprint arXiv:2503.11651, 2025

    Jianyuan Wang, Minghao Chen, Nikita Karaev, Andrea Vedaldi, Christian Rupprecht, and David Novotny. VGGT: Visual geometry grounded transformer.arXiv preprint arXiv:2503.11651, 2025. URL https: //arxiv.org/abs/2503.11651

    2025 arXiv

  145. [160]

    WorldCoder, a model-based LLM agent: Building world models by writing code and interacting with the environment

    Hao Tang, Darren Key, and Kevin Ellis. WorldCoder, a model-based LLM agent: Building world models by writing code and interacting with the environment. InAdv. NeuralInf. Process. Syst., volume 37, 2024. URL https://arxiv.org/abs/2402.12275

    2024 arXiv

  146. [161]

    VAGEN: Reinforcing world model reasoning for multi-turn VLM agents

    Kangrui Wang, Pingyue Zhang, Zihan Wang, Yaning Gao, Linjie Li, Qineng Wang, Hanyang Chen, Chi Wan, Yiping Lu, Zhengyuan Yang, et al. VAGEN: Reinforcing world model reasoning for multi-turn VLM agents. InAdv. Neural Inf. Process. Syst., 2025. URLhttps://arxiv.org/abs/2510.16907

    2025

  147. [162]

    MuJoCo: A physics engine for model-based control

    Emanuel Todorov, Tom Erez, and Yuval Tassa. MuJoCo: A physics engine for model-based control. In IEEE/RSJ Int. Conf. Intell. Robots Syst., pages 5026–5033, 2012. URLhttps://ieeexplore.ieee.org/ document/6386109. 33

    2012

  148. [163]

    Efros, and Angjoo Kanazawa

    Qianqian Wang, Yifei Zhang, Aleksander Holynski, Alexei A. Efros, and Angjoo Kanazawa. Continuous 3Dperceptionmodelwithpersistentstate. arXivpreprintarXiv:2501.12387 , 2025. URLhttps://arxiv. org/abs/2501.12387

    2025 arXiv

  149. [164]

    URL https://arxiv.org/abs/2502.10498

  150. [165]

    Solving math word problems with process- and outcome- based feedback.arXiv preprint arXiv:2211.14275, 2022

    Jonathan Uesato, Nate Kushman, Ramana Kumar, Francis Song, Noah Siegel, Lisa Wang, Antonia Creswell, Geoffrey Irving, and Irina Higgins. Solving math word problems with process- and outcome- based feedback.arXiv preprint arXiv:2211.14275, 2022. URLhttps://arxiv.org/abs/2211.14275

    2022 arXiv

  151. [166]

    Chen, Ashesh Rambachan, Jon Kleinberg, and Sendhil Mullainathan

    Keyon Vafa, Justin Y. Chen, Ashesh Rambachan, Jon Kleinberg, and Sendhil Mullainathan. Evaluating the world model implicit in a generative model. InAdv. Neural Inf. Process. Syst., volume 37, 2024. URL https://arxiv.org/abs/2406.03689

    2024 arXiv

  152. [167]

    Agent world model: Infinity synthetic environments for agentic reinforcement learning

    Zhaoyang Wang, Canwen Xu, Boyi Liu, Yite Wang, Siwei Han, Zhewei Yao, Huaxiu Yao, and Yuxiong He. Agent world model: Infinity synthetic environments for agentic reinforcement learning. InInt. Conf. Mach. Learn., 2026. URLhttps://arxiv.org/abs/2602.10090

    2026 arXiv

  153. [168]

    RAGEN: Understanding self-evolution in LLM agents via multi-turn reinforcement learning.arXiv preprint arXiv:2504.20073, 2025

    Zihan Wang, Kangrui Wang, Qineng Wang, Pingyue Zhang, Linjie Li, Zhengyuan Yang, Xing Jin, Kefan Yu, Minh Nhat Nguyen, Licheng Liu, et al. RAGEN: Understanding self-evolution in LLM agents via multi-turn reinforcement learning.arXiv preprint arXiv:2504.20073, 2025. URL https:/...

    2025 arXiv

  154. [169]

    MCVD: Masked conditional video dif- fusion for prediction, generation, and interpolation

    Vikram Voleti, Alexia Jolicoeur-Martineau, and Christopher Pal. MCVD: Masked conditional video dif- fusion for prediction, generation, and interpolation. In Adv. Neural Inf. Process. Syst., 2022. URL https://arxiv.org/abs/2205.09853

    2022 arXiv

  155. [170]

    Marble: A multimodal world model

    World Labs Team. Marble: A multimodal world model. World Labs Technical Post, 2025. URLhttps: //www.worldlabs.ai/blog/marble-world-model

    2025

  156. [171]

    3D reconstruction with spatial memory

    Hengyi Wang and Lourdes Agapito. 3D reconstruction with spatial memory. InInt. Conf. 3D Vis., 2025. URL https://arxiv.org/abs/2408.16061

    2025 arXiv

  157. [172]

    iVideoGPT: Interactive VideoGPTs are scalable world models

    Jialong Wu, Shaofeng Yin, Ningya Feng, Xu He, Dong Li, Jianye Hao, and Mingsheng Long. iVideoGPT: Interactive VideoGPTs are scalable world models. InAdv. Neural Inf. Process. Syst., volume 37, pages 68082–68119, 2024. URLhttps://arxiv.org/abs/2405.15223

    2024 arXiv

  158. [173]

    MVISTA-4D: View-consistent 4D world model with test-time action inference for robotic manipulation.arXiv preprint arXiv:2602.09878, 2026

    Jiaxu Wang, Yicheng Jiang, Tianlun He, Jingkai Sun, Qiang Zhang, Junhao He, Jiahang Cao, Zesen Gan, Mingyuan Sun, Qiming Shao, and Xiangyu Yue. MVISTA-4D: View-consistent 4D world model with test-time action inference for robotic manipulation.arXiv preprint arXiv:2602.09878, 2...

    2026 arXiv

  159. [174]

    Memharness: Memory is reconstructed, not replayed.arXiv preprint arXiv:2607.28272, 2026

    Rong Wu, Daocheng Fu, Licheng Wen, Xuemeng Yang, Shu Zou, Jianbiao Mei, Yuxin Wang, Hairong Zhang, Yu Yang, Tao Hu, et al. Memharness: Memory is reconstructed, not replayed.arXiv preprint arXiv:2607.28272, 2026. URLhttps://arxiv.org/abs/2607.28272

    2026 arXiv

  160. [175]

    Peiyi Wang, Lei Li, Zhihong Shao, R. X. Xu, Damai Dai, Yifei Li, Deli Chen, Y. Wu, and Zhifang Sui. Math- Shepherd: Verify and reinforce LLMs step-by-step without human annotations. InAnnu. Meet. Assoc. Comput. Linguist., 2024. URLhttps://arxiv.org/abs/2312.08935

    2024 arXiv

  161. [176]

    CityDreamer: Compositionalgenerativemodel of unbounded 3D cities

    HaozheXie,ZhaoxiChen,FangzhouHong,andZiweiLiu. CityDreamer: Compositionalgenerativemodel of unbounded 3D cities. InIEEE/CVF Conf. Comput. Vis. Pattern Recog., 2024. URLhttps://arxiv.org/ abs/2309.00610

    2024 arXiv

  162. [177]

    MindCube: Spatial mental modeling from limited views

    Qineng Wang, Baiqiao Yin, Pingyue Zhang, Jianshu Zhang, Kangrui Wang, Zihan Wang, Jieyu Zhang, Keshigeyan Chandrasegaran, et al. MindCube: Spatial mental modeling from limited views. arXiv preprint arXiv:2506.21458, 2025. URLhttps://arxiv.org/abs/2506.21458

    2025

  163. [178]

    DUSt3R: Geometric 3D vision made easy

    Shuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii, and Jerome Revaud. DUSt3R: Geometric 3D vision made easy. InIEEE/CVF Conf. Comput. Vis. Pattern Recog., 2024. URL https://arxiv.org/ abs/2312.14132. 34

    2024 arXiv

  164. [179]

    DriveDreamer: Towards real-world-driven world models for autonomous driving

    Xiaofeng Wang, Zheng Zhu, Guan Huang, Xinze Chen, Jiagang Zhu, and Jiwen Lu. DriveDreamer: Towards real-world-driven world models for autonomous driving. InEur. Conf. Comput. Vis., 2024. URL https://arxiv.org/abs/2309.09777

    2024 arXiv

  165. [180]

    SafeDream: Safety world model for proactive early jailbreak detection.arXiv preprint arXiv:2604.16824, 2026

    Bo Yan, Weikai Lin, Yada Zhu, and Song Wang. SafeDream: Safety world model for proactive early jailbreak detection.arXiv preprint arXiv:2604.16824, 2026. URLhttps://arxiv.org/abs/2604.16824. 35

    2026 arXiv

  166. [181]

    AD-R1: Closed-loopreinforcementlearningforend-to-endautonomousdrivingwithimpartial world models

    TianyiYan,TaoTang,XingtaiGui,YongkangLi,JiasenZheng,WeiyaoHuang,LingdongKong,Wencheng Han,etal. AD-R1: Closed-loopreinforcementlearningforend-to-endautonomousdrivingwithimpartial world models. In IEEE/CVF Conf. Comput. Vis. Pattern Recog., pages 1085–1095, 2026. URL https: //a...

    2026

  167. [182]

    Le, and Denny Zhou

    Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed Chi, Quoc V. Le, and Denny Zhou. Chain-of-thought prompting elicits reasoning in large language models. InAdv. Neural Inf. Process. Syst., volume 35, pages 24824–24837, 2022. URLhttps://arxiv.org...

    2022 arXiv

  168. [183]

    Liang, Mikael Henaff, Hao Tang, Ang Cao, Joyce Chai, Franziska Meier, and Matt Feiszli

    Jianing Yang, Alexander Sax, Kevin J. Liang, Mikael Henaff, Hao Tang, Ang Cao, Joyce Chai, Franziska Meier, and Matt Feiszli. Fast3R: Towards 3D reconstruction of 1000+ images in one forward pass.arXiv preprint arXiv:2501.13928, 2025. URLhttps://arxiv.org/abs/2501.13928

    2025 arXiv

  169. [184]

    4Dgaussiansplattingforreal-timedynamicscenerendering

    Guanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie, Xiaopeng Zhang, Wei Wei, Wenyu Liu, Qi Tian, and XinggangWang. 4Dgaussiansplattingforreal-timedynamicscenerendering. In IEEE/CVFConf.Comput. Vis. Pattern Recog., 2024. URLhttps://arxiv.org/abs/2310.08528

    2024 arXiv

  170. [185]

    Driving in the occupancy world: Vision-centric 4d occupancy forecasting and planning via world models for autonomous driving

    Yu Yang, Jianbiao Mei, Yukai Ma, Siliang Du, Wenqing Chen, Yijie Qian, Yuxiang Feng, and Yong Liu. Driving in the occupancy world: Vision-centric 4d occupancy forecasting and planning via world models for autonomous driving. InAAAI Conf. Artif. Intell., volume 39, pages 9327–9...

    2025 arXiv

  171. [186]

    DayDreamer: World models for physical robot learning

    PhilippWu, AlejandroEscontrela, DanijarHafner, KenGoldberg, andPieterAbbeel. DayDreamer: World models for physical robot learning. InConf. Robot Learn., 2023. URL https://arxiv.org/abs/2206. 14176

    2023

  172. [187]

    SPIRAL: Self-evolving action-conditioned video generation via reflective planning agents.arXiv preprint arXiv:2603.08403, 2026

    Yu Yang, Yue Liao, Jianbiao Mei, Baisen Wang, Xuemeng Yang, Licheng Wen, Jiangning Zhang, Xiangtai Li, Liang Lv, Hanlin Chen, et al. SPIRAL: Self-evolving action-conditioned video generation via reflective planning agents.arXiv preprint arXiv:2603.08403, 2026. URLhttps://arxiv...

    2026 arXiv

  173. [188]

    WebWorld: A large-scale world model for web agent training.arXiv preprint arXiv:2602.14721, 2026

    Zikai Xiao, Jianhong Tu, Chuhang Zou, Yuxin Zuo, Zhi Li, Peng Wang, Bowen Yu, Fei Huang, Junyang Lin, and Zuozhu Liu. WebWorld: A large-scale world model for web agent training.arXiv preprint arXiv:2602.14721, 2026. URLhttps://arxiv.org/abs/2602.14721

    2026

  174. [189]

    ReAct: Synergizing reasoning and acting in language models

    Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. ReAct: Synergizing reasoning and acting in language models. InInt. Conf. Learn. Represent., 2023. URLhttps: //arxiv.org/abs/2210.03629

    2023 arXiv

  175. [190]

    OSWorld: Benchmarkingmultimodalagentsforopen-endedtasksinrealcomputer environments

    Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li, Siheng Zhao, Ruisheng Cao, Toh Jing Hua, ZhoujunCheng,etal. OSWorld: Benchmarkingmultimodalagentsforopen-endedtasksinrealcomputer environments. InAdv. Neural Inf. Process. Syst., volume 37, 2024. URLhttps://arxiv.org/abs/2...

    2024

  176. [191]

    CtrlAttack: Aunifiedattackonworld-modelcontrolindiffusionmodels

    ShuhanXu,SiyuanLiang,HonglingZheng,YongLuo,HanHu,LefeiZhang,andDachengTao. CtrlAttack: Aunifiedattackonworld-modelcontrolindiffusionmodels. arXivpreprintarXiv:2603.13435 ,2026. URL https://arxiv.org/abs/2603.13435

    2026

  177. [192]

    U4D: Uncertainty-aware 4D world modeling from LiDAR sequences

    Xiang Xu, Ao Liang, Youquan Liu, Linfeng Li, Lingdong Kong, Ziwei Liu, and Qingshan Liu. U4D: Uncertainty-aware 4D world modeling from LiDAR sequences. InIEEE/CVF Conf. Comput. Vis. Pattern Recog., pages 10027–10039, 2026. URLhttps://arxiv.org/abs/2512.02982

    2026

  178. [193]

    Vismem: Latent vision memory unlocks potential of vision-language models

    Xinlei Yu, Chengming Xu, Guibin Zhang, Zhangquan Chen, Yudong Zhang, Yongbo He, Peng-Tao Jiang, Jiangning Zhang, Xiaobin Hu, and Shuicheng Yan. Vismem: Latent vision memory unlocks potential of vision-language models. arXiv preprint arXiv:2511.11007, 2025. URL https://arxiv.or...

    2025

  179. [194]

    Thelatentspace: Foundation,evolution,mechanism,ability,andoutlook

    Xinlei Yu, Zhangquan Chen, Yongbo He, Tianyu Fu, Guanting Dong, Cheng Yang, Chengming Xu, Yue Ma,XiaobinHu,ZheCao,etal. Thelatentspace: Foundation,evolution,mechanism,ability,andoutlook. arXiv preprint arXiv:2604.02029, 2026. URLhttps://arxiv.org/abs/2604.02029. 36

    2026 arXiv

  180. [195]

    VideoGPT: Video generation using VQ- VAE and transformers

    Wilson Yan, Yunzhi Zhang, Pieter Abbeel, and Aravind Srinivas. VideoGPT: Video generation using VQ- VAE and transformers. arXiv preprint arXiv:2104.10157, 2021. URL https://arxiv.org/abs/2104. 10157

    2021 arXiv

  181. [196]

    RRHF: Rank responses to align language models with human feedback without tears

    Zheng Yuan, Hongyi Yuan, Chuanqi Tan, Wei Wang, Songfang Huang, and Fei Huang. RRHF: Rank responses to align language models with human feedback without tears. InAdv. Neural Inf. Process. Syst.,

  182. [197]

    Learning interactive real-world simulators

    Sherry Yang, Yilun Du, Seyed Kamyar Seyed Ghasemipour, Jonathan Tompson, Leslie Pack Kaelbling, Dale Schuurmans, and Pieter Abbeel. Learning interactive real-world simulators. InInt. Conf. Learn. Represent., 2024. URLhttps://arxiv.org/abs/2310.06114

    2024 arXiv

  183. [198]

    World models: The safety perspective.arXiv preprint arXiv:2411.07690, 2024

    ZifanZeng,ChongzheZhang,FengLiu,JosephSifakis,QunliZhang,ShimingLiu,andPengWang. World models: The safety perspective.arXiv preprint arXiv:2411.07690, 2024. URLhttps://arxiv.org/abs/ 2411.07690

    2024 arXiv

  184. [199]

    X-scene: Large-scale driving scenegenerationwithhighfidelityandflexiblecontrollability

    Yu Yang, Alan Liang, Jianbiao Mei, Yukai Ma, Yong Liu, and Gim Hee Lee. X-scene: Large-scale driving scenegenerationwithhighfidelityandflexiblecontrollability. In Adv.NeuralInf.Process.Syst. ,volume38, pages 104415–104451, 2026. URLhttps://arxiv.org/abs/2506.13558

    2026

  185. [200]

    Critic-V: VLM critics help catch VLM errors in multimodal reasoning

    Di Zhang, Junxian Li, Jingdi Lei, Xunzhi Wang, Yujie Liu, Zonglin Yang, Jiatong Li, Weida Wang, et al. Critic-V: VLM critics help catch VLM errors in multimodal reasoning. InIEEE/CVF Conf. Comput. Vis. Pattern Recog., pages 9050–9061, 2025. URLhttps://arxiv.org/abs/2411.18203

    2025 arXiv

  186. [201]

    Griffiths, Yuan Cao, and Karthik Narasimhan

    Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L. Griffiths, Yuan Cao, and Karthik Narasimhan. Tree of thoughts: Deliberate problem solving with large language models. InAdv. Neural Inf. Process. Syst., volume 36, 2023. URLhttps://arxiv.org/abs/2305.10601

    2023 arXiv

  187. [202]

    MonST3R: A simple approach for estimating geometry in the presence of motion

    Junyi Zhang, Charles Herrmann, Junhwa Hur, Varun Jampani, Trevor Darrell, Forrester Cole, Deqing Sun, and Ming-Hsuan Yang. MonST3R: A simple approach for estimating geometry in the presence of motion. InInt. Conf. Learn. Represent., 2025. URLhttps://arxiv.org/abs/2410.03825

    2025 arXiv

  188. [203]

    Plenoxels: Radiancefieldswithoutneuralnetworks

    Alex Yu, Sara Fridovich-Keil, Matthew Tancik, Qinhong Chen, Benjamin Recht, and Angjoo Kanazawa. Plenoxels: Radiancefieldswithoutneuralnetworks. In IEEE/CVFConf.Comput.Vis.PatternRecog. ,pages 5501–5510, 2022. URLhttps://arxiv.org/abs/2112.05131

    2022 arXiv

  189. [204]

    Freeman, and Jiajun Wu

    Hong-Xing Yu, Haoyi Duan, Charles Herrmann, William T. Freeman, and Jiajun Wu. WonderWorld: Interactive 3D scene generation from a single image. InIEEE/CVF Conf. Comput. Vis. Pattern Recog.,

  190. [205]

    URL https://arxiv.org/abs/2406.09394

    arXiv

  191. [206]

    GameFactory: Creating new gameswithgenerativeinteractivevideos

    Jiwen Yu, Yiran Qin, Xintao Wang, Pengfei Wan, Di Zhang, and Xihui Liu. GameFactory: Creating new gameswithgenerativeinteractivevideos. In IEEE/CVFInt.Conf.Comput.Vis. ,pages11590–11599,2025. URL https://arxiv.org/abs/2501.08325

    2025

  192. [207]

    Matrix-Game: Interactive world foundation model.arXiv preprint arXiv:2506.18701, 2025

    YifanZhang, Chunli Peng, BoyangWang, Puyi Wang, QingchengZhu, FeiKang, BiaoJiang, ZedongGao, Eric Li, Yang Liu, and Yahui Zhou. Matrix-Game: Interactive world foundation model.arXiv preprint arXiv:2506.18701, 2025. URLhttps://arxiv.org/abs/2506.18701

    2025 arXiv

  193. [208]

    Occupancy world model for robots.arXiv preprint arXiv:2505.05512, 2025

    Zhang Zhang, Qiang Zhang, Wei Cui, Shuai Shi, Yijie Guo, Gang Han, Wen Zhao, Jingkai Sun, et al. Occupancy world model for robots.arXiv preprint arXiv:2505.05512, 2025. URLhttps://arxiv.org/ abs/2505.05512

    2025 arXiv

  194. [209]

    Mip-Splatting: Alias-free 3D gaussian splatting

    Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler, and Andreas Geiger. Mip-Splatting: Alias-free 3D gaussian splatting. InIEEE/CVF Conf. Comput. Vis. Pattern Recog., pages 19447–19456, 2024. URL https://arxiv.org/abs/2311.16493

    2024 arXiv

  195. [210]

    Judging LLM-as-a-judge with MT-Bench and chatbot arena

    Lianmin Zheng, Wei-Lin Chiang, Ying Sheng, Siyuan Zhuang, Zhanghao Wu, Yonghao Zhuang, Zi Lin, Zhuohan Li, et al. Judging LLM-as-a-judge with MT-Bench and chatbot arena. InAdv. Neural Inf. Process. Syst., 2023. URLhttps://arxiv.org/abs/2306.05685

    2023 arXiv

  196. [211]

    URL https://arxiv.org/abs/2304.05302

    arXiv

  197. [212]

    Transporter networks: Rearranging the visual world for robotic manipulation

    Andy Zeng, Pete Florence, Jonathan Tompson, Stefan Welker, Jonathan Chien, Maria Attarian, Travis Armstrong, Ivan Krasin, Dan Duong, Ayzaan Wahid, Vikas Sindhwani, and Johnny Lee. Transporter networks: Rearranging the visual world for robotic manipulation. InConf. Robot Learn....

    2020 arXiv

  198. [213]

    Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig

    Shuyan Zhou, Frank F. Xu, Hao Zhu, Xuhui Zhou, Robert Lo, Abishek Sridhar, Xianyi Cheng, Tianyue Ou, Yonatan Bisk, Daniel Fried, Uri Alon, and Graham Neubig. WebArena: A realistic web environment for building autonomous agents. InInt. Conf. Learn. Represent., 2024. URL https:/...

    2024 arXiv

  199. [214]

    How to enable LLM with 3D capacity? a survey of spatial reasoning in LLM

    Jirong Zha, Yuxuan Fan, Xiao Yang, Chen Gao, and Xinlei Chen. How to enable LLM with 3D capacity? a survey of spatial reasoning in LLM. InInt. Joint Conf. Artif. Intell., pages 10817–10825, 2025. URL https://arxiv.org/abs/2504.05786

    2025

  200. [215]

    Is Sora a world simulator? a comprehensive survey on general world models and beyond.arXiv preprint arXiv:2405.03520, 2024

    Zheng Zhu, Xiaofeng Wang, Wangbo Zhao, Chen Min, Bohan Li, Nianchen Deng, Min Dou, Yuqi Wang, et al. Is Sora a world simulator? a comprehensive survey on general world models and beyond.arXiv preprint arXiv:2405.03520, 2024. URLhttps://arxiv.org/abs/2405.03520

    2024

  201. [216]

    Text2NeRF: Text-driven 3D scene genera- tion with neural radiance fields.IEEE Trans

    Jingbo Zhang, Xiaoyu Li, Ziyu Wan, Can Wang, and Jing Liao. Text2NeRF: Text-driven 3D scene genera- tion with neural radiance fields.IEEE Trans. Vis. Comput. Graph., 2024. URLhttps://arxiv.org/abs/ 2305.11588

    2024 arXiv

  202. [218]

    Agent learning via early experience

    Kai Zhang, Xiangchao Chen, Bo Liu, Tianci Xue, Zeyi Liao, Zhihan Liu, Xiyao Wang, Yuting Ning, et al. Agent learning via early experience. InInt. Conf. Mach. Learn., 2026. URL https://arxiv.org/abs/ 2510.08558

    2026 arXiv

  203. [219]

    Copilot4D: Learning unsupervised world models for autonomous driving via discrete diffusion

    Lunjun Zhang, Yuwen Xiong, Ze Yang, Sergio Casas, Rui Hu, and Raquel Urtasun. Copilot4D: Learning unsupervised world models for autonomous driving via discrete diffusion. InInt. Conf. Learn. Represent.,

  204. [220]

    URL https://arxiv.org/abs/2311.01017

    arXiv

  205. [221]

    STORM: Efficient stochastic trans- former based world models for reinforcement learning

    Weipu Zhang, Gang Wang, Jian Sun, Yetian Yuan, and Gao Huang. STORM: Efficient stochastic trans- former based world models for reinforcement learning. InAdv. Neural Inf. Process. Syst., volume 36,

  206. [222]

    URL https://arxiv.org/abs/2310.09615

    arXiv

  207. [223]

    SearchGym: Bootstrapping real-world search agents via cost-effective and high-fidelity environment simulation

    Xichen Zhang, Ziyi He, Yinghao Zhu, Sitong Wu, Shaozuo Yu, Meng Chu, Wenhu Zhang, Haoru Tan, and Jiaya Jia. SearchGym: Bootstrapping real-world search agents via cost-effective and high-fidelity environment simulation. arXiv preprint arXiv:2601.14615, 2026. URL https://arxiv.o...

    2026

  208. [226]

    TesserAct: Learning 4D embodied world models.arXiv preprint arXiv:2504.20995, 2025

    Haoyu Zhen, Qiao Sun, Hongxin Zhang, Junyan Li, Siyuan Zhou, Yilun Du, and Chuang Gan. TesserAct: Learning 4D embodied world models.arXiv preprint arXiv:2504.20995, 2025. URL https://arxiv. org/abs/2504.20995. 37

    2025 arXiv

  209. [228]

    OccWorld: Learning a 3D occupancy world model for autonomous driving

    Wenzhao Zheng, Weiliang Chen, Yuanhui Huang, Borui Zhang, Yueqi Duan, and Jiwen Lu. OccWorld: Learning a 3D occupancy world model for autonomous driving. InEur. Conf. Comput. Vis., 2024. URL https://arxiv.org/abs/2311.16038

    2024 arXiv

  210. [229]

    Code2World: A GUI world model via renderable code generation.arXiv preprint arXiv:2602.09856, 2026

    Yuhao Zheng, Li’an Zhong, Yi Wang, Rui Dai, Kaikui Liu, Xiangxiang Chu, Linyuan Lv, Philip Torr, and Kevin Qinghong Lin. Code2World: A GUI world model via renderable code generation.arXiv preprint arXiv:2602.09856, 2026. URLhttps://arxiv.org/abs/2602.09856

    2026

  211. [231]

    Aether: Geometric-aware unified world modeling

    Haoyi Zhu, Yifan Wang, Jianjun Zhou, Wenzheng Chang, Yang Zhou, Zizun Li, Junyi Chen, Chunhua Shen, Jiangmiao Pang, and Tong He. Aether: Geometric-aware unified world modeling. InIEEE/CVF Int. Conf. Comput. Vis., pages 8535–8546, 2025. URLhttps://arxiv.org/abs/2503.18945

    2025 arXiv

  212. [233]

    Ziegler, Nisan Stiennon, Jeffrey Wu, Tom B

    Daniel M. Ziegler, Nisan Stiennon, Jeffrey Wu, Tom B. Brown, Alec Radford, Dario Amodei, Paul Chris- tiano, and Geoffrey Irving. Fine-tuning language models from human preferences. arXiv preprint arXiv:1909.08593, 2019. URLhttps://arxiv.org/abs/1909.08593. 38

    1909 arXiv

  213. [2019]

    URL https://arxiv.org/abs/1811.04551

    arXiv

  214. [2020]

    URL https://arxiv.org/abs/1903.00374

    1903 arXiv

  215. [2023]

    URL https://arxiv.org/abs/2209.07753

    arXiv

  216. [2024]

    URL https://arxiv.org/abs/2410.18072

    arXiv

  217. [2025]

    URL https://arxiv.org/abs/2510.08713

  218. [2026]

    URL https://arxiv.org/abs/2603.26741

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.