REVIEW 4 cited by
WorldCoder, a Model-Based LLM Agent: Building World Models by Writing Code and Interacting with the Environment
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We give a model-based agent that builds a Python program representing its knowledge of the world based on its interactions with the environment. The world model tries to explain its interactions, while also being optimistic about what reward it can achieve. We define this optimism as a logical constraint between a program and a planner. We study our agent on gridworlds, and on task planning, finding our approach is more sample-efficient compared to deep RL, more compute-efficient compared to ReAct-style agents, and that it can transfer its knowledge across environments by editing its code.
Forward citations
Cited by 4 Pith papers
-
Programmatic Video Prediction Using Large Language Models
ProgGen uses language-model-written programs for perception, dynamics, and rendering to predict future video frames from about ten training examples, beating large diffusion baselines on two synthetic benchmarks.
-
Quo Vadis, World Modeling?
An agent-centric reframing of world modeling, replacing physical state prediction with 'information transitions' organized into six proxy functions and three empowerment levels.
-
VisualPatchWorld: Code World Models as Latent Structured Representations for Planning
A two-level induction procedure—active-probe sketch selection plus multi-step rollout fitting—recovers executable code world models that improve CEM planning over prior code baselines on four LeWM tasks.
-
Generating Symbolic World Models via Test-time Scaling of Large Language Models
Best-of-N sampling plus iterative self-critique, called iVML, lets a 7B open LLM generate PDDL planning domains with over 85% and 71% success on two benchmarks, outperforming o1-mini.
Discussion (0). Continue with ORCID to comment.