pith. sign in

Learning from trials and errors: Reflective test-time planning for embodied LLMs

3 Pith papers cite this work. Polarity classification is still indexing.

3 Pith papers citing it
abstract

Embodied LLMs endow robots with high-level task reasoning, but they cannot reflect on what went wrong or why, turning deployment into a sequence of independent trials where mistakes repeat rather than accumulate into experience. Drawing upon human reflective practitioners, we introduce Reflective Test-Time Planning, which integrates two modes of reflection: \textit{reflection-in-action}, where the agent uses test-time scaling to generate and score multiple candidate actions using internal reflections before execution; and \textit{reflection-on-action}, which uses test-time training to update both its internal reflection model and its action policy based on external reflections after execution. We also include retrospective reflection, allowing the agent to re-evaluate earlier decisions and perform model updates with hindsight for proper long-horizon credit assignment. Experiments on our newly-designed Long-Horizon Household benchmark and MuJoCo Cupboard Fitting benchmark show significant gains over baseline models, with zero-shot generalization to photorealistic HM3D environments and real-robot experiments on a Franka Panda arm. Ablations confirm that reflection-in-action and reflection-on-action are mutually dependent, and that retrospective reflection achieves better credit assignment than step-wise external feedback at lower computational overhead. Qualitative analyses further highlight behavioral correction through reflection.

citation-role summary

background 1

citation-polarity summary

fields

cs.AI 2 cs.LG 1

years

2026 3

verdicts

UNVERDICTED 3

roles

background 1

polarities

background 1

clear filters

representative citing papers

AdaJEPA: An Adaptive Latent World Model

cs.LG · 2026-06-30 · unverdicted · novelty 5.0

AdaJEPA performs closed-loop test-time adaptation of latent world models during MPC by executing an action chunk, observing the transition, and taking one gradient step on the model before replanning, yielding higher goal-reaching success.

citing papers explorer

Showing 2 of 2 citing papers after filters.