REVIEW 7 cited by
EWMBench: Evaluating Scene, Motion, and Semantic Quality in Embodied World Models
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Recent advances in creative AI have enabled the synthesis of high-fidelity images and videos conditioned on language instructions. Building on these developments, text-to-video diffusion models have evolved into embodied world models (EWMs) capable of generating physically plausible scenes from language commands, effectively bridging vision and action in embodied AI applications. This work addresses the critical challenge of evaluating EWMs beyond general perceptual metrics to ensure the generation of physically grounded and action-consistent behaviors. We propose the Embodied World Model Benchmark (EWMBench), a dedicated framework designed to evaluate EWMs based on three key aspects: visual scene consistency, motion correctness, and semantic alignment. Our approach leverages a meticulously curated dataset encompassing diverse scenes and motion patterns, alongside a comprehensive multi-dimensional evaluation toolkit, to assess and compare candidate models. The proposed benchmark not only identifies the limitations of existing video generation models in meeting the unique requirements of embodied tasks but also provides valuable insights to guide future advancements in the field. The dataset and evaluation tools are publicly available at https://github.com/AgibotTech/EWMBench.
Forward citations
Cited by 7 Pith papers
-
WorldSimProbe: Diagnosing Simulator Faithfulness in Action-Conditioned World Models for Embodied Manipulation
WorldSimProbe is a five-suite benchmark showing that six action-conditioned world models systematically degrade in action-to-motion fidelity and interaction grounding across RoboTwin, ManiSkill, and LIBERO.
-
verdi: retrieval is not transfer for continual world model optimization
A continual world-model optimization framework in which retrieved strategies are hypotheses until verified under a frozen target-side evaluator; on three world-model families it cuts search and GPU cost by roughly two...
-
WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity
Across 1,474 cases and 20 models, WorldExam shows that video world models split along paradigm lines — camera-, action-, and language-driven models each dominate one capability, and none combines strong reactivity wit...
-
A Comprehensive Survey on World Models for Embodied AI
A unified three-axis taxonomy — functionality, temporal modeling, spatial representation — organizes the world-model literature for embodied AI.
-
WorldEval: World Model as Real-World Robot Policies Evaluator
WorldEval conditions a video generation model on a policy's internal action embeddings (Policy2Vec) and shows generated-video success rates correlate with real-world robot success rates.
-
A Definition and Roadmap for World Models
A perspective article defining world models as finite-resource compression of physical state transitions and outlining a roadmap toward physical AGI via unified representations and interactive simulators.
-
FaceAnonyMixer: Cancelable Faces via Identity Consistent Latent Space Mixing
FaceAnonyMixer claims a cancelable face generation method that irreversibly mixes real latent codes with key-derived synthetic codes for privacy-preserving face recognition.
Discussion (0). Continue with ORCID to comment.