Pith. sign in

REVIEW 3 cited by

ViMo: A Generative Visual GUI World Model for App Agents

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2504.13936 v2 pith:PKD6Q5MF submitted 2025-04-15 cs.HC cs.LGcs.SYeess.SY

classification cs.HCcs.LGcs.SYeess.SY
keywords textvimoworldagentsgeneratingguisvisualactions
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

App agents, which autonomously operate mobile Apps through Graphical User Interfaces (GUIs), have gained significant interest in real-world applications. Yet, they often struggle with long-horizon planning, failing to find the optimal actions for complex tasks with longer steps. To address this, world models are used to predict the next GUI observation based on user actions, enabling more effective agent planning. However, existing world models primarily focus on generating only textual descriptions, lacking essential visual details. To fill this gap, we propose ViMo, the first visual world model designed to generate future App observations as images. For the challenge of generating text in image patches, where even minor pixel errors can distort readability, we decompose GUI generation into graphic and text content generation. We propose a novel data representation, the Symbolic Text Representation~(STR) to overlay text content with symbolic placeholders while preserving graphics. With this design, ViMo employs a STR Predictor to predict future GUIs' graphics and a GUI-text Predictor for generating the corresponding text. Moreover, we deploy ViMo to enhance agent-focused tasks by predicting the outcome of different action options. Experiments show ViMo's ability to generate visually plausible and functionally effective GUIs that enable App agents to make more informed decisions.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents

    cs.AI 2026-08 conditional novelty 6.0 of 10

    AppDeltaWorld predicts mobile GUI transitions as code updates retrieved under action constraints, and its generated trajectories improve an 8B mobile agent on several benchmarks.

  2. Why Are GUI Agents Correct but Late? Decode on the Decision-Time Critical Path, Tested with Pre-Compiled Policy Trees

    cs.LG 2026-07 conditional novelty 6.0 of 10

    Removing autoregressive decode from the decision-time critical path via pre-compiled guarded policy trees recovers contested GUI action windows when outcomes are enumerable in advance.

  3. Quo Vadis, World Modeling?

    cs.CV 2026-08 conditional novelty 5.0 of 10

    An agent-centric reframing of world modeling, replacing physical state prediction with 'information transitions' organized into six proxy functions and three empowerment levels.

Pith tools