Persona Prompting in Multimodal Urban Perception: Descriptive Convergence and Interpretive Variation

Daniel Silver; Matt Ratto; Myriam Delgado; Neemias da Silva; Rodrigo Minetto; Thiago H Silva

Persona Prompting in Multimodal Urban Perception: Descriptive Convergence and Interpretive Variation

T0 review · 3 major / 0 minor · reviewed 2026-06-29 · grok-4.3

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Persona prompts make multimodal LLMs vary their justifications for urban scenes while captions converge and perception tags stay similar.

desk verdict The paper finds persona effects mainly in justifications but the abstract leaves the prompting isolation and stats too thin to verify the claims. read the letter →

arxiv 2605.29064 v2 pith:EVFZZCXP submitted 2026-05-27 cs.CL cs.CVcs.HCcs.MA

Neemias da Silva , Matt Ratto , Myriam Delgado , Rodrigo Minetto , Daniel Silver , Thiago H Silva This is my paper · ORCID

classification cs.CLcs.CVcs.HCcs.MA

keywords personapromptingmultimodalLLMurbanperceptiongeneratedexplanationscaptionsjustificationstagstopicanalysis

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tests whether assigning socioeconomic or political personas to multimodal LLM agents changes the language they produce when describing the same city images. Across 59,808 annotations it finds that short captions remain largely the same regardless of persona, yet the longer justifications shift in ways that track the assigned attributes, and topic modeling shows each persona group highlighting different evaluative themes. Perception tags show only weak, non-significant trends. A reader would care because the result indicates that persona prompting can steer explanatory text in a measurable, attribute-linked manner without altering the core visual summary.

What carries the argument

Persona-conditioned generation of three output types—captions, justifications, and perception tags—analyzed for convergence, attribute-linked variation, and thematic emphasis.

What would settle it

A replication study that holds model, prompt structure, and image set fixed but finds no systematic alignment between assigned persona attributes and justification content would falsify the central claim.

Watch

Extended reading notes

Core claim

Using 1,200 persona-conditioned multimodal LLM agents plus two no-persona controls on urban images, the study shows strong convergence across personas in the generated captions, systematic variation in justifications that correlates with socioeconomic and political persona attributes, no statistically significant persona effects on perception tags though directional trends appear, and distinct evaluative themes emphasized by different personas in topic analysis of the same scenes.

Load-bearing premise

The study assumes that persona prompting successfully conditions the multimodal LLM outputs to reflect distinct socioeconomic and political attributes in a controllable and measurable way, without the observed variations arising primarily from other uncontrolled factors in the model or prompt construction.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Desk Editor's Note

read the letter

The main thing to know is that captions converge across personas while justifications vary with socioeconomic and political attributes, tags show no significant differences, and topic analysis picks up different emphases. They ran this on 59808 annotations from 1200 agents plus baselines in a multimodal urban perception setup.

The scale and the split across output types (captions vs justifications vs tags) plus the topic breakdown is a reasonable extension of persona work to this domain. It gives a concrete look at where the variation appears and where it does not.

The soft spots are the missing method details. The abstract gives no information on the exact statistical tests, multiple-comparison handling, how the personas were worded, or whether the prompt template stayed identical except for the persona clause. The stress-test concern holds: without that, the reported associations could come from prompt structure differences or other factors rather than the intended attributes. The assumption that persona prompting cleanly conditions the outputs is not checkable from what is here.

This is for people working on prompt effects in applied multimodal settings or urban AI. A reader already studying persona variation might pull the dataset size or the output-type split, but the work stays narrow and observational.

Send it to peer review once the full methods and stats are supplied; the design has enough structure to be worth referee time even if revisions are needed.

Referee Report

3 major / 0 minor

Summary. The manuscript presents an empirical study examining how persona prompting influences outputs from multimodal LLMs in an urban perception task. It generates 59,808 annotations from 1,200 persona-conditioned agents plus two no-persona baselines, then analyzes captions, justifications, and perception tags. The central claims are that captions show strong convergence across personas, justifications exhibit systematic variation linked to socioeconomic and political attributes, perception tags show no statistically significant persona-related differences (though trends appear), and topic analysis reveals personas emphasizing different evaluative themes for the same scenes.

Significance. If the results hold after methodological clarification, the work would provide large-scale observational evidence that persona conditioning affects certain components of LLM-generated explanations more than others in a perception setting. The experiment scale (nearly 60k annotations) supplies substantial data volume for detecting patterns, which is a positive aspect of the design. This could inform research on controllability and attribute-specific biases in multimodal models applied to urban studies.

major comments (3)

[Abstract] Abstract: The claims of 'systematic variation associated with socioeconomic and political attributes' and 'no statistically significant persona-related differences' are presented without any description of the statistical tests, p-value thresholds, multiple-comparison corrections, or methods for quantifying and associating persona attributes with outputs. These details are required to substantiate the central empirical findings.
[Methods] Methods (prompt construction): The abstract supplies no information on whether prompt templates were held strictly constant across persona conditions, with only the persona descriptor varying, or whether other elements (sentence structure, added instructions, or length) differed systematically between socioeconomic or political groups. Without explicit standardization, the reported variations in justifications cannot be confidently attributed to the persona attributes rather than prompt artifacts.
[Methods] Methods (persona definition): Details on how the 1,200 personas were constructed, including the specific socioeconomic and political attributes used and their mapping to prompt text, are absent. This is load-bearing for evaluating whether the observed associations reflect genuine conditioning effects.

Simulated Author's Rebuttal

3 responses · 0 unresolved

We thank the referee for the careful and constructive review. We address each major comment below and will revise the manuscript to improve methodological transparency.

read point-by-point responses

Referee: [Abstract] Abstract: The claims of 'systematic variation associated with socioeconomic and political attributes' and 'no statistically significant persona-related differences' are presented without any description of the statistical tests, p-value thresholds, multiple-comparison corrections, or methods for quantifying and associating persona attributes with outputs. These details are required to substantiate the central empirical findings.

Authors: We agree that the abstract would benefit from a concise reference to the statistical methods. In the revision we will add one sentence to the abstract noting the use of chi-squared tests (with Bonferroni correction) for perception tags and regression models for linking persona attributes to justification content. Full details already appear in Section 4; the change is limited to the abstract for self-containment. revision: yes
Referee: [Methods] Methods (prompt construction): The abstract supplies no information on whether prompt templates were held strictly constant across persona conditions, with only the persona descriptor varying, or whether other elements (sentence structure, added instructions, or length) differed systematically between socioeconomic or political groups. Without explicit standardization, the reported variations in justifications cannot be confidently attributed to the persona attributes rather than prompt artifacts.

Authors: Section 3.2 states that a single fixed template was used for all conditions, varying only the persona descriptor. To eliminate any remaining ambiguity we will add an explicit paragraph confirming identical structure, sentence length, and instructions across groups, and we will include the verbatim template in the appendix. revision: yes
Referee: [Methods] Methods (persona definition): Details on how the 1,200 personas were constructed, including the specific socioeconomic and political attributes used and their mapping to prompt text, are absent. This is load-bearing for evaluating whether the observed associations reflect genuine conditioning effects.

Authors: Section 3.1 describes the attribute selection from census and survey sources and the mapping procedure. We will expand this section with a summary table of the attribute categories and representative prompt phrases to make the construction process fully transparent. revision: yes

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: purely observational empirical study

full rationale

The paper performs direct statistical and topic analysis on 59,808 LLM-generated annotations conditioned on personas. No derivations, fitted parameters renamed as predictions, self-citation load-bearing premises, or ansatzes are present. All reported patterns (caption convergence, justification variation, tag trends) are measured outputs rather than constructed from the inputs by definition. The central claim rests on external generation and measurement, not on any self-referential reduction.

Assumptions & free parameters 0 free parameters · 1 assumptions · 0 invented entities

The paper is an empirical measurement study and introduces no new mathematical objects or fitted constants; it relies on standard assumptions from statistics and LLM evaluation.

assumptions (1)

domain assumption Standard statistical significance testing is appropriate for detecting persona-related differences in perception tags and justifications.
The abstract states 'no statistically significant persona-related differences' for tags, implying conventional hypothesis testing without further specification.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Persona Prompting in Multimodal Urban Perception: Descriptive Convergence and Interpretive Variation." pith.science (2026). https://pith.science/paper/EVFZZCXP

@misc{pith2026260529064,
  author       = {Pith},
  title        = {Pith review of: Persona Prompting in Multimodal Urban Perception: Descriptive Convergence and Interpretive Variation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/EVFZZCXP}},
  note         = {Machine review of arXiv:2605.29064}
}

read the original abstract

This study examines how persona prompting shapes language generated by two multimodal large language models in urban perception, a setting for examining subjective interpretations of shared visual evidence. We organize outputs into three functional levels: descriptive grounding (captions), intermediate semantic layer (perception tags), and interpretive framing (justifications). Using approximately 60,000 persona-conditioned annotations per model from Qwen3-VL-8B and Gemma-4-E4B-it, we find that captions converge strongly across persona profiles and show only small attribute-associated differences. Justifications vary substantially more: economic status produces the largest difference in both models, with political orientation and personality also prominent. Paired image-level comparisons confirm larger justification than caption differences for these three attributes. For perception tags, personas sharing the same attribute level produce more similar tag sets than personas with different attribute levels, with the largest separation observed for economic status. Exploratory topic analysis further reveals persona-specific evaluative emphasis. Across models, profile-pair similarity patterns are strongly correlated for all three output types, although agreement is lowest for justifications. Overall, persona prompting affects interpretive framing more strongly than descriptive grounding.