Pith. sign in

REVIEW 2 major objections 6 minor 18 references

Using Theory of Mind to Arbitrate between Social and Non-social Learning

T0 review · 2 major / 6 minor · reviewed 2026-07-31 · grok-4.5

Pith's one-line read People decide whether to watch others or explore alone by mentalizing about goals and weighing expected costs.

desk verdict Clean integration of BToM with observe-vs-act utility that actually fits human whom-to-watch data; absolute under-prediction is real but does not sink the relative claim. read the letter →

arxiv 2607.28601 v1 pith:K2ZHUDYL submitted 2026-07-30 cs.MA q-bio.NC

classification cs.MAq-bio.NC
keywords sociallearningTheoryofMindBayesianinferencedecisionmakingcomputationalmodelingactivemulti-agent
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Humans do not copy others indiscriminately, nor do they always explore alone. This paper argues that the choice is a step-by-step utility comparison: the observer uses Theory of Mind to infer another agent's goals and beliefs, simulates how that agent's future path would shrink its own uncertainty, and watches only when the expected cost of watching is lower than the cost of exploring now. A novel multi-agent grid game forces participants to choose, on every step, whether to observe a selected agent or move themselves, while maps vary goal uncertainty, number of agents, and expertise. Across four experiments the full model matches human observation counts closely (pooled concordance 0.89), whereas ablations that drop mentalizing or drop the cost comparison systematically over- or under-observe and fail to pick the right agent. The result matters because it unifies two literatures—Bayesian mentalizing and active information search—into a single account of when social information is worth the price.

What carries the argument

The Rational Mentalizing model: Bayesian inverse planning over another agent's goal and belief, forward simulation of each hypothesis's trajectory to obtain a residual plan cost, and a hard comparison of that expected watching cost Q_obs against self-exploration cost C_self.

What would settle it

In the same game, if human observation counts reverse or decouple from the model's Q_obs versus C_self ranking—especially when the greedy residual planner and human exploration paths diverge, or when non-instrumental monitoring of the less-informative agent stays high—the utility-arbitration claim fails.

Watch

Extended reading notes

Core claim

Selective social learning is guided by Theory of Mind in the service of utility maximization. At each timestep the observer compares the non-social exploration cost under its current beliefs against the posterior-weighted expected cost of watching each available agent (observation steps until the candidate set narrows, plus residual planning cost afterward) and observes only the cheapest informative source when watching is cheaper than acting.

Load-bearing premise

The leftover cost after watching is well captured by a fixed greedy nearest-wizard planner, and the decision is a hard threshold comparison of that scalar to the expected watching cost.

Editorial extensions

If this is right

  • When agents pursue different goals, the value of watching cannot be read off outcomes alone; it must be computed from inferred goals and beliefs.
  • Whom-to-watch choices fall out of the same cost comparison: the agent whose simulated trajectory is expected to shrink the observer's candidate set fastest per observation step.
  • Selective trust can emerge as a byproduct of mentalizing rather than a separate accuracy-tracking module: expertise matters only insofar as it changes expected informativeness in the current map.
  • Ablations that keep only mentalizing over-observe; ablations that keep only cost comparison cannot choose the right source once goals diverge.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same arbitration could be ported to advice-taking and pedagogical settings if the generative model is extended so the observed agent sometimes optimizes for the learner rather than its own goal.
  • The systematic under-prediction of absolute observation suggests a measurable curiosity or hedging term that could be added without discarding the instrumental core.
  • Cross-trial accumulation of agent-specific priors—histories of who tended to be informative—would turn the per-trial posterior into a longer-horizon trust model testable in repeated play.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 6 minor

Summary. The paper proposes a Rational Mentalizing model of selective social learning: at each step the observer compares the non-social exploration cost C_self(b_t) to a posterior-weighted expected cost of watching agent j, Q^j_obs(t)=Σ_i p_i[c_obs T_i + C_plan(b'_t)], obtained by Bayesian Theory of Mind (inverse planning over goals and beliefs) plus forward simulation of how that agent’s trajectory would shrink the observer’s candidate set. Observation occurs only when watching is cheaper; with multiple agents the argmin selects whom to watch. A novel multi-agent grid game (observe-or-act turns; wizards/amulets; expert/novice NPCs) creates parametric trade-offs across four experiments of increasing complexity (goal uncertainty, whom-to-watch, expertise). With parameters fixed a priori and shared across experiments, the full model matches human observation counts (pooled CCC=0.89, near split-half reliability ceilings), while three ablations that remove mentalizing, utility comparison, or both fit substantially worse and fail in opposite directions (over- vs under-observe).

Significance. If the result holds, the paper supplies a concrete, testable account of how Theory of Mind is used not only to interpret others but to decide whether social observation is worth its cost relative to individual exploration—bridging Bayesian ToM, active information seeking, and social-learning-strategy literatures that have largely treated observed behavior as a reliability-weighted signal rather than as goal-directed evidence. Strengths that raise the contribution above a pure modeling exercise include: a novel paradigm with controllable goal/expertise structure; a priori shared parameters never fit to human observation; high split-half reliability of the behavioral target; ablations that dissociate components; and released code, stimuli, and anonymized data (OSF). The whom-to-watch and expert/novice reversals are especially diagnostic relative to heuristic or pure RL social-learning accounts.

major comments (2)
  1. [Methods §6.4, Algorithm 1, Discussion] Methods §6.4 and Algorithm 1 implement utility maximization as a hard myopic rule: observe j* iff min_j Q^j_obs(t) < C_self(b_t), else permanently commit to a greedy nearest-wizard self-exploration planner C_self(b)=Σ_k[d(x_{k-1},w^{(k)})+c_int]+d(x_K,x_g). Discussion correctly notes systematic under-prediction of absolute observation and total steps, plus residual watching of the non-chosen agent. That pattern is exactly what a misspecified C_self magnitude, missing interleaving of observe/act, or softer-than-argmin choice would produce. Because the central claim is that selective social learning is guided by ToM “in the service of utility maximization,” the paper should either (i) report a sensitivity analysis (soft-max over {act, observe-j}, alternative residual planners, or a small exploration bonus) showing that relative CCC/whom-to-watch results are robust, or (ii) explicitly downg
  2. [§4, Methods §6.5, Introduction] The Rational Observer ablation (Methods §6.5) decides once at trial start using a fixed horizon to the other agent’s first wizard interaction, with no online re-evaluation and no goal inference. That is a weak foil for “cost-benefit without mentalizing”: a stronger non-mentalizing baseline would recompute expected information value online from observed trajectories treated as exogenous signals (e.g., reliability-weighted or volatility-based arbitration in the spirit of Behrens et al. / Diaconescu et al., which the Introduction cites). If such a baseline still fails on Experiments 2–4 (goal divergence, whom, novice), the ToM necessity claim is stronger; if it closes much of the gap on observation counts, the unique contribution of generative mentalizing needs tighter bounds. At minimum, justify why the once-and-done Rational Observer is the right contrast rather than an online non-ToM act
minor comments (6)
  1. [§4.1, Figure 3] Figure 3 reports pooled CCC and r, but per-experiment observation scatter with identity lines (partially in SI Figs. A12–A13) should be promoted or at least cross-referenced more clearly in the main Results so readers can see absolute calibration, not only concordance.
  2. [§3, Methods §6.4] Eq. (1) and Eq. (4) are identical; renumber or drop the duplicate and keep a single definition of Q^j_obs(t).
  3. [Appendix A, Table A2] The Mentalizing Observer’s divergence threshold ε=0.1 (Table A2) is listed among free parameters; briefly state that it was set a priori like the others and, if any informal tuning occurred, disclose it.
  4. [Throughout / References] Typographical inconsistencies: “Theoryof Mind”, “Muthukrishnaetal.”, “VélezandHyowonGweon”, missing spaces in keywords and some references. A pass for spacing and en-dashes would help.
  5. [Figure 5, §6.3] Figure 5’s “3×move + 5×interact” execution-cost definition is clear in the caption but should be stated once in Methods when point costs are introduced so the observation–execution coupling analysis is self-contained.
  6. [§4, Appendix A.3] SI notes total cost is not model-diagnostic (Fig. A14) while observation cost is—this is an important design lesson; one sentence in main §4 would help readers who only skim the SI.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: a priori fixed-cost ToM arbitration yields out-of-sample behavioral predictions, not tautologies.

full rationale

The paper’s load-bearing claim is that observers decide whether/whom to watch by comparing C_self(b_t) to the posterior-weighted Q^j_obs(t)=Σ_i p_i[c_obs T_i + C_plan(b'_t)], with posteriors from Bayesian inverse planning (SIPS) and residual costs from a greedy wizard tour. That comparison is a genuine generative procedure: map geometry, NPC policies, and fixed point costs are inputs; observation counts and whom-to-watch patterns are outputs that could (and for ablations do) mismatch humans. Methods explicitly state all parameters (β=0.5, c_obs=1, movement 3, interaction 5, convergence 0.95, prune 0.1) were set a priori, held identical across four experiments, and never fit to human observation. Predictions are scored against held-out participant behavior (pooled CCC=0.89 near split-half ceilings) and three ablations that remove mentalizing or utility comparison. Self-citations to Baker/Zhi-Xuan/Ying BToM–SIPS supply the inverse-planning engine as reusable machinery, not a uniqueness theorem that forces the arbitration result. Under-prediction of absolute observation is a misspecification concern, not circularity: the model is not definitionally equal to the data it is tested on. No fitted-input-as-prediction, self-definitional identity, or renamed empirical law is present.

Assumptions & free parameters 5 free parameters · 6 assumptions · 2 invented entities

The central behavioral claim rests on standard Bayesian inverse-planning assumptions plus several modeling choices fixed without fitting to the human observation data. No new physical entities are postulated; the ‘Rational Mentalizing’ construct is a decision procedure over existing BToM machinery. Load-bearing domain assumptions are near-optimal Boltzmann planning by NPCs, exhaustive discrete goal–belief hypotheses, greedy self-exploration cost, and hard threshold comparison of C_self vs Q_obs.

free parameters (5)
  • Boltzmann planning temperature β = 0.5 (a priori)
    Controls softness of observed-agent action likelihoods in inverse planning (Eq. 2). Set a priori to 0.5 for all experiments; not fit to human data but still a hand-chosen value the likelihoods depend on.
  • State-convergence threshold = 0.95 (a priori)
    Posterior mass above which a wizard hypothesis is treated as converged when computing T_i. Affects predicted observation horizons.
  • Hypothesis-pruning threshold = 0.1 (a priori)
    Drops goal/belief hypotheses below this posterior when aggregating Q_obs; changes which particles enter the utility sum.
  • Mentalizing Observer belief-divergence ε = 0.1 (a priori)
    Threshold on Euclidean belief-distance that keeps the no-utility ablation observing; ablation-specific but affects baseline comparisons.
  • Per-step point costs (move=3, interact=5, observe=1) = 3 / 5 / 1
    Define the experimental economy and enter C_self and Q_obs directly. Matched to participant incentives rather than fit, but the numerical trade-off is design-chosen.
assumptions (6)
  • domain assumption Observed NPCs are near-optimal planners with Boltzmann policies over cost-to-go under latent goal and belief (Eq. 2).
    Standard BToM generative model; required for inverse planning posteriors that feed Q_obs.
  • domain assumption Observer maintains a joint posterior over the other agent’s goal and amulet belief via Bayesian inverse planning / SIPS particle filter (Eq. 3).
    Core ToM engine; without it the model collapses to the Rational Observer ablation.
  • ad hoc to paper Decision rule is myopic one-step re-evaluation: observe j* iff min_j Q^j_obs(t) < C_self(b_t), else act (Algorithm 1).
    Specific arbitration rule combining mentalizing with cost comparison; not forced by prior theorems.
  • ad hoc to paper Non-social cost C_self is the cost of a greedy nearest-first wizard tour plus path to goal under current belief.
    Computational approximation to belief-space exploration cost; load-bearing for the utility comparison.
  • domain assumption Agents’ actions do not change each other’s environment state; amulets/barriers/chests are non-rival.
    Game design assumption that isolates informational value of observation from strategic interference.
  • standard math Standard probability calculus and Bayes rule for updating posteriors from action likelihoods.
    Ordinary Bayesian updating; no nonstandard measure theory.
invented entities (2)
  • Rational Mentalizing decision procedure (Q_obs via simulated ToM trajectories vs C_self) independent evidence
    purpose: Unify goal/belief inference with observe-versus-act utility arbitration in one per-timestep rule.
    Not a new ontological object in nature, but a new composite model entity relative to prior BToM or social-RL accounts; independent evidence is the human behavioral fit and ablation pattern, not an external physical measurement.
  • Social learning grid game (observe-or-act turns, wizards/amulets, expert/novice NPCs)
    purpose: Parametrically create trade-offs between social and non-social learning under goal uncertainty and source choice.
    Novel experimental environment constructed for the paper; validates the model only inside this task family unless generalized.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Using Theory of Mind to Arbitrate between Social and Non-social Learning." pith.science (2026). https://pith.science/paper/K2ZHUDYL

@misc{pith2026260728601,
  author       = {Pith},
  title        = {Pith review of: Using Theory of Mind to Arbitrate between Social and Non-social Learning},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/K2ZHUDYL}},
  note         = {Machine review of arXiv:2607.28601}
}
read the original abstract

Social learning is a powerful mechanism through which agents learn about the world from others. However, humans sometimes choose direct experience over social learning, which can carry time and cognitive resource costs. How do people balance social and non-social learning? We propose a Rational Mentalizing model of the decision to engage in social learning. This model estimates the utility of social learning by reasoning about another agent's goal and the informativeness of their future actions. It then weighs the utility of social learning against the utility of non-social learning. Using a novel game where players choose between observing other agents or exploring the environment, we show that the Rational Mentalizing model can quantitatively capture human trade-offs between these strategies. These findings suggest that selective social learning is guided by 'Theory of Mind' in the service of utility maximization.

Figures

Figures reproduced from arXiv: 2607.28601 by the authors.

Figure 1
Figure 1. Illustration of the social learning game. The participant controls the red (main) agent [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Schematic of the Rational Mentalizing model. At each timestep, the observer (red agent) decides whether to act or observe another agent. Utility comparison: it weights the cost of acting now (Cself) against the expected cost of watching the expert for another step (Qobs), and observes only when watching is cheaper. Theory of Mind: to establish that cost, the observer infers the observed agent’s goal and belief, for … view at source ↗
Figure 3
Figure 3. Observation steps pooled across all four experiments. Each panel shows one model, with [PITH_FULL_IMAGE:figures/full_fig_p007_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Qualitative examples of observation behavior across the four experiments. Each panel [PITH_FULL_IMAGE:figures/full_fig_p009_4.png]
Figure 5
Figure 5. Figure 5: Observation cost vs. execution cost (3×move + 5×interact), pooled across experiments; teal = human means, coral = model, with each panel’s fitted slope and its 95% bootstrap CI band. Humans show a positive coupling—more observation accompanies more execution. The Menta…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

18 extracted references · 10 canonical work pages

  1. [6]

    Elizabeth Dutemple, Hanifa Hakimi, and Diane Poulin-Dubois

    doi: 10.7554/eLife.54051. Elizabeth Dutemple, Hanifa Hakimi, and Diane Poulin-Dubois. Do I know what they know? link- ing metacognition, theory of mind, and selective social learning.Journal of experimental child psychology, 227:105572,

  2. [13]

    David Schultner, Lucas Molleman, and Björn Lindström

    doi: 10.1016/j.cognition.2019.104013. David Schultner, Lucas Molleman, and Björn Lindström. Feature-based reward learning shapes human social learning strategies.Nature Human Behaviour, 9:2183–2198,

  3. [15]

    Natalia Vélez and Hyowon Gweon

    doi: 10.1111/tops.12388. Natalia Vélez and Hyowon Gweon. Learning from other minds: an optimistic critique of reinforce- ment learning models of social learning.Current Opinion in Behavioral Sciences, 38:110–115,

  4. [16]

    Henry M Wellman

    doi: 10.1016/j.cobeha.2021.01.006. Henry M Wellman. Understanding the psychological world: Developing a theory of mind. In Usha Goswami, editor,Blackwell Handbook of Childhood Cognitive Development, pages 167–187. Blackwell,

  5. [18]

    Language-informed synthe- sis of rational agent models for grounded theory-of-mind reasoning on-the-fly

    Lance Ying, Ryan Truong, Katherine M Collins, Cedegao E Zhang, Megan Wei, Tyler Brooke- Wilson, Tan Zhi-Xuan, Lionel Wong, and Joshua B Tenenbaum. Language-informed synthe- sis of rational agent models for grounded theory-of-mind reasoning on-the-fly. arXiv preprint arXiv:2506.16755,

  6. [1994]

    Maayan Pereg, Uri Hertz, Ido Ben-Artzi, and Nitzan Shahar

    doi: 10.1037/0033-295X.101.4.608. Maayan Pereg, Uri Hertz, Ido Ben-Artzi, and Nitzan Shahar. Disentangling the contribution of individual and social learning processes in human advice-taking behavior.npj Science of Learning, 9(1):4,

  7. [2005]

    Kevin N Laland

    doi: 10.1111/j.1467-8624.2005.00849.x. Kevin N Laland. Social learning strategies.Learning & Behavior, 32(1):4–14,

  8. [2008]

    Guido Biele, Jörg Rieskamp, and Richard Gonzalez

    doi: 10.1038/nature07538. Guido Biele, Jörg Rieskamp, and Richard Gonzalez. Computational models for the combination of advice and individual learning.Cognitive Science, 33(2):206–242,

Show all 18 references
  1. [2009]

    2009.01010.x

    doi: 10.1111/j.1551-6709. 2009.01010.x. Elizabeth Bonawitz and Patrick Shafto. Computational models of development, social influences. Current Opinion in Behavioral Sciences, 7:95–100,

  2. [2010]

    Stephanie Stacy, Chenfei Li, Minglu Zhao, Yiling Yun, Qingyi Zhao, Max Kleiman-Weiner, and Tao Gao

    doi: 10.1111/ j.1468-0017.2010.01394.x. Stephanie Stacy, Chenfei Li, Minglu Zhao, Yiling Yun, Qingyi Zhao, Max Kleiman-Weiner, and Tao Gao. Modeling communication to coordinate perspectives in cooperation. InProceedings of the Annual Meeting of the Cognitive Science Society, v...

  3. [2011]

    Sophie Bridgers, Julian Jara-Ettinger, and Hyowon Gweon

    doi: 10.1016/j.cognition.2010.10.001. Sophie Bridgers, Julian Jara-Ettinger, and Hyowon Gweon. Young children consider the expected utility of others’ learning to decide what to teach.Nature Human Behaviour, 4(2):144–152,

  4. [2014]

    Michael Muthukrishna, Thomas JH Morgan, and Joseph Henrich

    doi: 10.1037/a0032108. Michael Muthukrishna, Thomas JH Morgan, and Joseph Henrich. The when and who of social learning and conformist transmission.Evolution and Human Behavior, 37(1):10–20,

  5. [2016]

    Learning how to behave: cognitive learning processes account for asymmetries in adap- tation to social norms.Proceedings of the Royal Society B, 288(1952):20210293,

    Uri Hertz. Learning how to behave: cognitive learning processes account for asymmetries in adap- tation to social norms.Proceedings of the Royal Society B, 288(1952):20210293,

  6. [2019]

    Andreea Oliviana Diaconescu, Madeline Stecy, Lars Kasper, Christopher J Burke, Zoltan Nagy, Christoph Mathys, and Philippe N Tobler

    doi: 10.3758/s13423-018-1470-5. Andreea Oliviana Diaconescu, Madeline Stecy, Lars Kasper, Christopher J Burke, Zoltan Nagy, Christoph Mathys, and Philippe N Tobler. Neural arbitration between social and individual learning systems.eLife, 9:e54051,

  7. [2020]

    Anna Coenen, Jonathan D Nelson, and Todd M Gureckis

    doi: 10.1038/s41562-019-0748-6. Anna Coenen, Jonathan D Nelson, and Todd M Gureckis. Asking the right questions about the psychology of human inquiry: Nine open challenges.Psychonomic Bulletin & Review, 26(5): 1548–1587,

  8. [2021]

    Cecilia Heyes

    doi: 10.1098/rspb.2021.0293. Cecilia Heyes. What’s social about social learning?Journal of comparative psychology, 126(2): 193–202,

  9. [2024]

    Luke Rendell, Laurel Fogarty, William JE Hoppitt, Thomas JH Morgan, Mike M Webster, and Kevin N Laland

    doi: 10.1038/s41539-024-00214-0. Luke Rendell, Laurel Fogarty, William JE Hoppitt, Thomas JH Morgan, Mike M Webster, and Kevin N Laland. Cognitive culture: theoretical and empirical insights into social learning strate- gies.Trends in Cognitive Sciences, 15(2):68–76,

  10. [2025]

    Lance Ying, Tan Zhi-Xuan, Lionel Wong, Vikash Mansinghka, and Joshua Tenenbaum

    doi: 10.1038/s41467-025-58365-6. Lance Ying, Tan Zhi-Xuan, Lionel Wong, Vikash Mansinghka, and Joshua Tenenbaum. Grounding language about belief in a Bayesian theory-of-mind. arXiv preprint arXiv:2402.10416,

Pith tools

Reviewed July 31, 2026 · model on record in the stance chip above.