Pith. sign in

REVIEW 3 major objections 5 minor 109 references

A three-stage pipeline gives vision-language models specialist spatial perception on demand, then transfers that perception into the model's own weights so the tools are no longer required.

Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

T0 review · deepseek-v4-flash

2026-08-05 04:21 UTC pith:EZV5JO5V

load-bearing objection A thorough, well-ablated pipeline for teaching VLMs to use and then internalize spatial tools; the internalization evidence is suggestive rather than airtight, but the external benchmark gains deserve a serious referee. the 3 major comments →

arxiv 2607.27703 v2 pith:EZV5JO5V submitted 2026-07-30 cs.AI

SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them

Yang Zhou , Zixuan Huang , Sunzhu Li , Zhuo Yang , Chen Zhang , Shunian Chen , Caijun Yan , Jianyao Xu
show 5 more authors
Shunyu Liu Weijie Fu Peiliang Li Xiaozhi Chen Yuxiang Cai
This is my paper
classification cs.AI
keywords vision-language modelsspatial reasoningtool-augmented agentsreinforcement learningcapability internalizationspatial perceptionembodied AIchain-of-thought distillation
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

Vision-language models reason well about tasks but see poorly at the level of exact boxes, boundaries, depths, and poses; specialist vision models measure those quantities precisely but cannot decide when to call them or what a task needs. This paper proposes SpatialCLI, a three-stage framework that lets a VLM borrow specialist perception at inference time as four callable spatial tools, trains it to use them through supervised cold-start data and reinforcement learning, and then converts its own successful tool-use trajectories into evidence-grounded reasoning text that trains it to answer without the tools. The central empirical claim is that both abilities improve together: an 8-billion-parameter VLM climbs from 29.3% to 84.6% on MindCube with tools and retains 73.8% without them, and the pattern holds across model scales and benchmarks, including a new 516-question benchmark, SpatialCLI-Bench, built to require composing localization, segmentation, depth, and pose in a single answer. If the claim holds, external tool use and internalized direct reasoning can coexist in one model, which is a step toward embodied foundation models that do not permanently depend on specialist vision backends.

Core claim

The central claim is that perceptual evidence a VLM collects from external spatial tools—bounding boxes, masks, depths, pose directions—can be converted into training text that transfers those capabilities into the model's own weights. SpatialCLI verbalizes each successful tool trajectory twice: turn by turn, consolidating each tool result into an evidence-reasoning unit, then globally, merging units into a tool-free reasoning chain that reaches the correct answer. Dual-view training supervises the model on both the tool-free chain and the original tool-call trace, so internalization does not overwrite tool use. Across benchmarks and model scales, trained models beat their base VLMs with too

What carries the argument

The load-bearing object is the interaction trajectory—the interleaved reasoning, tool calls, and returned results a VLM produces in a ReAct-style loop. Four tools expose specialist models: Locate (Locate Anything fused with Grounding DINO), Segment (SAM 3), Depth (Depth Anything 3), and Pose (Orient Anything V2, plus VGGT for camera motion). Learning uses cold-start SFT on filtered teacher trajectories, then agentic RL with the GRPO objective and outcome rewards. Internalization applies Progressive Evidence-Grounded Trajectory Verbalization—turn-wise evidence consolidation followed by global verbalization by a large teacher LLM—and Dual-View Capability Internalization, jointly optimizing an

Load-bearing premise

The entire transfer step trusts that the teacher model's written summaries of tool outputs are exact—no dropped, rounded, or invented coordinate, count, depth, or relation—and the paper does not measure how often the verbalizer preserves every value.

What would settle it

Unpoisoned audit: on a random sample of the trajectories used for internalization, diff every number and relational claim in the verbalized reasoning chain against the raw tool result it was built from; a non-negligible mismatch rate would show the supervision is corrupted at its source. Poisoned test: run the full pipeline with one tool deliberately biased (e.g., all depths shifted +20%) on a held-out set, then check whether the tool-free model reproduces that same bias—if it does, the model has memorized tool outputs rather than learned geometry.

Watch this falsifier. Get emailed when new claim-graph text bears on it.

Share X Bluesky LinkedIn Reddit HN

If this is right

  • A single checkpoint can serve both tool-augmented and tool-free inference: SpatialCLI-8B scores 91.3% with tools and 72.7% without on SpatialCLI-Bench, versus 35.3% for the untrained base model without tools.
  • Structured textual returns—coordinates, polygons, metric depths—carry the gain; rendering the same evidence as annotated images adds no consistent benefit, and structured text is what makes verbalization into language training possible.
  • Tool-use training and direct-reasoning training are complementary: cold-start SFT plus agentic RL keeps tool calls near 2.6 per task and stabilizes learning, whereas RL without tools degrades tool competence and internalizes far less (52.7% vs 72.7% on SpatialCLI-Bench).
  • Internalization scales with both data and model size: task accuracy and the Capability Internalization Index rise together as more trajectories are verbalized, and larger models absorb more capability even after tool-use performance saturates.

Where Pith is reading between the lines

These are editorial extensions of the paper, not claims the author makes directly.

  • The same verbalize-and-train loop likely transfers to other tool classes—search, code execution, simulation—wherever a tool's structured output can be written as text; the paper itself notes its scope is limited to structured perceptual outputs.
  • The framework implies a renewable-curriculum view: swap in a stronger specialist tool, regenerate successful trajectories, re-run internalization, and the model's native capability should upgrade—a test the paper does not run.
  • Because the verbalizer is itself a language model, internalized knowledge is a second-hand copy of tool outputs; any systematic verbalizer drift (dropped, rounded, or invented values) would be baked into the trained model, so auditing verbalizer fidelity is the natural first check on the method.
  • The benchmark's design—forcing composition of multiple spatial capabilities per question—suggests isolated-capability benchmarks understate how far frontier models lag tool-augmented reasoning; on SpatialCLI-Bench a frontier model scores 48.8% without tools and 72.9% with them, a gap worth probing on other compositional tasks.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper proposes SpatialCLI, a three-stage framework (Call–Learn–Internalize) for improving vision-language models' spatial reasoning. In the Call stage, specialist vision models are exposed as spatial tools for localization, segmentation, depth, and pose. In the Learn stage, cold-start SFT followed by GRPO-based agentic RL trains the VLM to use these tools. In the Internalize stage, successful tool-use trajectories are verbalized into evidence-grounded reasoning chains via turn-wise consolidation and a global verbalizer, and the model is trained jointly on a capability-internalization view and a tool-use view. The authors also introduce SpatialCLI-Bench, a 516-example six-choice benchmark for compositional spatial reasoning. Experiments on Qwen3-VL-8B, Qwen3.6-35B-A3B, and Qwen3.6-27B, plus several frontier models, report large w/ Tools and w/o Tools gains across MindCube, SpatialCLI-Bench, MMSI, DA-2K, and BOPASK.

Significance. If the internalization stage is faithful, the paper makes a valuable contribution: it demonstrates that tool-grounded perceptual reasoning can be converted into direct, tool-free VLM capability without sacrificing tool use, and it provides a new benchmark for compositional spatial perception. The work is unusually thorough in its ablations, including tool-return format comparisons, verbalization-variant comparisons, λ sensitivity, and training-dynamics analysis. The authors also provide code, model, and dataset links, and the external benchmarks (MindCube, MMSI, DA-2K, BOPASK) are not fitted by design. The principal weakness is that the key verbalization step is unverified and answer-conditioned, leaving open the possibility that the w/o Tools gains partly reflect rationalization rather than internalized tool evidence. With an explicit fidelity audit and variance reporting, the contribution would be solid.

major comments (3)
  1. [§3.3, Box G.3] The global verbalizer Φ_verb receives the correct answer y* as input. The turn-wise consolidator deliberately withholds y* to prevent answer-conditioned evidence reconstruction, but the global pass reintroduces it and is instructed to construct a reasoning chain 'explaining why the evidence supports that answer.' The prompt rules prohibit introducing unsupported entities/relations, but no verification or quantitative audit is reported. If the teacher silently fills gaps in Eτ to fit y*, then the trained w/o Tools model may be learning answer-shaped reasoning rather than internalized spatial capabilities. This is load-bearing because both the w/o Tools performance and the CII metric are trained on these chains. Please provide a chain-fidelity audit (e.g., automated or human verification that every factual statement in c is entailed by the corresponding tool result or explicit observation)
  2. [Appendix E, §4.3] The Capability Internalization Index is defined as similarity between the model's tool-free outputs and the specialist-tool outputs. But those same tool outputs were used as the supervision targets for internalization training, so high CII is expected by construction and does not independently establish 'genuine transfer of specialist perceptual capabilities rather than final-answer memorization.' The external w/o Tools gains on MindCube, BOPASK, MMSI, and DA-2K are more convincing evidence, but the CII-based claim in §4.3 should be reframed as a measurement of reproduction fidelity, with the external benchmarks carrying the burden of showing transfer.
  3. [§4.1, Appendix B.2] All task-performance numbers are reported as means over three evaluation runs, without error bars, confidence intervals, or per-run values. Several improvements in Table 1 are small (e.g., MMSI Pos-Cam-Cam 49.5 vs 53.8, or BOPASK ObjRrr 48.5 vs 52.3) and could be within run-to-run noise. The claim of 'consistent' improvement across all subsets would be much stronger with a measure of variance or a statistical test. Please report standard deviations or the three individual-run results for at least the main tables.
minor comments (5)
  1. [Abstract] The word 'Learn' is typeset as 'L earn' in the abstract. Please fix the formatting glitch.
  2. [Figure 4] Panel (a) is labeled 'Performance vs. Steps' but the y-axis label is only 'Score (%)'. Please specify which benchmark the curve refers to, or add per-panel captions.
  3. [Table 1] The column header 'Pos-Cam-Cam Traj. ObjRrr' is unclear. Please use consistent subset names (e.g., 'Pos-Cam-Cam', 'Trajectory', 'Object-Rearrangement') and match them to the text in §4.1.
  4. [Appendix C.5] Human review is described as 'two graduate students' who must agree with the generated answer. Reporting inter-annotator agreement or at least the per-annotator accuracy rates would strengthen the claim of independent verification.
  5. [Appendix B.3] The hardware is described as 'PPU-ZW810E accelerators.' Please provide the vendor/model name or a reference, since this is not a standard publicly identifiable device.

Circularity Check

1 steps flagged

Central w/o Tools gains are independently grounded on external benchmarks; the CII diagnostic is self-referential but not load-bearing, and the verbalizer-fidelity concern is a validity risk rather than circularity.

specific steps
  1. self definitional [Section 4.3 and Appendix E.4; supervision source in Section 3.3]
    "To quantify internalization, we use the Capability Internalization Index (CII), which measures how closely a model can reproduce the corresponding spatial-tool outputs without invoking the tools; higher values indicate stronger internalization... SpatialCLI therefore uses successful SpatialCLI-RL trajectories as the source of supervision for internalizing the specialist perceptual capabilities supplied by spatial tools."

    CII's reference standard is the spatial-tool output, and the internalization supervision is a verbalization of trajectories produced by those same spatial tools. Thus CII measures agreement with the source distribution that generated the training target; an increase after training is expected from fitting that distribution. The paper uses the synchronized rise of CII and task scores to claim 'genuine transfer ... rather than final-answer memorization,' but CII cannot independently distinguish internalization from distributional mimicry because the metric and the training signal share the same oracle. The held-out CII suite mitigates direct memorization, and the main external-benchmark gains remain independent, so this is a self-referential diagnostic rather than a derivation of the central

full rationale

The central claim—SpatialCLI improves both w/ Tools and w/o Tools reasoning—is supported by Table 1 on external benchmarks (MindCube, MMSI, DA-2K, BOPASK) that are not constructed by the paper and are claimed to be non-overlapping with training data. Those w/o Tools gains (e.g., MindCube 29.3→73.8 for Qwen3-VL-8B-Instruct) are not fitted to the evaluation sets and give the main result independent content. The self-referential components are auxiliary: CII is defined as reproducing the same specialist-tool outputs that generated the internalization supervision, and SpatialCLI-Bench questions are conditioned on specialist evidence, but neither is the sole evidence for transfer. A separate validity risk is that the global verbalizer receives the correct answer y* before composing the reasoning chain (Section 3.3, Box G.3); the prompt rules forbid unsupported additions but no fidelity audit is reported. This could make the w/o Tools chains answer-conditioned rationalizations, but it is a correctness/robustness threat, not a circularity, because the model does not see y* at inference and the external benchmark evaluations are independent. Overall, no load-bearing step reduces by construction to its inputs; the paper's derivation is self-contained enough for a low circularity score.

Axiom & Free-Parameter Ledger

5 free parameters · 4 axioms · 0 invented entities

The framework does not introduce new physical entities, forces, or dimensions. The main unstated costs are the hand-set tool thresholds and the trust placed in the teacher verbalizer and specialist models.

free parameters (5)
  • Tool-Use View loss weight λ = 0.5
    Hand-chosen after a sensitivity sweep over {0.2, 0.5, 1.0, 1.5} balancing capability internalization (CII, w/o Tools score) against preservation of the tool-use policy (w/ Tools score). Reported in Appendix F.4.
  • Locate fusion thresholds = confidence 0.30, NMS IoU 0.50, cross-confirm IoU 0.50, dedup IoU 0.75, near-contained ratio 0.90
    Hand-set thresholds controlling how Grounding DINO and Locate Anything detections are fused and deduplicated. They determine the boxes the VLM sees and therefore the evidence for localization and downstream depth queries. Appendix D.2.
  • Segment simplification parameters = confidence 0.30, mask suppression IoU 0.90, polygon target IoU 0.97, vertex budget 16, min component area 16 px²
    Hand-set parameters for converting SAM 3 masks into polygon_2d outputs. The target IoU of 0.97 is described as a target, not unconditional; if not met the bounded candidate is returned. Appendix D.2.
  • Depth backend settings = processing resolution 504 px, deterministic metric-scale alignment
    Choice of Depth Anything 3 backend and resolution affects the depth_m values that ground all depth comparisons and benchmark construction. Appendix D.2.
  • Pose discretization thresholds = 45° sectors, translation norm 0.002, rotation suppression 2°
    Hand-set thresholds defining how VGGT/Orient Anything V2 outputs are serialized into direction names and axes. These determine the pose evidence used in training and benchmark construction. Appendix D.2.
axioms (4)
  • domain assumption Specialist vision models (SAM 3, Grounding DINO, Locate Anything, Depth Anything 3, VGGT, Orient Anything V2) produce sufficiently reliable spatial outputs to serve as ground-truth evidence.
    The tools' outputs are used both as the evidence for benchmark questions and as supervision/reward for the VLM. If they are systematically wrong, the whole pipeline inherits their errors. Invoked in Sections 3.1, 3.4, and throughout Appendix D.
  • domain assumption The teacher LLM (Qwen3.5-397B-A17B) generates correct tool-use trajectories and faithfully verbalizes them without hallucinating or omitting evidence.
    Cold-Start SFT data and the internalization targets come from this model. The prompts in Boxes G.2 and G.3 instruct faithfulness, but there is no verification that the verbalized chains contain no unsupported entities or values. Sections 3.2, 3.3.
  • domain assumption GRPO/DAPO reinforcement learning with sparse outcome rewards shapes the tool-use policy as expected.
    The method relies on RL to improve tool selection and termination from a binary/multiple-choice reward. This is a standard assumption for such training, not proven in the paper. Section 3.2 and Appendix B.1.
  • domain assumption Gemini 3.1 Pro and human expert review produce valid, unbiased ground truth for SpatialCLI-Bench.
    Benchmark questions, answers, and distractors are generated by Gemini 3.1 Pro conditioned on specialist outputs and filtered by human agreement (71.67% retention). The benchmark's validity depends on both. Section 3.4 and Appendix C.

pith-pipeline@v1.3.0-alltime-deepseek · 47306 in / 16042 out tokens · 156102 ms · 2026-08-05T04:21:16.163385+00:00 · methodology

0 comments
Cite this review

Pith. "Pith review of SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them." pith.science (2026). https://pith.science/paper/EZV5JO5V

@misc{pith2026260727703,
  author       = {Pith},
  title        = {Pith review of: SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/EZV5JO5V}},
  note         = {Machine review of arXiv:2607.27703}
}
Share X Bluesky LinkedIn Reddit HN
read the original abstract

Vision-language models (VLMs) are increasingly used in embodied agents to interpret visual inputs, reason about spatial relationships, and make task-level decisions based on that reasoning. However, a fundamental capability mismatch remains: general VLMs can reason about the overall task but often miss the visual details that determine success, while specialist vision models can capture those details but cannot translate them into task-level decisions. In this work, we propose SpatialCLI, a framework that teaches VLMs to reason with spatial tools and progressively internalize the specialist perceptual capabilities they provide. SpatialCLI proceeds in three stages: (1) Call exposes specialist vision models as spatial tools to augment the VLM's perception; (2) Learn uses Cold-Start SFT and agentic RL to improve tool use; and (3) Internalize verbalizes successful tool-use trajectories to internalize specialist perceptual capabilities. We further introduce SpatialCLI-Bench, a 516-example benchmark for compositional perception across localization, segmentation, depth, and pose. On MindCube, SpatialCLI raises Qwen3-VL-8B-Instruct from 29.3% to 84.6% with tools, surpassing GPT-5.6 Sol with tools (72.1%), while retaining 73.8% without tools after internalization.

Review history (2 revisions) →

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Reference graph

Works this paper leans on

109 extracted references · 52 canonical work pages · 7 internal anchors

  1. [1]

    Qwen3-vl technical report.arXiv preprint arXiv:2511.21631, 2025

    Shuai Bai, Yuxuan Cai, Ruizhe Chen, Keqin Chen, Xionghui Chen, Zesen Cheng, Lianghao Deng, Wei Ding, Chang Gao, Chunjiang Ge, et al. Qwen3-vl technical report.arXiv preprint arXiv:2511.21631, 2025

    Pith/arXiv arXiv 2025

  2. [2]

    Bop-ask: Object-interaction reasoning for vision-language models

    Vineet Bhat, Sungsu Kim, Valts Blukis, Greg Heinrich, Prashanth Krishnamurthy, Ramesh Karri, Stan Birchfield, Farshad Khorrami, and Jonathan Tremblay. Bop-ask: Object-interaction reasoning for vision-language models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16746–16757, 2026

    2026

  3. [3]

    VLM3: Vision Language Models Are Native 3D Learners

    Zhipeng Cai, Zhuang Liu, Yunyang Xiong, Zechun Liu, Vikas Chandra, and Yangyang Shi. Vlm3: Vision language models are native 3d learners.arXiv preprint arXiv:2605.30561, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  4. [4]

    Sam 3: Segment anything with concepts

    Nicolas Carion, Laura Gustafson, Yuan-Ting Hu, Shoubhik Debnath, Ronghang Hu, Didac Suris, Chaitanya Ryali, Kalyan Vasudev Alwala, Haitham Khedr, Andrew Huang, et al. Sam 3: Segment anything with concepts. arXiv preprint arXiv:2511.16719, 2025

    Pith/arXiv arXiv 2025

  5. [5]

    Spatialvlm: Endowingvision-languagemodelswithspatialreasoningcapabilities

    Boyuan Chen, Zhuo Xu, Sean Kirmani, Brain Ichter, Dorsa Sadigh, Leonidas Guibas, and Fei Xia. Spatialvlm: Endowingvision-languagemodelswithspatialreasoningcapabilities. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14455–14465, 2024

    2024

  6. [6]

    VoLo: A Physical Orchestrator for Open-Vocabulary Long-Horizon Manipulation

    Siyi Chen, Hugo Hadfield, Alex Zook, Mikaela Angelina Uy, Chan Hee Song, Erwin Coumans, Xuning Yang, Faisal Ladhak, Qing Qu, Stan Birchfield, et al. Volo: A physical orchestrator for open-vocabulary long-horizon manipulation.arXiv preprint arXiv:2606.07723, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  7. [7]

    Spacetools: Tool-augmented spatial reasoning via double interactive rl

    Siyi Chen, Mikaela Angelina Uy, Chan Hee Song, Faisal Ladhak, Adithyavairavan Murali, Qing Qu, Stan Birch- field, Valts Blukis, and Jonathan Tremblay. Spacetools: Tool-augmented spatial reasoning via double interactive rl. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 37109–37120, 2026

    2026

  8. [8]

    Geometrically-constrained agent for spatial reasoning

    Zeren Chen, Xiaoya Lu, Zhijie Zheng, Pengrui Li, Lehan He, Yijin Zhou, Jing Shao, Bohan Zhuang, and Lu Sheng. Geometrically-constrained agent for spatial reasoning. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 38689–38699, 2026

    2026

  9. [9]

    Spatialrgpt: Grounded spatial reasoning in vision-language models

    An-Chieh Cheng, Hongxu Yin, Yang Fu, Qiushan Guo, Ruihan Yang, Jan Kautz, Xiaolong Wang, and Sifei Liu. Spatialrgpt: Grounded spatial reasoning in vision-language models. InAdvances in Neural Information Processing Systems, volume 37, pages 135062–135093, 2024

    2024

  10. [10]

    S-Agent: Spatial Tool-Use Elicits Reasoning for Spatial Intelligence

    Yalun Dai, Hao Li, Shulin Tian, Runmao Yao, Yuhao Dong, Fangzhou Hong, Zhaoxi Chen, Fangfu Liu, Baoliang Tian, Dingwen Zhang, et al. S-agent: Spatial tool-use elicits reasoning for spatial intelligence.arXiv preprint arXiv:2606.20515, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  11. [11]

    Gemini 3.1 Pro model card, February 2026.https://deepmind.google/models/model-cards/ gemini-3-1-pro/

    Google DeepMind. Gemini 3.1 Pro model card, February 2026.https://deepmind.google/models/model-cards/ gemini-3-1-pro/

    2026

  12. [12]

    Handal: A dataset of real-world manipulable object categories with pose annotations, affordances, and reconstructions

    Andrew Guo, Bowen Wen, Jianhe Yuan, Jonathan Tremblay, Stephen Tyree, Jeffrey Smith, and Stan Birch- field. Handal: A dataset of real-world manipulable object categories with pose annotations, affordances, and reconstructions. In2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 11428–11435. IEEE, 2023

    2023

  13. [13]

    Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning

    Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Peiyi Wang, Qihao Zhu, Runxin Xu, Ruoyu Zhang, Shirong Ma, Xiao Bi, et al. Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning. arXiv preprint arXiv:2501.12948, 2025

    Pith/arXiv arXiv 2025

  14. [14]

    Visual programming: Compositional visual reasoning without training

    Tanmay Gupta and Aniruddha Kembhavi. Visual programming: Compositional visual reasoning without training. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 14953–14962, 2023

    2023

  15. [15]

    Tiger: Tool-integrated geometric reasoning in vision-language models for robotics.arXiv preprint arXiv:2510.07181, 2025

    Yi Han, Enshen Zhou, Shanyu Rong, Jingkun An, Pengwei Wang, Zhongyuan Wang, Cheng Chi, Lu Sheng, and Shanghang Zhang. Tiger: Tool-integrated geometric reasoning in vision-language models for robotics.arXiv preprint arXiv:2510.07181, 2025

    arXiv 2025

  16. [16]

    Model based training, detection and pose estimation of texture-less 3d objects in heavily cluttered scenes

    Stefan Hinterstoisser, Vincent Lepetit, Slobodan Ilic, Stefan Holzer, Gary Bradski, Kurt Konolige, and Nassir Navab. Model based training, detection and pose estimation of texture-less 3d objects in heavily cluttered scenes. InAsian conference on computer vision, pages 548–562. Springer, 2012. 11

    2012

  17. [17]

    What Matters in Orchestrating Robot Policies: A Systematic Study of Hierarchical VLA Agents

    Jiaheng Hu, Mohit Shridhar, Caden Lu, Dhruv Shah, Hao-Tien Lewis Chiang, Jie Tan, and Annie Xie. What matters in orchestrating robot policies: A systematic study of hierarchical vla agents.arXiv preprint arXiv:2606.10267, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  18. [18]

    Visual program distillation: Distilling tools and programmatic reasoning into vision-language models

    Yushi Hu, Otilia Stretcu, Chun-Ta Lu, Krishnamurthy Viswanathan, Kenji Hata, Enming Luo, Ranjay Krishna, and Ariel Fuxman. Visual program distillation: Distilling tools and programmatic reasoning into vision-language models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 9590– 9601, 2024

    2024

  19. [19]

    Does your reasoning model implicitly know when to stop thinking?arXiv preprint arXiv:2602.08354, 2026

    Zixuan Huang, Xin Xia, Yuxi Ren, Jianbin Zheng, Xuanda Wang, Zhixia Zhang, Hongyan Xie, Songshi Liang, Zehao Chen, Xuefeng Xiao, et al. Does your reasoning model implicitly know when to stop thinking?arXiv preprint arXiv:2602.08354, 2026

    Pith/arXiv arXiv 2026

  20. [20]

    Search-r1: Training llms to reason and leverage search engines with reinforcement learning.arXiv preprint arXiv:2503.09516, 2025

    Bowen Jin, Hansi Zeng, Zhenrui Yue, Jinsung Yoon, Sercan Arik, Dong Wang, Hamed Zamani, and Jiawei Han. Search-r1: Training llms to reason and leverage search engines with reinforcement learning.arXiv preprint arXiv:2503.09516, 2025

    Pith/arXiv arXiv 2025

  21. [21]

    Openvla: An open-source vision-language-action model.arXiv preprint arXiv:2406.09246, 2024

    Moo Jin Kim, Karl Pertsch, Siddharth Karamcheti, Ted Xiao, Ashwin Balakrishna, Suraj Nair, Rafael Rafailov, Ethan Foster, Grace Lam, Pannag Sanketi, et al. Openvla: An open-source vision-language-action model.arXiv preprint arXiv:2406.09246, 2024

    Pith/arXiv arXiv 2024

  22. [22]

    The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale.arXiv preprint arXiv:1811.00982, 2018

    Alina Kuznetsova, Hassan Rom, Neil Alldrin, Jasper Uijlings, Ivan Krasin, Jordi Pont-Tuset, Shahab Kamali, Ste- fan Popov, Matteo Malloci, Alexander Kolesnikov, et al. The open images dataset v4: Unified image classification, object detection, and visual relationship detection at scale.arXiv preprint arXiv:1811.00982, 2018

    Pith/arXiv arXiv 2018

  23. [23]

    Cubify anything: Scaling indoor 3d object detection.arXiv preprint arXiv:2412.04458, 2024

    Justin Lazarow, David Griffiths, Gefen Kohavi, Francisco Crespo, and Afshin Dehghan. Cubify anything: Scaling indoor 3d object detection.arXiv preprint arXiv:2412.04458, 2024

    Pith/arXiv arXiv 2024

  24. [24]

    Towards long-horizon embodied agents with tool-aligned vision-language-action models.arXiv preprint arXiv:2605.13119, 2026

    Zixing Lei, Changxing Liu, Yichen Xiong, Minhao Xiong, Yuanzhuo Ding, Zhipeng Zhang, Weixin Li, and Siheng Chen. Towards long-horizon embodied agents with tool-aligned vision-language-action models.arXiv preprint arXiv:2605.13119, 2026

    Pith/arXiv arXiv 2026

  25. [25]

    Depth anything 3: Recovering the visual space from any views.arXiv preprint arXiv:2511.10647, 2025

    Haotong Lin, Sili Chen, Junhao Liew, Donny Y Chen, Zhenyu Li, Guang Shi, Jiashi Feng, and Bingyi Kang. Depth anything 3: Recovering the visual space from any views.arXiv preprint arXiv:2511.10647, 2025

    Pith/arXiv arXiv 2025

  26. [26]

    Deepseek-v3.2: Pushing the frontier of open large language models.arXiv preprint arXiv:2512.02556, 2025

    Aixin Liu, Aoxue Mei, Bangcai Lin, Bing Xue, Bingxuan Wang, Bingzheng Xu, Bochao Wu, Bowei Zhang, Chaofan Lin, Chen Dong, et al. Deepseek-v3.2: Pushing the frontier of open large language models.arXiv preprint arXiv:2512.02556, 2025

    Pith/arXiv arXiv 2025

  27. [27]

    Guava: An Effective and Universal Harness for Embodied Manipulation

    Haowen Liu, Xirui Li, Shaoxiong Yao, Peng Shi, Tianyi Zhou, Jia-Bin Huang, Furong Huang, and Jiayuan Mao. Guava: An effective and universal harness for embodied manipulation.arXiv preprint arXiv:2606.18363, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  28. [28]

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection

    Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, et al. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. InEuropean conference on computer vision, pages 38–55. Springer, 2024

    2024

  29. [29]

    Veriweb: Verifiable long-chain web benchmark for agentic information-seeking.arXiv preprint arXiv:2508.04026, 2025

    Shunyu Liu, Minghao Liu, Huichi Zhou, Zhenyu Cui, Yang Zhou, Yuhao Zhou, Jialiang Gao, Heng Zhou, Yunhao Yang, Wendong Fan, et al. Veriweb: Verifiable long-chain web benchmark for agentic information-seeking.arXiv preprint arXiv:2508.04026, 2025

    arXiv 2025

  30. [30]

    Budget-aware tool-use enables effective agent scaling.arXiv preprint arXiv:2511.17006, 2025

    Tengxiao Liu, Zifeng Wang, Jin Miao, I Hsu, Jun Yan, Jiefeng Chen, Rujun Han, Fangyuan Xu, Yanfei Chen, Ke Jiang, et al. Budget-aware tool-use enables effective agent scaling.arXiv preprint arXiv:2511.17006, 2025

    arXiv 2025

  31. [31]

    Spatialpin: Enhancing spatial reasoning capabilities of vision-language models through prompting and interacting 3d priors

    Chenyang Ma, Kai Lu, Ta-Ying Cheng, Niki Trigoni, and Andrew Markham. Spatialpin: Enhancing spatial reasoning capabilities of vision-language models through prompting and interacting 3d priors. InAdvances in neural information processing systems, volume 37, pages 68803–68832, 2024

    2024

  32. [32]

    Webgpt: Browser-assisted question-answering with human feedback.arXiv preprint arXiv:2112.09332, 2021

    Reiichiro Nakano, Jacob Hilton, Suchir Balaji, Jeff Wu, Long Ouyang, Christina Kim, Christopher Hesse, Shan- tanu Jain, Vineet Kosaraju, William Saunders, et al. Webgpt: Browser-assisted question-answering with human feedback.arXiv preprint arXiv:2112.09332, 2021

    Pith/arXiv arXiv 2021

  33. [33]

    Gpt-5.6: Frontier intelligence that scales with your ambition, July 2026.https://openai.com/index/ gpt-5-6/

    OpenAI. Gpt-5.6: Frontier intelligence that scales with your ambition, July 2026.https://openai.com/index/ gpt-5-6/

    2026

  34. [34]

    Ui-tars: Pioneering automated gui interaction with native agents.arXiv preprint arXiv:2501.12326, 2025

    Yujia Qin, Yining Ye, Junjie Fang, Haoming Wang, Shihao Liang, Shizuo Tian, Junda Zhang, Jiahao Li, Yunxin Li, Shijue Huang, et al. Ui-tars: Pioneering automated gui interaction with native agents.arXiv preprint arXiv:2501.12326, 2025. 12

    Pith/arXiv arXiv 2025

  35. [35]

    Qwen3.5: Towards native multimodal agents, February 2026.https://qwen.ai/blog?id=qwen3.5

    Qwen Team. Qwen3.5: Towards native multimodal agents, February 2026.https://qwen.ai/blog?id=qwen3.5

    2026

  36. [36]

    Qwen3.7-Plus: Multimodal agent intelligence, June 2026.https://qwen.ai/blog?id=qwen3.7-plus

    Qwen Team. Qwen3.7-Plus: Multimodal agent intelligence, June 2026.https://qwen.ai/blog?id=qwen3.7-plus

    2026

  37. [37]

    AlloSpatial: Agentic Harness Framework for Spatial Reasoning in Foundation Models

    ShouweiRuan, BinWang, ZhenyuWu, QihuiZhu, YuxiangZhang, JingzhiLi, YubinWang, andXingxingWei. Al- lospatial: Agenticharnessframeworkforspatialreasoninginfoundationmodels.arXiv preprint arXiv:2606.08952, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  38. [38]

    Toolformer: Language models can teach themselves to use tools

    Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Eric Hambro, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom. Toolformer: Language models can teach themselves to use tools. In Advances in neural information processing systems, volume 36, pages 68539–68551, 2023

    2023

  39. [39]

    Deepseekmath: Pushing the limits of mathematical reasoning in open language models

    Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, YK Li, Yang Wu, et al. Deepseekmath: Pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300, 2024

    Pith/arXiv arXiv 2024

  40. [40]

    Hugginggpt: Solving ai tasks with chatgpt and its friends in hugging face

    Yongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li, Weiming Lu, and Yueting Zhuang. Hugginggpt: Solving ai tasks with chatgpt and its friends in hugging face. InAdvances in Neural Information Processing Systems, volume 36, pages 38154–38180, 2023

    2023

  41. [41]

    Hybridflow: A flexible and efficient rlhf framework.arXiv preprint arXiv:2409.19256, 2024

    Guangming Sheng, Chi Zhang, Zilingfeng Ye, Xibin Wu, Wang Zhang, Ru Zhang, Yanghua Peng, Haibin Lin, and Chuan Wu. Hybridflow: A flexible and efficient rlhf framework.arXiv preprint arXiv:2409.19256, 2024

    Pith/arXiv arXiv 2024

  42. [42]

    Vipergpt: Visual inference via python execution for reasoning

    Dídac Surís, Sachit Menon, and Carl Vondrick. Vipergpt: Visual inference via python execution for reasoning. InProceedings of the IEEE/CVF international conference on computer vision, pages 11888–11898, 2023

    2023

  43. [43]

    Hy-embodied-0.5: Embodied foundation models for real-world agents.arXiv preprint arXiv:2604.07430, 2026

    HY Team, Xumin Yu, Zuyan Liu, Ziyi Wang, He Zhang, Yongming Rao, Fangfu Liu, Yani Zhang, Ruowen Zhao, Oran Wang, et al. Hy-embodied-0.5: Embodied foundation models for real-world agents.arXiv preprint arXiv:2604.07430, 2026

    Pith/arXiv arXiv 2026

  44. [44]

    6-dof pose estimation of household objects for robotic manipulation: An accessible dataset and benchmark

    Stephen Tyree, Jonathan Tremblay, Thang To, Jia Cheng, Terry Mosier, Jeffrey Smith, and Stan Birchfield. 6-dof pose estimation of household objects for robotic manipulation: An accessible dataset and benchmark. In2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 13081–13088. IEEE, 2022

    2022

  45. [45]

    Vggt: Visual geometry grounded transformer

    Jianyuan Wang, Minghao Chen, Nikita Karaev, Andrea Vedaldi, Christian Rupprecht, and David Novotny. Vggt: Visual geometry grounded transformer. InProceedings of the Computer Vision and Pattern Recognition Conference, pages 5294–5306, 2025

    2025

  46. [46]

    Locateanything: Fast and high-quality vision-language grounding with parallel box decoding.arXiv preprint arXiv:2605.27365, 2026

    Shihao Wang, Shilong Liu, Yuanguo Kuang, Xinyu Wei, Yangzhou Liu, Zhiqi Li, Yunze Man, Guo Chen, Andrew Tao, Guilin Liu, et al. Locateanything: Fast and high-quality vision-language grounding with parallel box decoding.arXiv preprint arXiv:2605.27365, 2026

    Pith/arXiv arXiv 2026

  47. [47]

    Orient anything v2: Unifying orientation and rotation understanding.arXiv preprint arXiv:2601.05573, 2026

    Zehan Wang, Ziang Zhang, Jiayang Xu, Jialei Wang, Tianyu Pang, Chao Du, Hengshuang Zhao, and Zhou Zhao. Orient anything v2: Unifying orientation and rotation understanding.arXiv preprint arXiv:2601.05573, 2026

    arXiv 2026

  48. [48]

    Chain-of-thought prompting elicits reasoning in large language models

    Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. Chain-of-thought prompting elicits reasoning in large language models. InAdvances in neural information pro- cessing systems, volume 35, pages 24824–24837, 2022

    2022

  49. [49]

    Posecnn: A convolutional neural network for 6d object pose estimation in cluttered scenes.arXiv preprint arXiv:1711.00199, 2017

    Yu Xiang, Tanner Schmidt, Venkatraman Narayanan, and Dieter Fox. Posecnn: A convolutional neural network for 6d object pose estimation in cluttered scenes.arXiv preprint arXiv:1711.00199, 2017

    Pith/arXiv arXiv 2017

  50. [50]

    Vlaser: Vision-language-action model with synergistic embodied reasoning.arXiv preprint arXiv:2510.11027, 2025

    Ganlin Yang, Tianyi Zhang, Haoran Hao, Weiyun Wang, Yibin Liu, Dehui Wang, Guanzhou Chen, Zijian Cai, Junting Chen, Weijie Su, et al. Vlaser: Vision-language-action model with synergistic embodied reasoning.arXiv preprint arXiv:2510.11027, 2025

    arXiv 2025

  51. [51]

    Thinking in space: How multimodal large language models see, remember, and recall spaces

    Jihan Yang, Shusheng Yang, Anjali W Gupta, Rilyn Han, Li Fei-Fei, and Saining Xie. Thinking in space: How multimodal large language models see, remember, and recall spaces. InProceedings of the Computer Vision and Pattern Recognition Conference, pages 10632–10643, 2025

    2025

  52. [52]

    Swe-agent: Agent-computer interfaces enable automated software engineering

    John Yang, Carlos Jimenez, Alexander Wettig, Kilian Lieret, Shunyu Yao, Karthik Narasimhan, and Ofir Press. Swe-agent: Agent-computer interfaces enable automated software engineering. InAdvances in Neural Information Processing Systems, volume 37, pages 50528–50652, 2024

    2024

  53. [53]

    Depth anything v2

    Lihe Yang, Bingyi Kang, Zilong Huang, Zhen Zhao, Xiaogang Xu, Jiashi Feng, and Hengshuang Zhao. Depth anything v2. InAdvances in Neural Information Processing Systems, volume 37, pages 21875–21911, 2024. 13

    2024

  54. [54]

    Mmsi-bench: A benchmark for multi-image spatial intelligence.arXiv preprint arXiv:2505.23764, 2025

    Sihan Yang, Runsen Xu, Yiman Xie, Sizhe Yang, Mo Li, Jingli Lin, Chenming Zhu, Xiaochen Chen, Haodong Duan, Xiangyu Yue, et al. Mmsi-bench: A benchmark for multi-image spatial intelligence.arXiv preprint arXiv:2505.23764, 2025

    Pith/arXiv arXiv 2025

  55. [55]

    Agentic robot: A brain-inspired framework for vision-language-action models in embodied agents.arXiv preprint arXiv:2505.23450, 2025

    Zhejian Yang, Yongchao Chen, Xueyang Zhou, Jiangyue Yan, Dingjie Song, Yinuo Liu, Yuting Li, Yu Zhang, Pan Zhou, Hechang Chen, et al. Agentic robot: A brain-inspired framework for vision-language-action models in embodied agents.arXiv preprint arXiv:2505.23450, 2025

    Pith/arXiv arXiv 2025

  56. [56]

    React: Synergizing reasoning and acting in language models.arXiv preprint arXiv:2210.03629, 2022

    Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. React: Synergizing reasoning and acting in language models.arXiv preprint arXiv:2210.03629, 2022

    Pith/arXiv arXiv 2022

  57. [57]

    Spatial mental modeling from limited views

    Baiqiao Yin, Qineng Wang, Pingyue Zhang, Jianshu Zhang, Kangrui Wang, Zihan Wang, Jieyu Zhang, Keshigeyan Chandrasegaran, Han Liu, Ranjay Krishna, et al. Spatial mental modeling from limited views. InStructural Priors for Vision Workshop at ICCV’25, 2025

    2025

  58. [58]

    Dapo: An open-source llm reinforcement learning system at scale

    Qiying Yu, Zheng Zhang, Ruofei Zhu, Yufeng Yuan, Xiaochen Zuo, Yu Yue, Weinan Dai, Tiantian Fan, Gaohong Liu, Lingjun Liu, et al. Dapo: An open-source llm reinforcement learning system at scale. InAdvances in Neural Information Processing Systems, volume 38, pages 113222–113244, 2025

    2025

  59. [59]

    Glm-5: from vibe coding to agentic engineering.arXiv preprint arXiv:2602.15763, 2026

    Aohan Zeng, Xin Lv, Zhenyu Hou, Zhengxiao Du, Qinkai Zheng, Bin Chen, Da Yin, Chendi Ge, Chenghua Huang, Chengxing Xie, et al. Glm-5: from vibe coding to agentic engineering.arXiv preprint arXiv:2602.15763, 2026

    Pith/arXiv arXiv 2026

  60. [60]

    Harness VLA: Steering Frozen VLAs into Reliable Manipulation Primitives via Memory-Guided Agents

    Yixian Zhang, Huanming Zhang, Feng Gao, Xiao Li, Zhihao Liu, Chunyang Zhu, Jiaxing Qiu, Yuchen Yan, Jiyuan Liu, Wenhao Tang, et al. Harness vla: Steering frozen vlas into reliable manipulation primitives via memory-guided agents.arXiv preprint arXiv:2607.08448, 2026

    work page internal anchor Pith review Pith/arXiv arXiv 2026

  61. [61]

    Gpt-4v (ision) is a generalist web agent, if grounded.arXiv preprint arXiv:2401.01614, 2024

    Boyuan Zheng, Boyu Gou, Jihyung Kil, Huan Sun, and Yu Su. Gpt-4v (ision) is a generalist web agent, if grounded.arXiv preprint arXiv:2401.01614, 2024

    Pith/arXiv arXiv 2024

  62. [62]

    Roborefer: Towards spatial referring with reasoning in vision-language models for robotics

    Enshen Zhou, Jingkun An, Cheng Chi, Yi Han, Shanyu Rong, Chi Zhang, Pengwei Wang, Zhongyuan Wang, Tiejun Huang, Lu Sheng, et al. Roborefer: Towards spatial referring with reasoning in vision-language models for robotics. InAdvances in Neural Information Processing Systems, volume 38, pages 28404–28481, 2025

    2025

  63. [63]

    name": "query_locate

    Brianna Zitkovich, Tianhe Yu, Sichun Xu, Peng Xu, Ted Xiao, Fei Xia, Jialin Wu, Paul Wohlhart, Stefan Welker, Ayzaan Wahid, et al. Rt-2: Vision-language-action models transfer web knowledge to robotic control. In Conference on Robot Learning, pages 2165–2183. PMLR, 2023. 14 Appendix Table of Contents A Algorithm Pseudocode 17 B Detailed Experimental Setti...

    2023

  64. [64]

    Do not turn a plan, a proposed tool action, answer-option analysis, or an uncertain guess into an observed fact

    Every perceptual claim must be traceable to the current tool result, an explicit visual observation written in the current original reasoning, or a previous unit. Do not turn a plan, a proposed tool action, answer-option analysis, or an uncertain guess into an observed fact

  65. [72]

    Exhaustively verbalize every item and every field exposed by the current tool result. Preserve the returned count, every instance, image index, label, bounding box, point, polygon component and vertex, depth value, pose field, motion field, direction, axis, error, and other returned value. Do not shorten, sample, merge, or omit returned information merely...

    work page

  66. [75]

    Use only entities, attributes, values, and relations present in the evidence units

    work page

  67. [76]

    Merge evidence in dependency order and remove repeated or superseded statements, but do not discard an explicit visual or spatial fact merely because it is unnecessary for choosing the answer

    work page

  68. [77]

    Preserve the concrete visual-spatial descriptions carried by the evidence units and include every essential inference needed to support all clauses of the answer

    work page

  69. [78]

    Never mention tools, calls, results, evidence units, confidence scores, or this instruction

    Write as direct visual reasoning. Never mention tools, calls, results, evidence units, confidence scores, or this instruction

    work page

  70. [79]

    Do not invent entities, attributes, measurements, or relations. 34

    work page

  71. [80]

    answer":

    Put reasoning and answer in separate XML sections. Copy the provided final answer exactly. 12 13Return the structured result in this form: 14<internalization_target> 15<reasoning_chain> 16Complete, detailed, tool-free perceptual reasoning. 17</reasoning_chain> 18<final_answer> 19Exact provided final answer. 20</final_answer> 21</internalization_target> 22...

    work page

  72. [81]

    Locate the beige trash can and the blue trash can in the first image

    work page

  73. [82]

    Get depth for both to confirm which is closer

    work page

  74. [83]

    This includes left/right, above/below, front/behind, near/far, overlap, containment, adjacency, occlusion, orientation, size, appearance, and count descriptions

    Preserve every explicit visual observation and absolute or relative visual-spatial relation from the current original reasoning, even when it is unrelated to the current task. This includes left/right, above/below, front/behind, near/far, overlap, containment, adjacency, occlusion, orientation, size, appearance, and count descriptions

    work page

  75. [84]

    Confirm left/right position based on location

    work page

  76. [85]

    camera motion

    Use ‘query_pose‘ with "camera motion" to determine the rotation direction from image 1 to image 2. **Execution:**

    work page

  77. [86]

    beige trash can

    ‘query_locate‘ for "beige trash can" and "blue trash can" in image 1

    work page

  78. [87]

    ‘query_depth‘ on their centers

    work page

  79. [88]

    camera motion

    ‘query_pose‘ for "camera motion" between image 1 and 2. Let’s refine the queries. - Query 1: "beige trash can with black bag" in image 1. - Query 2: "blue trash can with clear bag" in image 1. - Query 3: "camera motion" from image 1 to 2. Wait, looking at image 2, the blue bin has a recycling symbol. In image 1, the blue bin on the right has a clear bag. ...

    work page

  80. [89]

    Since 0.776 < 0.928, the **blue receptacle is closer**

    **Distances**: The depth query shows the beige receptacle (point [310, 524]) is at **0.928m** and the blue receptacle (point [773, 643]) is at **0.776m**. Since 0.776 < 0.928, the **blue receptacle is closer**

    work page

Showing first 80 references.