Pith. sign in

REVIEW 2 major objections 6 minor 19 references

Impact of Target and Tool Visualization on Depth Perception and Usability in Optical See-Through AR

T0 review · 2 major / 6 minor · reviewed 2026-08-05 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Opaque target rendering and real-tool occlusion reduce depth errors in optical see-through AR at arm's length.

desk verdict Opaque targets help depth perception in OST-AR, but the real-tool condition bundles occlusion with physical tool presence, so the headline causal claim is overreach. read the letter →

arxiv 2508.18481 v1 pith:BA52UXX5 submitted 2025-08-25 cs.HC cs.CVcs.GR

Yue Yang , Xue Xie , Xinkai Wang , Hui Zhang , Chiming Yu , Xiaoxian Xiong , Lifeng Zhu , Yuanyi Zheng
show 3 more authors
Jue Cen Bruce Daniel Fred Baik
This is my paper · ORCID
classification cs.HCcs.CVcs.GR
keywords opticalsee-throughARdepthperceptionocclusiontransparencyusabilityHoloLens2surgicalguidancetooltracking
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tests how target transparency and tool visualization affect depth perception and usability in optical see-through AR (HoloLens 2) for arm's-distance tasks. Across two experiments with ten participants, it finds that rendering the target opaque rather than highly transparent significantly lowers depth estimation error, and that showing the user's real tracked tool occluding the virtual target produces the highest accuracy and usability with the lowest workload. Failing to track the tool yields the worst performance. The authors argue that correct occlusion cues and opaque rendering are critical for precision in OST-AR, and that transparency should be used only when tool tracking is unavailable.

What carries the argument

The experimental manipulation is the central object: a 2x3 design crossing target transparency (high vs. low) with tool visualization mode (virtual hologram proxy, real tracked tool, no tool tracking). The load-bearing mechanism is occlusion: the real tool hiding part of the target in real time, combined with opaque target rendering, provides a monocular occlusion cue that anchors depth judgment at near-field arm's distance.

What would settle it

Run a preregistered replication with 40+ participants and a realistic surgical drill task on cadavers or phantoms; if opaque target rendering with real-tool occlusion fails to produce lower depth error and higher usability than a transparent target, the central claim is false. Alternatively, a field study in an operating room comparing error rates under the same visualization conditions would settle it.

Watch

Extended reading notes

Core claim

The central discovery is a systematic ordering of visualization conditions: at arm's distance, a low-transparency (opaque) holographic target is estimated with significantly lower depth error than a high-transparency target, and the best overall performance comes from rendering the virtual target opaque while letting the real tracked tool pass in front of it, occluding part of the hologram. The real tool condition outperforms both a virtual tool proxy and a no-tracking condition on localization error, system usability, and perceived workload. The paper interprets this as evidence that occlusion of the virtual target by the real tool supplies the strongest depth cue among the tested options,

Load-bearing premise

The results rest on ten participants performing two controlled laboratory tasks, and if those tasks do not capture the visual and motor demands of real arm's-distance AR use, the reported differences may not transfer to actual surgery or industrial work.

Editorial extensions

If this is right

  • OST-AR designers should render targets opaque and invest in real-time occlusion of virtual content by real tracked tools.
  • If robust tool tracking is unavailable, transparency can be a fallback, but it will not recover depth accuracy or usability.
  • Depth estimation errors increase when a target is highly transparent, so see-through rendering should not be used for precision-critical tasks.
  • Surgical and industrial guidance systems at arm's length should prioritize tool tracking over transparency features.
  • User workload and usability ratings align with objective accuracy, so subjective ratings can serve as a proxy for depth-quality failures.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The occlusion advantage likely generalizes to any manipulated tool (e.g., pointers, drills, styluses) at arm's distance, not just surgical pinpoints.
  • A larger sample with more diverse participants may reveal interactions between transparency and tool mode, since the paper notes the transparent-target/real-tool condition slightly impaired depth cues.
  • The findings suggest that future OST-AR systems should expose occlusion handling as a first-class API, not an optional rendering flag.
  • A testable extension: measure vergence or accommodative responses to see whether occlusion reduces depth error by easing stereo-conflict, which would explain the observed error reduction.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 6 minor

Summary. This paper reports a two-experiment user study on optical see-through AR (HoloLens 2) at arm's distance. Experiment 1 compares high- vs. low-transparency target rendering in a depth matching task; Experiment 2 uses a simulated surgical pinpoint task on a frontal bone model with a 2×3 design (two target transparencies, three tool visualization modes: virtual tool hologram, real tool, and no tool tracking). The authors report that low-transparency targets produce significantly lower depth estimation error, that the real-tool condition (which occludes the virtual target) yields the highest accuracy and usability and the lowest workload, and that no tool tracking yields the worst outcomes. They conclude that correct occlusion, opaque rendering, and real-time tool tracking are critical for depth perception and precision in OST-AR.

Significance. If the findings hold, the paper provides practical, easily actionable guidance: rendering virtual targets opaque and ensuring real tools occlude them can improve depth perception in hand-scale AR tasks. The work is empirical rather than theoretical, with the strength of using a commercial OST-AR device and two complementary tasks (perceptual matching and a precision interaction task). The comparison across tool visualization modes is a useful contribution to a space where occlusion cues are often neglected. However, the causal claim about occlusion is not uniquely established by the experimental design, and the small sample size and lack of reported precision metrics temper the strength of the conclusions.

major comments (2)
  1. [Experiment 2 (abstract)] The real-tool condition bundles several independent cues: presence of the physical tool, occlusion of the virtual target by that real tool, proprioceptive/haptic feedback from the user's hand, and vergence/accommodation from a real object near the task plane. The virtual-tool and no-tracking conditions differ from it along all of these dimensions at once. Therefore the paper's central conclusion that 'correct occlusion cues' are the critical factor is not uniquely supported; the advantage could stem from any component of the bundle. To support the stated design recommendation, the authors need either an experimental condition that separates occlusion from tool presence (e.g., a real tool that does not occlude, or a virtual tool with identical occlusion geometry) or a substantially more cautious causal interpretation.
  2. [Abstract / Results] The abstract repeatedly uses 'significantly' without reporting effect sizes, confidence intervals, or the specific statistical tests and multiple-comparison corrections used for the six-condition comparison. With n=10 participants, the precision of the estimates is a load-bearing concern; the strongest headline claims (e.g., 'lowest workload,' 'worst performance') should be accompanied by quantitative effect sizes and uncertainty bounds. If this information appears later in the full text, the abstract should summarize it; otherwise it should be added.
minor comments (6)
  1. [Abstract / Method] The transparency levels are described only as 'high' and 'low'; please report the actual transmittance or opacity values used, as this is essential for replicating the rendering conditions.
  2. [Experiment 2] Clarify how the 'virtual tool hologram' condition was implemented relative to the real tool: was the same geometric model used, and was its occlusion behavior matched to the real tool? This would help readers assess what the virtual tool condition isolates.
  3. [Experiment 2] The phrase 'showing the real tool (occluding the virtual target)' in the abstract is a characterization of the condition, not an analysis of which cue is responsible. Please rephrase to avoid implying that occlusion is the sole manipulated factor.
  4. [General] The qualitative claim that 'making the target highly transparent... slightly impaired depth cues' is presented as if quantitative; if this is based on user comments, say so and avoid mixing qualitative impressions with significance statements.
  5. [Method] Provide details on counterbalancing/order of the six conditions, since learning and fatigue effects are plausible in a within-subjects design with n=10.
  6. [General] The external validity of the simulated surgical pinpoint task is acknowledged as a limitation in spirit but should be stated explicitly; arm's-length depth perception in a lab may not generalize to real surgical or industrial workflows.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: this is an empirical evaluation with no derivational chain that reduces to its own inputs.

full rationale

The paper is an empirical user study, not a theoretical derivation. It compares rendering transparencies and tool-visualization modes against measured depth matching error, localization error, usability, and workload. No parameter is fitted to the outcome and then renamed as a prediction; no theoretical uniqueness theorem is imported from the authors; no ansatz is smuggled in through citation; and no equation defines a predicted quantity in terms of the measured outcome. The central claims—that more opaque targets yield lower depth error and that showing the real tool occluding the virtual target yields highest accuracy/usability—are direct empirical observations from the 2×3 experiment. Even the skeptical observation that the 'real tool' condition bundles occlusion with physical-tool presence and proprioception is an internal-validity confound, not a circularity: the treatment is not defined by the outcome, and the result would remain an empirical finding even if the causal attribution were underdetermined. Similarly, the small sample size and lack of reported effect sizes concern statistical robustness and generalizability, not circular reasoning. The paper does cite prior work, but the provided text does not show any load-bearing claim resting solely on self-citation; the conclusions are tied to the collected data. Therefore the appropriate circularity score is 0.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

The paper is an empirical user study, so no mathematical free parameters are introduced. The central claims rest on domain assumptions about the validity of the measurements, the representativeness of the sample, and the fidelity of the AR system.

assumptions (3)
  • domain assumption Depth matching error and target localization error are valid operational measures of depth perception in OST-AR.
    The experiments evaluate depth perception through these error metrics (Abstract, Experiment 1 and 2); the paper treats these measurements as proxies for perceptual accuracy.
  • domain assumption The ten participants are representative of the intended user population for arm's-distance AR guidance tasks.
    The study draws conclusions about design guidance from a 10-person sample (Abstract); this assumes the sample size and composition support generalization.
  • domain assumption The HoloLens 2 system renders the conditions as intended and the tracking of the real tool is accurate in the experimental setup.
    The comparisons of tool visualization modes assume that the system's tracking and occlusion rendering behave according to the described conditions (Abstract, Experiment 2).

how reviews work

0 comments
Cite this review

Pith. "Pith review of Impact of Target and Tool Visualization on Depth Perception and Usability in Optical See-Through AR." pith.science (2026). https://pith.science/paper/BA52UXX5

@misc{pith2026250818481,
  author       = {Pith},
  title        = {Pith review of: Impact of Target and Tool Visualization on Depth Perception and Usability in Optical See-Through AR},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/BA52UXX5}},
  note         = {Machine review of arXiv:2508.18481}
}
abstract

Optical see-through augmented reality (OST-AR) systems like Microsoft HoloLens 2 hold promise for arm's distance guidance (e.g., surgery), but depth perception of the hologram and occlusion of real instruments remain challenging. We present an evaluation of how visualizing the target object with different transparencies and visualizing a tracked tool (virtual proxy vs. real tool vs. no tool tracking) affects depth perception and system usability. Ten participants performed two experiments on HoloLens 2. In Experiment 1, we compared high-transparency vs. low-transparency target rendering in a depth matching task at arm's length. In Experiment 2, participants performed a simulated surgical pinpoint task on a frontal bone target under six visualization conditions ($2 \times 3$: two target transparencies and three tool visualization modes: virtual tool hologram, real tool, or no tool tracking). We collected data on depth matching error, target localization error, system usability, task workload, and qualitative feedback. Results show that a more opaque target yields significantly lower depth estimation error than a highly transparent target at arm's distance. Moreover, showing the real tool (occluding the virtual target) led to the highest accuracy and usability with the lowest workload, while not tracking the tool yielded the worst performance and user ratings. However, making the target highly transparent, while allowing the real tool to remain visible, slightly impaired depth cues and did not improve usability. Our findings underscore that correct occlusion cues, rendering virtual content opaque and occluding it with real tools in real time, are critical for depth perception and precision in OST-AR. Designers of arm-distance AR systems should prioritize robust tool tracking and occlusion handling; if unavailable, cautiously use transparency to balance depth perception and tool visibility.

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

19 extracted references · 15 canonical work pages

  1. [1]

    write newline

    " write newline "" before.all 'output.state := STRINGS d dc pc.str doi.urlstr INTEGERS nth.dash doi.string.pos doilen FUNCTION add.doi doi empty "\ doi 'd := "" 'doi.urlstr := #0 'nth.dash := #1 'doi.string.pos := d text.length 'doilen := nth.dash #3 < d doi.string.pos #1 substring 'dc := #1 doi.string.pos + 'doi.string.pos := dc "/" = #1 nth.dash + 'nth....

  2. [2]

    write newline

    " write newline "" before.all 'output.state := STRINGS d dc pc.str doi.urlstr INTEGERS nth.dash doi.string.pos doilen FUNCTION add.doi doi empty "\ doi 'd := "" 'doi.urlstr := #0 'nth.dash := #1 'doi.string.pos := d text.length 'doilen := nth.dash #3 < d doi.string.pos #1 substring 'dc := #1 doi.string.pos + 'doi.string.pos := dc "/" = #1 nth.dash + 'nth....

  3. [3]

    write newline

    " write newline "" before.all 'output.state := STRINGS d dc pc.str doi.urlstr INTEGERS nth.dash doi.string.pos doilen FUNCTION add.doi doi empty "\ doi 'd := "" 'doi.urlstr := #0 'nth.dash := #1 'doi.string.pos := d text.length 'doilen := nth.dash #3 < d doi.string.pos #1 substring 'dc := #1 doi.string.pos + 'doi.string.pos := dc "/" = #1 nth.dash + 'nth....

  4. [4]

    write newline

    " write newline "" before.all 'output.state := STRINGS d dc pc.str doi.urlstr INTEGERS nth.dash doi.string.pos doilen FUNCTION add.doi doi empty "\ doi 'd := "" 'doi.urlstr := #0 'nth.dash := #1 'doi.string.pos := d text.length 'doilen := nth.dash #3 < d doi.string.pos #1 substring 'dc := #1 doi.string.pos + 'doi.string.pos := dc "/" = #1 nth.dash + 'nth....

  5. [5]

    Adams, J

    H. Adams, J. Stefanucci, S. Creem-Regehr, and B. Bodenheimer. Depth perception in augmented reality: The effects of display, shadow, and position. In 2022 IEEE conference on virtual reality and 3D user interfaces (VR) , pp. 792--801. IEEE, 2022

    work page 2022

  6. [6]

    Bangor, P

    A. Bangor, P. Kortum, and J. Miller. Determining what individual sus scores mean: Adding an adjective rating scale. Journal of usability studies , 4(3):114--123, 2009

    work page 2009

  7. [7]

    Bangor, P

    A. Bangor, P. T. Kortum, and J. T. Miller. An empirical evaluation of the system usability scale. Intl. Journal of Human--Computer Interaction , 24(6):574--594, 2008

    work page 2008

  8. [8]

    Birlo, P

    M. Birlo, P. E. Edwards, M. Clarkson, and D. Stoyanov. Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review. Medical Image Analysis , 77:102361, 2022

    work page 2022

Show all 19 references
  1. [9]

    J. C. Dibene and E. Dunn. Hololens 2 sensor streaming. https://github.com/jdibenes/hl2ss, 2022. Accessed: 2025-01-12

    2022

  2. [10]

    Doughty, N

    M. Doughty, N. R. Ghugre, and G. A. Wright. Augmenting performance: A systematic review of optical see-through head-mounted displays in surgery. Journal of Imaging , 8(7):203, 2022

    2022

  3. [11]

    S. G. Hart. Nasa-task load index (nasa-tlx); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting , vol. 50, pp. 904--908. Sage publications Sage CA: Los Angeles, CA, 2006

    2006

  4. [12]

    Krajancich, N

    B. Krajancich, N. Padmanaban, and G. Wetzstein. Factored occlusion: Single spatial light modulator occlusion-capable optical see-through augmented reality display. IEEE transactions on visualization and computer graphics , 26(5):1871--1879, 2020

    2020

  5. [13]

    Y. Li, D. Hu, B. Wang, D. A. Bowman, and S. W. Lee. The effects of incorrect occlusion cues on the understanding of barehanded referencing in collaborative augmented reality. Frontiers in Virtual Reality , 2:681585, 2021

    2021

  6. [14]

    C. Liu, S. Ma, Y. Liu, Y. Wang, and W. Song. Depth perception in optical see-through augmented reality: Investigating the impact of texture density, luminance contrast, and color contrast. IEEE Transactions on Visualization and Computer Graphics , 2024

    2024

  7. [15]

    M. C. Macedo and A. L. Apolinario. Occlusion handling in augmented reality: Past, present and future. IEEE Transactions on Visualization and Computer Graphics , 29(2):1590--1609, 2021

    2021

  8. [16]

    Martin-Gomez, H

    A. Martin-Gomez, H. Li, T. Song, S. Yang, G. Wang, H. Ding, N. Navab, Z. Zhao, and M. Armand. Sttar: surgical tool tracking using off-the-shelf augmented reality head-mounted displays. IEEE Transactions on Visualization and Computer Graphics , 2023

    2023

  9. [17]

    The micron series digitizing probe is useful

    Optitrack. The micron series digitizing probe is useful. https://optitrack.com/accessories/measurement-tools/, 2025. Accessed: 2025-05-12

    2025

  10. [18]

    S. R. Sanches, D. M. Tokunaga, V. F. Silva, A. C. Sementille, and R. Tori. Mutual occlusion between real and virtual elements in augmented reality based on fiducial markers. In 2012 IEEE Workshop on the Applications of Computer Vision (WACV) , pp. 49--54. IEEE, 2012

    2012

  11. [19]

    X. Tang, X. Hu, C.-W. Fu, and D. Cohen-Or. Grabar: Occlusion-aware grabbing virtual objects in ar. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology , pp. 697--708, 2020

    2020

Pith tools

Reviewed August 5, 2026 · model on record in the stance chip above.