Pith. sign in

REVIEW 4 major objections 5 minor 21 references

Sensor-Placement-Agnostic Sonomyography: Toward Continuous High-Dimensional Control by Users with Tetraplegia

T0 review · 4 major / 5 minor · reviewed 2026-08-01 · deepseek-v4-flash

Pith's one-line read The paper's central claim is that a single ultrasound probe placed almost anywhere on the body yields continuous cursor control from arbitrary tissue motion after a three-pose calibration, with a 2-DOF extension achieving multi-axis control

desk verdict A resourceful pilot with a genuinely useful placement-agnostic SMG idea; the abstract sells the claim harder than the data support. read the letter →

arxiv 2607.26401 v1 pith:Y6TWJGLC submitted 2026-07-29 cs.HC cs.ROeess.SP

classification cs.HCcs.ROeess.SP
keywords sonomyographyultrasoundcontrolopticalflowtetraplegiaassistivetechnologycontinuoussensor-placement-agnosticmotorrehabilitation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that a single ultrasound probe, placed almost anywhere on the body, can give a person continuous control of a cursor after only a three-pose calibration. The method tracks small tissue features in the ultrasound image and maps their aggregate motion — including passive tissue motion, not just muscle contraction — to a continuous 1-DOF signal. All nine participants, including three cervical spinal cord injury survivors, achieved continuous 1-DOF control at all six sensor locations tested, and every participant reached under 5.5% tracking error at least one placement. A preliminary 2-DOF extension, calibrated with the help of an orthogonality check, let all participants modulate a two-dimensional cursor and several complete a letter-drawing task, which the authors call the first location-agnostic multi-DOF continuous sonomyography control. If these claims hold, SMG becomes a rapidly calibratable, high-dimensional control channel for assistive devices that can be tailored to each user's residual function.

What carries the argument

The load-bearing object is a linear mean-projection control law. For each tracked point, calibration records its neutral, up, and down positions; the live cursor position is the average across points of how far the current point has moved along the neutral-to-up line, normalized by the calibration distance and clamped to [0,1]. For 2-DOF, a computer-guided calibration adds a 'right' pose at which at least roughly half the points move within 30 degrees of orthogonal to their up motion, and the same projection is applied along each axis. This turns raw image motion into a bounded, continuous, unitless signal with no training data and makes the algorithm indifferent to which tissue is moving.

What would settle it

Take a sensor placement that passes the 1-DOF calibration but whose 'up' and 'right' feature-displacement vectors are mostly within 30 degrees of orthogonal (|cosine| ≤ 0.5) for fewer than half the tracked points. The paper's criterion predicts 2-DOF calibration should fail or couple; if independent 2-DOF control still emerges, the orthogonality assumption is not the deciding factor. Symmetrically, if a placement with the criterion satisfied yields no independent axes, the sufficiency claim is falsified.

Watch

Extended reading notes

Core claim

The central claim: a control signal can be read out of arbitrary tissue deformation with no learned model. Roughly 30 trackable points are selected in the brightness-mode ultrasound image; the user defines neutral, up, and down poses; the live cursor position is the average, across points, of the current position's progress along the neutral-to-up vector, normalized and clamped. The same geometric rule works on biceps, neck, shoulder, and wrist sites, using passive tissue motion when the underlying muscle is not voluntarily active. All nine participants (three with cervical spinal cord injury) achieved continuous 1-DOF control at all six placements, with best errors under 5.5% (often under 4

Load-bearing premise

The system's load-bearing premise is that the chosen sensor spot always provides enough trackable image features moving far enough — and, for 2-DOF, in sufficiently orthogonal directions — between the user's calibration poses, and that the resulting linear projection stays accurate for minutes despite tracker drift; the paper itself reports placements where this failed.

Editorial extensions

If this is right

  • Continuous 1-DOF control works at all tested body locations, including placements where the user has no voluntary control of the underlying muscle, because the tracker uses passive tissue motion.
  • Three-pose calibration makes it practical to quickly test many sensor locations and motions, letting each user find the control site that best fits their residual function and preference.
  • Since the best placement varied by user and every placement was best for at least one participant, placement-agnosticism is a functional requirement for heterogeneous tetraplegic populations, not just a convenience.
  • Single-probe 2-DOF control is feasible: all participants could modulate both axes and all three SCI participants traversed the full 2D workspace, supporting high-dimensional control without additional hardware.
  • Performance is best during slow, held motions and degrades with speed and time due to optical-flow drift, so the current system is a proof point for the approach rather than a finished interface.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the geometric readout works at arbitrary sites, a natural next system is a 'body scan' calibration where a clinician sweeps one probe over several regions and software automatically recommends the placement with the largest, most orthogonal feature motions — something the paper's data implicitly enables.
  • The 2-DOF coupling and 'binding' the authors observe suggest the independence assumption, not the image content, is the bottleneck; a nonlinear decoder or signal-decomposition step trained on the same three-pose calibration could recover more independent axes.
  • The finding that passive tissue motion carries usable control signals expands the candidate body surface for tetraplegic users beyond innervated muscles; head and neck placements could serve users with no arm function, which the authors flag but did not yet recruit.
  • The anti-correlation between calibration motion size and error points to a testable refinement: automatically rescaling or amplifying small feature displacements before projection could improve control for users with limited range of motion.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper presents a real-time sonomyography (SMG) control system based on sparse Lucas–Kanade optical flow tracking of B-mode ultrasound features. A 1-DOF controller is calibrated from three user-defined poses (neutral, up, down) and maps the average normalized displacement of tracked points to cursor position (Eq. 1). A preliminary 2-DOF extension adds a computer-aided calibration that asks users to find a second motion approximately orthogonal to the first. The system is evaluated on 3 cervical SCI survivors and 6 uninjured participants across 6 sensor placements, with an abstract claim that all participants achieved continuous 1-DOF control at all tested sensor locations and <5.5% tracking error at least one placement, and that the 2-DOF results constitute the first location-agnostic multi-DOF continuous SMG control demonstration. The authors also release code and data via OpenMyoControl on SimTK.

Significance. If the claims hold, the work is significant: it offers a calibration-lean, placement-agnostic alternative to data-hungry SMG/sEMG decoders, with a plausible mechanism for exploiting passive tissue motion for users with tetraplegia. Strengths include the open-source release, real-time operation, inclusion of SCI participants, and exploration of anatomically diverse sensor locations. The central 1-DOF idea is simple and intuitive, and the paper is honest about several limitations in Section VI. However, the headline claims outrun the evidence: the evaluation protocol pre-screened sensor placements, incomplete trials are folded into averages, and the 2-DOF 'location-agnostic' claim rests on a single self-selected placement per participant. These issues are fixable with more transparent reporting and qualified claims, so the result is not fatally compromised.

major comments (4)
  1. [§IV-C and §III-A] The placement-agnostic claim is undermined by the evaluation protocol. §IV-C states that probe placement was 'adjusted as needed by investigators based on real-time inspection of the ultrasound image to ensure sufficient adherence to section III-A-defined signal qualities.' Because the tested locations were thus filtered to satisfy the algorithm's preconditions (trackable features, sufficient displacement, and, for 2-DOF, orthogonality), the abstract's 'all tested sensor locations' cannot be read as evidence for arbitrary placement. To support the central claim, the paper should report the number of initial attachment failures, the number/type of adjustments per placement, and ideally include a condition in which placements are chosen without real-time image-based correction.
  2. [Fig. 3 and §V-A.2] The reporting of incomplete trials is misleading. The Fig. 3 caption says values are averaged across 'all successful trials' while asterisks indicate participants who 'were unable to complete all trials' for given placements/motions (participants 2, 5, 7; BIC, TRA, DEL, FLE, SCM). These non-completions are silently absorbed into the per-placement means, so the statement in §V-A.2 that 'every participant demonstrated some level of control with every sensor placement' and the abstract's 'all participants achieved continuous 1-DOF control at all tested sensor locations' are not supported. The paper should report trial completion rates separately, treat incomplete configurations as failures in any aggregate claim, and provide a defined criterion for 'control' (e.g., RMSE relative to a no-control or chance baseline).
  3. [§V-A.1 and §V-A.2] No error bars, confidence intervals, or chance baseline are provided for the primary 1-DOF results. RMSE is reported as a unitless fraction of screen height, but without a comparison to chance-level tracking (e.g., cursor held at center, uncontrolled drift, or a random mapping) the numerical RMSE values do not themselves establish that a participant achieved voluntary 'control.' This is particularly important for the strongest claim, '<5.5% tracking error at at least one placement,' which needs a statistical or pre-specified threshold. Adding per-participant/per-placement variability and a null-condition comparison would make the claim falsifiable and reproducible.
  4. [§V-B, Fig. 6, Fig. 7] The 2-DOF 'location-agnostic' claim is not supported by the experimental design. Each participant was tested at a single self-selected sensor location, with unlimited recalibration and repositioning (§IV-D), and the results show substantial coupling, 'binding,' and inaccessible workspace regions for several participants (Fig. 6). The abstract's 'location-agnostic multi-DOF continuous SMG-based control' should be qualified to 'single arbitrary location per participant' or 'proof-of-concept at a user-selected location.' The quantitative success criteria for the drawing task (Fig. 7) should also be stated.
minor comments (5)
  1. [§V-A.4 / Fig. 5] The regression in Fig. 5 has R²=0.0466; the phrase 'significantly anticorrelated' is technically true (p=0.002) but the effect size is very small. Please temper the wording and discuss practical relevance.
  2. [§III-D] The 2-DOF orthogonality threshold ('at least 50% of available points within 30°') is presented as an empirical choice. A sensitivity analysis or at least a note on how this threshold affects calibration success would strengthen the paper.
  3. [§IV-C] The statement that functional attachment locations were 'largely easy to find' (footnote 1) is anecdotal. Please report the actual number of placement attempts and adjustments per participant.
  4. [General] Some formatting issues: '12×12cm' should be '12 cm × 12 cm'; '29.2±14.2y' should be formatted consistently; the OpenMyoControl release should include a version/access date.
  5. [§V-A.3 / Fig. 4] The exemplar trajectory is illustrative but not quantitatively representative. Consider reporting median/quartile trajectories or a summary statistic for the qualitative claims about overshoot and saturation.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the calibration defines a control law, and the evaluation measures behavioral tracking on that law rather than a fitted prediction.

full rationale

The paper's central derivation is a signal-processing construction, not a predictive model. Equation (1) defines the cursor position as the mean projected displacement of optical-flow-tracked points relative to user-defined neutral/up/down poses; it is an implemented control law rather than a quantity fitted to outcome data. The tracking task then measures how well users can hold intermediate positions on that calibrated mapping, which is a standard user-calibration loop, not a fitted-input-called-prediction: no held-out prediction is made from fitted parameters, and trajectory error is an external behavioral measurement. The only self-citations ([6], [7]) are background for the optical-flow approach; the algorithm is fully specified in Sections III-B/C using Lucas-Kanade from OpenCV, so those citations are not load-bearing. The protocol's real-time placement adjustment (Section IV-C) and recalibration allowance could weaken the external claim of placement-agnosticism, but that is a sampling/validity limitation (acknowledged in footnote 1), not circular reasoning, because placement selection does not enter Eq. (1) as a fitted parameter and no equation reduces to its input. Similarly, the computer-aided 'right' calibration in Section III-D selects a pose with orthogonal feature motion, but the drawing task evaluates independent modulation beyond the calibration points. Therefore no circular step is present.

Assumptions & free parameters 4 free parameters · 6 assumptions · 0 invented entities

The system's success depends on empirical algorithmic choices (point counts, thresholds) and on assumptions about tissue motion linearity and optical-flow stability. No new physical entities are introduced. The 3-pose calibration is per-user data, not a fitted model.

free parameters (4)
  • feature counts (60 initial, <=30 tracked) = 60 / 30
    Chosen empirically in preprocessing (Sec. III-B); affects spatial coverage and robustness to point loss.
  • border exclusion fraction = 20% of image border
    Points near border removed to reduce track loss (Sec. III-B); value is a hand-set threshold.
  • 2-DOF orthogonality threshold = 30 degrees
    A right pose is accepted when enough feature displacement vectors are within 30 degrees of orthogonal to up displacement (Sec. III-D).
  • minimum orthogonal-feature fraction = 50%
    The paper says at least 50% of points generally provides reasonable performance for 2-DOF (Sec. III-D).
assumptions (6)
  • domain assumption Lucas-Kanade optical flow assumes brightness constancy and small inter-frame motion between ultrasound frames.
    Used to track features (Sec. III-B); violations cause point drift, acknowledged in V-A.3.
  • domain assumption Tissue deformation between calibration poses is approximately linear, so the mean-projection cursor mapping (Eq. 1) is valid.
    Nonlinear soft-tissue dynamics are acknowledged in the 2-DOF section V-B; if nonlinearity is severe, the cursor mapping distorts.
  • domain assumption User-selected calibration poses bracket the range of intended control and remain stable across the trial.
    Calibration defines neutral/up/down (and right) positions; without stability, the control signal saturates or drifts.
  • domain assumption RMSE relative to screen height is a meaningful measure of control performance; a chance-level or no-control baseline is not needed.
    Metric defined in V-A.1; no baseline is provided, so the paper implicitly assumes low RMSE implies volitional control.
  • domain assumption At non-innervated sensor sites, residual or passive tissue motion can still drive the cursor.
    Supports the placement-agnostic claim, e.g., participant 2 using FLE via supination/pronation (V-A.2).
  • standard math Principal component analysis identifies the direction of maximal feature spread for resampling.
    Used in preprocessing (Sec. III-B); assumes PCA on the point cloud is a good proxy for promising tissue features.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Sensor-Placement-Agnostic Sonomyography: Toward Continuous High-Dimensional Control by Users with Tetraplegia." pith.science (2026). https://pith.science/paper/Y6TWJGLC

@misc{pith2026260726401,
  author       = {Pith},
  title        = {Pith review of: Sensor-Placement-Agnostic Sonomyography: Toward Continuous High-Dimensional Control by Users with Tetraplegia},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/Y6TWJGLC}},
  note         = {Machine review of arXiv:2607.26401}
}
read the original abstract

Sonomyography (SMG) enables continuous device control via ultrasound-measured muscle deformation signals, but existing SMG interfaces generally require substantial user- and sensor-location-specific training data and provide only one proportional signal or task-specific classification. We present a real-time, sensor-placement-agnostic SMG control system based on sparse optical flow tracking that enables continuous 1-DOF control after minimal calibration (3 pose definitions). We also present a preliminary expansion of this method that augments this algorithm with a short computer-aided calibration to enable 2-DOF control. We evaluate both 1- and 2-DOF systems' performance for a preliminary cohort of 3 cervical spinal cord injury survivors and 6 uninjured individuals across 6 sensor placements spanning the arm, neck, and upper torso. As assessed by a cursor trajectory tracking task, all participants achieved continuous 1-DOF control at all tested sensor locations (even those that relied on passive tissue motions), with all participants achieving <5.5% tracking error using at least one placement (and many <4% across many). All participants were also able to modulate 2D cursor position via the 2-DOF system, with varying levels of control authority, and several were able to complete a 2D drawing task, constituting the first (to our knowledge) demonstration of location-agnostic multi-DOF continuous SMG-based control. These results highlight the promise of SMG to enable rapidly calibratable, high-dimensional, sensor-placement-agnostic device control by users with tetraplegia, and also illuminate key challenges in both signal processing and practical system deployment. To enable further development by scientific and user communities, developed algorithms have been open-sourced as part of the OpenMyoControl project on SimTK (simtk.org/projects/openmyocontrol).

Figures

Figures reproduced from arXiv: 2607.26401 by the authors.

Figure 1
Figure 1. While biosensing interfaces are a promising tool with which to [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Hardware setup, signal preprocessing, and algorithmic details enabling 1- and 2-DOF cursor control from a single B-mode ultrasound time series [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Average RMSE during the 1-DOF trajectory tracking task, [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figures from the paper (4 more)
Figure 4
Figure 4. Figure 4: Top: Average RMSE for each participant during each segment of the 1-DOF trajectory tracking task across all successful trials and sensor placements. Early segments highlight the strong performance of the system during slow motions and holds — a notable advantage over m…
Figure 3
Figure 3. Figure 3: Figure 4 ( [PITH_FULL_IMAGE:figures/full_fig_p006_3.png]
Figure 8
Figure 8. Figure 8: Ranking of each sensor placement from 1 (most preferred) to 6 [PITH_FULL_IMAGE:figures/full_fig_p007_8.png]
Figure 7
Figure 7. Figure 7: Exemplar target (blue) and user-generated (yellow) trajectories (participant 8, placement SCM) illustrate the trajectory following capabil￾ities of the current 2-DOF system, the first (to the authors’ knowledge) demonstration of continuous, location-agnostic, 2-dimensi…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

21 extracted references · 1 linked inside Pith

  1. [1]

    A review and ap- praisal of clinically prevalent control devices for electrically powered wheelchairs,

    G. I. Henderson, M. J. Dolan, and C. J. Geggie, “A review and ap- praisal of clinically prevalent control devices for electrically powered wheelchairs,”Technology and Disability, vol. 25, no. 4, pp. 221–232, 2013

  2. [2]

    Control of a wheelchair-mounted 6DOF assistive robot with chin and finger joysticks,

    I. Rulik, M. S. H. Sunnyet al., “Control of a wheelchair-mounted 6DOF assistive robot with chin and finger joysticks,”Frontiers in Robotics and AI, vol. 9, p. 885610, 2022

  3. [3]

    Controlling a robotic arm for functional tasks using a wireless head-joystick: A case study of a child with congenital absence of upper and lower limbs,

    S. Aspelund, P. Patelet al., “Controlling a robotic arm for functional tasks using a wireless head-joystick: A case study of a child with congenital absence of upper and lower limbs,”PLOS One, vol. 15, no. 8, p. e0226052, 2020

  4. [4]

    Comparative study on different adaptation approaches concerning a sip and puff controller for a powered wheelchair,

    I. Mougharbel, R. El-Hajjet al., “Comparative study on different adaptation approaches concerning a sip and puff controller for a powered wheelchair,” in2013 Science and Information Conference. IEEE, 2013, pp. 597–603

  5. [5]

    Sonomyography for Control of Upper-Limb Prostheses: Current State and Future Directions,

    S. M. Engdahl, S. A. Acu ˜naet al., “Sonomyography for Control of Upper-Limb Prostheses: Current State and Future Directions,”JPO: Journal of Prosthetics and Orthotics, vol. 36, no. 3, p. 174, Jul. 2024

  6. [6]

    Muscle deformation correlates with output force during isometric contraction,

    L. A. Hallock, A. Veluet al., “Muscle deformation correlates with output force during isometric contraction,” inBioRob. IEEE, 2020

  7. [7]

    Toward Real-Time Muscle Force Inference and Device Control via Optical-Flow-Tracked Muscle De- formation,

    L. A. Hallock, B. Sudet al., “Toward Real-Time Muscle Force Inference and Device Control via Optical-Flow-Tracked Muscle De- formation,”IEEE TNSRE, vol. 29, pp. 2625–2634, 2021

  8. [8]

    Targeting recovery: Priorities of the spinal cord- injured population,

    K. D. Anderson, “Targeting recovery: Priorities of the spinal cord- injured population,”Journal of Neurotrauma, vol. 21, no. 10, pp. 1371–1383, 2004

Show all 21 references
  1. [9]

    Traumatic spinal cord injury facts and figures at a glance,

    National Spinal Cord Injury Statistical Center, “Traumatic spinal cord injury facts and figures at a glance,” 2024, accessed: 2025-06-26

  2. [10]

    Jaco assistive robot user guide,

    Kinova, “Jaco assistive robot user guide,” https://assistive. kinovarobotics.com/uploads/EN-UG-007-Jaco-user-guide-R05.pdf, 2021, accessed: 2025-06-26

  3. [11]

    emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation,

    S. Salter, R. Warrenet al., “emg2pose: A Large and Diverse Benchmark for Surface Electromyographic Hand Pose Estimation,” Dec. 2024, arXiv:2412.02725 [cs]. [Online]. Available: http://arxiv. org/abs/2412.02725

  4. [12]

    Proprioceptive Sonomyographic Control: A novel method for intuitive and proportional control of multiple degrees-of-freedom for individuals with upper extremity limb loss,

    A. S. Dhawan, B. Mukherjeeet al., “Proprioceptive Sonomyographic Control: A novel method for intuitive and proportional control of multiple degrees-of-freedom for individuals with upper extremity limb loss,”Scientific Reports, vol. 9, no. 1, p. 9499, Jul. 2019

  5. [13]

    Review of sEMG for Robot Control: Tech- niques and Applications,

    T. Song, Z. Yanet al., “Review of sEMG for Robot Control: Tech- niques and Applications,”Applied Sciences, vol. 13, no. 17, p. 9546, Jan. 2023

  6. [14]

    A Sonomyography-Based Muscle Computer Interface for Individuals With Spinal Cord Injury,

    M. Shenbagam, A. T. Kamathamet al., “A Sonomyography-Based Muscle Computer Interface for Individuals With Spinal Cord Injury,” IEEE Journal of Biomedical and Health Informatics, vol. 28, no. 5, pp. 2713–2722, May 2024

  7. [15]

    An iterative image registration technique with an application to stereo vision,

    B. D. Lucas and T. Kanade, “An iterative image registration technique with an application to stereo vision,” inProceedings of Imaging Understanding Workshop, 1981, pp. 121–130

  8. [16]

    The OpenCV Library,

    G. Bradski, “The OpenCV Library,”Dr. Dobb’s Journal of Software Tools, pp. 120–125, 2000

  9. [17]

    Good features to track,

    J. Shi and Tomasi, “Good features to track,” inCVPR, Jun. 1994, pp. 593–600, iSSN: 1063-6919

  10. [18]

    Measuring emotion: The Self- Assessment Manikin and the Semantic Differential,

    M. M. Bradley and P. J. Lang, “Measuring emotion: The Self- Assessment Manikin and the Semantic Differential,”Journal of Behav- ior Therapy and Experimental Psychiatry, vol. 25, no. 1, pp. 49–59, 1994

  11. [19]

    A technique for the measurement of attitudes,

    R. Likert, “A technique for the measurement of attitudes,”Archives of Psychology, 1932

  12. [20]

    Uncertainty Quantification of Lucas Kanade Feature Track and Application to Visual Odometry,

    X. I. Wong and M. Majji, “Uncertainty Quantification of Lucas Kanade Feature Track and Application to Visual Odometry,” inCVPR Workshops, Jul. 2017, pp. 950–958, iSSN: 2160-7516

  13. [21]

    Learning to control complex robots using high-dimensional body-machine interfaces,

    J. Lee, T. Gebrekristoset al., “Learning to control complex robots using high-dimensional body-machine interfaces,”ACM Transactions on Human–Robot Interaction, vol. 13, no. 3, pp. 1–20, 2024

Pith tools

Reviewed August 1, 2026 · model on record in the stance chip above.