REVIEW 4 cited by
Estimating Body and Hand Motion in an Ego-sensed World
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
We present EgoAllo, a system for human motion estimation from a head-mounted device. Using only egocentric SLAM poses and images, EgoAllo guides sampling from a conditional diffusion model to estimate 3D body pose, height, and hand parameters that capture a device wearer's actions in the allocentric coordinate frame of the scene. To achieve this, our key insight is in representation: we propose spatial and temporal invariance criteria for improving model performance, from which we derive a head motion conditioning parameterization that improves estimation by up to 18%. We also show how the bodies estimated by our system can improve hand estimation: the resulting kinematic and temporal constraints can reduce world-frame errors in single-frame estimates by 40%. Project page: https://egoallo.github.io/
Forward citations
Cited by 4 Pith papers
-
Visual Imitation Enables Contextual Humanoid Control
A single policy trained from 123 monocular videos, fine-tuned in simulation, and distilled to heightmap plus root-direction inputs lets a Unitree G1 climb stairs and sit and stand on real furniture.
-
ECHO: Ego-Centric modeling of Human-Object interactions
ECHO jointly predicts human pose, object trajectory, and contact from sparse head-and-wrist tracking using a tri-variate diffusion transformer, and reports the best egocentric human-object interaction reconstruction r...
-
Event-based Egocentric Human Pose Estimation in Dynamic Environment
D-EventEgo is the first pipeline for full-body egocentric pose estimation from a front-facing event camera, validated on a synthetic dataset derived from EgoBody.
-
PyRoki: A Modular Toolkit for Robot Kinematic Optimization
PyRoki is a modular, cross-platform JAX-based toolkit that unifies inverse kinematics, trajectory optimization, and motion retargeting with a Levenberg-Marquardt solver.
Discussion (0). Continue with ORCID to comment.