REVIEW 12 cited by
OPEN TEACH: A Versatile Teleoperation System for Robotic Manipulation
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
abstract
Open-sourced, user-friendly tools form the bedrock of scientific advancement across disciplines. The widespread adoption of data-driven learning has led to remarkable progress in multi-fingered dexterity, bimanual manipulation, and applications ranging from logistics to home robotics. However, existing data collection platforms are often proprietary, costly, or tailored to specific robotic morphologies. We present OPEN TEACH, a new teleoperation system leveraging VR headsets to immerse users in mixed reality for intuitive robot control. Built on the affordable Meta Quest 3, which costs $500, OPEN TEACH enables real-time control of various robots, including multi-fingered hands and bimanual arms, through an easy-to-use app. Using natural hand gestures and movements, users can manipulate robots at up to 90Hz with smooth visual feedback and interface widgets offering closeup environment views. We demonstrate the versatility of OPEN TEACH across 38 tasks on different robots. A comprehensive user study indicates significant improvement in teleoperation capability over the AnyTeleop framework. Further experiments exhibit that the collected data is compatible with policy learning on 10 dexterous and contact-rich manipulation tasks. Currently supporting Franka, xArm, Jaco, and Allegro platforms, OPEN TEACH is fully open-sourced to promote broader adoption. Videos are available at https://open-teach.github.io/.
Forward citations
Cited by 12 Pith papers
-
SAIL: Faster-than-Demonstration Execution of Imitation Learning Policies
A full-stack speed-adaptation system lets imitation-learned robot policies execute up to 3-4x faster than human demonstrations while preserving task success rates.
-
Learning Panorama-Aware VLA for Mobile Manipulation with Whole-Body Teleoperation
Adding a panoramic camera feed to a vision-language-action policy raises end-to-end success on four real-world mobile two-arm tasks from 30% to 73%.
-
DexDirect: Direct Kinesthetic Arm Guidance for Efficient Dexterous Demonstration Collection
A hybrid kinesthetic-arm-plus-webcam-hand teleoperation interface achieved 17x/3x higher demonstration throughput than vision baselines and trained a 90%-success pick-and-place policy in a ten-person study.
-
ModPack: An Extensible Teleoperation Interface for Bimanual Mobile Manipulation
A modular backpack-based teleoperation interface enables bimanual mobile manipulation with haptic feedback and active perception across multiple robot platforms.
-
Play2Perfect: What Matters in Dexterous Play Pretraining for Precise Assembly?
Task-agnostic RL play pretraining on diverse objects yields a reusable dexterous prior that makes sparse-reward assembly learning ~33× more sample-efficient and enables zero-shot sim-to-real transfer on tight insertio...
-
BEAVR: Bimanual, multi-Embodiment, Accessible, Virtual Reality Teleoperation System for Robots
BEAVR provides an open-source, low-cost VR teleoperation pipeline for multiple robot embodiments, with LeRobot-format data recording and compatibility with ACT, Diffusion Policy, and SmolVLA.
-
TypeTele: Releasing Dexterity in Teleoperation by Dexterous Manipulation Types
A type-guided teleoperation system that selects predefined dexterous hand poses with a language model outperforms retargeting-based teleoperation on nine real-world tasks and improves imitation learning success.
-
Vision in Action: Learning Active Perception from Human Demonstrations
ViA trains bimanual manipulation policies from human demonstrations that include active head-camera movement, using a 6-DoF robot neck and a VR interface with point-cloud rendering, reporting large gains on three occl...
-
Touch begins where vision ends: Generalizable policies for contact-rich manipulation
A localize-then-execute policy that combines vision-language reaching, semantic background augmentation, and residual reinforcement learning with tactile sensing reaches about 90% success on millimeter-precision manip...
-
Understanding and Mitigating Network Latency Effect on Teleoperated-Robot with Extended Reality
TeleXR decouples robot control and XR visualization from network delays by having each side reconstruct the other's state from local sensor data.
-
SCIZOR: A Self-Supervised Approach to Data Curation for Large-Scale Imitation Learning
SCIZOR filters suboptimal and redundant state-action pairs from robot demonstrations without human labels, improving imitation-learning policy success rates by about 15% on average.
-
Ask-to-Clarify: Resolving Instruction Ambiguity through Multi-turn Dialogue
Ask-to-Clarify combines a dialogue VLM with a frozen diffusion policy so a robot can disambiguate instructions and then execute low-level actions on 8 real-world tasks.
Discussion (0). Sign in to comment.