REVIEW 6 cited by
IndustReal: Transferring Contact-Rich Assembly Tasks from Simulation to Reality
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Robotic assembly is a longstanding challenge, requiring contact-rich interaction and high precision and accuracy. Many applications also require adaptivity to diverse parts, poses, and environments, as well as low cycle times. In other areas of robotics, simulation is a powerful tool to develop algorithms, generate datasets, and train agents. However, simulation has had a more limited impact on assembly. We present IndustReal, a set of algorithms, systems, and tools that solve assembly tasks in simulation with reinforcement learning (RL) and successfully achieve policy transfer to the real world. Specifically, we propose 1) simulation-aware policy updates, 2) signed-distance-field rewards, and 3) sampling-based curricula for robotic RL agents. We use these algorithms to enable robots to solve contact-rich pick, place, and insertion tasks in simulation. We then propose 4) a policy-level action integrator to minimize error at policy deployment time. We build and demonstrate a real-world robotic assembly system that uses the trained policies and action integrator to achieve repeatable performance in the real world. Finally, we present hardware and software tools that allow other researchers to reproduce our system and results. For videos and additional details, please see http://sites.google.com/nvidia.com/industreal .
Forward citations
Cited by 6 Pith papers
-
FORGE-plus: Force-Budgeted Recovery for Contact-Rich Assembly with a Frozen LLM Supervisor
With a hidden per-episode breaking force, an LLM-set force ceiling plus force-signature recovery achieves 256/256 clean insertions on fragile and robust parts and resolves 40–64% of injected jams in simulation.
-
Probabilistic Human Intent Prediction for Mobile Manipulation: An Evaluation with Human-Inspired Constraints
GUIDER couples navigation-level and manipulation-level probabilistic intent beliefs using map context, visual saliency, grasp-feasibility checks, and end-effector kinematics, and reports higher prediction stability th...
-
Tactile Beyond Pixels: Multisensory Touch Representations for Robot Manipulation
Sparsh-X is a transformer trained on about one million unlabeled touch interactions that fuses image, audio, motion, and pressure into representations that boost downstream robot manipulation performance over tactile-...
-
Fabrica: Dual-Arm Assembly of General Multi-Part Objects via Integrated Planning and Learning
A dual-arm robotic system combining hierarchical planning with equivariant residual RL policies demonstrates multi-part assembly of five-to-nine-part objects, with strong step-level but weaker end-to-end real-world success.
-
FlashBack: Consistency Model-Accelerated Shared Autonomy
Consistency model distillation enables one-step denoising of user actions for shared autonomy, achieving faster assistance than DDPM-based methods with comparable or better task success.
-
What Matters for Simulation to Online Reinforcement Learning on Real Robots
Sim-to-online RL on three real robots is stabilized by retaining data, warm-starting the replay buffer, and using asymmetric actor-critic updates with a low actor learning rate.
Discussion (0). Continue with ORCID to comment.