Versatile Loco-Manipulation through Flexible Interlimb Coordination
read the original abstract
The ability to flexibly leverage limbs for loco-manipulation is essential for enabling autonomous robots to operate in unstructured environments. Yet, prior work on loco-manipulation is often constrained to specific tasks or predetermined limb configurations. In this work, we present Reinforcement Learning for Interlimb Coordination (ReLIC), an approach that enables versatile loco-manipulation through flexible interlimb coordination. The key to our approach is an adaptive controller that seamlessly bridges the execution of manipulation motions and the generation of stable gaits based on task demands. Through the interplay between two controller modules, ReLIC dynamically assigns each limb for manipulation or locomotion and robustly coordinates them to achieve the task success. Using efficient reinforcement learning in simulation, ReLIC learns to perform stable gaits in accordance with the manipulation goals in the real world. To solve diverse and complex tasks, we further propose to interface the learned controller with different types of task specifications, including target trajectories, contact points, and natural language instructions. Evaluated on 12 real-world tasks that require diverse and complex coordination patterns, ReLIC demonstrates its versatility and robustness by achieving a success rate of 78.9% on average. Videos and code can be found at https://relic-locoman.rai-inst.com.
This paper has not been read by Pith yet.
Forward citations
Cited by 5 Pith papers
-
FT-WBC: Learning Fault-Tolerant Whole-Body Control for Legged Loco-Manipulation
FT-WBC introduces a decoupled policy architecture with a Fault Estimator and Posture Adaptation Module that converts unstable arm-driven posture requests into safe base commands under actuator failures in legged manipulators.
-
Dynamics Are Learned, Not Told: Semi-Supervised Discovery of Latent Dynamics Geometries For Zero-Shot Policy Adaptation
Contrastive learning bounds the Lipschitz constant of a trajectory dynamics encoder to support outcome-centric zero-shot adaptation in MuJoCo robotics tasks under severe dynamics shifts.
-
Sumo: Dynamic and Generalizable Whole-Body Loco-Manipulation
Test-time steering of pre-trained whole-body policies via sample-based planning lets legged robots generalize dynamic loco-manipulation to varied heavy objects and tasks without additional training or tuning.
-
FT-WBC: Learning Fault-Tolerant Whole-Body Control for Legged Loco-Manipulation
FT-WBC is a decoupled-policy framework that uses fault estimation and posture adaptation to synthesize compensatory gaits and preserve arm workspace in legged manipulators under actuator failures.
-
Learning Terrain-Aware Whole-Body Control for Perceptive Legged Loco-Manipulation
TA-WBC is a terrain-aware RL policy for legged loco-manipulation using exteroception, contact-plane sampling, and distillation to improve reachable space, tracking, and stability across terrains.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.