REVIEW 5 cited by
AnyRotate: Gravity-Invariant In-Hand Object Rotation with Sim-to-Real Touch
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Human hands are capable of in-hand manipulation in the presence of different hand motions. For a robot hand, harnessing rich tactile information to achieve this level of dexterity still remains a significant challenge. In this paper, we present AnyRotate, a system for gravity-invariant multi-axis in-hand object rotation using dense featured sim-to-real touch. We tackle this problem by training a dense tactile policy in simulation and present a sim-to-real method for rich tactile sensing to achieve zero-shot policy transfer. Our formulation allows the training of a unified policy to rotate unseen objects about arbitrary rotation axes in any hand direction. In our experiments, we highlight the benefit of capturing detailed contact information when handling objects of varying properties. Interestingly, we found rich multi-fingered tactile sensing can detect unstable grasps and provide a reactive behavior that improves the robustness of the policy. The project website can be found at https://maxyang27896.github.io/anyrotate/.
Forward citations
Cited by 5 Pith papers
-
NeuralTouch: Neural Descriptors for Precise Sim-to-Real Tactile Robot Control
A robot grasping system that uses neural descriptor fields to guide a tactile RL policy achieves sub-millimetre precision in simulation and zero-shot transfer to real peg-in-hole and bottle-lid-opening tasks.
-
Towards Artificial Nerves: Biomimetic Optical-Fiber Tactile Sensing for Robots
One-to-one pin-to-optical-fiber pairing lets a soft skin send touch images to a remote camera, where image moments localize contacts to 0.4 mm and classify basic shapes.
-
PTLD: Sim-to-real Privileged Tactile Latent Distillation for Dexterous Manipulation
PTLD distills real privileged tactile data into a state estimator to boost sim-to-real performance of proprioceptive dexterous manipulation policies, yielding 182% improvement on in-hand rotation and 57% on reorientat...
-
Text2Touch: Tactile In-Hand Manipulation with LLM-Designed Reward Functions
First demonstration that LLM-generated reward functions using tactile sensing can outperform a human-engineered baseline for real-world in-hand rotation.
-
Detecting Reading-Induced Confusion Using EEG and Eye Tracking
Multimodal EEG plus eye tracking classifies reading-induced confusion at 77.3% average weighted accuracy, beating unimodal models by 4-22%, in an 11-participant study.
Discussion (0). Continue with ORCID to comment.