REVIEW 9 cited by
PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videos
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Creating a physical digital twin of a real-world object has immense potential in robotics, content creation, and XR. In this paper, we present PhysTwin, a novel framework that uses sparse videos of dynamic objects under interaction to produce a photo- and physically realistic, real-time interactive virtual replica. Our approach centers on two key components: (1) a physics-informed representation that combines spring-mass models for realistic physical simulation, generative shape models for geometry, and Gaussian splats for rendering; and (2) a novel multi-stage, optimization-based inverse modeling framework that reconstructs complete geometry, infers dense physical properties, and replicates realistic appearance from videos. Our method integrates an inverse physics framework with visual perception cues, enabling high-fidelity reconstruction even from partial, occluded, and limited viewpoints. PhysTwin supports modeling various deformable objects, including ropes, stuffed animals, cloth, and delivery packages. Experiments show that PhysTwin outperforms competing methods in reconstruction, rendering, future prediction, and simulation under novel interactions. We further demonstrate its applications in interactive real-time simulation and model-based robotic motion planning.
Forward citations
Cited by 9 Pith papers
-
Learning Physics-Guided Residual Dynamics for Deformable Object Simulation
Physics-guided residual dynamics, a spring-mass simulator plus a network that predicts velocity corrections, yields the most accurate deformable-object simulation in the paper's real-world tests.
-
Picasso: Holistic Scene Reconstruction with Physics-Constrained Sampling
Picasso produces multi-object scene reconstructions that are both geometrically accurate and physically plausible by using physics-constrained rejection sampling over an inferred contact graph, outperforming prior met...
-
SoMA: A Real-to-Sim Neural Simulator for Robotic Soft-body Manipulation
SoMA couples robot joint actions, environmental forces, and learned Gaussian-splat dynamics into a single neural simulator, improving resimulation and generalization on real robot soft-body manipulation by about 20% o...
-
TRELLIS-Enhanced Surface Features for Comprehensive Intracranial Aneurysm Analysis
TRELLIS-derived surface features improve aneurysm classification, segmentation, and hemodynamic simulation, including a 15% lower blood-flow prediction error.
-
AntiGrounding: Lifting Robotic Actions into VLM Representation Space for Decision Making
AntiGrounding lifts candidate robot trajectories into the VLM's visual space via multi-view rendering and structured VQA, and reports 57.5% average success across eight manipulation tasks, beating three intermediate-r...
-
SiPhy: Single-Image Physical Property Reasoning
A single-image vision-language pipeline reports state-of-the-art mass, density, and stiffness predictions by combining CLIP features, a fine-tuned VLM, and depth-adaptive pseudo-voxel sampling.
-
Pixie: Fast and Generalizable Supervised Learning of 3D Physics from Pixels
A supervised 3D U-Net predicts per-voxel material fields from CLIP feature grids, enabling fast MPM-based animation, but the reported evidence depends on pseudo-labels and a VLM judge from the same model family as the...
-
BoxTwin: Learning Elastoplastic Articulated Object Dynamics from Videos
BoxTwin models elastoplastic articulated objects as hinged links with nonlinear elastic, plastic, and damage terms, but it does not demonstrate that these dynamics are learned from video beyond qualitative replay.
-
From World Models to World Action Models: A Concise Tutorial for Robotics
World models are action-conditioned predictors of task-relevant futures; world action models couple those futures to robot actions via four paradigms: imagine-then-execute, feature-conditioned, joint, and auxiliary pr...
Discussion (0). Continue with ORCID to comment.