REVIEW 5 cited by
gradSim: Differentiable simulation for system identification and visuomotor control
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
We consider the problem of estimating an object's physical properties such as mass, friction, and elasticity directly from video sequences. Such a system identification problem is fundamentally ill-posed due to the loss of information during image formation. Current solutions require precise 3D labels which are labor-intensive to gather, and infeasible to create for many systems such as deformable solids or cloth. We present gradSim, a framework that overcomes the dependence on 3D supervision by leveraging differentiable multiphysics simulation and differentiable rendering to jointly model the evolution of scene dynamics and image formation. This novel combination enables backpropagation from pixels in a video sequence through to the underlying physical attributes that generated them. Moreover, our unified computation graph -- spanning from the dynamics and through the rendering process -- enables learning in challenging visuomotor control tasks, without relying on state-based (3D) supervision, while obtaining performance competitive to or better than techniques that rely on precise 3D labels.
Forward citations
Cited by 5 Pith papers
-
Learning Physics-Guided Residual Dynamics for Deformable Object Simulation
Physics-guided residual dynamics, a spring-mass simulator plus a network that predicts velocity corrections, yields the most accurate deformable-object simulation in the paper's real-world tests.
-
Robust and Efficient MuJoCo-based Model Predictive Control via Web of Affine Spaces Derivatives
WASP derivative reuse speeds up MuJoCo MPC by 1.26–2.08x versus finite differences on selected locomotion tasks, with comparable task costs.
-
Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulation
Vid2Sim recovers 3D geometry, appearance, and elastic material parameters from multi-view videos using a feed-forward network plus a fast refinement, enabling mesh-free reduced-order simulation.
-
Physics-Grounded Differentiable Simulation for Soft Growing Robots
A differentiable simulator for soft growing robots with a new wrinkling-based bending stiffness model, fitted and validated against real robot trajectories.
-
Generative Physical AI in Vision: A Survey
A structured review that categorizes physics-aware generative models in vision into explicit-simulation and implicit-learning families and proposes six integration paradigms.
Discussion (0). Continue with ORCID to comment.