REVIEW 8 cited by
PAC-NeRF: Physics Augmented Continuum Neural Radiance Fields for Geometry-Agnostic System Identification
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Existing approaches to system identification (estimating the physical parameters of an object) from videos assume known object geometries. This precludes their applicability in a vast majority of scenes where object geometries are complex or unknown. In this work, we aim to identify parameters characterizing a physical system from a set of multi-view videos without any assumption on object geometry or topology. To this end, we propose "Physics Augmented Continuum Neural Radiance Fields" (PAC-NeRF), to estimate both the unknown geometry and physical parameters of highly dynamic objects from multi-view videos. We design PAC-NeRF to only ever produce physically plausible states by enforcing the neural radiance field to follow the conservation laws of continuum mechanics. For this, we design a hybrid Eulerian-Lagrangian representation of the neural radiance field, i.e., we use the Eulerian grid representation for NeRF density and color fields, while advecting the neural radiance fields via Lagrangian particles. This hybrid Eulerian-Lagrangian representation seamlessly blends efficient neural rendering with the material point method (MPM) for robust differentiable physics simulation. We validate the effectiveness of our proposed framework on geometry and physical parameter estimation over a vast range of materials, including elastic bodies, plasticine, sand, Newtonian and non-Newtonian fluids, and demonstrate significant performance gain on most tasks.
Forward citations
Cited by 8 Pith papers
-
Volumetric Inverse Rendering via Neural Radiative Transfer
A physics-informed neural optimization that enforces the Radiative Transfer Equation as a residual recovers volumetric optical properties under global illumination from multi-view images, without explicit global-illum...
-
VDAWorld: World Modelling via VLM-Directed Abstraction and Simulation
A vision-language model writes a simulation program—grounded by segmentation and 3D tools—that predicts physically plausible futures from an image and caption, outperforming video generators on modified benchmarks.
-
Vid2Sim: Generalizable, Video-based Reconstruction of Appearance, Geometry and Physics for Mesh-free Simulation
Vid2Sim recovers 3D geometry, appearance, and elastic material parameters from multi-view videos using a feed-forward network plus a fast refinement, enabling mesh-free reduced-order simulation.
-
InteRecon: Towards Reconstructing Interactivity of Personal Memorable Items in Mixed Reality
The paper demonstrates a prototype that lets people turn cherished objects into interactive AR versions that preserve their original motions, buttons, and embedded media.
-
BoxTwin: Learning Elastoplastic Articulated Object Dynamics from Videos
BoxTwin models elastoplastic articulated objects as hinged links with nonlinear elastic, plastic, and damage terms, but it does not demonstrate that these dynamics are learned from video beyond qualitative replay.
-
CA-World: Multi-Object Counterfactual Alignment for Efficient Interactive-Ready Reconstruction
The paper's stated CA-World counterfactual claim is absent from the body, which instead describes the SAM3D-Phys pipeline for multi-object interactive reconstruction and simulation.
-
Advances in 4D Representation: Geometry, Motion, and Interaction
A representation-centric survey of 4D generation and reconstruction, organized by geometry, motion, and interaction, with qualitative trade-off comparisons across seven representation families.
-
DEM-NeRF: A Neuro-Symbolic Method for Scientific Discovery through Physics-Informed Simulation
DEM-NeRF is a pipeline that builds a 3D model from multi-view images with NeRF and predicts hyperelastic deformation with a deep energy method, but it presents no accuracy validation.
Discussion (0). Continue with ORCID to comment.