REVIEW 6 cited by
Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
3D articulated objects modeling has long been a challenging problem, since it requires to capture both accurate surface geometries and semantically meaningful and spatially precise structures, parts, and joints. Existing methods heavily depend on training data from a limited set of handcrafted articulated object categories (e.g., cabinets and drawers), which restricts their ability to model a wide range of articulated objects in an open-vocabulary context. To address these limitations, we propose Articulate Anymesh, an automated framework that is able to convert any rigid 3D mesh into its articulated counterpart in an open-vocabulary manner. Given a 3D mesh, our framework utilizes advanced Vision-Language Models and visual prompting techniques to extract semantic information, allowing for both the segmentation of object parts and the construction of functional joints. Our experiments show that Articulate Anymesh can generate large-scale, high-quality 3D articulated objects, including tools, toys, mechanical devices, and vehicles, significantly expanding the coverage of existing 3D articulated object datasets. Additionally, we show that these generated assets can facilitate the acquisition of new articulated object manipulation skills in simulation, which can then be transferred to a real robotic system. Our Github website is https://articulate-anymesh.github.io.
Forward citations
Cited by 6 Pith papers
-
StructureGS: Structure-aware Gaussian Splatting for Articulated Object Reconstruction
OBB-based part-fitting and contact losses on 3D Gaussians disentangle geometry, appearance, and motion for cleaner articulated reconstruction than photometric-only baselines.
-
SimFoundry: Modular and Automated Scene Generation for Policy Learning and Evaluation
SimFoundry automates zero-shot real-to-sim scene generation from video, producing digital twins and cousins that enable policy training with 0.911 mean Pearson correlation to real-world results and 17-40% success gain...
-
Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalization
ATOP personalizes a pre-trained multi-view diffusion model with a few reference videos to generate part motion from text and masks, then lifts that motion to a 3D articulation axis via score distillation.
-
UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets
A unified pipeline and LLM-based model that jointly predicts articulation and physical properties of 3D assets, plus a 40K-object dataset and verified benchmark.
-
From Scan to Action: Leveraging Realistic Scans for Embodied Scene Understanding
A pipeline that converts real-world 3D scans into application-specific USD formats, enabling LLM-based object insertion (80% success) and robotic drawer-opening policies (87% success).
-
Advances in 4D Representation: Geometry, Motion, and Interaction
A representation-centric survey of 4D generation and reconstruction, organized by geometry, motion, and interaction, with qualitative trade-off comparisons across seven representation families.
Discussion (0). Continue with ORCID to comment.