Pith. sign in

REVIEW 14 cited by

GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generation

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2403.14621 v1 pith:6D56DSMP submitted 2024-03-21 cs.CV

Yinghao Xu , Zifan Shi , Wang Yifan , Hansheng Chen , Ceyuan Yang , Sida Peng , Yujun Shen , Gordon Wetzstein This is my paper
classification cs.CV
keywords reconstructiongaussiansefficientmodelmulti-viewalternativesarchitecturearound
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We introduce GRM, a large-scale reconstructor capable of recovering a 3D asset from sparse-view images in around 0.1s. GRM is a feed-forward transformer-based model that efficiently incorporates multi-view information to translate the input pixels into pixel-aligned Gaussians, which are unprojected to create a set of densely distributed 3D Gaussians representing a scene. Together, our transformer architecture and the use of 3D Gaussians unlock a scalable and efficient reconstruction framework. Extensive experimental results demonstrate the superiority of our method over alternatives regarding both reconstruction quality and efficiency. We also showcase the potential of GRM in generative tasks, i.e., text-to-3D and image-to-3D, by integrating it with existing multi-view diffusion models. Our project website is at: https://justimyhxu.github.io/projects/grm/.

Discussion (0). Sign in to comment.

Forward citations

Cited by 14 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Hallo4D: Multi-Modal Hallucination Mitigation for Consistent Spatio-Temporal Generation

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Hallo4D uses vision-language models to detect and correct spatial and temporal mistakes in AI-generated 3D and 4D content, improving consistency without retraining the base generators.

  2. AdaptiveSplat:Texture Aware Controllable 3D Gaussian Allocation for Feed-Forward Reconstruction

    cs.CV 2026-07 conditional novelty 6.0 of 10

    Texture-aware SuperCluster pruning plus an adaptive Gaussian head lets feed-forward 3DGS models hit a user budget β while outperforming post-hoc pruners on RE10K, ACID, DL3DV and DTU.

  3. PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation

    cs.CV 2026-07 unverdicted novelty 6.0 of 10

    PixGS is a single-stage pixel-space diffusion model that directly produces high-quality 3D Gaussian Splats from text or images in ~1s, outperforming multi-stage latent methods on standard benchmarks.

  4. Articulate3D: Zero-Shot Text-Driven 3D Object Posing

    cs.CV 2025-08 conditional novelty 6.0 of 10

    A zero-shot pipeline that reposes 3D meshes by generating text-conditioned target images with rewired multi-view attention and aligning mesh keypoints to them.

  5. Make Your MoVe: Make Your 3D Contents by Adapting Multi-View Diffusion Models to External Editing

    cs.CV 2025-08 conditional novelty 6.0 of 10

    A tuning-free dual-pipeline that injects original normal latents into an edited multi-view diffusion stream, preserving geometry during 2D-to-3D appearance editing.

  6. DualMat: PBR Material Estimation via Coherent Dual-Path Diffusion

    cs.CV 2025-08 conditional novelty 6.0 of 10

    DualMat is a dual-path diffusion model combining an albedo-optimized pretrained latent path with a material-specialized compact latent path, using feature distillation and rectified flow to estimate PBR materials from...

  7. iLRM: An Iterative Large 3D Reconstruction Model

    cs.CV 2025-07 conditional novelty 6.0 of 10

    iLRM reconstructs 3D Gaussian scenes from multiple photos through iterative refinement of viewpoint tokens, achieving higher quality and speed than prior feed-forward models.

  8. AutoPartGen: Autogressive 3D Part Generation and Discovery

    cs.CV 2025-07 conditional novelty 6.0 of 10

    AutoPartGen generates 3D objects as a sequence of latent-space parts, conditioning each new part on previously generated parts, and reports state-of-the-art part completion on PartObjaverse-Tiny.

  9. SHReg: Strictly Rotation-Equivariant Point Cloud Registration via Spherical Harmonics

    cs.CV 2026-07 conditional novelty 5.0 of 10

    A rotation-equivariant registration network whose per-correspondence closed-form pose hypotheses improve 3D match accuracy, especially under large rotations.

  10. SynthDrive: Scalable Real2Sim2Real Sensor Simulation Pipeline for High-Fidelity Asset Generation and Driving Data Synthesis

    cs.CV 2025-09 conditional novelty 5.0 of 10

    SynthDrive automatically mines images of rare objects, reconstructs them as 3D assets from a single view, and synthesizes driving footage that modestly improves detection of those objects.

  11. Few-step Flow for 3D Generation via Marginal-Data Transport Distillation

    cs.CV 2025-09 conditional novelty 5.0 of 10

    MDT-dist distills a pretrained 3D flow model into a 1-2 step generator using velocity matching plus velocity distillation, cutting TRELLIS inference from 6.1s to 0.68s while approximately preserving generation quality.

  12. Collaborative Multi-Modal Coding for High-Quality 3D Generation

    cs.CV 2025-08 conditional novelty 5.0 of 10

    TriMM fuses RGB, RGB-D, and point-cloud encoding into a shared triplane latent space and generates 3D assets from a single image with a latent diffusion model.

  13. Drive Any Mesh: 4D Latent Diffusion for Mesh Deformation from Video

    cs.CV 2025-06 conditional novelty 5.0 of 10

    A video-conditioned latent diffusion model generates mesh vertex trajectories that deform an input 3D asset into render-ready 4D animations.

  14. SAT: Supervisor Regularization and Animation Augmentation for Two-process Monocular Texture 3D Human Reconstruction

    cs.CV 2025-08 conditional novelty 4.0 of 10

    A two-stage Gaussian-splatting framework with supervisor feature regularization and online animation augmentation improves monocular textured 3D human reconstruction on CustomHuman and THuman3.0.

Pith tools