REVIEW 7 cited by
LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priors
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We aim to address sparse-view reconstruction of a 3D scene by leveraging priors from large-scale vision models. While recent advancements such as 3D Gaussian Splatting (3DGS) have demonstrated remarkable successes in 3D reconstruction, these methods typically necessitate hundreds of input images that densely capture the underlying scene, making them time-consuming and impractical for real-world applications. However, sparse-view reconstruction is inherently ill-posed and under-constrained, often resulting in inferior and incomplete outcomes. This is due to issues such as failed initialization, overfitting on input images, and a lack of details. To mitigate these challenges, we introduce LM-Gaussian, a method capable of generating high-quality reconstructions from a limited number of images. Specifically, we propose a robust initialization module that leverages stereo priors to aid in the recovery of camera poses and the reliable point clouds. Additionally, a diffusion-based refinement is iteratively applied to incorporate image diffusion priors into the Gaussian optimization process to preserve intricate scene details. Finally, we utilize video diffusion priors to further enhance the rendered images for realistic visual effects. Overall, our approach significantly reduces the data acquisition requirements compared to previous 3DGS methods. We validate the effectiveness of our framework through experiments on various public datasets, demonstrating its potential for high-quality 360-degree scene reconstruction. Visual results are on our website.
Forward citations
Cited by 7 Pith papers
-
MAC-Splat: Multi-Attribute Consistency for High-Fidelity Sparse-View Reconstruction
Semantically enriched MASt3R correspondences plus a multi-attribute 3D consistency loss raise sparse-view ScanNet++ PSNR by >4.5 dB over Splatt3R and preserve quality under wide baselines.
-
Perceiving and Acting in First-Person: A Dataset and Benchmark for Egocentric Human-Object-Human Interactions
Claimed first large-scale egocentric and multi-view dataset of human-object-human assistance (11.4 hours, 1.2M frames) with three benchmarks; only the abstract was assessable because the submitted body text is a diffe...
-
Gaussian Splatting Feature Fields for Privacy-Preserving Visual Localization
A self-supervised 3D Gaussian feature field, with cluster-derived segmentations, is used for accurate camera pose refinement and privacy-preserving visual localization.
-
Zero-P-to-3: Zero-Shot Partial-View Images to 3D Object
Zero-P-to-3 fuses multi-view diffusion, a restoration prior, and a coarse 3D Gaussian rendering in DDIM sampling, then refines with rotated views, and reports improved invisible-region reconstruction from partial-view...
-
4DSloMo: 4D Reconstruction for High Speed Scene with Asynchronous Capture
Staggering camera start times and cleaning 4D renderings with a video diffusion model improves high-speed 4D reconstruction from low-FPS cameras.
-
DET-GS: Depth- and Edge-Aware Regularization for High-Fidelity 3D Gaussian Splatting
DET-GS combines hierarchical depth normalization, Canny-guided depth smoothing, and RGB-gated total variation to modestly improve 3DGS rendering quality on five standard datasets.
-
Sparse-View 3D Reconstruction: Recent Advances and Open Challenges
A comprehensive survey that organizes sparse-view 3D reconstruction methods into geometry-based, NeRF, 3DGS, and diffusion-based categories, with benchmarks and open challenges.
Discussion (0). Continue with ORCID to comment.