REVIEW 7 cited by
GaussianCube: A Structured and Explicit Radiance Representation for 3D Generative Modeling
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
We introduce a radiance representation that is both structured and fully explicit and thus greatly facilitates 3D generative modeling. Existing radiance representations either require an implicit feature decoder, which significantly degrades the modeling power of the representation, or are spatially unstructured, making them difficult to integrate with mainstream 3D diffusion methods. We derive GaussianCube by first using a novel densification-constrained Gaussian fitting algorithm, which yields high-accuracy fitting using a fixed number of free Gaussians, and then rearranging these Gaussians into a predefined voxel grid via Optimal Transport. Since GaussianCube is a structured grid representation, it allows us to use standard 3D U-Net as our backbone in diffusion modeling without elaborate designs. More importantly, the high-accuracy fitting of the Gaussians allows us to achieve a high-quality representation with orders of magnitude fewer parameters than previous structured representations for comparable quality, ranging from one to two orders of magnitude. The compactness of GaussianCube greatly eases the difficulty of 3D generative modeling. Extensive experiments conducted on unconditional and class-conditioned object generation, digital avatar creation, and text-to-3D synthesis all show that our model achieves state-of-the-art generation results both qualitatively and quantitatively, underscoring the potential of GaussianCube as a highly accurate and versatile radiance representation for 3D generative modeling. Project page: https://gaussiancube.github.io/.
Forward citations
Cited by 7 Pith papers
-
MSVS-VAE: Multi-Scale Anchored VecSet for High-Fidelity 3D Reconstruction
Hierarchical point-shuffle densification plus local AVS-Conv multi-scale decoding lets compact VecSet VAEs approach voxel-level 3D reconstruction fidelity at much lower token and query cost.
-
PixGS: Pixel-Space Diffusion for Direct 3D Gaussian Splat Generation
PixGS is a single-stage pixel-space diffusion model that directly produces high-quality 3D Gaussian Splats from text or images in ~1s, outperforming multi-stage latent methods on standard benchmarks.
-
Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussians
Can3Tok tokenizes scene-level 3D Gaussian splats into canonical latent tokens with normalization and saliency filtering, enabling reconstruction and text/image-to-3D generation.
-
Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesis
A video-to-4D model that encodes mesh animations into compact Gaussian variation latents and diffuses them conditioned on the video and a canonical Gaussian splat.
-
Nabla-R2D3: Effective and Efficient 3D Diffusion Alignment with 2D Rewards
Nabla-R2D3 aligns 3D-native diffusion models with human preferences by backpropagating multi-view 2D reward gradients through the denoising process, improving reward without destroying the pretrained 3D prior.
-
LTM3D: Bridging Token Spaces for Conditional 3D Generation with Auto-Regressive Diffusion Framework
A conditional 3D generation framework that combines masked autoencoding and diffusion in token space, with prefix learning and reconstruction-guided sampling, reports state-of-the-art results on ShapeNet and Objaverse.
-
Sel3DCraft: Interactive Visual Prompts for User-Friendly Text-to-3D Generation
A visual prompt engineering system for text-to-3D generation uses multi-view MLLM scoring and interactive visualizations to help designers create models faster, with 70.5% time reduction and higher quality ratings (4....
Discussion (0). Continue with ORCID to comment.