Pith. sign in

REVIEW 18 cited by

LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2311.13384 v2 pith:JUK355ZD submitted 2023-11-22 cs.CV

classification cs.CV
keywords scenegenerationluciddreamergaussianpointsclouddomaindomain-free
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

With the widespread usage of VR devices and contents, demands for 3D scene generation techniques become more popular. Existing 3D scene generation models, however, limit the target scene to specific domain, primarily due to their training strategies using 3D scan dataset that is far from the real-world. To address such limitation, we propose LucidDreamer, a domain-free scene generation pipeline by fully leveraging the power of existing large-scale diffusion-based generative model. Our LucidDreamer has two alternate steps: Dreaming and Alignment. First, to generate multi-view consistent images from inputs, we set the point cloud as a geometrical guideline for each image generation. Specifically, we project a portion of point cloud to the desired view and provide the projection as a guidance for inpainting using the generative model. The inpainted images are lifted to 3D space with estimated depth maps, composing a new points. Second, to aggregate the new points into the 3D scene, we propose an aligning algorithm which harmoniously integrates the portions of newly generated 3D scenes. The finally obtained 3D scene serves as initial points for optimizing Gaussian splats. LucidDreamer produces Gaussian splats that are highly-detailed compared to the previous 3D scene generation methods, with no constraint on domain of the target scene. Project page: https://luciddreamer-cvlab.github.io/

Discussion (0). Sign in to comment.

Forward citations

Cited by 18 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Engine-Native Editable 3D World Reconstruction with Objects and Lighting

    cs.CV 2026-07 conditional novelty 7.0 of 10

    A UE5-derived dataset (Lumera-2K) and VLM pipeline parse single-image scenes into oriented object boxes and parametric light tuples, establishing a measurable benchmark for editable, light-aware 3D reconstruction.

  2. UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models

    cs.CV 2026-08 conditional novelty 6.0 of 10

    UniWorld-View couples an occlusion-aware point cloud renderer with a dual-stream video diffusion model to synthesize large-baseline novel views from monocular video.

  3. GS-Agent: Creating 4D Physical Worlds With Generative Simulation

    cs.RO 2026-07 conditional novelty 6.0 of 10

    Three LLM agents write physics-engine code from text, review rendered frames, and correct errors, turning prompts into physically simulated 4D worlds with camera control.

  4. CGGS: Consistency-Augmented Geometric Gaussian Splatting for Ego-Centric 3D Scene Generation

    cs.GR 2026-07 conditional novelty 6.0 of 10

    CGGS generates viewpoint-consistent, text-aligned ego-centric 3D scenes via consistency-augmented multi-view diffusion, flow-guided layout initialization, and mutual-information depth-refined Gaussian optimization.

  5. LivingWorld: Interactive 4D World Generation with Environmental Dynamics

    cs.CV 2026-04 conditional novelty 6.0 of 10

    An interactive pipeline generates expanding 4D worlds with globally coherent environmental dynamics from a single image in roughly 12 seconds per expansion step.

  6. Reevaluating the Intra-Modal Misalignment Hypothesis in CLIP

    cs.CV 2026-03 conditional novelty 6.0 of 10

    Diffusing in a unified 3D representation (geometry plus appearance and semantics) produces more cross-view-consistent 3D Gaussian scenes than 2D latent pipelines.

  7. TabletopGen: Tabletop Scene Generation and Interactive Simulation for Robotic Manipulation

    cs.CV 2025-12 conditional novelty 6.0 of 10

    A training-free pipeline generates instance-level, physically interactive 3D tabletop scenes from text or one image, with a differentiable rotation optimizer and top-view spatial alignment for collision-free layouts.

  8. GeoWorld: Providing Full-frame Geometry Features to Facilitate 3D Scene Generation

    cs.CV 2025-11 conditional novelty 6.0 of 10

    GeoWorld improves image-to-3D scene generation by conditioning a video-diffusion model on full-frame geometry features extracted by a multi-view geometry model, yielding higher PSNR/SSIM/LPIPS than prior methods.

  9. Droplet3D: Commonsense Priors from Videos Facilitate 3D Generation

    cs.CV 2025-08 conditional novelty 6.0 of 10

    A video diffusion backbone fine-tuned on 4M densely captioned 360-degree renderings generates spatially consistent multi-view images for 3D assets from image plus detailed text input.

  10. HOLODECK 2.0: Vision-Language-Guided 3D World Generation with Editing

    cs.CV 2025-08 conditional novelty 6.0 of 10

    HOLODECK 2.0 generates and edits stylistically varied 3D scenes from text by combining VLM-based scene analysis and layout planning with generative 3D assets, outperforming the retrieval-based HOLODECK baseline in hum...

  11. Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussians

    cs.CV 2025-08 conditional novelty 6.0 of 10

    Can3Tok tokenizes scene-level 3D Gaussian splats into canonical latent tokens with normalization and saliency filtering, enabling reconstruction and text/image-to-3D generation.

  12. High-fidelity 3D Gaussian Inpainting: preserving multi-view consistency and photorealistic details

    cs.CV 2025-07 conditional novelty 6.0 of 10

    A 3D Gaussian inpainting framework with automatic mask refinement and depth-initialized uncertainty weighting balances multi-view consistency and visual detail, reporting the best LPIPS on the SPIn-NeRF dataset.

  13. WonderFree: Enhancing Novel View Quality and Cross-View Consistency for 3D Scene Exploration

    cs.CV 2025-06 conditional novelty 6.0 of 10

    A pipeline that restores corrupted novel-view videos with a video diffusion model and jointly denoises multiple viewpoints to improve 3D scene exploration from a single image.

  14. Non-invasive Assessment of Pancreatic Duct Hypertension Using Computational Flow Modeling

    physics.med-ph 2025-08 unverdicted novelty 5.0 of 10

    A computational model estimates pancreatic duct pressure non-invasively from MRCP geometry, with reported agreement against ERCP pressure measurements.

  15. HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixels

    cs.CV 2025-07 conditional novelty 5.0 of 10

    A staged pipeline generates layered, mesh-based 3D worlds from text or images by combining panoramic diffusion, semantic layer decomposition, and video-based expansion.

  16. SceneCompleter: Dense 3D Scene Completion for Generative Novel View Synthesis

    cs.CV 2025-06 conditional novelty 5.0 of 10

    SceneCompleter jointly denoises RGB and depth latents, conditioned on projected depth and global scene features, yielding higher quality and more pose-consistent novel views than 2D-inpainting baselines.

  17. From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence

    cs.RO 2026-07 conditional novelty 4.0 of 10

    Physical intelligence needs an embodied brain that reasons over interventions and emits capability requests, grounded by a physical harness and shared experience contracts rather than direct actuator policies.

  18. Observable Performance Does Not Fully Reflect Adaptive System Organization: A Multi-Level Analysis of Gait Dynamics Under Occlusal Constraint

    cs.LG 2026-05 unverdicted novelty 4.0 of 10

    In one Parkinson's patient, six occlusal probes produce overlapping gait scores and UMAP embeddings, so observable performance does not uniquely identify adaptive system state under VDO constraint.

Pith tools