REVIEW 7 cited by
RoomDreamer: Text-Driven 3D Indoor Scene Synthesis with Coherent Geometry and Texture
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
The techniques for 3D indoor scene capturing are widely used, but the meshes produced leave much to be desired. In this paper, we propose "RoomDreamer", which leverages powerful natural language to synthesize a new room with a different style. Unlike existing image synthesis methods, our work addresses the challenge of synthesizing both geometry and texture aligned to the input scene structure and prompt simultaneously. The key insight is that a scene should be treated as a whole, taking into account both scene texture and geometry. The proposed framework consists of two significant components: Geometry Guided Diffusion and Mesh Optimization. Geometry Guided Diffusion for 3D Scene guarantees the consistency of the scene style by applying the 2D prior to the entire scene simultaneously. Mesh Optimization improves the geometry and texture jointly and eliminates the artifacts in the scanned scene. To validate the proposed method, real indoor scenes scanned with smartphones are used for extensive experiments, through which the effectiveness of our method is demonstrated.
Forward citations
Cited by 7 Pith papers
-
PrITTI: Primitive-based Generation of Controllable and Editable 3D Semantic Urban Scenes
PrITTI generates controllable 3D semantic urban scenes from a hybrid primitive/raster representation and reports state-of-the-art generation quality over voxel-based baselines on KITTI-360.
-
D3D-GEN: Robot-Aware Domain-Grounded Interactive 3D World Generation for Social Robotics
D3D-GEN automatically builds a domain knowledge base from web research and uses it to generate interactive 3D robot simulation worlds for residential, office, and hospital settings.
-
Programmable-Room: Interactive Textured 3D Room Meshes Generation Empowered by Large Language Models
A visual-programming framework uses GPT-4 to chain modules that generate, texture, furnish, and edit 3D room meshes from natural language, with a new panorama diffusion model (PRIG).
-
ReSpace: Text-Driven Autoregressive 3D Indoor Scene Synthesis and Editing
ReSpace is an autoregressive LLM framework for text-driven 3D indoor scene editing and synthesis, using a structured JSON scene representation and a voxelization-based layout metric.
-
LatticeWorld: A Multimodal Large Language Model-Empowered Framework for Interactive Complex World Generation
A multimodal LLM framework generates interactive Unreal-based 3D environments from text and height maps, claiming superior layout accuracy and over 90x faster production than manual methods.
-
Few-step Flow for 3D Generation via Marginal-Data Transport Distillation
MDT-dist distills a pretrained 3D flow model into a 1-2 step generator using velocity matching plus velocity distillation, cutting TRELLIS inference from 6.1s to 0.68s while approximately preserving generation quality.
-
MetaDecorator: Generating Immersive Virtual Tours through Multimodality
MetaDecorator combines diffusion-based panorama decoration with a depth-prior-constrained NeRF to build personalized 3D virtual tours, claiming higher PSNR and 10x faster training on a single scene.
Discussion (0). Continue with ORCID to comment.