Pith. sign in

REVIEW 4 major objections 6 minor 5 cited by

PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models

T0 review · 4 major / 6 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read PartGen uses two multi-view diffusion models to split 3D objects into meaningful, complete parts that can be edited and reassembled, and the paper reports it outperforms segmentation baselines by a large margin.

desk verdict A well-engineered pipeline that convincingly demonstrates part segmentation and amodal completion on its own dataset, but the part-semantics assumption needs external validation. read the letter →

arxiv 2412.18608 v2 pith:KU5VYDYD submitted 2024-12-24 cs.CV

Minghao Chen , Roman Shapovalov , Iro Laina , Tom Monnier , Jianyuan Wang , David Novotny , Andrea Vedaldi This is my paper · ORCID
classification cs.CV
keywords part-level3Dgenerationmulti-viewdiffusionpartsegmentationcompletionamodalreconstructioneditingtext-to-3Dimage-to-3D
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

PartGen aims to show that unstructured 3D content, whether generated from text or an image or captured by a scanner, can be converted automatically into a composition of meaningful, standalone parts, the way a human artist would build the asset. It claims that two fine-tuned multi-view diffusion models are enough: one paints view-consistent colour-coded part masks across a four-view grid, and a second completes the masked views of each part using the whole object as context, so that hidden or entirely invisible geometry is plausibly filled in. The completed multi-view images are then lifted to 3D by a feed-forward reconstruction network. The paper reports that this beats segmentation baselines by a large margin and that the reassembled parts match the quality of unsegmented reconstruction, which would mean structure can be added to modern 3D generation and scanning pipelines without sacrificing fidelity.

What carries the argument

The load-bearing machinery is a pair of fine-tuned multi-view diffusion generators built from a pretrained text-to-image diffusion model in an 8-channel latent space. The segmentation network takes a four-view grid image as conditioning and generates a colour-coded segmentation grid, with the mapping from parts to colours randomly permuted per training sample so the model learns part boundaries rather than part identities. The completion network takes a 25-channel input consisting of the noised latent, the encoded masked part views, the encoded full object views for context, and the unencoded part mask, and generates completed multi-view images of the part; conditioning on the intact object is what lets the model hallucinate invisible parts that still fit the whole. The reconstruction step uses a feed-forward reconstruction model that turns the completed multi-view images into a 3D field per part, and parts are assembled with an emission-absorption renderer that sums per-part opacities and features along each ray.

What would settle it

Give PartGen object classes absent from its training corpus, such as mechanical devices or biological specimens, and compare its segmentations against parts annotated by independent human judges using a functional definition of 'part' (a component that can be removed, moved, or replaced without destroying the object); if mean average precision against the functional ground truth is no better than against random groupings, the artist-GLTF grouping assumption fails.

Watch

Extended reading notes

Core claim

PartGen's central claim is that part-level 3D structure can be produced by reusing the two-stage paradigm of modern 3D generation, multi-view diffusion followed by a reconstruction network, rather than by inventing a dedicated 3D segmentation architecture. The first contribution is to frame segmentation as a stochastic multi-view colouring problem: a diffusion model, conditioned on a four-view grid image of the object, generates colour-coded masks whose colour-to-part assignment is randomized at training time, which lets the model capture the ambiguity in how artists split an object into parts and sidesteps instance-naming issues. The second contribution is contextual completion: a diffusion model takes the masked views of one part together with the full object views and generates complete, view-consistent images of that part, inferring occluded or completely invisible geometry from the object's overall context. Completed part views are fed to a reconstruction model to obtain full 3D parts, and the parts are composited by a modified emission-absorption renderer. The paper demonstrates the pipeline on text-to-3D, image-to-3D, decomposition of real scans, and text-guided part editing.

Load-bearing premise

The method learns what counts as a 'part' from the native mesh groupings in a licensed collection of 140k artist-made GLTF assets, and it assumes those groupings reflect the semantic parts users actually want to manipulate.

Editorial extensions

If this is right

  • Text- and image-to-3D generators that adopt this pipeline will output assets already split into meaningful parts, removing a manual step in creative workflows.
  • Decomposing a scanned or generated object no longer requires the part to be visible: the completion model can infer occluded internals or hallucinate entirely hidden parts while keeping them coherent with the whole.
  • The modular design means reconstruction models can be swapped without retraining the segmentation or completion networks, so the method tracks improvements in feed-forward 3D reconstruction.
  • Reassembled part-based reconstructions match the fidelity of unsegmented reconstructions, so structure is obtained without a fidelity penalty.
  • Because parts are independently reconstructed, applications like text-guided part editing, part replacement, and iterative part addition follow directly from the same machinery.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The random colour-permutation trick is a transferable idea: any multi-view instance-segmentation problem with unknown identity counts could use a generative model conditioned on a permuted-colour target to avoid matching and naming, not just 3D part decomposition.
  • Conditioning part completion on the whole object suggests a scalable route to amodal scene decomposition: if training data with scene-level part or object decompositions existed, the same context-conditioned completion could plausibly recover objects hidden behind other objects, not just parts hidden inside one asset.
  • A direct test of the artist-intent assumption would be to compare PartGen's parts against functional part annotations from naive users on object categories outside the training distribution; the paper's reliance on artist GLTF groupings makes this the main open empirical question.
  • The paper stops short of evaluating whether completed parts are physically usable for animation rigging or physics simulation; a follow-up measuring part-boundary alignment, watertightness of completed parts, and joint placement would tell whether the parts are not just visually plausible but mechanically meaningful.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. PartGen is a two-stage pipeline for generating or decomposing 3D assets into parts. Given text, an image, or an unstructured 3D object, the method first renders a four-view grid and uses a fine-tuned multi-view diffusion model to sample color-coded part segmentation maps, merging multiple stochastic samples into a ranked list of part proposals. It then uses a second multi-view diffusion model to complete each part's masked views, conditioned on the full-object context, and reconstructs the completed part with LightplaneLRM. Parts are finally assembled into a compositional 3D object. The paper reports that the segmentation stage substantially outperforms SAM2 and Part123 on mAP (Table 1), that contextual completion improves part-view PSNR/LPIPS/CLIP over no-completion and context-free baselines (Table 2), and that part-based reassembly matches monolithic reconstruction (Table 3). Applications demonstrated include part-aware text/image-to-3D, decomposition of Google Scanned Objects, iterative part addition, and text-guided part editing.

Significance. If the underlying artist-decomposition assumption holds, PartGen is a strong and timely contribution. The core ideas—treating part segmentation as stochastic multi-view coloring and treating part completion as generative, context-conditioned inpainting—are natural fits for the inherent ambiguity of part boundaries and amodal completion, and the reported quantitative gains are large: Table 1 shows 59.3 mAP50 for PartGen versus 35.3 for SAM2, and Table 2 shows PSNR increasing from 13.24 without completion to 21.38 with contextual completion. The ablations in Table 2 isolate the contributions of multi-view reasoning and object context, which is good experimental practice. The supplementary material is detailed and the method is built from reasonably described components. The main caveat is that the definition of 'meaningful part' is inherited from the raw node hierarchies of licensed artist-created GLTF assets, and all quantitative evaluation is performed on a held-out split of the same collection. The paper's self-stated limitation in Sec. E that the approach is 'heavily dependent on the quality and diversity of the dataset' is directly relevant to this concern.

major comments (4)
  1. [Sec. 3.5 and Table 1] The central assumption that GLTF node decompositions 'often align with semantic parts due to being created by a human who likely aimed to create an editable asset' is not validated. The paper culls parts smaller than 5% of object volume and removes assets with more than 10 parts, but it provides no evidence about how often the node hierarchies actually match human semantic judgments, no inter-annotator agreement statistics, and no evaluation on any external dataset. Since both training and the held-out test set come from the same licensed collection, the mAP numbers in Table 1 measure how well the model reproduces that collection's particular decomposition convention, not whether the resulting parts are semantically meaningful for arbitrary assets. This is load-bearing for the abstract's claim of 'meaningful parts' and for all downstream applications. Please add a human study on part validity, or an external benchmark with independent part annotations (e.g., PartNet, PartImageNet, or manually annotated GSO objects), and report results per category and across datasets; alternatively, the generalization claims should be explicitly narrowed.
  2. [Sec. 4.2 and Table 2] The completion and reconstruction evaluation uses ground-truth masks: the test tuples are (S, I, M^k, J^k), and one random part per object is selected. This isolates completion quality from segmentation errors, which is a reasonable design, but it means the main quantitative evidence for the full pipeline is Table 3 combined with qualitative figures. Table 3 compares the reassembled part-based reconstruction with an unstructured reconstruction by the same reconstruction model; this shows that part-based assembly does not lose much reconstruction fidelity, but it does not establish that the parts are semantically correct or that they match artist intent. Please either report an end-to-end metric that feeds predicted masks into the completion and reconstruction stages and evaluates part-level accuracy, or explicitly state in the main text that Table 2 is an oracle-mask evaluation and that end-to-end part quality is demonstrated only qualitatively.
  3. [Sec. 4.1 and Sec. B] The automatic-segmentation comparison may not be proposal-matched. PartGen is evaluated with 1, 5, and 10 stochastic samples and then uses an overlap-based reliability score with non-maximum suppression to build a ranked list, whereas the SAM2 baselines are seeded with a set of query points and return up to three regions per seed. The paper does not control for the number of proposals per object, and a retrieval-style mAP with ten merged samples can be inflated simply by the increased diversity of the candidate pool. The recall-at-K curves in Fig. 9 are helpful, but please also report precision at fixed recall, recall at equal proposal counts, or precision-recall curves for each method, and state explicitly how many proposals each baseline produces on average. Without this, the 'large margin' over SAM2 in the automatic setting is not fully quantified.
  4. [Sec. 3.5 and Sec. 4] Several hand-set thresholds control the data and the method: the 5% volume culling threshold, the maximum of 10 parts per object, the four orthogonal views, and the number of quantized colors Q. No sensitivity analysis is reported for any of these choices. Because the segmentation network is trained only after these filters are applied, the reported mAP and completion metrics could depend substantially on them. Please report the effect of varying the volume threshold (e.g., 2%/5%/10%), the maximum part count (e.g., 6/10/15), and the number of views, or justify these choices with evidence that the results are stable.
minor comments (6)
  1. [Abstract and Sec. 1] The abstract and introduction state that the segmentation maps are 'view-consistent,' but no quantitative view-consistency metric is reported; consider adding a measure such as cross-view mask IoU or projecting masks into 3D and measuring 3D consistency.
  2. [Table 1] The table uses SAM2† and SAM2∗ with a caption explanation, but the symbols are easy to confuse; consider renaming them 'SAM2-MV' and 'SAM2-FT' or adding an explicit legend in the table itself.
  3. [Sec. 4.2] The text says 'We choose one random part index k per model' for evaluation; since the choice is random, the reported numbers may depend on the random seed. Please report mean and standard deviation over multiple random choices, or evaluate all parts.
  4. [Sec. 3.5] The sentence 'This results in the dataset of 45k objects contain the total of 210k parts' contains a grammatical error ('contain'); please revise to 'containing a total of 210k parts.'
  5. [Sec. D] The failure-case section notes that the implementation is limited to objects with no more than 10 parts, but this limitation is not mentioned in the main-text Limitations section (Sec. E); please state it prominently in Sec. E as well.
  6. [Sec. 3.3] The conditioning of the completion network includes the mask M, but the mask is provided as a single unencoded channel while the masked image and context are encoded; a sentence explaining why the mask is not VAE-encoded would help reproducibility.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity: segmentation and completion are trained on artist-created GLTF decompositions and evaluated against external baselines and an oracle; the artist-decomposition assumption is a dataset-validity limitation, not a circular derivation.

full rationale

The paper's derivation chain is empirically supervised rather than definitionally self-referential. The segmentation network (Sec. 3.2) is trained to predict color-coded multi-view maps derived from the GLTF part decompositions described in Sec. 3.5, and is tested on a held-out 100-object subset of the same licensed collection against external baselines SAM2 and Part123 (Table 1). The completion network (Sec. 3.3) is trained to map the masked part view and context to the ground-truth part render, and Table 2 compares it against no-completion, no-context, single-view, and oracle upper-bound conditions. Reassembly (Table 3) compares the compositional reconstruction to direct unstructured reconstruction. No parameter is fitted to these target metrics, and the ablations isolate genuine design choices. The self-citations to AssetGen [76] and LightplaneLRM [5] are infrastructure citations with independent published or code-reproduced status; they do not smuggle in the paper's conclusions. The central 'meaningful parts' premise is inherited from the artist-created GLTF decompositions, and the paper itself concedes in Sec. E that the approach 'is heavily dependent on the quality and diversity of the dataset.' That concession is a data-bias and generalization risk, not a circular reduction: the method does not define its output in terms of its prediction, and the evaluation does not reward the model for reproducing its own training objective in a disguised form. The claim of large gains over SAM2 and Part123 is an external comparison, and the oracle bound in Table 2 is ground truth, not the model's own output. The paper is therefore self-contained against external benchmarks, with no exhibited reduction of a predicted quantity to a fitted input or a self-citation chain.

Assumptions & free parameters 3 free parameters · 3 assumptions · 0 invented entities

This is an empirical ML paper with no analytic derivation. The central claim rests on the availability and quality of a large artist-created dataset, on the sufficiency of four orthographic views, and on the ability to reuse a pretrained multi-view generator and reconstruction network. No new physical or mathematical entities are introduced.

free parameters (3)
  • part volume culling threshold = 5% of object volume
    Parts smaller than 5% of object volume are removed from training and evaluation (Sec 3.5). This hand-chosen threshold defines what counts as a meaningful part and directly affects segmentation metrics.
  • maximum part count = 10
    Assets with more than 10 parts are removed from training, and the method is limited to 10 parts at inference (Sec 3.5 and Supplement D). This constraint bounds the complexity of the segmentation task.
  • number of views = 4 (2x2 grid at 20 degrees elevation)
    The entire pipeline operates on four orthogonal views (Sec 3.5). The choice affects how much occlusion must be handled by the completion model and how much geometry remains invisible.
assumptions (3)
  • domain assumption Artist-created GLTF meshes align with semantically meaningful parts
    Sec 3.5 uses these native decompositions as ground truth; the meaning of 'part' is defined by this data. If decompositions are arbitrary, the model does not learn a general part concept.
  • domain assumption Four fixed views are sufficient to segment and reconstruct any object
    The generator and completion model operate only on the 2x2 grid (Sec 3.5). Heavy occlusions or complex topology are handled by hallucination, which is learned from the dataset and may fail for unseen structures (Supplement D).
  • domain assumption The reconstruction model can be applied to parts without fine-tuning
    Sec 3.4 states the RM 'does not require special finetuning to move from objects to their parts.' If the RM is biased toward whole objects, part reconstructions would be degraded.

how reviews work

0 comments
Cite this review

Pith. "Pith review of PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models." pith.science (2026). https://pith.science/paper/KU5VYDYD

@misc{pith2026241218608,
  author       = {Pith},
  title        = {Pith review of: PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/KU5VYDYD}},
  note         = {Machine review of arXiv:2412.18608}
}
read the original abstract

Text- or image-to-3D generators and 3D scanners can now produce 3D assets with high-quality shapes and textures. These assets typically consist of a single, fused representation, like an implicit neural field, a Gaussian mixture, or a mesh, without any useful structure. However, most applications and creative workflows require assets to be made of several meaningful parts that can be manipulated independently. To address this gap, we introduce PartGen, a novel approach that generates 3D objects composed of meaningful parts starting from text, an image, or an unstructured 3D object. First, given multiple views of a 3D object, generated or rendered, a multi-view diffusion model extracts a set of plausible and view-consistent part segmentations, dividing the object into parts. Then, a second multi-view diffusion model takes each part separately, fills in the occlusions, and uses those completed views for 3D reconstruction by feeding them to a 3D reconstruction network. This completion process considers the context of the entire object to ensure that the parts integrate cohesively. The generative completion model can make up for the information missing due to occlusions; in extreme cases, it can hallucinate entirely invisible parts based on the input 3D asset. We evaluate our method on generated and real 3D assets and show that it outperforms segmentation and part-extraction baselines by a large margin. We also showcase downstream applications such as 3D part editing.

Figures

Figures reproduced from arXiv: 2412.18608 by the authors.

Figure 1
Figure 1. We introduce PartGen, a pipeline that generates compositional 3D objects similar to a human artist. It can start from text, an image, or an existing, unstructured 3D object. It consists of a multi-view diffusion model that identifies plausible parts automatically and another that completes and reconstructs them in 3D, accounting for their context, i.e., the other parts, to ensure that they fit together correctly. Ad… view at source ↗
Figure 2
Figure 2. Overview of PartGen. Our method begins with text, single images, or existing 3D objects to obtain an initial grid view of the object. This view is then processed by a diffusion-based segmentation network to achieve multi-view consistent part segmentation. Next, the segmented parts, along with contextual information, are input into a multi-view part completion network to generate a fully completed view of each part. … view at source ↗
Figure 3
Figure 3. Training data. We obtain a dataset of 3D objects de￾composed into parts from assets created by artists. These come ‘naturally’ decomposed into parts according to the artist’s design. Implementation details. The network Φseg has the same architecture as the network Φ with some changes to allow conditioning on the multi-view image I: we encode it into latent space with the VAE and stack it with the noised latent as th… view at source ↗
Figures from the paper (9 more)
Figure 4
Figure 4. Figure 4: Examples of automatic multi-view part segmentations. By running our method several times, we obtain different segmenta￾tions, covering the space of artist intents. Automatic Seeded Method mAP50↑ mAP75↑ mAP50↑ mAP75↑ Part123 [44] 11.5 7.4 10.3 6.5 SAM2† [70] 20.3 11.8 2…
Figure 5
Figure 5. Figure 5: Qualitative results of part completion. The images with blue borders are the inputs. Our algorithm produces various plausible outputs across different runs. Even if given an empty part, PartGen attempts to generate internal structures inside the object, such as sand or…
Figure 6
Figure 6. Figure 6: Examples of applications. PartGen can effectively generate or reconstruct 3D objects with meaningful and realistic parts in different scenarios: a) Part-aware text-to-3D generation; b) Part-aware image-to-3D generation; c) 3D decomposition. Baselines. We consider the o…
Figure 7
Figure 7. Figure 7: 3D part editing. We can edit the appearance and shape of the 3D objects with text prompt. Method CLIP↑ LPIPS↓ PSNR↑ PartGen (Lˆ = S k Φ(Jˆ k)) 0.952 0.065 20.33 Unstructured (Lˆ = Φ(I)) 0.955 0.064 20.47 [PITH_FULL_IMAGE:figures/full_fig_p008_7.png]
Figure 8
Figure 8. Figure 8: 3D part editing and captioning examples. The top sec￾tion illustrates training examples for the editing network, where a mask, a masked image, and text instructions are provided as con￾ditioning to the diffusion network, which fills in the part based on the given textu…
Figure 9
Figure 9. Figure 9: Recall curve of different methods. Our method achieve better performance comparing with SAM2 and its variants. generator, employing a DDPM scheduler, v-prediction, and rescaled SNR. The network is trained with 64 H100 GPUs, a batch size of 512, a learning rate of 10−5 …
Figure 10
Figure 10. Figure 10: More examples. Additional examples illustrate that PartGen can process various modalities and effectively generate or recon￾struct 3D objects with distinct parts. B. Additional Experiment Details We provide a detailed explanation of the ranking rules ap￾plied to diffe…
Figure 11
Figure 11. Figure 11: Iteratively adding parts. We show that users can iteratively add parts and combine the results of PartGen pipeline. The constant ϵ = 10−4 smooths the metric when both re￾gions are empty, in which case m(ϕ, ϕ) = 1, and will be useful later. Finally, we sort the regions…
Figure 12
Figure 12. Figure 12: Failure Cases. (a) Multi-view grid generation failure, where the generated views lack 3D consistency. (b) Segmentation failure, where semantically distinct parts are incorrectly grouped together. (c) Reconstruction model failure, where the complex ge￾ometry of the inp…

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Articulate AnyMesh: Open-Vocabulary 3D Articulated Objects Modeling

    cs.CV 2025-02 conditional novelty 7.0 of 10

    Articulate AnyMesh converts arbitrary rigid 3D meshes into articulated objects by combining VLM-driven part segmentation, geometry-aware joint estimation, and optional shape completion.

  2. PhysX-CoT: Structured Physical Reasoning from a Single Image to Simulation-Ready 3D Assets

    cs.RO 2026-08 conditional novelty 6.0 of 10

    PhysX-CoT turns single-image 3D asset generation into an explicit, ordered, supervised chain of physical states, beating an output-centric VLM baseline on geometry and physical attributes.

  3. GraphBrep: Learning B-Rep in Graph Structure for Efficient CAD Generation

    cs.CV 2025-07 conditional novelty 6.0 of 10

    GraphBrep replaces the redundant tree-based topology of prior B-Rep generators with an explicit graph adjacency representation, cutting training and inference cost while preserving generation quality.

  4. Efficient Part-level 3D Object Generation via Dual Volume Packing

    cs.CV 2025-06 conditional novelty 6.0 of 10

    From a single image, a 3D latent diffusion model generates all parts of an object at once by packing the part structure into two non-overlapping volumes.

  5. PartCrafter: Structured 3D Mesh Generation via Compositional Latent Diffusion Transformers

    cs.CV 2025-06 conditional novelty 6.0 of 10

    PartCrafter generates several separable 3D part meshes at once from a single image by fine-tuning a pretrained 3D diffusion transformer with part identity tokens and local-global attention.

Reference graph

Works this paper leans on

108 extracted references · 40 canonical work pages · cited by 5 Pith papers

  1. [1]

    SPAGHETTI: editing implicit shapes through part aware generation

    Hertz Amir, Perel Or, Giryes Raja, Sorkine-Hornung Olga, and Cohen-Or Daniel. SPAGHETTI: editing implicit shapes through part aware generation. In ACM Transac- tions on Graphics, 2022. 3

    2022

  2. [2]

    Henriques, Andrea Vedaldi, and Andrew Zisserman

    Yash Sanjay Bhalgat, Iro Laina, Joao F. Henriques, Andrea Vedaldi, and Andrew Zisserman. Contrastive Lift: 3D ob- ject instance segmentation by slow-fast contrastive fusion. In Proceedings of Advances in Neural Information Process- ing Systems (NeurIPS), 2023. 3

    2023

  3. [3]

    Henriques, Andrew Zisserman, and Andrea Vedaldi

    Yash Sanjay Bhalgat, Iro Laina, Joao F. Henriques, Andrew Zisserman, and Andrea Vedaldi. N2F2: Hierarchical scene understanding with nested neural feature fields. In Pro- ceedings of the European Conference on Computer Vision (ECCV), 2024. 3

    2024

  4. [4]

    Neural part priors: Learning to optimize part-based object completion in rgb- d scans

    Aleksei Bokhovkin and Angela Dai. Neural part priors: Learning to optimize part-based object completion in rgb- d scans. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 9032– 9042, 2023. 3

    2023

  5. [5]

    Lightplane: Highly-scalable components for neu- ral 3d fields

    Ang Cao, Justin Johnson, Andrea Vedaldi, and David Novotny. Lightplane: Highly-scalable components for neu- ral 3d fields. arXiv preprint arXiv:2404.19760 , 2024. 4, 2

    arXiv 2024

  6. [6]

    Chan, Koki Nagano, Matthew A

    Eric R. Chan, Koki Nagano, Matthew A. Chan, Alexan- der W. Bergman, Jeong Joon Park, Axel Levy, Miika Ait- tala, Shalini De Mello, Tero Karras, and Gordon Wetzstein. Generative novel view synthesis with 3D-aware diffusion models. In Proc. ICCV, 2023. 3

    2023

  7. [7]

    Comboverse: Compositional 3d assets creation using spatially-aware diffusion guidance

    Yongwei Chen, Tengfei Wang, Tong Wu, Xingang Pan, Kui Jia, and Ziwei Liu. Comboverse: Compositional 3d assets creation using spatially-aware diffusion guidance. arXiv preprint arXiv:2403.12409, 2024. 3

    arXiv 2024

  8. [8]

    Text-to-3D using Gaussian splatting

    Zilong Chen, Feng Wang, and Huaping Liu. Text-to-3D using Gaussian splatting. arXiv, 2309.16585, 2023. 3

    arXiv 2023

Show all 108 references
  1. [9]

    V3D: Video diffusion models are effective 3D generators

    Zilong Chen, Yikai Wang, Feng Wang, Zhengyi Wang, and Huaping Liu. V3D: Video diffusion models are effective 3D generators. arXiv, 2403.06738, 2024. 3

    2024 arXiv

  2. [10]

    Catvton: Concatenation is all you need for virtual try-on with diffusion models

    Zheng Chong, Xiao Dong, Haoxiang Li, Shiyue Zhang, Wenqing Zhang, Xujie Zhang, Hanqing Zhao, and Xi- aodan Liang. Catvton: Concatenation is all you need for virtual try-on with diffusion models. arXiv preprint arXiv:2407.15886, 2024. 1

    2024 arXiv

  3. [11]

    Set-the-scene: Global-local training for generating controllable nerf scenes

    Dana Cohen-Bar, Elad Richardson, Gal Metzer, Raja Giryes, and Daniel Cohen-Or. Set-the-scene: Global-local training for generating controllable nerf scenes. In Proc. ICCV Workshops, 2023. 3

    2023

  4. [12]

    CSM text-to-3D cube 2.0, 2024

    CSM. CSM text-to-3D cube 2.0, 2024. 2

    2024

  5. [13]

    Xiaoliang Dai, Ji Hou, Chih-Yao Ma, Sam S. Tsai, Jialiang Wang, Rui Wang, Peizhao Zhang, Simon Vandenhende, Xi- aofang Wang, Abhimanyu Dubey, Matthew Yu, Abhishek Kadian, Filip Radenovic, Dhruv Mahajan, Kunpeng Li, Yue Zhao, Vladan Petrovic, Mitesh Kumar Singh, Simran Mot- wan...

    2023 arXiv

  6. [14]

    Rodin text-to-3D gen-1 (0525) v0.5, 2024

    Deemos. Rodin text-to-3D gen-1 (0525) v0.5, 2024. 2

    2024

  7. [15]

    Google scanned objects: A high-quality dataset of 3d scanned household items

    Laura Downs, Anthony Francis, Nate Koenig, Brandon Kinman, Ryan Hickman, Krista Reymann, Thomas B McHugh, and Vincent Vanhoucke. Google scanned objects: A high-quality dataset of 3d scanned household items. In 2022 International Conference on Robotics and Automa- tion (ICRA), ...

    2022

  8. [16]

    Abhimanyu Dubey, Abhinav Jauhri, Abhinav Pandey, Ab- hishek Kadian, Ahmad Al-Dahle, Aiesha Letman, Akhil Mathur, Alan Schelten, Amy Yang, Angela Fan, Anirudh Goyal, Anthony Hartshorn, Aobo Yang, Archi Mitra, Archie Sravankumar, Artem Korenev, Arthur Hinsvark, Arun Rao, Aston Z...

    2024 arXiv

  9. [17]

    Efros, and Aleksander Holynski

    Dave Epstein, Ben Poole, Ben Mildenhall, Alexei A. Efros, and Aleksander Holynski. Disentangled 3d scene genera- tion with layout learning, 2024. 3

    2024

  10. [18]

    Barron, and Ben Poole

    Ruiqi Gao, Aleksander Holynski, Philipp Henzler, Arthur Brussee, Ricardo Martin-Brualla, Pratul Srinivasan, Jonathan T. Barron, and Ben Poole. CAT3D: create any- thing in 3d with multi-view diffusion models. arXiv, 2405.10314, 2024. 2, 3

    2024 arXiv

  11. [19]

    Freeman, and Thomas Funkhouser

    Kyle Genova, Forrester Cole, Daniel Vlasic, Aaron Sarna, William T. Freeman, and Thomas Funkhouser. Learning shape templates with structured implicit functions. In Proc. CVPR, 2019. 3

    2019

  12. [20]

    Funkhouser

    Kyle Genova, Forrester Cole, Avneesh Sud, Aaron Sarna, and Thomas A. Funkhouser. Local deep implicit functions for 3D shape. In Proc. CVPR, 2020. 3

    2020

  13. [21]

    3DGen: Triplane latent diffusion for textured mesh generation

    Anchit Gupta, Wenhan Xiong, Yixin Nie, Ian Jones, and Barlas Oguz. 3DGen: Triplane latent diffusion for textured mesh generation. corr, abs/2303.05371, 2023. 2

    2023 arXiv

  14. [22]

    Flex3d: Feed-forward 3d genera- tion with flexible reconstruction model and input view cu- ration

    Junlin Han, Jianyuan Wang, Andrea Vedaldi, Philip Torr, and Filippos Kokkinos. Flex3d: Feed-forward 3d genera- tion with flexible reconstruction model and input view cu- ration. arXiv preprint arXiv:2410.00890, 2024. 3

    2024 arXiv

  15. [23]

    Vfusion3d: Learning scalable 3d generative models from video diffu- sion models

    Junlin Han, Filippos Kokkinos, and Philip Torr. Vfusion3d: Learning scalable 3d generative models from video diffu- sion models. In European Conference on Computer Vision, pages 333–350. Springer, 2025. 3, 8

    2025

  16. [24]

    Denoising dif- fusion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising dif- fusion probabilistic models. In Proc. NeurIPS, 2020. 1

    2020

  17. [25]

    ViewDiff: 3D-consistent image generation with text-to-image models

    Lukas H ¨ollein, Aljaz Bozic, Norman M ¨uller, David Novotn´y, Hung-Yu Tseng, Christian Richardt, Michael Zollh¨ofer, and Matthias Nießner. ViewDiff: 3D-consistent image generation with text-to-image models. In Proc. CVPR, 2024. 3

    2024

  18. [26]

    LRM: Large reconstruction model for single im- age to 3D

    Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan. LRM: Large reconstruction model for single im- age to 3D. In Proc. ICLR, 2024. 3

    2024

  19. [27]

    Dreamtime: An im- proved optimization strategy for text-to-3D content cre- ation

    Yukun Huang, Jianan Wang, Yukai Shi, Xianbiao Qi, Zheng-Jun Zha, and Lei Zhang. Dreamtime: An im- proved optimization strategy for text-to-3D content cre- ation. CoRR, abs/2306.12422, 2023. 3

    2023 arXiv

  20. [28]

    Neu- ral template: Topology-aware reconstruction and disentan- gled generation of 3d meshes

    Ka-Hei Hui, Ruihui Li, Jingyu Hu, and Chi-Wing Fu. Neu- ral template: Topology-aware reconstruction and disentan- gled generation of 3d meshes. In Proc. CVPR, 2022. 3

    2022

  21. [29]

    H ´enaff, Matthew M

    Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac, Carl Doersch, Catalin Ionescu, David Ding, Skanda Koppula, Daniel Zoran, Andrew Brock, Evan Shelhamer, Olivier J. H ´enaff, Matthew M. Botvinick, Andrew Zisserman, Oriol Vinyals, and Jo ˜ao Carreira. Perceiver IO: A gen...

    2022

  22. [30]

    CodeNeRF: Disen- tangled neural radiance fields for object categories

    Wonbong Jang and Lourdes Agapito. CodeNeRF: Disen- tangled neural radiance fields for object categories. InProc. ICCV, 2021. 2

    2021

  23. [31]

    Shap-E: Generating condi- tional 3D implicit functions

    Heewoo Jun and Alex Nichol. Shap-E: Generating condi- tional 3D implicit functions. arXiv, 2023. 2

    2023

  24. [32]

    3D Gaussian Splatting for real-time radiance field rendering

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimk ¨uhler, and George Drettakis. 3D Gaussian Splatting for real-time radiance field rendering. Proc. SIGGRAPH, 42(4), 2023. 3

    2023

  25. [33]

    LERF: language embed- ded radiance fields

    Justin Kerr, Chung Min Kim, Ken Goldberg, Angjoo Kanazawa, and Matthew Tancik. LERF: language embed- ded radiance fields. In Proc. ICCV, 2023. 3

    2023

  26. [34]

    Garfield: Group anything with radiance fields

    Chung Min Kim, Mingxuan Wu, Justin Kerr, Ken Goldberg, Matthew Tancik, and Angjoo Kanazawa. Garfield: Group anything with radiance fields. arXiv.cs, abs/2401.09419, 2024. 3

    2024 arXiv

  27. [35]

    Berg, Wan-Yen Lo, Piotr Doll´ar, and Ross Girshick

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C. Berg, Wan-Yen Lo, Piotr Doll´ar, and Ross Girshick. Segment anything. In Proc. CVPR,

  28. [36]

    Decomposing NeRF for editing via feature field dis- tillation

    Sosuke Kobayashi, Eiichi Matsumoto, and Vincent Sitz- mann. Decomposing NeRF for editing via feature field dis- tillation. arXiv.cs, 2022. 3

    2022

  29. [37]

    SALAD: part-level latent diffusion for 3D shape generation and manipulation

    Juil Koo, Seungwoo Yoo, Minh Hieu Nguyen, and Min- hyuk Sung. SALAD: part-level latent diffusion for 3D shape generation and manipulation. In Proc. ICCV, 2023. 3

    2023

  30. [38]

    Larlus, G

    D. Larlus, G. Dorko, D. Jurie, and B. Triggs. Pascal visual object classes challenge. In Selected Proceeding of the first PASCAL Challenges Workshop, 2006. 3

    2006

  31. [39]

    Instant3D: Fast text-to-3D with sparse-view generation and large reconstruction model

    Jiahao Li, Hao Tan, Kai Zhang, Zexiang Xu, Fujun Luan, Yinghao Xu, Yicong Hong, Kalyan Sunkavalli, Greg Shakhnarovich, and Sai Bi. Instant3D: Fast text-to-3D with sparse-view generation and large reconstruction model. Proc. ICLR, 2024. 2, 3, 4, 5, 1

    2024

  32. [40]

    Focaldreamer: Text-driven 3d editing via focal-fusion assembly, 2023

    Yuhan Li, Yishun Dou, Yue Shi, Yu Lei, Xuanhong Chen, Yi Zhang, Peng Zhou, and Bingbing Ni. Focaldreamer: Text-driven 3d editing via focal-fusion assembly, 2023. 3

    2023

  33. [41]

    Magic3D: High-resolution text-to-3D content creation

    Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, and Tsung-Yi Lin. Magic3D: High-resolution text-to-3D content creation. arXiv.cs, abs/2211.10440, 2022. 3

    2022 arXiv

  34. [42]

    Guibas, and Paul Guerrero

    Connor Lin, Niloy Mitra, Gordon Wetzstein, Leonidas J. Guibas, and Paul Guerrero. NeuForm: adaptive overfitting for neural shape editing. In Proc. NeurIPS, 2022. 3

    2022

  35. [43]

    Common diffusion noise schedules and sample steps are flawed

    Shanchuan Lin, Bingchen Liu, Jiashi Li, and Xiao Yang. Common diffusion noise schedules and sample steps are flawed. In Proceedings of the IEEE/CVF winter confer- ence on applications of computer vision, pages 5404–5411,

  36. [44]

    Part123: Part-aware 3d reconstruction from a single-view image

    Anran Liu, Cheng Lin, Yuan Liu, Xiaoxiao Long, Zhiyang Dou, Hao-Xiang Guo, Ping Luo, and Wenping Wang. Part123: Part-aware 3d reconstruction from a single-view image. arXiv, 2405.16888, 2024. 3, 6, 7

    2024 arXiv

  37. [45]

    One-2-3-45: Any single image to 3D mesh in 45 seconds without per- shape optimization

    Minghua Liu, Chao Xu, Haian Jin, Linghao Chen, Mukund Varma T, Zexiang Xu, and Hao Su. One-2-3-45: Any single image to 3D mesh in 45 seconds without per- shape optimization. In Proc. NeurIPS, 2023. 3

    2023

  38. [46]

    PartSLIP: low-shot part segmentation for 3D point clouds via pretrained image- language models

    Minghua Liu, Yinhao Zhu, Hong Cai, Shizhong Han, Zhan Ling, Fatih Porikli, and Hao Su. PartSLIP: low-shot part segmentation for 3D point clouds via pretrained image- language models. In Proc. CVPR, 2023. 3

    2023

  39. [47]

    Zero-1-to-3: Zero-shot one image to 3D object

    Ruoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tok- makov, Sergey Zakharov, and Carl V ondrick. Zero-1-to-3: Zero-shot one image to 3D object. In Proc. ICCV, 2023. 3

    2023

  40. [48]

    Composable part-based manip- ulation

    Weiyu Liu, Jiayuan Mao, Joy Hsu, Tucker Hermans, Ani- mesh Garg, and Jiajun Wu. Composable part-based manip- ulation. In CoRL 2023, 2023. 2

    2023

  41. [49]

    SyncDreamer: Generating multiview-consistent images from a single-view image

    Yuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long, Lingjie Liu, Taku Komura, and Wenping Wang. SyncDreamer: Generating multiview-consistent images from a single-view image. arXiv, 2309.03453, 2023. 3

    2023 arXiv

  42. [50]

    Wonder3D: Single image to 3D using cross-domain diffu- sion

    Xiaoxiao Long, Yuanchen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, and Wenping Wang. Wonder3D: Single image to 3D using cross-domain diffu- sion. arXiv.cs, abs/2310.15008, 2023. 3

    arXiv

  43. [51]

    Genie text-to-3D v1.0, 2024

    LumaAI. Genie text-to-3D v1.0, 2024. 2

    2024

  44. [52]

    Scalable 3d captioning with pretrained models

    Tiange Luo, Chris Rockwell, Honglak Lee, and Justin John- son. Scalable 3d captioning with pretrained models. arXiv preprint arXiv:2306.07279, 2023. 5

    2023 arXiv

  45. [53]

    Grounding language with visual affordances over unstruc- tured data

    Oier Mees, Jessica Borja-Diaz, and Wolfram Burgard. Grounding language with visual affordances over unstruc- tured data. In Proceedings of the IEEE International Con- ference on Robotics and Automation (ICRA), London, UK,

  46. [54]

    RealFusion: 360 reconstruction of any object from a single image

    Luke Melas-Kyriazi, Christian Rupprecht, Iro Laina, and Andrea Vedaldi. RealFusion: 360 reconstruction of any object from a single image. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023. 3

    2023

  47. [55]

    PC2: Projection-conditioned point cloud diffusion for single-image 3d reconstruction

    Luke Melas-Kyriazi, Christian Rupprecht, and Andrea Vedaldi. PC2: Projection-conditioned point cloud diffusion for single-image 3d reconstruction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recog- nition (CVPR), 2023. 2

    2023

  48. [56]

    IM-3D: Iterative multiview diffusion and re- construction for high-quality 3D generation

    Luke Melas-Kyriazi, Iro Laina, Christian Rupprecht, Na- talia Neverova, Andrea Vedaldi, Oran Gafni, and Filippos Kokkinos. IM-3D: Iterative multiview diffusion and re- construction for high-quality 3D generation. In Proceed- ings of the International Conference on Machine Lear...

    2024

  49. [57]

    Mescheder, M

    L. Mescheder, M. Oechsle, M. Niemeyer, S. Nowozin, and A. Geiger. Occupancy Networks: Learning 3D reconstruc- tion in function space. In Proc. CVPR, 2019. 3

    2019

  50. [58]

    Meshy text-to-3D v3.0, 2024

    Meshy. Meshy text-to-3D v3.0, 2024. 2

    2024

  51. [59]

    Srinivasan, Matthew Tancik, Jonathan T

    Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, and Ren Ng. NeRF: Representing scenes as neural radiance fields for view synthesis. In Proc. ECCV, 2020. 3

    2020

  52. [60]

    Differentiable blocks world: Qualitative 3d decomposition by rendering primitives

    Tom Monnier, Jake Austin, Angjoo Kanazawa, Alexei Efros, and Mathieu Aubry. Differentiable blocks world: Qualitative 3d decomposition by rendering primitives. Ad- vances in Neural Information Processing Systems , 36: 5791–5807, 2023. 3

    2023

  53. [61]

    Diff- Facto: controllable part-based 3D point cloud generation with cross diffusion

    George Kiyohiro Nakayama, Mikaela Angelina Uy, Jiahui Huang, Shi-Min Hu, Ke Li, and Leonidas Guibas. Diff- Facto: controllable part-based 3D point cloud generation with cross diffusion. In Proc. ICCV, 2023. 3

    2023

  54. [62]

    Point-E: A system for gener- ating 3D point clouds from complex prompts

    Alex Nichol, Heewoo Jun, Prafulla Dhariwal, Pamela Mishkin, and Mark Chen. Point-E: A system for gener- ating 3D point clouds from complex prompts. arXiv.cs, abs/2212.08751, 2022. 2

    2022 arXiv

  55. [63]

    Aria digital twin: A new benchmark dataset for egocentric 3d machine percep- tion, 2023

    Xiaqing Pan, Nicholas Charron, Yongqian Yang, Scott Pe- ters, Thomas Whelan, Chen Kong, Omkar Parkhi, Richard Newcombe, and Carl Yuheng Ren. Aria digital twin: A new benchmark dataset for egocentric 3d machine percep- tion, 2023. 2

    2023

  56. [64]

    Compositional 3d scene generation using locally conditioned diffusion

    Ryan Po and Gordon Wetzstein. Compositional 3d scene generation using locally conditioned diffusion. ArXiv, abs/2303.12218, 2023. 3

    2023 arXiv

  57. [65]

    Barron, and Ben Milden- hall

    Ben Poole, Ajay Jain, Jonathan T. Barron, and Ben Milden- hall. DreamFusion: Text-to-3D using 2D diffusion. InProc. ICLR, 2023. 3, 8

    2023

  58. [66]

    Magic123: One image to high-quality 3D object generation using both 2D and 3D diffusion priors

    Guocheng Qian, Jinjie Mai, Abdullah Hamdi, Jian Ren, Aliaksandr Siarohin, Bing Li, Hsin-Ying Lee, Ivan Sko- rokhodov, Peter Wonka, Sergey Tulyakov, and Bernard Ghanem. Magic123: One image to high-quality 3D object generation using both 2D and 3D diffusion priors. arXiv.cs, abs...

    2023 arXiv

  59. [67]

    LangSplat: 3D language Gaussian splat- ting

    Minghan Qin, Wanhua Li, Jiawei Zhou, Haoqian Wang, and Hanspeter Pfister. LangSplat: 3D language Gaussian splat- ting. In Proc. CVPR, 2024. 3

    2024

  60. [68]

    Richdreamer: A gen- eralizable normal-depth diffusion model for detail richness in text-to-3D

    Lingteng Qiu, Guanying Chen, Xiaodong Gu, Qi Zuo, Mutian Xu, Yushuang Wu, Weihao Yuan, Zilong Dong, Liefeng Bo, and Xiaoguang Han. Richdreamer: A gen- eralizable normal-depth diffusion model for detail richness in text-to-3D. arXiv.cs, abs/2311.16918, 2023. 3

    2023 arXiv

  61. [69]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. Learning transferable visual models from natural language supervision. In Proc. ICML, pages...

    2021

  62. [70]

    SAM 2: Segment anything in images and videos

    Nikhila Ravi, Valentin Gabeur, Yuan-Ting Hu, Ronghang Hu, Chaitanya Ryali, Tengyu Ma, Haitham Khedr, Roman R¨adle, Chloe Rolland, Laura Gustafson, Eric Mintun, Junt- ing Pan, Kalyan Vasudev Alwala, Nicolas Carion, Chao- Yuan Wu, Ross Girshick, Piotr Doll ´ar, and Christoph Fe-...

    2024 arXiv

  63. [71]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. In Proc. CVPR ,

  64. [72]

    Progressive distillation for fast sampling of diffusion models

    Tim Salimans and Jonathan Ho. Progressive distillation for fast sampling of diffusion models. arXiv preprint arXiv:2202.00512, 2022. 1

    2022 arXiv

  65. [73]

    Zero123++: a single image to consistent multi- view diffusion base model.arXiv.cs, abs/2310.15110, 2023

    Ruoxi Shi, Hansheng Chen, Zhuoyang Zhang, Minghua Liu, Chao Xu, Xinyue Wei, Linghao Chen, Chong Zeng, and Hao Su. Zero123++: a single image to consistent multi- view diffusion base model.arXiv.cs, abs/2310.15110, 2023. 4

    2023 arXiv

  66. [74]

    MVDream: Multi-view diffusion for 3D generation

    Yichun Shi, Peng Wang, Jianglong Ye, Mai Long, Kejie Li, and Xiao Yang. MVDream: Multi-view diffusion for 3D generation. In Proc. ICLR, 2024. 3, 4

    2024

  67. [75]

    What does clip know about a red circle? vi- sual prompt engineering for vlms

    Aleksandar Shtedritski, Christian Rupprecht, and Andrea Vedaldi. What does clip know about a red circle? vi- sual prompt engineering for vlms. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 11987–11997, 2023. 2

    2023

  68. [76]

    Meta 3D Asset Gen: Text-to-mesh gener- ation with high-quality geometry, texture, and PBR mate- rials

    Yawar Siddiqui, Filippos Kokkinos, Tom Monnier, Mahen- dra Kariya, Yanir Kleiman, Emilien Garreau, Oran Gafni, Natalia Neverova, Andrea Vedaldi, Roman Shapovalov, and David Novotny. Meta 3D Asset Gen: Text-to-mesh gener- ation with high-quality geometry, texture, and PBR mate-...

    2024

  69. [77]

    Denois- ing diffusion implicit models

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denois- ing diffusion implicit models. In Proc. ICLR, 2021. 1

    2021

  70. [78]

    DreamCraft3D: Hier- archical 3D generation with bootstrapped diffusion prior

    Jingxiang Sun, Bo Zhang, Ruizhi Shao, Lizhen Wang, Wen Liu, Zhenda Xie, and Yebin Liu. DreamCraft3D: Hier- archical 3D generation with bootstrapped diffusion prior. arXiv.cs, abs/2310.16818, 2023. 3

    2023 arXiv

  71. [79]

    DreamGaussian: Generative gaussian splat- ting for efficient 3D content creation

    Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, and Gang Zeng. DreamGaussian: Generative gaussian splat- ting for efficient 3D content creation. arXiv, 2309.16653,

    arXiv

  72. [80]

    Make-It-3D: High- fidelity 3d creation from A single image with diffusion prior

    Junshu Tang, Tengfei Wang, Bo Zhang, Ting Zhang, Ran Yi, Lizhuang Ma, and Dong Chen. Make-It-3D: High- fidelity 3d creation from A single image with diffusion prior. arXiv.cs, abs/2303.14184, 2023. 3

    2023 arXiv

  73. [81]

    MVDiffusion++: A dense high-resolution multi-view diffusion model for single or sparse-view 3d object reconstruction

    Shitao Tang, Jiacheng Chen, Dilin Wang, Chengzhou Tang, Fuyang Zhang, Yuchen Fan, Vikas Chandra, Yasutaka Fu- rukawa, and Rakesh Ranjan. MVDiffusion++: A dense high-resolution multi-view diffusion model for single or sparse-view 3d object reconstruction. arXiv, 2402.12712,

    arXiv

  74. [82]

    Emiris, Yannis Avrithis, and Leonidas J

    Konstantinos Tertikas, Despoina Paschalidou, Boxiao Pan, Jeong Joon Park, Mikaela Angelina Uy, Ioannis Z. Emiris, Yannis Avrithis, and Leonidas J. Guibas. PartNeRF: Gen- erating part-aware editable 3D shapes without 3D supervi- sion. arXiv.cs, abs/2303.09554, 2023. 3

    2023 arXiv

  75. [83]

    Tripo3D text-to-3D, 2024

    TripoAI. Tripo3D text-to-3D, 2024. 2

    2024

  76. [84]

    Neural Feature Fusion Fields: 3D distillation of self-supervised 2D image representation

    Vadim Tschernezki, Iro Laina, Diane Larlus, and Andrea Vedaldi. Neural Feature Fusion Fields: 3D distillation of self-supervised 2D image representation. In Proceedings of the International Conference on 3D Vision (3DV), 2022. 3

    2022

  77. [85]

    Yeh, and Greg Shakhnarovich

    Haochen Wang, Xiaodan Du, Jiahao Li, Raymond A. Yeh, and Greg Shakhnarovich. Score Jacobian chaining: Lifting pretrained 2D diffusion models for 3D generation. In Proc. CVPR, 2023. 3

    2023

  78. [86]

    ImageDream: Image-prompt multi-view diffusion for 3D generation

    Peng Wang and Yichun Shi. ImageDream: Image-prompt multi-view diffusion for 3D generation. In Proc. ICLR,

  79. [87]

    ProlificDreamer: High- fidelity and diverse text-to-3D generation with variational score distillation

    Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongx- uan Li, Hang Su, and Jun Zhu. ProlificDreamer: High- fidelity and diverse text-to-3D generation with variational score distillation. arXiv.cs, abs/2305.16213, 2023. 3

    2023 arXiv

  80. [88]

    Novel view synthesis with diffusion models

    Daniel Watson, William Chan, Ricardo Martin-Brualla, Jonathan Ho, Andrea Tagliasacchi, and Mohammad Norouzi. Novel view synthesis with diffusion models. In Proc. ICLR, 2023. 3

    2023

  81. [89]

    Omniobject3d: Large- vocabulary 3d object dataset for realistic perception, re- construction and generation

    Tong Wu, Jiarui Zhang, Xiao Fu, Yuxin Wang, Liang Pan Jiawei Ren, Wayne Wu, Lei Yang, Jiaqi Wang, Chen Qian, Dahua Lin, and Ziwei Liu. Omniobject3d: Large- vocabulary 3d object dataset for realistic perception, re- construction and generation. In IEEE/CVF Conference on Compute...

    2023

  82. [90]

    InstantMesh: efficient 3D mesh generation from a single image with sparse-view large reconstruction models

    Jiale Xu, Weihao Cheng, Yiming Gao, Xintao Wang, Shenghua Gao, and Ying Shan. InstantMesh: efficient 3D mesh generation from a single image with sparse-view large reconstruction models. arXiv, 2404.07191, 2024. 3, 8

    2024 arXiv

  83. [91]

    GRM: Large gaussian reconstruction model for effi- cient 3D reconstruction and generation

    Yinghao Xu, Zifan Shi, Wang Yifan, Hansheng Chen, Ceyuan Yang, Sida Peng, Yujun Shen, and Gordon Wet- zstein. GRM: Large gaussian reconstruction model for effi- cient 3D reconstruction and generation. arXiv, 2403.14621,

    arXiv

  84. [92]

    DMV3D: Denoising multi- view diffusion using 3D large reconstruction model

    Yinghao Xu, Hao Tan, Fujun Luan, Sai Bi, Peng Wang, Ji- ahao Li, Zifan Shi, Kalyan Sunkavalli, Gordon Wetzstein, Zexiang Xu, and Kai Zhang. DMV3D: Denoising multi- view diffusion using 3D large reconstruction model. In Proc. ICLR, 2024. 3

    2024

  85. [93]

    ConsistNet: Enforcing 3D consistency for multi- view images diffusion

    Jiayu Yang, Ziang Cheng, Yunfei Duan, Pan Ji, and Hong- dong Li. ConsistNet: Enforcing 3D consistency for multi- view images diffusion. arXiv.cs, abs/2310.10343, 2023

    2023 arXiv

  86. [94]

    DreamComposer: Controllable 3D object gener- ation via multi-view conditions

    Yunhan Yang, Yukun Huang, Xiaoyang Wu, Yuan-Chen Guo, Song-Hai Zhang, Hengshuang Zhao, Tong He, and Xihui Liu. DreamComposer: Controllable 3D object gener- ation via multi-view conditions. arXiv.cs, abs/2312.03611,

    arXiv

  87. [95]

    Mosaic-SDF for 3D generative models

    Lior Yariv, Omri Puny, Natalia Neverova, Oran Gafni, and Yaron Lipman. Mosaic-SDF for 3D generative models. arXiv.cs, abs/2312.09222, 2023. 2

    2023 arXiv

  88. [96]

    Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models

    Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models. arXiv preprint arxiv:2308.06721,

    arXiv

  89. [97]

    GaussianDreamer: Fast generation from text to 3D gaussian splatting with point cloud priors

    Taoran Yi, Jiemin Fang, Guanjun Wu, Lingxi Xie, Xi- aopeng Zhang, Wenyu Liu, Qi Tian, and Xinggang Wang. GaussianDreamer: Fast generation from text to 3D gaussian splatting with point cloud priors. arXiv.cs, abs/2310.08529,

    arXiv

  90. [98]

    Omniseg3d: Omniversal 3d segmentation via hierarchical contrastive learning

    Haiyang Ying, Yixuan Yin, Jinzhi Zhang, Fan Wang, Tao Yu, Ruqi Huang, and Lu Fang. Omniseg3d: Omniversal 3d segmentation via hierarchical contrastive learning. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 20612–20622, 2024. 3

    2024

  91. [99]

    HiFi-123: Towards high-fidelity one image to 3D content generation

    Wangbo Yu, Li Yuan, Yan-Pei Cao, Xiangjun Gao, Xiaoyu Li, Long Quan, Ying Shan, and Yonghong Tian. HiFi-123: Towards high-fidelity one image to 3D content generation. arXiv.cs, abs/2310.06744, 2023. 3

    2023 arXiv

  92. [100]

    Generative 3d part assembly via dynamic graph learning

    Guanqi Zhan, Qingnan Fan, Kaichun Mo, Lin Shao, Bao- quan Chen, Leonidas J Guibas, Hao Dong, et al. Generative 3d part assembly via dynamic graph learning. Advances in Neural Information Processing Systems, 33:6315–6326,

  93. [101]

    Efros, Eli Shecht- man, and Oliver Wang

    Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shecht- man, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In Proc. CVPR, pages 586–595, 2018. 7

    2018

  94. [102]

    Shuaifeng Zhi, Tristan Laidlow, Stefan Leutenegger, and Andrew J. Davison. In-place scene labelling and under- standing with implicit scene representation. In Proc. ICCV,

  95. [103]

    Uni3D: Exploring uni- fied 3D representation at scale

    Junsheng Zhou, Jinsheng Wang, Baorui Ma, Yu-Shen Liu, Tiejun Huang, and Xinlong Wang. Uni3D: Exploring uni- fied 3D representation at scale. In Proc. ICLR, 2024. 3

    2024

  96. [104]

    PartSLIP++: enhancing low-shot 3d part segmentation via multi-view instance segmentation and maximum likelihood estimation

    Yuchen Zhou, Jiayuan Gu, Xuanlin Li, Minghua Liu, Yun- hao Fang, and Hao Su. PartSLIP++: enhancing low-shot 3d part segmentation via multi-view instance segmentation and maximum likelihood estimation. arXiv, 2312.03015,

    arXiv

  97. [105]

    HiFA: High-fidelity text-to-3D with advanced diffusion guidance

    Junzhe Zhu and Peiye Zhuang. HiFA: High-fidelity text-to-3D with advanced diffusion guidance. CoRR, abs/2305.18766, 2023. 3

    2023 arXiv

  98. [106]

    Dreamdissector: Learning disentan- gled text-to-3d generation from 2d diffusion priors

    Yan Zizheng, Zhou Jiapeng, Meng Fanpeng, Wu Yushuang, Qiu Lingteng, Ye Zisheng, Cui Shuguang, Chen Guanying, and Han Xiaoguang. Dreamdissector: Learning disentan- gled text-to-3d generation from 2d diffusion priors. ECCV,

  99. [108]

    The resolution of each view is 512 × 512, resulting in the total size of 1024 × 1024

    via v-prediction [72] loss. The resolution of each view is 512 × 512, resulting in the total size of 1024 × 1024. To avoid the problem of the cluttered background mentioned in [39], we rescale the noise scheduler to force a zero termi- nal signal-to-noise ratio (SNR) following...

  100. [2024]

    Detailed descriptions of the training and inference settings for all models used in Part- Gen are provided

    3 PartGen: Part-level 3D Generation and Reconstruction with Multi-View Diffusion Models Supplementary Material This supplementary material contains the following parts: • Implementation Details. Detailed descriptions of the training and inference settings for all models used i...

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.