REVIEW 3 major objections 4 minor 76 references
Dive3D: Diverse Distillation-based Text-to-3D Generation via Score Implicit Matching
T0 review · 3 major / 4 minor · reviewed 2026-08-15 · deepseek-v4-flash
Pith's one-line read The paper claims that mode collapse in text-to-3D generation comes from the asymmetric KL divergence inside SDS and reward losses, and that replacing it with a score-based matching loss delivers both more diversity and higher fidelity.
desk verdict Plausible application of score-implicit matching to text-to-3D, but the method is underspecified and the empirical claims outrun the evidence. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the Score Implicit Matching (SIM) divergence, Eq. 15: a time-integrated, weighted distance between the score fields of two distributions, $D_{[0,T]}(p,q)=\int_0^T w(t)\,\mathbb{E}_{x_t\sim\pi_t}[d(s_p(x_t)-s_q(x_t))]\,dt$, where $s_p=\nabla_x\log p$ and $d$ is a distance function. It works because its gradient can be written, via the conditional score-projection identity (Appendix A, Eq. 20), as an expectation that requires only forward evaluations of the target score network plus a separately trained auxiliary score network—no backpropagation through the score function itself. Dive3D assembles three such terms: a conditional diffusion-prior term (S-CDP), an unconditional term (S-UDP), and an explicit reward term (S-ER), combined as $L_{\mathrm{Dive3D}}=(1+\gamma)L_{\mathrm{S\text{-}CDP}}-\gamma L_{\mathrm{S\text{-}UDP}}+\lambda L_{\mathrm{S\text{-}ER}}$.
What would settle it
Run Dive3D and the leading KL-based baseline on the same open-ended prompts with matched seeds, compute, and initialization, and measure within-prompt diversity by mean pairwise perceptual distance (e.g., LPIPS) across many samples; the claim fails if the score-based loss is not significantly more diverse. The sharper test is numerical: verify on a toy two-mode mixture whether Algorithm 1's gradient is an unbiased estimator of $\nabla_\theta D_{[0,T]}(p,q)$ for a fixed $\pi_t$ and $d$—if the estimate is biased in a way that favours one mode, the mechanism itself does not deliver what the equations promise.
Extended reading notes
Core claim
On its own terms, the paper's discovery is that the mode-seeking behaviour blamed for text-to-3D diversity loss is built into the loss, not the 3D representation: score distillation sampling reduces to $(1+\gamma)D_{\mathrm{KL}}(q_\theta(x_t|c)\,\|\,p(x_t|y_c))-\gamma D_{\mathrm{KL}}(q_\theta(x_t|c)\,\|\,p(x_t))$, and the reward term adds another KL against an exponential reward distribution, so every existing objective is an asymmetric KL combination. Dive3D replaces these with the SIM divergence $D_{[0,T]}(p,q)=\int_0^T w(t)\,\mathbb{E}_{x_t\sim\pi_t}[d(s_p(x_t)-s_q(x_t))]\,dt$, which aligns score fields rather than densities and therefore does not penalize a distribution for covering several high-probability regions. The gradient of this divergence is computed through the conditional score-projection identity, which swaps differentiation of the target score for an expectation against a separately trained score network, making the loss practical. The paper reports that under this loss, a single prompt produces many distinct plausible assets—different weather, times of day, architecture, poses—while all six GPTEval3D evaluation metrics improve over prior methods.
Load-bearing premise
The load-bearing premise is that the score divergence of Eq. 15 can actually be optimized through the gradient formula of Appendix A with a separately trained auxiliary network and that Algorithm 1's estimate is faithful to it; the paper never fixes the sampling distribution $\pi_t$, the distance $d$, or the auxiliary network's training objective, so an unstable or biased choice among them could erase the diversity gain.
Editorial extensions
If this is right
- One prompt should now yield many distinct but plausible 3D assets—varied lighting, weather, background, geometry, and style—instead of a near-identical cluster, because score matching does not force the optimizer to pick a single dominant mode.
- Diversity is not bought at the cost of alignment: the same loss tops all six GPTEval3D metrics (text–asset alignment, plausibility, text–geometry consistency, texture details, geometry details, overall) against nine baselines.
- Reward guidance and diffusion priors become interchangeable terms of one divergence sum: the paper shows that reward-plus-unconditional-prior alone can generate 3D objects without a text-to-image model, so components can be reweighted or ablated systematically.
- The recipe transfers across 3D representations—NeRF, mesh, and Gaussian splatting—and across diffusion backbones, with the loss being the main difference between pipelines.
- Loss-combination ablations give practitioners a tuning dial: balanced conditional/unconditional weights (ratio near one) are best, and higher reward weights sharpen text detail while risking oversaturation.
Reading between the lines
- If the causal story is right, the same KL-to-score swap should transfer to other SDS-based distillation settings—image-, video-, or sketch-conditional generation, and one-step diffusion distillation—wherever KL's mode-seeking pressure is the bottleneck; the paper's 2D experiments hint at this, but transfer beyond text-to-3D is a prediction the paper does not test.
- The paper leaves the sampling distribution $\pi_t$ and the distance $d$ unspecified; a natural follow-up is to map how the diversity–fidelity trade-off moves as $\pi_t$ widens around the rendered-data distribution, since the mechanism predicts wider support means more mode coverage and more diversity.
- The framework predicts an interaction with prompt specificity: open-ended prompts should show the largest diversity gain over KL baselines, while maximal-specificity prompts should show almost none, because with a single narrow mode the two divergences nearly coincide—a checkable prediction the paper does not report.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes Dive3D, a text-to-3D generation framework that replaces the KL-divergence-based objectives used by SDS and reward-guided methods with a score-based divergence called Score Implicit Matching (SIM). The authors argue that asymmetric KL divergence is mode-seeking, and that matching score fields instead of densities encourages diversity without sacrificing fidelity or alignment. They present a unified divergence view in which SDS and reward losses are linear combinations of CDP, UDP, and ER KL terms, then replace each with a corresponding score-based loss. Experiments on the GPTEval3D benchmark and additional qualitative comparisons against nine baselines report improvements in text alignment, plausibility, texture/geometry details, human preference, and output diversity. The appendix contains a derivation of a conditional score-projection identity and a pseudo-code algorithm for the proposed updates.
Significance. If the central claim held, Dive3D would be a practically useful loss for diverse text-to-3D generation, and the unification of distillation and reward guidance under one divergence family could be a useful conceptual perspective. The paper has concrete strengths: it evaluates on a standard benchmark against many strong baselines, tests multiple 3D representations (NeRF, mesh, Gaussian splatting), and includes ablations over loss-weight combinations. These empirical efforts are valuable. However, the theoretical derivation of the SIM objective is substantially underspecified, and the specific mechanism by which diversity arises is not established by the equations or the algorithm as written. The lack of a quantitative diversity metric is also a gap for a paper whose headline claim is 'mitigates mode collapse'. The significance is therefore conditional on a corrected derivation and a more complete algorithm specification.
major comments (3)
- [4.1, Eq. (12)] The derivation of L_ER as a KL divergence is not valid as written. The term E_{t,c,x_t}[ω(t) log q_θ(x_t|c)] is declared constant on the grounds that q_θ is a uniform collection of N particles, but the positions of those particles are determined by the rendered images g(θ,c), so this expectation has non-vanishing θ-dependence. Furthermore, p_ER(y_c,x_t) ∝ exp(r(y_c, xhat_0(x_t))) is unnormalized, so D_KL(q_θ || p_ER) is not defined without a partition function. Because the claim that reward guidance can be written as a KL divergence underpins the unified framework in Eq. (14), this step needs to be corrected or explicitly reframed as a heuristic analogy.
- [Appendix A and Algorithm 1] The core optimization claim is not established. Eq. (15) defines a score-based divergence with an unspecified distance function d and an unspecified sampling distribution π_t, and neither is defined anywhere in the paper. The proof of Theorem 1 is compressed, and the symbols in Eq. (22), in particular s_q(y|x_t), are never defined. No argument is given that ∇_θ of Eq. (15) equals the update implemented in Algorithm 1. Lines 17–24 of Algorithm 1 call a function d_score(...) that is never defined, and line 29 asks to update φ by 'Denoising Score Matching(x_t,t)' without specifying the training data, the conditioning, or how φ relates to q_θ(x_t|c). Without these definitions, the reported diversity gain cannot be attributed to the SIM mechanism rather than to the auxiliary score network, reward weighting, or unstated hyperparameters.
- [5.2, Figs. 1(a), 5, and 7] The central claim of improved diversity is evaluated only qualitatively. No quantitative diversity metric (e.g., pairwise LPIPS, coverage, number of detected modes, or variance across seeds/particles) is reported for either the 2D or 3D settings. The figures show selected samples rather than a distributional assessment, so a reader cannot tell whether the apparent diversity is consistent or merely cherry-picked. Since the abstract states that SIM 'effectively mitigates mode collapse,' the paper should include a quantitative diversity measurement over multiple runs or seeds.
minor comments (4)
- [Table 1] Table 1 reports a single run of GPT-4o-mini evaluations with no variance, confidence intervals, or significance tests; the footnote explains the switch from GPT-4V, but the headline claim of 'highest score on every metric' needs repeated evaluation or at least a statement about evaluation noise.
- [5.1 and Table 1] Section 5.1 says the comparison includes nine state-of-the-art methods, but Table 1 additionally lists SyncDreamer, so the baseline count and the table rows are inconsistent.
- [Appendix B] The runtime statements are inconsistent: Section 5.1 says optimization takes about one hour per object on an A100, while Appendix B reports 1.5 hours on an A100 for NeRF generation and 12 hours for mesh generation. Please clarify the actual settings.
- [Eq. (5) and Algorithm 1] The notation for the score network is inconsistent: the main text uses φ for the diffusion model in Eq. (4)–(5), while Algorithm 1 uses φ for the LoRA parameters and s_φ for an auxiliary network. Please unify the symbols to avoid confusion.
Circularity Check
No significant circularity: the SIM objective is explicitly defined and the diversity claims are empirically tested against external baselines; the under-specification of d_score and pi_t is a reproducibility gap, not a circular reduction.
full rationale
Dive3D's central claim is that replacing KL-based objectives with the score-based SIM loss improves diversity and fidelity. The SIM divergence is defined in Eq. 15 with explicit score functions, a distance d, a sampling distribution pi_t, and a weighting w(t); the Dive3D objective in Eq. 16 is then formed as a linear combination of score-based CDP/UDP/ER terms. This is a construction, not a prediction derived from itself: the diversity gain is not asserted to follow algebraically from Eq. 15 but is demonstrated empirically on the GPTEval3D benchmark and in controlled 2D and 3D comparisons against DreamFusion, ProlificDreamer, MVDream, and DreamReward. The theoretical motivation cites the authors' earlier SIM work (refs 31 and 33), which shares co-author Weijian Luo, but that prior work is externally validated on one-step image and flow distillation benchmarks, and the appendix independently reproduces the score-projection identity argument leading to Eq. 22. No fitted parameter is renamed as a prediction: the loss weights gamma and lambda are reported hyperparameters, and the outcome metrics are measured on generated assets rather than read off from the loss definition. The main weakness is under-specification — d_score, pi_t, and the auxiliary-network training are not fully defined, so the implemented update is not rigorously connected to Eq. 15. That is a correctness and reproducibility concern, not a circularity: it does not make the conclusion equal to the input. Hence no circular step can be exhibited, and the appropriate finding is no significant circularity.
Assumptions & free parameters
free parameters (2)
- CFG guidance scale gamma =
7.5 (mesh), 20 (Gaussian Splatting)
- Reward scale lambda (PickScore) =
100 (mesh), 10,000 (Gaussian Splatting)
assumptions (5)
- domain assumption Pretrained 2D diffusion score s_phi(xt, y, t) is a valid score for the view-conditioned target distribution p(xt | yc).
- ad hoc to paper Reward defines an exponential distribution pER(yc, xt) proportional to exp(r(yc, xhat_0(xt))).
- ad hoc to paper The entropy term E_qtheta[log qtheta] in the KL decompositions is constant during optimization.
- standard math The score-projection identity (Appendix Theorem 1) and the gradient formula in Eq. 20 are valid under the stated 'mild conditions'.
- domain assumption GPT-4o-mini scores measure text alignment, plausibility, and quality reliably.
Cite this review
Pith. "Pith review of Dive3D: Diverse Distillation-based Text-to-3D Generation via Score Implicit Matching." pith.science (2026). https://pith.science/paper/BAIJB5ZU
@misc{pith2026250613594,
author = {Pith},
title = {Pith review of: Dive3D: Diverse Distillation-based Text-to-3D Generation via Score Implicit Matching},
year = {2026},
howpublished = {\url{https://pith.science/paper/BAIJB5ZU}},
note = {Machine review of arXiv:2506.13594}
}
read the original abstract
Distilling pre-trained 2D diffusion models into 3D assets has driven remarkable advances in text-to-3D synthesis. However, existing methods typically rely on Score Distillation Sampling (SDS) loss, which involves asymmetric KL divergence--a formulation that inherently favors mode-seeking behavior and limits generation diversity. In this paper, we introduce Dive3D, a novel text-to-3D generation framework that replaces KL-based objectives with Score Implicit Matching (SIM) loss, a score-based objective that effectively mitigates mode collapse. Furthermore, Dive3D integrates both diffusion distillation and reward-guided optimization under a unified divergence perspective. Such reformulation, together with SIM loss, yields significantly more diverse 3D outputs while improving text alignment, human preference, and overall visual fidelity. We validate Dive3D across various 2D-to-3D prompts and find that it consistently outperforms prior methods in qualitative assessments, including diversity, photorealism, and aesthetic appeal. We further evaluate its performance on the GPTEval3D benchmark, comparing against nine state-of-the-art baselines. Dive3D also achieves strong results on quantitative metrics, including text-asset alignment, 3D plausibility, text-geometry consistency, texture quality, and geometric detail.
Figures
Figures from the paper (7 more)
Reference graph
Works this paper leans on
-
[1]
Self-rectifying diffu- sion sampling with perturbed-attention guidance
Donghoon Ahn, Hyoungwon Cho, Jaewon Min, Wooseok Jang, Jungwoo Kim, SeonHwa Kim, Hyun Hee Park, Ky- ong Hwan Jin, and Seungryong Kim. Self-rectifying diffu- sion sampling with perturbed-attention guidance. InEuropean Conference on Computer Vision, pages 1–17. Springer, 2024. 3
work page 2024
-
[2]
Mohammadreza Armandpour, Huangjie Zheng, Ali Sadeghian, Amir Sadeghian, and Mingyuan Zhou. Re- imagine the negative prompt algorithm: Transform 2d diffusion into 3d, alleviate janus problem and beyond.arXiv preprint arXiv:2304.04968, 2023. 2
arXiv 2023
-
[3]
Yogesh Balaji, Seungjun Nah, Xun Huang, Arash Vahdat, Jiaming Song, Qinsheng Zhang, Karsten Kreis, Miika Aittala, Timo Aila, Samuli Laine, et al. ediff-i: Text-to-image dif- fusion models with an ensemble of expert denoisers.arXiv preprint arXiv:2211.01324, 2022. 2
arXiv 2022
-
[4]
Fan- tasia3d: Disentangling geometry and appearance for high- quality text-to-3d content creation
Rui Chen, Yongwei Chen, Ningxin Jiao, and Kui Jia. Fan- tasia3d: Disentangling geometry and appearance for high- quality text-to-3d content creation. InProceedings of the IEEE/CVF international conference on computer vision, pages 22246–22256, 2023. 2, 6, 7
work page 2023
-
[5]
Consistency models made easy.arXiv preprint arXiv:2406.14548, 2024
Zhengyang Geng, Ashwini Pokle, William Luo, Justin Lin, and J Zico Kolter. Consistency models made easy.arXiv preprint arXiv:2406.14548, 2024. 2
arXiv 2024
-
[6]
threestudio: A unified framework for 3d content generation
Yuan-Chen Guo, Ying-Tian Liu, Ruizhi Shao, Christian Laforte, Vikram V oleti, Guan Luo, Chia-Hao Chen, Zi- Xin Zou, Chen Wang, Yan-Pei Cao, and Song-Hai Zhang. threestudio: A unified framework for 3d content generation. https://github.com/threestudio- project/ threestudio, 2023. 6
work page 2023
-
[7]
Classifier-free diffusion guidance.arXiv preprint arXiv:2207.12598, 2022
Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance.arXiv preprint arXiv:2207.12598, 2022. 3
arXiv 2022
-
[8]
Denoising diffu- sion probabilistic models.Advances in neural information processing systems, 33:6840–6851, 2020
Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffu- sion probabilistic models.Advances in neural information processing systems, 33:6840–6851, 2020. 3
2020
Show all 76 references
-
[9]
Lrm: Large reconstruction model for single image to 3d
Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan. Lrm: Large reconstruction model for single image to 3d. arXiv preprint arXiv:2311.04400, 2023. 3
2023 arXiv
-
[10]
Turbo3d: Ultra-fast text-to-3d generation.arXiv preprint arXiv:2412.04470, 2024
Hanzhe Hu, Tianwei Yin, Fujun Luan, Yiwei Hu, Hao Tan, Zexiang Xu, Sai Bi, Shubham Tulsiani, and Kai Zhang. Turbo3d: Ultra-fast text-to-3d generation.arXiv preprint arXiv:2412.04470, 2024. 3
2024 arXiv
-
[11]
Dreamtime: An improved optimization strategy for diffusion-guided 3d generation
Yukun Huang, Jianan Wang, Yukai Shi, Boshi Tang, Xianbiao Qi, and Lei Zhang. Dreamtime: An improved optimization strategy for diffusion-guided 3d generation. InThe Twelfth International Conference on Learning Representations, 2024. 2
2024
-
[12]
Flow generator matching.arXiv preprint arXiv:2410.19310, 2024
Zemin Huang, Zhengyang Geng, Weijian Luo, and Guo- jun Qi. Flow generator matching.arXiv preprint arXiv:2410.19310, 2024. 2, 5
2024 arXiv
-
[13]
Zero-shot text-guided object generation with dream fields
Ajay Jain, Ben Mildenhall, Jonathan T Barron, Pieter Abbeel, and Ben Poole. Zero-shot text-guided object generation with dream fields. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 867–876,
-
[14]
Guiding a diffu- sion model with a bad version of itself.Advances in Neural Information Processing Systems, 37:52996–53021, 2024
Tero Karras, Miika Aittala, Tuomas Kynkäänniemi, Jaakko Lehtinen, Timo Aila, and Samuli Laine. Guiding a diffu- sion model with a bad version of itself.Advances in Neural Information Processing Systems, 37:52996–53021, 2024. 3
2024
-
[15]
Noise-free score distillation
Oren Katzir, Or Patashnik, Daniel Cohen-Or, and Dani Lischinski. Noise-free score distillation. InThe Twelfth International Conference on Learning Representations, 2024. 2
2024
-
[16]
3d gaussian splatting for real-time radiance field rendering.ACM Trans
Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, and George Drettakis. 3d gaussian splatting for real-time radiance field rendering.ACM Trans. Graph., 42(4):139–1, 2023. 2
2023
-
[17]
Pick-a-pic: An open dataset of user preferences for text-to-image generation.Advances in Neural Information Processing Systems, 36:36652–36663,
Yuval Kirstain, Adam Polyak, Uriel Singer, Shahbuland Ma- tiana, Joe Penna, and Omer Levy. Pick-a-pic: An open dataset of user preferences for text-to-image generation.Advances in Neural Information Processing Systems, 36:36652–36663,
-
[18]
Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model.arXiv preprint arXiv:2311.06214, 2023
Jiahao Li, Hao Tan, Kai Zhang, Zexiang Xu, Fujun Luan, Yinghao Xu, Yicong Hong, Kalyan Sunkavalli, Greg Shakhnarovich, and Sai Bi. Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model.arXiv preprint arXiv:2311.06214, 2023. 3, 6, 7
2023 arXiv
-
[19]
Self-guidance: Boosting flow and diffusion generation on their own.arXiv preprint arXiv:2412.05827,
Tiancheng Li, Weijian Luo, Zhiyang Chen, Liyuan Ma, and Guo-Jun Qi. Self-guidance: Boosting flow and diffusion generation on their own.arXiv preprint arXiv:2412.05827,
-
[20]
Luciddreamer: Towards high-fidelity text-to-3d generation via interval score matching.arXiv preprint arXiv:2311.11284, 2023
Yixun Liang, Xin Yang, Jiantao Lin, Haodong Li, Xiaogang Xu, and Yingcong Chen. Luciddreamer: Towards high-fidelity text-to-3d generation via interval score matching.arXiv preprint arXiv:2311.11284, 2023. 2
2023 arXiv
-
[21]
Magic3d: High-resolution text- to-3d content creation
Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming- Yu Liu, and Tsung-Yi Lin. Magic3d: High-resolution text- to-3d content creation. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recogniti...
2023
-
[22]
Pseudo numerical methods for diffusion models on manifolds.arXiv preprint arXiv:2202.09778, 2022
Luping Liu, Yi Ren, Zhijie Lin, and Zhou Zhao. Pseudo numerical methods for diffusion models on manifolds.arXiv preprint arXiv:2202.09778, 2022. 3
2022 arXiv
-
[23]
Zero-1-to-3: Zero-shot one image to 3d object
Ruoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov, Sergey Zakharov, and Carl V ondrick. Zero-1-to-3: Zero-shot one image to 3d object. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 9298– 9309, 2023. 2
2023
-
[24]
Syncdreamer: Gener- ating multiview-consistent images from a single-view image
Yuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long, Lingjie Liu, Taku Komura, and Wenping Wang. Syncdreamer: Gener- ating multiview-consistent images from a single-view image. InThe Twelfth International Conference on Learning Repre- sentations, 2024. 7
2024
-
[25]
Wonder3d: Sin- gle image to 3d using cross-domain diffusion.arXiv preprint arXiv:2310.15008, 2023
Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, et al. Wonder3d: Sin- gle image to 3d using cross-domain diffusion.arXiv preprint arXiv:2310.15008, 2023. 2
-
[26]
Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps.Advances in Neural Information Processing Systems, 35:5775–5787, 2022
Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, and Jun Zhu. Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps.Advances in Neural Information Processing Systems, 35:5775–5787, 2022. 3 11
2022
-
[27]
A comprehensive survey on knowledge distilla- tion of diffusion models.arXiv preprint arXiv:2304.04262,
Weijian Luo. A comprehensive survey on knowledge distilla- tion of diffusion models.arXiv preprint arXiv:2304.04262,
-
[28]
Diff-instruct: A universal ap- proach for transferring knowledge from pre-trained diffusion models.Advances in Neural Information Processing Systems, 36:76525–76546, 2023
Weijian Luo, Tianyang Hu, Shifeng Zhang, Jiacheng Sun, Zhenguo Li, and Zhihua Zhang. Diff-instruct: A universal ap- proach for transferring knowledge from pre-trained diffusion models.Advances in Neural Information Processing Systems, 36:76525–76546, 2023. 2
2023
-
[29]
Entropy-based training methods for scalable neural implicit samplers.Ad- vances in Neural Information Processing Systems, 36:7137– 7157, 2023
Weijian Luo, Boya Zhang, and Zhihua Zhang. Entropy-based training methods for scalable neural implicit samplers.Ad- vances in Neural Information Processing Systems, 36:7137– 7157, 2023. 2
2023
-
[30]
Diff-instruct: A universal ap- proach for transferring knowledge from pre-trained diffusion models.Advances in Neural Information Processing Systems, 36, 2024
Weijian Luo, Tianyang Hu, Shifeng Zhang, Jiacheng Sun, Zhenguo Li, and Zhihua Zhang. Diff-instruct: A universal ap- proach for transferring knowledge from pre-trained diffusion models.Advances in Neural Information Processing Systems, 36, 2024. 2, 3
2024
-
[31]
One-step diffusion distillation through score implicit matching.Advances in Neural Information Process- ing Systems, 37:115377–115408, 2024
Weijian Luo, Zemin Huang, Zhengyang Geng, J Zico Kolter, and Guo-jun Qi. One-step diffusion distillation through score implicit matching.Advances in Neural Information Process- ing Systems, 37:115377–115408, 2024. 2, 5
2024
-
[32]
Diff-instruct*: Towards human-preferred one- step text-to-image generative models.arXiv preprint arXiv:2410.20898, 2024
Weijian Luo, Colin Zhang, Debing Zhang, and Zhengyang Geng. Diff-instruct*: Towards human-preferred one- step text-to-image generative models.arXiv preprint arXiv:2410.20898, 2024. 3
2024 arXiv
-
[33]
One-step diffusion distillation through score implicit matching.Advances in Neural Information Process- ing Systems, 37:115377–115408, 2025
Weijian Luo, Zemin Huang, Zhengyang Geng, J Zico Kolter, and Guo-jun Qi. One-step diffusion distillation through score implicit matching.Advances in Neural Information Process- ing Systems, 37:115377–115408, 2025. 5, 1
2025
-
[34]
Geodream: Disentan- gling 2d and geometric priors for high-fidelity and consistent 3d generation.arXiv preprint arXiv:2311.17971, 2023
Baorui Ma, Haoge Deng, Junsheng Zhou, Yu-Shen Liu, Tiejun Huang, and Xinlong Wang. Geodream: Disentan- gling 2d and geometric priors for high-fidelity and consistent 3d generation.arXiv preprint arXiv:2311.17971, 2023. 2
2023 arXiv
-
[35]
X- mesh: Towards fast and accurate text-driven 3d stylization via dynamic textual guidance
Yiwei Ma, Xiaoqing Zhang, Xiaoshuai Sun, Jiayi Ji, Haowei Wang, Guannan Jiang, Weilin Zhuang, and Rongrong Ji. X- mesh: Towards fast and accurate text-driven 3d stylization via dynamic textual guidance. InProceedings of the IEEE/CVF International Conference on Computer Vision,...
2023
-
[36]
Latent-nerf for shape-guided generation of 3d shapes and textures.arXiv preprint arXiv:2211.07600,
Gal Metzer, Elad Richardson, Or Patashnik, Raja Giryes, and Daniel Cohen-Or. Latent-nerf for shape-guided generation of 3d shapes and textures.arXiv preprint arXiv:2211.07600,
-
[37]
Nerf: Representing scenes as neural radiance fields for view syn- thesis.Communications of the ACM, 65(1):99–106, 2021
Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. Nerf: Representing scenes as neural radiance fields for view syn- thesis.Communications of the ACM, 65(1):99–106, 2021. 2
2021
-
[38]
Clip-mesh: Generating textured meshes from text using pretrained image-text models
Nasir Mohammad Khalid, Tianhao Xie, Eugene Belilovsky, and Tiberiu Popa. Clip-mesh: Generating textured meshes from text using pretrained image-text models. InSIGGRAPH Asia 2022 conference papers, pages 1–8, 2022. 2, 4
2022
-
[39]
Ava: A large-scale database for aesthetic visual analysis
Naila Murray, Luca Marchesotti, and Florent Perronnin. Ava: A large-scale database for aesthetic visual analysis. In2012 IEEE conference on computer vision and pattern recognition, pages 2408–2415. IEEE, 2012. 4
2012
-
[40]
Diffusion models for adver- sarial purification.arXiv preprint arXiv:2205.07460, 2022
Weili Nie, Brandon Guo, Yujia Huang, Chaowei Xiao, Arash Vahdat, and Anima Anandkumar. Diffusion models for adver- sarial purification.arXiv preprint arXiv:2205.07460, 2022. 2
2022 arXiv
-
[41]
Dreamfusion: Text-to-3d using 2d diffusion.arXiv preprint arXiv:2209.14988, 2022
Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Mildenhall. Dreamfusion: Text-to-3d using 2d diffusion.arXiv preprint arXiv:2209.14988, 2022. 2, 3, 6, 7
2022 arXiv
-
[42]
Learning transferable visual models from natural language supervi- sion
Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervi- sion. InInternational conference on machine learning, p...
2021
-
[43]
Hierarchical text-conditional image genera- tion with clip latents.arXiv preprint arXiv:2204.06125, 2022
Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. Hierarchical text-conditional image genera- tion with clip latents.arXiv preprint arXiv:2204.06125, 2022. 2
2022 arXiv
-
[44]
High-resolution image synthesis with latent diffusion models
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High-resolution image synthesis with latent diffusion models. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022. 2, 3, 6, 8
2022
-
[45]
Pho- torealistic text-to-image diffusion models with deep language understanding.Advances in neural information processing systems, 35:36479–36494, 2022
Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al. Pho- torealistic text-to-image diffusion models with deep language understanding.Advances in neural informatio...
2022
-
[46]
Clip-forge: Towards zero-shot text-to-shape generation
Aditya Sanghi, Hang Chu, Joseph G Lambourne, Ye Wang, Chin-Yi Cheng, Marco Fumero, and Kamal Rahimi Malek- shan. Clip-forge: Towards zero-shot text-to-shape generation. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 18603–18613, 2022. 3
2022
-
[47]
Clip-sculptor: Zero-shot generation of high-fidelity and diverse shapes from natural language
Aditya Sanghi, Rao Fu, Vivian Liu, Karl DD Willis, Hooman Shayani, Amir H Khasahmadi, Srinath Sridhar, and Daniel Ritchie. Clip-sculptor: Zero-shot generation of high-fidelity and diverse shapes from natural language. InProceedings of the IEEE/CVF Conference on Computer Vision...
2023
-
[48]
Mvdream: Multi-view diffusion for 3d gen- eration.arXiv preprint arXiv:2308.16512, 2023
Yichun Shi, Peng Wang, Jianglong Ye, Mai Long, Kejie Li, and Xiao Yang. Mvdream: Multi-view diffusion for 3d gen- eration.arXiv preprint arXiv:2308.16512, 2023. 2, 3, 6, 7
2023 arXiv
-
[49]
Deep unsupervised learning using nonequilibrium thermodynamics
Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. InInternational confer- ence on machine learning, pages 2256–2265. PMLR, 2015. 3
2015
-
[50]
Denoising diffusion implicit models.arXiv preprint arXiv:2010.02502,
Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models.arXiv preprint arXiv:2010.02502,
2010 arXiv
-
[51]
Score-based generative modeling through stochastic differential equations
Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Ab- hishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456, 2020. 3
2011 arXiv
-
[52]
Sta- ble score distillation for high-quality 3d generation.arXiv preprint arXiv:2312.09305, 2023
Boshi Tang, Jianan Wang, Zhiyong Wu, and Lei Zhang. Sta- ble score distillation for high-quality 3d generation.arXiv preprint arXiv:2312.09305, 2023. 2 12
2023 arXiv
-
[53]
Dreamgaussian: Generative gaussian splatting for effi- cient 3d content creation.arXiv preprint arXiv:2309.16653,
Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, and Gang Zeng. Dreamgaussian: Generative gaussian splatting for effi- cient 3d content creation.arXiv preprint arXiv:2309.16653,
-
[54]
A connection between score matching and denoising autoencoders.Neural computation, 23(7):1661– 1674, 2011
Pascal Vincent. A connection between score matching and denoising autoencoders.Neural computation, 23(7):1661– 1674, 2011. 1
2011
-
[55]
Score jacobian chaining: Lifting pretrained 2d diffusion models for 3d generation
Haochen Wang, Xiaodan Du, Jiahao Li, Raymond A Yeh, and Greg Shakhnarovich. Score jacobian chaining: Lifting pretrained 2d diffusion models for 3d generation. InProceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12619–12629, 2023. 3
2023
-
[56]
Imagedream: Image-prompt multi-view diffusion for 3d generation.arXiv preprint arXiv:2312.02201, 2023
Peng Wang and Yichun Shi. Imagedream: Image-prompt multi-view diffusion for 3d generation.arXiv preprint arXiv:2312.02201, 2023. 2
2023 arXiv
-
[57]
Taming mode collapse in score distillation for text-to-3d generation.arXiv preprint arXiv:2401.00909, 2023
Peihao Wang, Dejia Xu, Zhiwen Fan, Dilin Wang, Sreyas Mohan, Forrest Iandola, Rakesh Ranjan, Yilei Li, Qiang Liu, Zhangyang Wang, et al. Taming mode collapse in score distillation for text-to-3d generation.arXiv preprint arXiv:2401.00909, 2023. 2
2023 arXiv
-
[58]
Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distilla- tion.arXiv preprint arXiv:2305.16213, 2023
Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, and Jun Zhu. Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distilla- tion.arXiv preprint arXiv:2305.16213, 2023. 6, 7, 8
2023 arXiv
-
[59]
Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distilla- tion.Advances in Neural Information Processing Systems, 36,
Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, and Jun Zhu. Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distilla- tion.Advances in Neural Information Processing Systems, 36,
-
[60]
Consistent123: Improve consistency for one image to 3d object synthesis.arXiv preprint arXiv:2310.08092, 2023
Haohan Weng, Tianyu Yang, Jianan Wang, Yu Li, Tong Zhang, CL Chen, and Lei Zhang. Consistent123: Improve consistency for one image to 3d object synthesis.arXiv preprint arXiv:2310.08092, 2023. 2
2023 arXiv
-
[61]
Gpt-4v (ision) is a human-aligned evaluator for text-to-3d generation
Tong Wu, Guandao Yang, Zhibing Li, Kai Zhang, Ziwei Liu, Leonidas Guibas, Dahua Lin, and Gordon Wetzstein. Gpt-4v (ision) is a human-aligned evaluator for text-to-3d generation. InCVPR, pages 22227–22238, 2024. 5, 6, 7
2024
-
[62]
Consistent3d: Towards consistent high-fidelity text-to-3d generation with deterministic sampling prior
Zike Wu, Pan Zhou, Xuanyu Yi, Xiaoding Yuan, and Han- wang Zhang. Consistent3d: Towards consistent high-fidelity text-to-3d generation with deterministic sampling prior. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 9892–9902, 2024. 2
2024
-
[63]
Imagereward: Learning and evaluating human preferences for text-to-image generation.Advances in Neural Information Processing Sys- tems, 36:15903–15935, 2023
Jiazheng Xu, Xiao Liu, Yuchen Wu, Yuxuan Tong, Qinkai Li, Ming Ding, Jie Tang, and Yuxiao Dong. Imagereward: Learning and evaluating human preferences for text-to-image generation.Advances in Neural Information Processing Sys- tems, 36:15903–15935, 2023. 4, 3
2023
-
[64]
Sa-solver: Stochastic adams solver for fast sampling of diffusion mod- els.Advances in Neural Information Processing Systems, 36: 77632–77674, 2023
Shuchen Xue, Mingyang Yi, Weijian Luo, Shifeng Zhang, Jiacheng Sun, Zhenguo Li, and Zhi-Ming Ma. Sa-solver: Stochastic adams solver for fast sampling of diffusion mod- els.Advances in Neural Information Processing Systems, 36: 77632–77674, 2023. 3
2023
-
[65]
Flow score distilla- tion for diverse text-to-3d generation, 2024
Runjie Yan, Kailu Wu, and Kaisheng Ma. Flow score distilla- tion for diverse text-to-3d generation, 2024. 2
2024
-
[66]
Consistent-1-to-3: Consistent image to 3d view syn- thesis via geometry-aware diffusion models.arXiv preprint arXiv:2310.03020, 2023
Jianglong Ye, Peng Wang, Kejie Li, Yichun Shi, and Heng Wang. Consistent-1-to-3: Consistent image to 3d view syn- thesis via geometry-aware diffusion models.arXiv preprint arXiv:2310.03020, 2023. 2
2023 arXiv
-
[67]
Dreamre- ward: Text-to-3d generation with human preference, 2024
Junliang Ye, Fangfu Liu, Qixiu Li, Zhengyi Wang, Yikai Wang, Xinzhou Wang, Yueqi Duan, and Jun Zhu. Dreamre- ward: Text-to-3d generation with human preference, 2024. 2, 4, 6, 7
2024
-
[68]
Gaussiandreamer: Fast generation from text to 3d gaussians by bridging 2d and 3d diffusion models
Taoran Yi, Jiemin Fang, Junjie Wang, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Qi Tian, and Xinggang Wang. Gaussiandreamer: Fast generation from text to 3d gaussians by bridging 2d and 3d diffusion models. InPro- ceedings of the IEEE/CVF Conference on Computer Vision ...
2024
-
[69]
One-step diffusion with distribution matching distillation
Tianwei Yin, Michaël Gharbi, Richard Zhang, Eli Shecht- man, Fredo Durand, William T Freeman, and Taesung Park. One-step diffusion with distribution matching distillation. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 6613–6623, 2024. 2
2024
-
[70]
Text-to-3d with classifier score distillation
Xin Yu, Yuan-Chen Guo, Yangguang Li, Ding Liang, Song- Hai Zhang, and XIAOJUAN QI. Text-to-3d with classifier score distillation. InThe Twelfth International Conference on Learning Representations, 2024. 2
2024
-
[71]
Enhancing ad- versarial robustness via score-based optimization.Advances in Neural Information Processing Systems, 36:51810–51829,
Boya Zhang, Weijian Luo, and Zhihua Zhang. Enhancing ad- versarial robustness via score-based optimization.Advances in Neural Information Processing Systems, 36:51810–51829,
-
[72]
Purify++: Im- proving diffusion-purification with advanced diffusion models and control of randomness.arXiv preprint arXiv:2310.18762,
Boya Zhang, Weijian Luo, and Zhihua Zhang. Purify++: Im- proving diffusion-purification with advanced diffusion models and control of randomness.arXiv preprint arXiv:2310.18762,
-
[73]
Fast sampling of dif- fusion models with exponential integrator.arXiv preprint arXiv:2204.13902, 2022
Qinsheng Zhang and Yongxin Chen. Fast sampling of dif- fusion models with exponential integrator.arXiv preprint arXiv:2204.13902, 2022. 3
2022 arXiv
-
[74]
Long and short guidance in score identity distilla- tion for one-step text-to-image generation.arXiv preprint arXiv:2406.01561, 2024
Mingyuan Zhou, Zhendong Wang, Huangjie Zheng, and Hai Huang. Long and short guidance in score identity distilla- tion for one-step text-to-image generation.arXiv preprint arXiv:2406.01561, 2024. 5
2024 arXiv
-
[75]
Score identity distillation: Exponentially fast distillation of pretrained diffusion models for one-step generation
Mingyuan Zhou, Huangjie Zheng, Zhendong Wang, Mingzhang Yin, and Hai Huang. Score identity distillation: Exponentially fast distillation of pretrained diffusion models for one-step generation. InForty-first International Confer- ence on Machine Learning, 2024. 2, 5, 1
2024
-
[76]
HIFA: High- fidelity text-to-3d generation with advanced diffusion guid- ance
Junzhe Zhu, Peiye Zhuang, and Sanmi Koyejo. HIFA: High- fidelity text-to-3d generation with advanced diffusion guid- ance. InThe Twelfth International Conference on Learning Representations, 2024. 2 13 Supplementary Material A. Derivation of the Score-based Loss Function The d...
2024
Reviewed August 15, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.