Pith. sign in

REVIEW 4 cited by

GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generation

T0 review · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A point-cloud-structured latent space with cascaded flow matching enables high-quality text- and image-conditioned 3D object generation and interactive editing.

desk verdict A genuinely new latent-space design, but the undisclosed evaluation split makes the headline numbers provisional. read the letter →

arxiv 2411.08033 v2 pith:4ZT2AX7O submitted 2024-11-12 cs.CV cs.AIcs.GR

Yushi Lan , Shangchen Zhou , Zhaoyang Lyu , Fangzhou Hong , Shuai Yang , Bo Dai , Xingang Pan , Chen Change Loy This is my paper · ORCID
classification cs.CVcs.AIcs.GR
keywords generationlatentspacepointallowingchallengesclouddesign
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Computers usually create a 3D model from text or images in two ways: by tweaking a 2D picture generator, which is slow and often makes inconsistent views, or by training a 3D model from scratch. GaussianAnything takes the second path. It first builds a point-cloud latent space: a small set of 3D points, each carrying a learned feature vector, that summarizes an object's geometry and appearance. To get this, the model looks at eight posed renderings (color, depth, normals), encodes them into a set of tokens, and then reads out the information onto a sparse point cloud sampled from the object's surface. Once this latent space is learned, the paper trains two flow-matching models on top of it. The first generates the point positions, that is, the overall shape. The second generates the feature vectors on those points, that is, the texture. This two-stage cascade is meant to keep geometry and appearance separate. At the end, a transformer decoder turns the featured point cloud into a dense set of 2D Gaussian splats that can be rendered at high speed. The authors report competitive or better scores than existing native 3D generators on text-to-3D and image-to-3D benchmarks, and they demonstrate an extra ability: because the latent is a point cloud, a user can move, delete, or add points and then regenerate the texture, which makes interactive 3D editing straightforward. The main caveats are that some quality gaps remain against multi-view pipelines, and the paper does not yet release code or a full train/test split.
Extended reading notes

Core claim

The abstract states: "the newly proposed latent space naturally enables geometry-texture disentanglement, thus allowing 3D-aware editing" and "Experimental results demonstrate ... outperforming existing native 3D methods in both text- and image-conditioned 3D generation." If correct, the paper establishes that a point-cloud-structured latent space, combined with cascaded flow matching, yields state-of-the-art native 3D generation and a practically editable 3D representation.

Load-bearing premise

The quantitative evaluation assumes that the 600 Objaverse instances used for benchmarking (Appendix A.2) are disjoint from the 176K instances used to train the VAE and diffusion models. The paper never specifies a train/test split, so if evaluation instances overlap with training data, the reported superiority over baselines is inflated. This is load-bearing for the central claim of state-of-the-art performance because all headline numbers in Tables 1 and 2 depend on it.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Assumptions & free parameters 4 free parameters · 3 assumptions · 0 invented entities

The paper is an empirical system-level contribution. It introduces no new physical entities and relies on standard deep-learning components. The main free parameters are architectural and loss-scale choices. The key external assumption is the validity of the held-out evaluation, which is not explicitly confirmed.

free parameters (4)
  • Number of latent points N = 768
    Sparse point cloud size for the latent; chosen as a balance between detail and compute (Sec. 3.1, implementation details).
  • Latent feature dimension Ch = 10
    Dimensionality of per-point features; chosen to keep the latent compact (Sec. 3.1).
  • Upsampling factors = 8, 4, 3
    Cascaded upsampler ratios producing 73,768 Gaussians; chosen for LoD trade-off (Sec. 3.1).
  • Loss weights in Eq. (5) = lambda_kl=2e-6, lambda_d=1000, lambda_n=0.2, lambda_GAN=0.1
    Weights balancing reconstruction, geometry, KL, and GAN terms; set by hand and reported in Sec. 3.1 and implementation details.
assumptions (3)
  • standard math Flow matching objective reduces to Gaussian noise prediction with the reparameterization in Eq. (26), an identity from prior work.
    Used for training the diffusion models (Sec. A.3).
  • domain assumption The 2D Gaussian splatting (surfel) representation can faithfully reconstruct 3D objects when decoded from the latent.
    The decoder outputs surfel Gaussians; the paper relies on 2DGS's surface modeling capability (Sec. 3.1, App. A.3).
  • domain assumption The 600 Objaverse evaluation instances are not in the training subset used to fit the VAE and diffusion models.
    Appendix A.2 states 600 instances are used for evaluation but does not specify a train/test split. The reported superiority over baselines depends on this assumption.

how reviews work

0 comments
Cite this review

Pith. "Pith review of GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generation." pith.science (2026). https://pith.science/paper/4ZT2AX7O

@misc{pith2026241108033,
  author       = {Pith},
  title        = {Pith review of: GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/4ZT2AX7O}},
  note         = {Machine review of arXiv:2411.08033}
}
read the original abstract

While 3D content generation has advanced significantly, existing methods still face challenges with input formats, latent space design, and output representations. This paper introduces a novel 3D generation framework that addresses these challenges, offering scalable, high-quality 3D generation with an interactive Point Cloud-structured Latent space. Our framework employs a Variational Autoencoder (VAE) with multi-view posed RGB-D(epth)-N(ormal) renderings as input, using a unique latent space design that preserves 3D shape information, and incorporates a cascaded latent flow-based model for improved shape-texture disentanglement. The proposed method, GaussianAnything, supports multi-modal conditional 3D generation, allowing for point cloud, caption, and single image inputs. Notably, the newly proposed latent space naturally enables geometry-texture disentanglement, thus allowing 3D-aware editing. Experimental results demonstrate the effectiveness of our approach on multiple datasets, outperforming existing native 3D methods in both text- and image-conditioned 3D generation.

Figures

Figures reproduced from arXiv: 2411.08033 by the authors.

Figure 1
Figure 1. Pipeline of the 3D VAE of GAUSSIANANYTHING. In the 3D latent space learning stage, our proposed 3D VAE Eϕ encodes V −views of posed RGB-D(epth)-N(ormal) renderings R into a point-cloud structured latent space. This is achieved by first processing the multi-view inputs into the un-structured set latent, which is further projected onto the 3D manifold through a cross attention block, yielding the point-cloud structure… view at source ↗
Figure 2
Figure 2. Diffusion training of GAUSSIANANYTHING. Based on the point-cloud structure 3D VAE, we perform cascaded 3D diffusion learning given text (a) and image (b) conditions. We adopt DiT architecture with AdaLN-single (Chen et al., 2023) and QK-Norm (Dehghani et al., 2023; Esser et al., 2021). For both condition modality, we send in the conditional feature with cross attention block, but at different positions. The 3D gener… view at source ↗
Figure 3
Figure 3. Qualitative Comparison of Image-to-3D. We showcase the novel view 3D reconstruc￾tion of all methods given a single image from unseen GSO dataset. Our proposed method achieves consistently stable performance across all cases. Note that though feed-forward 3D reconstruction methods achieve sharper texture reconstruction, these method fail to yield intact 3D predictions un￾der challenging cases (e.g., the rhino in row … view at source ↗
Figures from the paper (8 more)
Figure 4
Figure 4. Figure 4: Qualitative Comparison of Text-to-3D. We present text-conditioned 3D objects gener￾ated by GAUSSIANANYTHING, displaying two views of each sample. The top section compares our results with baseline methods, while the bottom shows additional samples from our method along…
Figure 5
Figure 5. Figure 5: 3D editing. Given two text prompts, we generate the corresponding point cloud z0,x with stage-1 diffusion model with ϵ x Θ, and the corresponding point cloud features z0,h can be further generated with ϵ h Θ. As can be seen, the samples from stage-2 are consistent in o…
Figure 6
Figure 6. Figure 6: Qualitative ablation of Cascaded diffusion and latent space editing. We first show the effectiveness of our two-stage cascaded diffusion framework in (a). Compared to [PITH_FULL_IMAGE:figures/full_fig_p010_6.png]
Figure 7
Figure 7. Figure 7: Our method generates high-quality and editable surfel Gaussians through a cascaded 3D diffusion pipeline, given single-view images or texts as the conditions. performance of the proposed method, GAUSSIANANYTHING. Here, we show the single-view con￾ditioned 3D generation…
Figure 8
Figure 8. Figure 8: 3D VAE Reconstruction. Here, we visualize the 3D VAE reconstruction performance across different level of details (LoD). As shown, higher LoD results in sharper textures and smoother surface. Better zoom in. generation (Huang et al., 2024b) and mesh generation (Siddiqu…
Figure 9
Figure 9. Figure 9: More Qualitative Comparison of Text-to-3D. We present more text-conditioned 3D objects generated by GAUSSIANANYTHING, alongside comparisons with competitive alternatives, including Point-E, Shape-E, and 3DTopia. As demonstrated, our approach consistently achieves super…
Figure 10
Figure 10. Figure 10: More Qualitative Results of Text-to-3D over DF-415 Captions. Our proposed method generalizes to long captions with detailed descriptions. All results are uncurated. 24 [PITH_FULL_IMAGE:figures/full_fig_p024_10.png]
Figure 11
Figure 11. Figure 11: Cascaded Text-to-3D with Point-E. Thanks to our cascaded 3D generation design, the stage-2 diffusion model in GAUSSIANANYTHING seamlessly integrates with other point cloud gen￾erative models. To illustrate this capability, we leverage the state-of-the-art Point-E mode…

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. GaussianGPT: Towards Autoregressive 3D Gaussian Scene Generation

    cs.CV 2026-03 conditional novelty 6.0 of 10

    A causal transformer with 3D RoPE generates vector-quantized 3D Gaussian latent grids autoregressively, enabling unconditional synthesis, completion, and open-ended outpainting of indoor scenes.

  2. Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework

    cs.GR 2025-09 conditional novelty 6.0 of 10

    SDF grids reconstruct best, Dual Octrees score best on automatic generation metrics, but users prefer SDF output, and reconstruction plus compression errors make up a large share of generation error.

  3. HiScene: Creating Hierarchical 3D Scenes with Isometric View Generation

    cs.GR 2025-04 conditional novelty 6.0 of 10

    HiScene generates compositional 3D scenes by treating a room as an object under isometric view, then decomposing and regenerating each instance with video-diffusion amodal completion.

  4. CAGE-GS: High-fidelity Cage Based 3D Gaussian Splatting Deformation

    cs.GR 2025-04 conditional novelty 5.0 of 10

    CAGE-GS deforms a source 3DGS model toward a target shape in any of five input formats, using a learned deformation cage and Jacobian-based Gaussian covariance updates to preserve texture.

Reference graph

Works this paper leans on

115 extracted references · 44 canonical work pages · cited by 4 Pith papers

  1. [1]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 global.max substring 't := if while FUNCTION format.date year duplicate empty "emp...

  2. [2]

    Stochastic interpolants: A unifying framework for flows and diffusions

    Michael S Albergo, Nicholas M Boffi, and Eric Vanden-Eijnden. Stochastic interpolants: A unifying framework for flows and diffusions. arXiv preprint arXiv:2303.08797, 2023

    arXiv 2023

  3. [3]

    Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul P

    Jonathan T. Barron, Ben Mildenhall, Matthew Tancik, Peter Hedman, Ricardo Martin-Brualla, and Pratul P. Srinivasan. Mip-NeRF : A multiscale representation for anti-aliasing neural radiance fields. In ICCV, 2021

    2021

  4. [4]

    Barron, Ben Mildenhall, Dor Verbin, Pratul P

    Jonathan T. Barron, Ben Mildenhall, Dor Verbin, Pratul P. Srinivasan, and Peter Hedman. Mip-nerf 360: Unbounded anti-aliased neural radiance fields. CVPR, 2022

    2022

  5. [5]

    Sutherland, Michael Arbel, and Arthur Gretton

    Miko aj Bi \'n kowski, Dougal J. Sutherland, Michael Arbel, and Arthur Gretton. Demystifying MMD GAN s. In ICLR, 2018

    2018

  6. [6]

    Chan, Connor Z

    Eric R. Chan, Connor Z. Lin, Matthew A. Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas Guibas, Jonathan Tremblay, Sameh Khamis, Tero Karras, and Gordon Wetzstein. Efficient geometry-aware 3D generative adversarial networks. In CVPR, 2022

    2022

  7. [7]

    Lara: Efficient large-baseline radiance fields

    Anpei Chen, Haofei Xu, Stefano Esposito, Siyu Tang, and Andreas Geiger. Lara: Efficient large-baseline radiance fields. In ECCV, 2024 a

    2024

  8. [8]

    Mvdrag3d: Drag-based creative 3d editing via multi-view generation-reconstruction priors

    Honghua Chen, Yushi Lan, Yongwei Chen, Yifan Zhou, and Xingang Pan. Mvdrag3d: Drag-based creative 3d editing via multi-view generation-reconstruction priors. arXiv preprint arXiv:2410.16272, 2024 b

    arXiv 2024

Show all 115 references
  1. [9]

    Pixart- : Fast training of diffusion transformer for photorealistic text-to-image synthesis, 2023

    Junsong Chen, Jincheng Yu, Chongjian Ge, Lewei Yao, Enze Xie, Yue Wu, Zhongdao Wang, James Kwok, Ping Luo, Huchuan Lu, and Zhenguo Li. Pixart- : Fast training of diffusion transformer for photorealistic text-to-image synthesis, 2023

    2023

  2. [10]

    Meshanything: Artist-created mesh generation with autoregressive transformers, 2024 c

    Yiwen Chen, Tong He, Di Huang, Weicai Ye, Sijin Chen, Jiaxiang Tang, Xin Chen, Zhongang Cai, Lei Yang, Gang Yu, Guosheng Lin, and Chi Zhang. Meshanything: Artist-created mesh generation with autoregressive transformers, 2024 c

    2024

  3. [11]

    Scannet: Richly-annotated 3D reconstructions of indoor scenes

    Angela Dai, Angel X Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, and Matthias Nie ner. Scannet: Richly-annotated 3D reconstructions of indoor scenes. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 5828--5839, 2017

    2017

  4. [12]

    Flash A ttention-2: Faster attention with better parallelism and work partitioning

    Tri Dao. Flash A ttention-2: Faster attention with better parallelism and work partitioning. In ICLR, 2024

    2024

  5. [13]

    Fu, Stefano Ermon, Atri Rudra, and Christopher R \'e

    Tri Dao, Daniel Y. Fu, Stefano Ermon, Atri Rudra, and Christopher R \'e . Flash A ttention: Fast and memory-efficient exact attention with IO -awareness. In NeurIPS, 2022

    2022

  6. [14]

    Scaling vision transformers to 22 billion parameters

    Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, et al. Scaling vision transformers to 22 billion parameters. In ICML, 2023

    2023

  7. [15]

    Objaverse-xl: A universe of 10m+ 3d objects

    Matt Deitke, Ruoshi Liu, Matthew Wallingford, Huong Ngo, Oscar Michel, Aditya Kusupati, Alan Fan, Christian Laforte, Vikram Voleti, Samir Yitzhak Gadre, Eli VanderBilt, Aniruddha Kembhavi, Carl Vondrick, Georgia Gkioxari, Kiana Ehsani, Ludwig Schmidt, and Ali Farhadi. Objavers...

    2023 arXiv

  8. [16]

    Objaverse: A universe of annotated 3d objects

    Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, and Ali Farhadi. Objaverse: A universe of annotated 3d objects. In CVPR, 2023 b

    2023

  9. [17]

    Interactive3d: Create what you want by interactive 3d generation

    Shaocong Dong, Lihe Ding, Zhanpeng Huang, Zibin Wang, Tianfan Xue, and Dan Xu. Interactive3d: Create what you want by interactive 3d generation. arXiv preprint arXiv:2404.16510, 2024

    2024 arXiv

  10. [18]

    An image is worth 16x16 words: Transformers for image recognition at scale

    Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, Dirk Weissenborn, Xiaohua Zhai, Thomas Unterthiner, Mostafa Dehghani, Matthias Minderer, Georg Heigold, Sylvain Gelly, Jakob Uszkoreit, and Neil Houlsby. An image is worth 16x16 words: Transformers for image recognition at...

    2021

  11. [19]

    Google scanned objects: A high-quality dataset of 3d scanned household items

    Laura Downs, Anthony Francis, Nate Koenig, Brandon Kinman, Ryan Hickman, Krista Reymann, Thomas B McHugh, and Vincent Vanhoucke. Google scanned objects: A high-quality dataset of 3d scanned household items. In ICRA, 2022

    2022

  12. [20]

    Taming transformers for high-resolution image synthesis

    Patrick Esser, Robin Rombach, and Björn Ommer. Taming transformers for high-resolution image synthesis. In CVPR, 2021

    2021

  13. [21]

    Scaling rectified flow transformers for high-resolution image synthesis

    Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, Dustin Podell, Tim Dockhorn, Zion English, Kyle Lacey, Alex Goodwin, Yannik Marek, and Robin Rombach. Scaling rectified flow transf...

    2024

  14. [22]

    Local deep implicit functions for 3D shape

    Kyle Genova, Forrester Cole, Avneesh Sud, Aaron Sarna, and Thomas Funkhouser. Local deep implicit functions for 3D shape. In CVPR, 2020

    2020

  15. [23]

    Point-based graphics

    Markus Gross and Hanspeter Pfister. Point-based graphics. Elsevier, 2011

    2011

  16. [24]

    OpenLRM : Open-source large reconstruction models

    Zexin He and Tengfei Wang. OpenLRM : Open-source large reconstruction models. https://github.com/3DTopia/OpenLRM, 2023

    2023

  17. [25]

    GANs trained by a two time-scale update rule converge to a local nash equilibrium

    Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. GANs trained by a two time-scale update rule converge to a local nash equilibrium. NeurIPS, 2017

    2017

  18. [26]

    Classifier-free diffusion guidance

    Jonathan Ho. Classifier-free diffusion guidance. In NeurIPS, 2021

    2021

  19. [27]

    Denoising diffusion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. NeurIPS, 2020

    2020

  20. [28]

    Cascaded diffusion models for high fidelity image generation

    Jonathan Ho, Chitwan Saharia, William Chan, David J Fleet, Mohammad Norouzi, and Tim Salimans. Cascaded diffusion models for high fidelity image generation. arXiv preprint arXiv:2106.15282, 2021

    2021 arXiv

  21. [29]

    3dtopia: Large text-to-3d generation model with hybrid diffusion priors

    Fangzhou Hong, Jiaxiang Tang, Ziang Cao, Min Shi, Tong Wu, Zhaoxi Chen, Tengfei Wang, Liang Pan, Dahua Lin, and Ziwei Liu. 3dtopia: Large text-to-3d generation model with hybrid diffusion priors. arXiv preprint arXiv:2403.02234, 2024 a

    2024 arXiv

  22. [30]

    Lrm: Large reconstruction model for single image to 3d

    Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan. Lrm: Large reconstruction model for single image to 3d. In ICLR, 2024 b

    2024

  23. [31]

    2d gaussian splatting for geometrically accurate radiance fields

    Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, and Shenghua Gao. 2d gaussian splatting for geometrically accurate radiance fields. In SIGGRAPH 2024 Conference Papers. Association for Computing Machinery, 2024 a

    2024

  24. [32]

    Pointinfinity: Resolution-invariant point diffusion models

    Zixuan Huang, Justin Johnson, Shoubhik Debnath, James M Rehg, and Chao-Yuan Wu. Pointinfinity: Resolution-invariant point diffusion models. In CVPR, 2024 b

    2024

  25. [33]

    Shap-E : Generating conditional 3D implicit functions

    Heewoo Jun and Alex Nichol. Shap-E : Generating conditional 3D implicit functions. arXiv preprint arXiv:2305.02463, 2023

    2023 arXiv

  26. [34]

    Elucidating the design space of diffusion-based generative models

    Tero Karras, Miika Aittala, Timo Aila, and Samuli Laine. Elucidating the design space of diffusion-based generative models. In NeurIPS, 2022

    2022

  27. [35]

    Musiq: Multi-scale image quality transformer

    Junjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar, and Feng Yang. Musiq: Multi-scale image quality transformer. In ICCV, pp.\ 5148--5157, 2021

    2021

  28. [36]

    3D gaussian splatting for real-time radiance field rendering

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimk \"u hler, and George Drettakis. 3D gaussian splatting for real-time radiance field rendering. ACM Transactions on Graphics, 42 0 (4): 0 1--14, 2023

    2023

  29. [37]

    Understanding diffusion objectives as the elbo with simple data augmentation

    Diederik P Kingma and Ruiqi Gao. Understanding diffusion objectives as the elbo with simple data augmentation. In Neurips, 2023

    2023

  30. [38]

    Kingma and Max Welling

    Diederik P. Kingma and Max Welling. Auto-encoding variational bayes. arXiv, 2013

    2013

  31. [39]

    Kosiorek, Heiko Strathmann, Daniel Zoran, Pol Moreno, Rosalia Schneider, Sovna Mokr'a, and Danilo Jimenez Rezende

    Adam R. Kosiorek, Heiko Strathmann, Daniel Zoran, Pol Moreno, Rosalia Schneider, Sovna Mokr'a, and Danilo Jimenez Rezende. NeRF-VAE : A geometry aware 3D scene generative model. ICML, 2021

    2021

  32. [40]

    LN3Diff : Scalable latent neural fields diffusion for speedy 3D generation

    Yushi Lan, Fangzhou Hong, Shuai Yang, Shangchen Zhou, Xuyi Meng, Bo Dai, Xingang Pan, and Chen Change Loy. LN3Diff : Scalable latent neural fields diffusion for speedy 3D generation. In ECCV, 2024 a

    2024

  33. [41]

    Gaussian3diff: 3d gaussian diffusion for 3d full head synthesis and editing

    Yushi Lan, Feitong Tan, Di Qiu, Qiangeng Xu, Kyle Genova, Zeng Huang, Sean Fanello, Rohit Pandey, Thomas Funkhouser, Chen Change Loy, and Yinda Zhang. Gaussian3diff: 3d gaussian diffusion for 3d full head synthesis and editing. In ECCV, 2024 b

    2024

  34. [42]

    Pulsar: Efficient sphere-based neural rendering

    Christoph Lassner and Michael Zollhöfer. Pulsar: Efficient sphere-based neural rendering. In CVPR, 2021

    2021

  35. [43]

    Set transformer: A framework for attention-based permutation-invariant neural networks

    Juho Lee, Yoonho Lee, Jungtaek Kim, Adam Kosiorek, Seungjin Choi, and Yee Whye Teh. Set transformer: A framework for attention-based permutation-invariant neural networks. In ICML, 2019

    2019

  36. [44]

    CraftsMan : High-fidelity mesh generation with 3D native generation and interactive geometry refiner, 2024

    Weiyu Li, Jiarui Liu, Rui Chen, Yixun Liang, Xuelin Chen, Ping Tan, and Xiaoxiao Long. CraftsMan : High-fidelity mesh generation with 3D native generation and interactive geometry refiner, 2024

    2024

  37. [45]

    Common diffusion noise schedules and sample steps are flawed

    Shanchuan Lin, Bingchen Liu, Jiashi Li, and Xiao Yang. Common diffusion noise schedules and sample steps are flawed. In WACV, 2023

    2023

  38. [46]

    Yaron Lipman, Ricky T. Q. Chen, Heli Ben-Hamu, Maximilian Nickel, and Matthew Le. Flow matching for generative modeling. In ICLR, 2023

    2023

  39. [47]

    One-2-3-45: Any single image to 3D mesh in 45 seconds without per-shape optimization

    Minghua Liu, Chao Xu, Haian Jin, Linghao Chen, Zexiang Xu, Hao Su, et al. One-2-3-45: Any single image to 3D mesh in 45 seconds without per-shape optimization. arXiv preprint arXiv:2306.16928, 2023 a

    2023 arXiv

  40. [48]

    Zero-1-to-3: Zero-shot one image to 3D object, 2023 b

    Ruoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov, Sergey Zakharov, and Carl Vondrick. Zero-1-to-3: Zero-shot one image to 3D object, 2023 b

    2023

  41. [49]

    Flow straight and fast: Learning to generate and transfer data with rectified flow

    Xingchao Liu, Chengyue Gong, and Qiang Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow. In ICLR, 2023 c

    2023

  42. [50]

    Wonder3D : Single image to 3D using cross-domain diffusion

    Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, et al. Wonder3D : Single image to 3D using cross-domain diffusion. In CVPR, 2024

    2024

  43. [51]

    Scalable 3D captioning with pretrained models

    Tiange Luo, Chris Rockwell, Honglak Lee, and Justin Johnson. Scalable 3D captioning with pretrained models. arXiv preprint arXiv:2306.07279, 2023

    2023 arXiv

  44. [52]

    View selection for 3D captioning via diffusion ranking

    Tiange Luo, Justin Johnson, and Honglak Lee. View selection for 3D captioning via diffusion ranking. arXiv preprint arXiv:2404.07984, 2024

    2024

  45. [53]

    Controllable mesh generation through sparse latent point diffusion models

    Zhaoyang Lyu, Jinyi Wang, Yuwei An, Ya Zhang, Dahua Lin, and Bo Dai. Controllable mesh generation through sparse latent point diffusion models. In CVPR, 2023

    2023

  46. [54]

    Getmesh: A controllable model for high-quality mesh generation and manipulation, 2024

    Zhaoyang Lyu, Ben Fei, Jinyi Wang, Xudong Xu, Ya Zhang, Weidong Yang, and Bo Dai. Getmesh: A controllable model for high-quality mesh generation and manipulation, 2024

    2024

  47. [55]

    Albergo, Nicholas M

    Nanye Ma, Mark Goldstein, Michael S. Albergo, Nicholas M. Boffi, Eric Vanden-Eijnden, and Saining Xie. Sit: Exploring flow and diffusion-based generative models with scalable interpolant transformers. arXiv, 2024

    2024

  48. [56]

    NeRF : Representing scenes as neural radiance fields for view synthesis

    Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. NeRF : Representing scenes as neural radiance fields for view synthesis. In ECCV, 2020

    2020

  49. [57]

    3d gaussian ray tracing: Fast tracing of particle scenes

    Nicolas Moenne-Loccoz, Ashkan Mirzaei, Or Perel, Riccardo de Lutio, Janick Martinez Esturo, Gavriel State, Sanja Fidler, Nicholas Sharp, and Zan Gojcic. 3d gaussian ray tracing: Fast tracing of particle scenes. ACM Transactions on Graphics and SIGGRAPH Asia, 2024

    2024

  50. [58]

    Diffeditor: Boosting accuracy and flexibility on diffusion-based image editing

    Chong Mou, Xintao Wang, Jiechong Song, Ying Shan, and Jian Zhang. Diffeditor: Boosting accuracy and flexibility on diffusion-based image editing. arXiv preprint arXiv:2402.02583, 2023 a

    2023 arXiv

  51. [59]

    Dragondiffusion: Enabling drag-style manipulation on diffusion models

    Chong Mou, Xintao Wang, Jiechong Song, Ying Shan, and Jian Zhang. Dragondiffusion: Enabling drag-style manipulation on diffusion models. arXiv preprint arXiv:2307.02421, 2023 b

    2023 arXiv

  52. [60]

    Instant neural graphics primitives with a multiresolution hash encoding

    Thomas M\"uller, Alex Evans, Christoph Schied, and Alexander Keller. Instant neural graphics primitives with a multiresolution hash encoding. TOG, 41 0 (4): 0 102:1--102:15, July 2022

    2022

  53. [61]

    Point-E : A system for generating 3D point clouds from complex prompts, 2022

    Alex Nichol, Heewoo Jun, Prafulla Dhariwal, Pamela Mishkin, and Mark Chen. Point-E : A system for generating 3D point clouds from complex prompts, 2022

    2022

  54. [62]

    Maxime Oquab, Timothée Darcet, Theo Moutakanni, Huy V. Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Russell Howes, Po-Yao Huang, Hu Xu, Vasu Sharma, Shang-Wen Li, Wojciech Galuba, Mike Rabbat, Mido Assran, Nicolas B...

    2023

  55. [63]

    Drag Your GAN : Interactive point-based manipulation on the generative image manifold

    Xingang Pan, Ayush Tewari, Thomas Leimk \"u hler, Lingjie Liu, Abhimitra Meka, and Christian Theobalt. Drag Your GAN : Interactive point-based manipulation on the generative image manifold. In SIGGRAPH, 2023

    2023

  56. [64]

    Scalable diffusion models with transformers

    William Peebles and Saining Xie. Scalable diffusion models with transformers. In ICCV, 2023

    2023

  57. [65]

    Surfels: Surface elements as rendering primitives

    Hanspeter Pfister, Matthias Zwicker, Jeroen Van Baar, and Markus Gross. Surfels: Surface elements as rendering primitives. In PACMCGIT, 2000

    2000

  58. [66]

    Barron, and Ben Mildenhall

    Ben Poole, Ajay Jain, Jonathan T. Barron, and Ben Mildenhall. DreamFusion : Text-to- 3D using 2D diffusion. ICLR, 2022

    2022

  59. [67]

    PointNet : Deep learning on point sets for 3D classification and segmentation

    Charles Qi, Hao Su, Kaichun Mo, and Leonidas Guibas. PointNet : Deep learning on point sets for 3D classification and segmentation. arXiv, 2016

    2016

  60. [68]

    PointNet++ : Deep hierarchical feature learning on point sets in a metric space

    Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J Guibas. PointNet++ : Deep hierarchical feature learning on point sets in a metric space. In NeurIPS, 2017

    2017

  61. [69]

    Richdreamer: A generalizable normal-depth diffusion model for detail richness in text-to-3d

    Lingteng Qiu, Guanying Chen, Xiaodong Gu, Qi zuo, Mutian Xu, Yushuang Wu, Weihao Yuan, Zilong Dong, Liefeng Bo, and Xiaoguang Han. Richdreamer: A generalizable normal-depth diffusion model for detail richness in text-to-3d. arXiv preprint arXiv:2311.16918, 2023

    2023 arXiv

  62. [70]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. Learning transferable visual models from natural language supervision. In ICML, 2021

    2021

  63. [71]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj \"o rn Ommer. High-resolution image synthesis with latent diffusion models. In CVPR, 2022

    2022

  64. [72]

    PIFu : Pixel-aligned implicit function for high-resolution clothed human digitization

    Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Angjoo Kanazawa, and Hao Li. PIFu : Pixel-aligned implicit function for high-resolution clothed human digitization. In ICCV, October 2019

    2019

  65. [73]

    Mehdi S. M. Sajjadi, Henning Meyer, Etienne Pot, Urs Bergmann, Klaus Greff, Noha Radwan, Suhani Vora, Mario Lucic, Daniel Duckworth, Alexey Dosovitskiy, Jakob Uszkoreit, Thomas Funkhouser, and Andrea Tagliasacchi. Scene Representation Transformer : Geometry-free novel view syn...

    2022

  66. [74]

    Mehdi S. M. Sajjadi, Aravindh Mahendran, Thomas Kipf, Etienne Pot, Daniel Duckworth, Mario Lu c i \'c , and Klaus Greff. RUST: Latent Neural Scene Representations from Unposed Imagery . CVPR, 2023

    2023

  67. [75]

    Neural point cloud diffusion for disentangled 3d shape and appearance generation

    Philipp Schr\"oppel, Christopher Wewer, Jan Eric Lenssen, Eddy Ilg, and Thomas Brox. Neural point cloud diffusion for disentangled 3d shape and appearance generation. In CVPR, 2024

    2024

  68. [76]

    Zero123++: a single image to consistent multi-view diffusion base model

    Ruoxi Shi, Hansheng Chen, Zhuoyang Zhang, Minghua Liu, Chao Xu, Xinyue Wei, Linghao Chen, Chong Zeng, and Hao Su. Zero123++: a single image to consistent multi-view diffusion base model. In arXiv, 2023 a

    2023

  69. [77]

    Mvdream: Multi-view diffusion for 3D generation

    Yichun Shi, Peng Wang, Jianglong Ye, Long Mai, Kejie Li, and Xiao Yang. Mvdream: Multi-view diffusion for 3D generation. arXiv:2308.16512, 2023 b

    2023 arXiv

  70. [78]

    Meshgpt: Generating triangle meshes with decoder-only transformers

    Yawar Siddiqui, Antonio Alliegro, Alexey Artemov, Tatiana Tommasi, Daniele Sirigatti, Vladislav Rosov, Angela Dai, and Matthias Nie ner. Meshgpt: Generating triangle meshes with decoder-only transformers. arXiv preprint arXiv:2311.15475, 2023

    2023 arXiv

  71. [79]

    Freeman, Joshua B

    Vincent Sitzmann, Semon Rezchikov, William T. Freeman, Joshua B. Tenenbaum, and Fredo Durand. Light field networks: Neural scene representations with single-evaluation rendering. In NeurIPS, 2021

    2021

  72. [80]

    Score-based generative modeling through stochastic differential equations

    Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Abhishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations. In ICLR, 2021

    2021

  73. [81]

    Splatter image: Ultra-fast single-view 3D reconstruction

    Stanislaw Szymanowicz, Christian Rupprecht, and Andrea Vedaldi. Splatter image: Ultra-fast single-view 3D reconstruction. In arXiv, 2023

    2023

  74. [82]

    Neural geometric level of detail: Real-time rendering with implicit 3D shapes

    Towaki Takikawa, Joey Litalien, Kangxue Yin, Karsten Kreis, Charles Loop, Derek Nowrouzezahrai, Alec Jacobson, Morgan McGuire, and Sanja Fidler. Neural geometric level of detail: Real-time rendering with implicit 3D shapes. In CVPR, 2021

    2021

  75. [83]

    Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T

    Matthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T. Barron, and Ren Ng. Fourier features let networks learn high frequency functions in low dimensional domains. In NeurIPS, 2020

    2020

  76. [84]

    Lgm: Large multi-view gaussian model for high-resolution 3d content creation

    Jiaxiang Tang, Zhaoxi Chen, Xiaokang Chen, Tengfei Wang, Gang Zeng, and Ziwei Liu. Lgm: Large multi-view gaussian model for high-resolution 3d content creation. In ECCV, 2024

    2024

  77. [85]

    Srinivasan, Howard Zhou, Jonathan T

    Qianqian Wang, Zhicheng Wang, Kyle Genova, Pratul P. Srinivasan, Howard Zhou, Jonathan T. Barron, Ricardo Martin-Brualla, Noah Snavely, and Thomas A. Funkhouser. IBRNet: Learning Multi-View Image-Based Rendering . In CVPR, 2021

    2021

  78. [86]

    Prolificdreamer: High-fidelity and diverse text-to- 3D generation with variational score distillation

    Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, and Jun Zhu. Prolificdreamer: High-fidelity and diverse text-to- 3D generation with variational score distillation. In NeurIPS, 2023

    2023

  79. [87]

    CRM : Single image to 3D textured mesh with convolutional reconstruction model

    Zhengyi Wang, Yikai Wang, Yifei Chen, Chendong Xiang, Shuo Chen, Dajiang Yu, Chongxuan Li, Hang Su, and Jun Zhu. CRM : Single image to 3D textured mesh with convolutional reconstruction model. In ECCV, 2024

    2024

  80. [88]

    Multiview compressive coding for 3 D reconstruction

    Chao-Yuan Wu, Justin Johnson, Jitendra Malik, Christoph Feichtenhofer, and Georgia Gkioxari. Multiview compressive coding for 3 D reconstruction. arXiv preprint arXiv:2301.08247, 2023 a

    2023 arXiv

  81. [89]

    Q-align: Teaching lmms for visual scoring via discrete text-defined levels

    Haoning Wu, Zicheng Zhang, Weixia Zhang, Chaofeng Chen, Chunyi Li, Liang Liao, Annan Wang, Erli Zhang, Wenxiu Sun, Qiong Yan, Xiongkuo Min, Guangtai Zhai, and Weisi Lin. Q-align: Teaching lmms for visual scoring via discrete text-defined levels. arXiv preprint arXiv:2312.17090...

    2023 arXiv

  82. [90]

    Direct3D : Scalable image-to-3d generation via 3D latent diffusion transformer, 2024

    Shuang Wu, Youtian Lin, Feihu Zhang, Yifei Zeng, Jingxi Xu, Philip Torr, Xun Cao, and Yao Yao. Direct3D : Scalable image-to-3d generation via 3D latent diffusion transformer, 2024

    2024

  83. [91]

    Structured 3d latents for scalable and versatile 3d generation

    Jianfeng Xiang, Zelong Lv, Sicheng Xu, Yu Deng, Ruicheng Wang, Bowen Zhang, Dong Chen, Xin Tong, and Jiaolong Yang. Structured 3d latents for scalable and versatile 3d generation. arXiv preprint arXiv:2412.01506, 2024

    2024 arXiv

  84. [92]

    On layer normalization in the transformer architecture, 2020

    Ruibin Xiong, Yunchang Yang, Di He, Kai Zheng, Shuxin Zheng, Chen Xing, Huishuai Zhang, Yanyan Lan, Liwei Wang, and Tie-Yan Liu. On layer normalization in the transformer architecture, 2020

    2020

  85. [93]

    Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models

    Jiale Xu, Weihao Cheng, Yiming Gao, Xintao Wang, Shenghua Gao, and Ying Shan. Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models. arXiv preprint arXiv:2404.07191, 2024 a

    2024 arXiv

  86. [94]

    Freesplatter: Pose-free gaussian splatting for sparse-view 3d reconstruction

    Jiale Xu, Shenghua Gao, and Ying Shan. Freesplatter: Pose-free gaussian splatting for sparse-view 3d reconstruction. arXiv preprint arXiv:2412.09573, 2024 b

    2024 arXiv

  87. [95]

    Point-NeRF : Point-based neural radiance fields

    Qiangeng Xu, Zexiang Xu, Julien Philip, Sai Bi, Zhixin Shu, Kalyan Sunkavalli, and Ulrich Neumann. Point-NeRF : Point-based neural radiance fields. In CVPR, 2022

    2022

  88. [96]

    DMV3D : Denoising multi-view diffusion using 3D large reconstruction model

    Yinghao Xu, Hao Tan, Fujun Luan, Sai Bi, Peng Wang, Jiahao Li, Zifan Shi, Kalyan Sunkavalli, Gordon Wetzstein, Zexiang Xu, and Kai Zhang. DMV3D : Denoising multi-view diffusion using 3D large reconstruction model. In ICLR, 2024 c

    2024

  89. [97]

    Atlas gaussians diffusion for 3d generation

    Haitao Yang, Yuan Dong, Hanwen Jiang, Dejia Xu, Georgios Pavlakos, and Qixing Huang. Atlas gaussians diffusion for 3d generation. In ICLR, 2025

    2025

  90. [98]

    Blendedmvs: A large-scale dataset for generalized multi-view stereo networks

    Yao Yao, Zixin Luo, Shiwei Li, Jingyang Zhang, Yufan Ren, Lei Zhou, Tian Fang, and Long Quan. Blendedmvs: A large-scale dataset for generalized multi-view stereo networks. CVPR, 2020

    2020

  91. [99]

    Mosaic-sdf for 3d generative models

    Lior Yariv, Omri Puny, Natalia Neverova, Oran Gafni, and Yaron Lipman. Mosaic-sdf for 3d generative models. In CVPR, 2024

    2024

  92. [100]

    Differentiable surface splatting for point-based geometry processing

    Wang Yifan, Felice Serena, Shihao Wu, Cengiz \" O ztireli, and Olga Sorkine - Hornung. Differentiable surface splatting for point-based geometry processing. ACM Transactions on Graphics (proceedings of ACM SIGGRAPH ASIA), 38 0 (6), 2019

    2019

  93. [101]

    GRM : Large gaussian reconstruction model for efficient 3d reconstruction and generation, 2024

    Xu Yinghao, Shi Zifan, Yifan Wang, Chen Hansheng, Yang Ceyuan, Peng Sida, Shen Yujun, and Wetzstein Gordon. GRM : Large gaussian reconstruction model for efficient 3d reconstruction and generation, 2024

    2024

  94. [102]

    PixelNeRF : Neural radiance fields from one or few images

    Alex Yu, Vickie Ye, Matthew Tancik, and Angjoo Kanazawa. PixelNeRF : Neural radiance fields from one or few images. In CVPR, 2021

    2021

  95. [103]

    Pu-net: Point cloud upsampling network

    Lequan Yu, Xianzhi Li, Chi-Wing Fu, Daniel Cohen-Or, and Pheng-Ann Heng. Pu-net: Point cloud upsampling network. In CVPR, 2018

    2018

  96. [104]

    MVImgNet : A large-scale dataset of multi-view images

    Xianggang Yu, Mutian Xu, Yidan Zhang, Haolin Liu, Chongjie Ye, Yushuang Wu, Zizheng Yan, Tianyou Liang, Guanying Chen, Shuguang Cui, and Xiaoguang Han. MVImgNet : A large-scale dataset of multi-view images. In CVPR, 2023

    2023

  97. [105]

    Lion: Latent point diffusion models for 3D shape generation

    Xiaohui Zeng, Arash Vahdat, Francis Williams, Zan Gojcic, Or Litany, Sanja Fidler, and Karsten Kreis. Lion: Latent point diffusion models for 3D shape generation. In NeurIPS, 2022

    2022

  98. [106]

    3DShape2VecSet : A 3d shape representation for neural fields and generative diffusion models

    Biao Zhang, Jiapeng Tang, Matthias Nie ner, and Peter Wonka. 3DShape2VecSet : A 3d shape representation for neural fields and generative diffusion models. ACM Trans. Graph., 42 0 (4), jul 2023. ISSN 0730-0301. doi:10.1145/3592442

    2023 doi

  99. [107]

    Geometry distributions

    Biao Zhang, Jing Ren, and Peter Wonka. Geometry distributions. arXiv preprint arXiv:2411.16076, 2024 a

    2024

  100. [108]

    CLAY : A controllable large-scale generative model for creating high-quality 3D assets

    Longwen Zhang, Ziyu Wang, Qixuan Zhang, Qiwei Qiu, Anqi Pang, Haoran Jiang, Wei Yang, Lan Xu, and Jingyi Yu. CLAY : A controllable large-scale generative model for creating high-quality 3D assets. ACM Transactions on Graphics, 2024 b

    2024

  101. [109]

    The unreasonable effectiveness of deep features as a perceptual metric

    Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In CVPR, 2018

    2018

  102. [110]

    Point transformer

    Hengshuang Zhao, Li Jiang, Jiaya Jia, Philip HS Torr, and Vladlen Koltun. Point transformer. In CVPR, 2021

    2021

  103. [111]

    Free3d: Consistent novel view synthesis without 3d representation

    Chuanxia Zheng and Andrea Vedaldi. Free3d: Consistent novel view synthesis without 3d representation. arXiv, 2023

    2023

  104. [112]

    Chan, Chongyi Li, and Chen Change Loy

    Shangchen Zhou, Kelvin C.K. Chan, Chongyi Li, and Chen Change Loy. Towards robust blind face restoration with codebook lookup transformer. In NeurIPS, 2022

    2022

  105. [113]

    @esa (Ref

    \@ifxundefined[1] #1\@undefined \@firstoftwo \@secondoftwo \@ifnum[1] #1 \@firstoftwo \@secondoftwo \@ifx[1] #1 \@firstoftwo \@secondoftwo [2] @ #1 \@temptokena #2 #1 @ \@temptokena \@ifclassloaded agu2001 natbib The agu2001 class already includes natbib coding, so you should ...

  106. [114]

    \@lbibitem[] @bibitem@first@sw\@secondoftwo \@lbibitem[#1]#2 \@extra@b@citeb \@ifundefined br@#2\@extra@b@citeb \@namedef br@#2 \@nameuse br@#2\@extra@b@citeb \@ifundefined b@#2\@extra@b@citeb @num @parse #2 @tmp #1 NAT@b@open@#2 NAT@b@shut@#2 \@ifnum @merge>\@ne @bibitem@firs...

  107. [115]

    @open @close @open @close and [1] URL: #1 \@ifundefined chapter * \@mkboth \@ifxundefined @sectionbib * \@mkboth * \@mkboth\@gobbletwo \@ifclassloaded amsart * \@ifclassloaded amsbook * \@ifxundefined @heading @heading NAT@ctr thebibliography [1] @ \@biblabel @NAT@ctr \@bibset...

    2024

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.