Pith. sign in

REVIEW 2 major objections 5 minor 2 cited by

MeshGen: Generating PBR Textured Mesh with Render-Enhanced Auto-Encoder and Generative Data Augmentation

T0 review · 2 major / 5 minor · reviewed 2026-08-15 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read MeshGen claims that a single reference image can drive generation of a detailed 3D mesh with physically based rendering (PBR) textures—albedo, metallic, roughness—in about 30 seconds, with geometry and appearance that follow the input…

desk verdict Solid image-to-3D pipeline with a genuine new combination; the 'new standard' claim overreaches thin error bars, and the untested rotation-covariance assumption is the structural risk to check. read the letter →

arxiv 2505.04656 v1 pith:EBTDNMGB submitted 2025-05-07 cs.GR

Zilong Chen , Yikai Wang , Wenqiang Sun , Feng Wang , Yiwen Chen , Huaping Liu This is my paper · ORCID
classification cs.GR
keywords image-to-3DgenerationPBRtexturepoint-to-shapeauto-encodertriplanelatentdiffusiongeometricalignmentaugmentationgenerativerenderingreferenceattentionControlNetmesh
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper tries to establish that single-image-to-3D generation can be made practical for real assets: not just a shape approximation, but a mesh whose geometry tracks the reference photo and whose texture is a set of PBR maps that can be relit. The main claim is that the two usual failure modes—auto-encoders that wash out surface detail, and diffusion models that fall back to symmetric shapes aligned poorly to the image—can be fixed by render-based supervision and by generating extra training data through geometric and lighting augmentations. On top of that, the paper claims a texture pipeline that produces albedo, metallic, and roughness maps consistent with the image, and reports that the full system runs in about 30 seconds. A sympathetic reading is that the limiting factor for image-to-3D is no longer the architecture but the training signal, and MeshGen supplies a recipe for that signal.

What carries the argument

The load-bearing object is the render-enhanced point-to-shape auto-encoder: input surface points encoded by cross- and self-attention into a triplane latent, decoded by convolutional upsampling plus an MLP occupancy network, and trained first with occupancy loss and then with rendered-normal perceptual losses and a ray-based regularization that forces occupancy toward zero in empty space. Around it sit two training mechanisms: geometric alignment, which exploits the encoder's expected covariance under azimuth rotation by rotating point clouds to the conditioning view, and generative rendering, which creates synthetic relit images from normal and depth maps to teach lighting-invariant shape inference. The texture stage carries the same structure: a geometry-conditioned multi-view generator with reference attention, followed by a PBR decomposer that turns shaded images into albedo, metallic, and roughness channels, and a UV-space inpainter for unobserved regions.

What would settle it

Encode a mesh's canonical point cloud, decode it, and measure the reconstruction; then rotate the same point cloud by, say, 90 degrees in azimuth, encode and decode it, rotate the result back, and compare the two reconstructed surfaces with Chamfer distance or F-Score. If the rotated-latent reconstruction deviates substantially from the canonical one beyond the auto-encoder's own reconstruction tolerance, the geometric-alignment augmentation is supplying corrupted image-shape training pairs, and the paper's ground for controllability would give way.

Watch

Extended reading notes

Core claim

MeshGen's central discovery is that a point-to-shape auto-encoder trained with coarse-to-fine optimization—occupancy first, then normal-map perceptual losses plus ray-based regularization—compresses meshes into a triplane latent (three axis-aligned feature planes decoded by an MLP) with enough high-frequency detail for downstream generation. The paper then argues that an image-to-shape diffusion model can be made controllable and generalizable on limited public data through geometric alignment augmentation (rotating the sampled point cloud to the conditioning view's azimuth so image and shape are true correspondences) and generative rendering augmentation (synthesizing relit, realistically textured renderings of the same geometry as additional conditions). For appearance, MeshGen claims a reference-attention multi-view generator, a PBR decomposer that estimates metallic, roughness, and albedo maps, and a UV-space inpainter that fills unobserved surface regions. The evidence offered consists of best geometry metrics on standard scanned-object benchmarks, large user-study win rates for texture alignment and overall quality, and PBR-specific reconstruction metrics.

Load-bearing premise

The load-bearing premise is that the point-to-shape auto-encoder is genuinely covariant under azimuth rotation, so a point cloud rotated to match the conditioning view maps to a valid, correctly aligned target latent even though the encoder was trained mainly on canonical orientations.

Editorial extensions

If this is right

  • If the central claim holds, a user can go from one photograph to a relightable, textured 3D asset in about 30 seconds, moving native 3D generation from per-scene optimization toward interactive asset production.
  • The geometric alignment augmentation would make image-shape correspondence learnable even on small datasets, addressing the symmetric-shape failure mode seen in earlier native 3D diffusion models.
  • The generative rendering augmentation would let a shape model read geometry from lighting cues, improving robustness to real-world photographs with complex illumination.
  • Because textures are generated as PBR maps rather than baked shading, downstream relighting, editing, and physically based rendering become possible without retraining or cleanup.
  • On the paper's reported benchmarks, the pipeline would be ahead of previous image-to-3D methods on both geometry metrics and texture-quality or user-study measurements.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • An untested consequence of the paper's own premise: geometric alignment only helps if the auto-encoder truly is azimuth-covariant, so the augmentation's benefit should track a direct measure of latent covariance; if covariance is imperfect, adding rotation augmentation to auto-encoder training would be a cheap correction.
  • The texture branch is modular—the reference-attention generator plus PBR decomposer could be attached to meshes from any geometry model, so the reported texture gains may transfer beyond MeshGen's own shape pipeline.
  • If azimuth covariance holds, the same alignment trick could be extended to elevation or arbitrary camera poses, potentially removing the need for multi-view conditioning in image-to-shape diffusion.
  • The success of synthetic relighting suggests a general recipe for appearance-invariant geometry learning: use generated relighting as free training data to make a shape model ignore texture and lighting while reading structure, a recipe that could transfer to other single-image reconstruction tasks.
Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 5 minor

Summary. The paper proposes MeshGen, a single-image-to-3D pipeline that produces meshes with PBR textures. The method combines a point-to-shape auto-encoder trained with render-based perceptual loss and ray-based regularization, an image-to-shape diffusion model trained with two augmentations (geometric alignment and generative rendering augmentation), and a texture-generation pipeline with a reference-attention multi-view ControlNet, a multi-view PBR decomposer, and a UV-space inpainter. The authors report improved F-score and Chamfer distance on GSO and OmniObject3D relative to several strong baselines, a user study with win rates of 92.31% for image alignment and 82.69% for overall quality, and ablations supporting each component.

Significance. If the reported results are statistically reliable, MeshGen is a meaningful step forward in image-to-3D generation, particularly in geometric controllability and in producing relightable PBR textures rather than baked-in shading. The paper is transparent about seed variance and includes quantitative ablations, which strengthens the empirical case. However, the significance hinges on two issues: the statistical confidence of the headline margins and the validity of the geometric-covariance assumption underlying the geometric alignment augmentation.

major comments (2)
  1. [Sec. 3.2 / App. A.1] The geometric alignment augmentation (Sec. 3.2) is described as exploiting the 'geometrical covariant property' of the point-to-shape auto-encoder for azimuth rotations. However, the auto-encoder is trained on meshes normalized to [-1,1]^3 without any rotation augmentation (App. A.1), and the triplane representation is defined on a fixed world-space grid. A Transformer-based point encoder with Fourier positional encoding is not inherently rotation-covariant, so rotated point clouds may be out-of-distribution inputs. The paper provides no direct test of reconstruction fidelity (e.g., F-score or Chamfer distance) for rotated inputs. The ablations in Tab. 5 and Fig. 6 compare whole-pipeline outcomes and therefore do not isolate whether the encoder produces valid latents for rotated clouds. If the encoder distorts rotated inputs, the diffusion model would be trained on corrupted image-to-latent pairs, and the improved controllability attributed to geometric alignment could be an artifact. Please provide a quantitative evaluation of the auto-encoder under azimuth rotations: encode-decode rotated point clouds and report F-score and Chamfer distance against the rotated ground-truth meshes, ideally compared to the canonical-orientation results.
  2. [Tab. 1] The headline quantitative claim that MeshGen 'largely outperforms previous methods' is not well supported by the statistics in Tab. 1. For GSO, the F-score margin over the best baseline (MeshFormer) is 0.971±0.014 vs 0.963, and the Chamfer distance margin is 0.028±0.005 vs 0.031. On OmniObject3D the margins are 0.918±0.010 vs 0.914 and 0.040±0.004 vs 0.043. In every case the margin is smaller than the reported standard deviation of the 'Ours' row, and the baselines are reported without any variance or number of runs. A proper comparison needs either multiple baseline runs, paired bootstrap confidence intervals, or another significance test; as presented, the improvement could be within run-to-run noise. Please either provide statistical significance evidence or temper the claim accordingly.
minor comments (5)
  1. [Sec. 4.3] The word 'Geomtric' in the subsection heading is a typo and should read 'Geometric'.
  2. [Abstract / Sec. 1] The term 'pioneer' for the render-enhanced auto-encoder is stronger than the evidence supports, since prior works have used render-based or patch-based GAN losses for 3D auto-encoders; please rephrase to avoid overclaiming novelty.
  3. [Sec. 3.3 / runtime claims] The paper states that MeshGen runs within 30 seconds but does not provide a hardware specification or per-stage timing breakdown; please add this information for reproducibility.
  4. [Eq. (5)] Equation (5) uses the symbol I_MV both for the input shaded multi-view images and for the denoised component output; please use distinct symbols to avoid ambiguity.
  5. [Supplementary Tab. 5 vs main Tab. 1] The supplementary ablation reports an F-score of 0.970 for the full model while Tab. 1 reports 0.971±0.014; please clarify whether these numbers are computed on the same evaluation set and with the same evaluation protocol.

Circularity Check

0 steps flagged · score 1.0 of 10

No load-bearing circularity; the geometric-covariance premise is a correctness risk, not a circular reduction.

full rationale

MeshGen's derivation chain is self-contained and externally benchmarked. The auto-encoder (Sec. 3.1) is optimized on Objaverse with BCE/KL/TV losses and render-based normal losses (Eqs. 3-4), with the render loss ablated on a held-out Objaverse validation set (Tab. 6). The image-to-shape diffusion model (Sec. 3.2) is trained on GObjaverse with geometric alignment and generative rendering augmentation, and both augmentations are ablated (Tab. 5, Fig. 6). The texture pipeline (Sec. 3.3, App. A.3) is trained on Blender-rendered PBR data and its PBR decomposer is compared against an expert-branch alternative (Fig. 16). Quantitative claims (Tab. 1, Tab. 2, Tab. 7) are evaluated on GSO and OmniObject3D, external datasets not used to fit any component, and against external baselines in a user study. Author self-citations (e.g., Chen et al. V3D for elevation conditioning, and the authors' prior Gaussian/triplane works) are contextual and not load-bearing: the paper states it 'experimentally found' its conditioning choice rather than importing a conclusion from its own citations. The most salient risk is the asserted 'geometrical covariant property' used to justify geometric alignment augmentation: the paper provides no direct test that rotating the input point cloud yields the correctly rotated latent, and a triplane encoder is not rotation-covariant by construction. That is a correctness and generalization concern, not circularity, because the augmentation's benefit is measured in ablations and the headline claims are checked against external benchmarks rather than being equivalent to the assumption by definition. No fitted parameter is renamed as a prediction, no self-citation chain forces the design, and the paper's own stated limitations (Appendix C: high-frequency texture details, complex lighting, transparent objects) are honest failure modes rather than evidence of circular reasoning.

Assumptions & free parameters 11 free parameters · 4 assumptions · 0 invented entities

The central claims rest mainly on domain assumptions and hand-tuned hyperparameters rather than on mathematical axioms. The two assumptions most worth testing are encoder geometric covariance under rotation and the validity of synthesized renderings as training data; both are asserted and empirically motivated but not independently verified. No parameter is fitted to the GSO/OmniObject3D benchmarks themselves, so the benchmark comparison is not circular. No new entities are invented.

free parameters (11)
  • lambda_KL (KL loss weight) = 1e-6
    Hand-chosen in Tab. 4; balances latent-space regularity in the auto-encoder loss.
  • lambda_TV (total variation loss weight) = 5e-3
    Hand-chosen in Tab. 4; suppresses floaters in the coarse stage.
  • lambda_MSE and lambda_LPIPS (normal render loss weights) = 1.0 and 2.0
    Hand-chosen in Tab. 4; balance pixel and perceptual normal supervision in the refine stage.
  • lambda_reg (ray-based regularization weight) = 0.5
    Hand-chosen in Tab. 4; forces empty-space occupancy toward zero to prevent floaters.
  • Nz (number of learnable queries) = 3072
    Latent capacity hyperparameter from Tab. 4.
  • Ns (ray samples per camera ray) = 128
    Sampling hyperparameter from Tab. 4.
  • encoder input point count = 65536
    Chosen because reconstruction quality saturates near this count (Fig. 9).
  • UV back-projection softmax temperature = 0.1
    Hand-chosen in appendix A.3 to sharpen multi-view fusion weights.
  • watertight-conversion isosurface threshold = 2/512
    Preprocessing choice in appendix A.1; affects the fidelity of training meshes.
  • training data filter (Objaverse 150k, GObjaverse 120k) = criteria unspecified
    The 'filtered subset' and 'high-quality' selection criteria are not described; this choice underpins the generalization and SOTA claims.
  • augmented-image quality filter (CLIP plus MLP evaluator) = trained on 500 samples, 91% validation accuracy
    Ad hoc filter for generated training images in appendix A.2; the operating threshold is not reported.
assumptions (4)
  • domain assumption The point-to-shape auto-encoder is geometrically covariant for azimuth rotations, even though no rotation augmentation for the encoder is reported.
    Geometric alignment augmentation in Sec. 3.2 rotates sampled point clouds to match the conditioning view; if the encoder's latents for rotated inputs are out-of-distribution, the diffusion model learns a corrupted image-shape mapping. This is the load-bearing assumption behind the paper's main augmentation, and it is asserted rather than directly tested.
  • domain assumption Render-based perceptual loss backpropagated through differentiable marching cubes, combined with ray-based regularization, improves high-frequency fidelity without introducing floaters.
    Core claim of Sec. 3.1. Supported only by internal ablations (Tab. 3, Fig. 8) and not by an external benchmark or formal argument; the coarse-to-fine schedule is an empirical fix, not a derived result.
  • domain assumption Images synthesized by ControlNet and IC-light from training geometry are valid training data that preserve shape information while adding realistic lighting and texture.
    Generative rendering augmentation (Sec. 3.2, appendix A.2) assumes these synthetic renderings bridge the domain gap to real photos; a biased synthesizer would teach the diffusion model incorrect image-to-shape associations. Only qualitative real-world examples are offered as evidence.
  • standard math Standard diffusion and rectified-flow training assumptions from SD3, and DINOv2 feature conditioning, hold as in the cited prior work.
    Adopted unchanged from prior literature (Sec. 3.2, appendix A.2); not a point of contention.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MeshGen: Generating PBR Textured Mesh with Render-Enhanced Auto-Encoder and Generative Data Augmentation." pith.science (2026). https://pith.science/paper/EBTDNMGB

@misc{pith2026250504656,
  author       = {Pith},
  title        = {Pith review of: MeshGen: Generating PBR Textured Mesh with Render-Enhanced Auto-Encoder and Generative Data Augmentation},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/EBTDNMGB}},
  note         = {Machine review of arXiv:2505.04656}
}
read the original abstract

In this paper, we introduce MeshGen, an advanced image-to-3D pipeline that generates high-quality 3D meshes with detailed geometry and physically based rendering (PBR) textures. Addressing the challenges faced by existing 3D native diffusion models, such as suboptimal auto-encoder performance, limited controllability, poor generalization, and inconsistent image-based PBR texturing, MeshGen employs several key innovations to overcome these limitations. We pioneer a render-enhanced point-to-shape auto-encoder that compresses meshes into a compact latent space by designing perceptual optimization with ray-based regularization. This ensures that the 3D shapes are accurately represented and reconstructed to preserve geometric details within the latent space. To address data scarcity and image-shape misalignment, we further propose geometric augmentation and generative rendering augmentation techniques, which enhance the model's controllability and generalization ability, allowing it to perform well even with limited public datasets. For the texture generation, MeshGen employs a reference attention-based multi-view ControlNet for consistent appearance synthesis. This is further complemented by our multi-view PBR decomposer that estimates PBR components and a UV inpainter that fills invisible areas, ensuring a seamless and consistent texture across the 3D mesh. Our extensive experiments demonstrate that MeshGen largely outperforms previous methods in both shape and texture generation, setting a new standard for the quality of 3D meshes generated with PBR textures. See our code at https://github.com/heheyas/MeshGen, project page https://heheyas.github.io/MeshGen

Figures

Figures reproduced from arXiv: 2505.04656 by the authors.

Figure 1
Figure 1. Overview of MeshGen. We first train a render-enhanced auto-encoder to compress meshes to more compact latent space (Sec [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Illustration of the proposed ray-based regularization and two data augmentations. [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. The effectiveness of the proposed reference attention [PITH_FULL_IMAGE:figures/full_fig_p005_3.png] view at source ↗
Figures from the paper (14 more)
Figure 4
Figure 4. Figure 4: Qualitative comparison on in-the-wild images with state-of-the-art large reconstruction models (upper part, including In [PITH_FULL_IMAGE:figures/full_fig_p006_4.png]
Figure 5
Figure 5. Figure 5: Qualitative comparison with previous mesh texturing methods, including EASI-Tex [ [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]
Figure 6
Figure 6. Figure 6: Ablation study results on render-enhanced auto-encoder, geometric alignment, and generative rendering augmentation. [PITH_FULL_IMAGE:figures/full_fig_p008_6.png]
Figure 7
Figure 7. Figure 7: An illustration of reference attention. age with more fine-grained information. This technique is also used in image editing [92] and video generation [25]. Data preparation. To train the geometry-conditioned ControlNet and the multi-view PBR decomposer, we ren￾der mul…
Figure 8
Figure 8. Figure 8: Ablations on ray-based regularization, depth filtering, and UV space inpainting. [PITH_FULL_IMAGE:figures/full_fig_p018_8.png]
Figure 9
Figure 9. Figure 9: Ablations on the number of points used in mesh auto [PITH_FULL_IMAGE:figures/full_fig_p018_9.png]
Figure 10
Figure 10. Figure 10: Qualitative comparison on textured meshes with state-of-the-art large reconstruction models, including InstantMesh [ [PITH_FULL_IMAGE:figures/full_fig_p020_10.png]
Figure 11
Figure 11. Figure 11: Comparison with non-open-source commercial products, including Direct3D and Hyperhuman Rodin. [PITH_FULL_IMAGE:figures/full_fig_p021_11.png]
Figure 12
Figure 12. Figure 12: Performance of MeshGen on real-world captures. [PITH_FULL_IMAGE:figures/full_fig_p021_12.png]
Figure 13
Figure 13. Figure 13: Some typical failure cases of MeshGen. 7 [PITH_FULL_IMAGE:figures/full_fig_p021_13.png]
Figure 14
Figure 14. Figure 14: More comparisons with large reconstruction models, including InstantMesh [ [PITH_FULL_IMAGE:figures/full_fig_p022_14.png]
Figure 15
Figure 15. Figure 15: More comparisons with 3D native generation models, including, CraftsMan [ [PITH_FULL_IMAGE:figures/full_fig_p023_15.png]
Figure 16
Figure 16. Figure 16: Comparison of PBR decomposer and expert branch on PBR component generation. [PITH_FULL_IMAGE:figures/full_fig_p024_16.png]
Figure 17
Figure 17. Figure 17: Intrinsic channels estimated using our multi-view PBR decomposer. The proposed PBR decomposer can handle images with [PITH_FULL_IMAGE:figures/full_fig_p025_17.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Twisted Fiber Bundle Codes over Group Algebras

    quant-ph 2026-04 unverdicted novelty 6.0 of 10

    Singular chain-compatible fiber twists over group algebras can increase CSS encoded dimension k at fixed blocklength n while examples keep distance d unchanged.

  2. Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attention

    cs.CV 2025-07 conditional novelty 6.0 of 10

    Ultra3D speeds up sparse-voxel 3D generation by generating a coarse mesh with compact VecSet latents, then refining voxel features with part-localized attention.

Reference graph

Works this paper leans on

106 extracted references · 26 canonical work pages · cited by 2 Pith papers

  1. [1]

    Re- imagine the negative prompt algorithm: Transform 2d diffusion into 3d, alleviate janus problem and beyond

    Mohammadreza Armandpour, Huangjie Zheng, Ali Sadeghian, Amir Sadeghian, and Mingyuan Zhou. Re- imagine the negative prompt algorithm: Transform 2d diffusion into 3d, alleviate janus problem and beyond. arXiv preprint arXiv:2304.04968, 2023. 1

    arXiv 2023

  2. [2]

    Meta 3d texturegen: Fast and consistent texture gen- eration for 3d objects

    Raphael Bensadoun, Yanir Kleiman, Idan Azuri, Omri Harosh, Andrea Vedaldi, Natalia Neverova, and Oran Gafni. Meta 3d texturegen: Fast and consistent texture gen- eration for 3d objects. arXiv preprint arXiv: 2407.02430 ,

    arXiv

  3. [3]

    Sf3d: Stable fast 3d mesh reconstruction with uv-unwrapping and illumination disentanglement

    Mark Boss, Zixuan Huang, Aaryaman Vasishta, and Varun Jampani. Sf3d: Stable fast 3d mesh reconstruction with uv-unwrapping and illumination disentanglement. arXiv preprint, 2024. 2

    2024

  4. [4]

    Tim Brooks, Aleksander Holynski, and Alexei A. Efros. Instructpix2pix: Learning to follow image editing instruc- tions. In CVPR, 2023. 5

    2023

  5. [5]

    Texfusion: Synthesizing 3d textures with text-guided image diffusion models

    Tianshi Cao, Karsten Kreis, Sanja Fidler, Nicholas Sharp, and Kangxue Yin. Texfusion: Synthesizing 3d textures with text-guided image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 4169–4181, 2023. 2

    2023

  6. [6]

    Lin, Matthew Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas J

    Eric Chan, Connor Z. Lin, Matthew Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas J. Guibas, Jonathan Tremblay, S. Khamis, Tero Karras, and Gordon Wetzstein. Efficient geometry-aware 3d genera- tive adversarial networks. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pages 16102–16112, 2021. 1

    2022

  7. [7]

    Text2tex: Text- driven texture synthesis via diffusion models

    Dave Zhenyu Chen, Yawar Siddiqui, Hsin-Ying Lee, Sergey Tulyakov, and Matthias Nießner. Text2tex: Text- driven texture synthesis via diffusion models. In Proceed- ings of the IEEE/CVF International Conference on Com- puter Vision (ICCV), pages 18558–18568, 2023. 2

    2023

  8. [8]

    Fan- tasia3d: Disentangling geometry and appearance for high- quality text-to-3d content creation

    Rui Chen, Yongwei Chen, Ningxin Jiao, and Kui Jia. Fan- tasia3d: Disentangling geometry and appearance for high- quality text-to-3d content creation. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2023. 2

    2023

Show all 106 references
  1. [9]

    Gaussianeditor: Swift and controllable 3d editing with gaussian splatting

    Yiwen Chen, Zilong Chen, Chi Zhang, Feng Wang, Xi- aofeng Yang, Yikai Wang, Zhongang Cai, Lei Yang, Huap- ing Liu, and Guosheng Lin. Gaussianeditor: Swift and controllable 3d editing with gaussian splatting. CoRR, abs/2311.14521, 2023. 2

    2023 arXiv

  2. [10]

    Auv-net: Learning aligned uv maps for texture transfer and synthesis

    Zhiqin Chen, Kangxue Yin, and Sanja Fidler. Auv-net: Learning aligned uv maps for texture transfer and synthesis. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1465–1474, 2022. 2

    2022

  3. [11]

    3dtopia-xl: High-quality 3d pbr asset generation via primitive diffusion

    Zhaoxi Chen, Jiaxiang Tang, Yuhao Dong, Ziang Cao, Fangzhou Hong, Yushi Lan, Tengfei Wang, Haozhe Xie, Tong Wu, Shunsuke Saito, Liang Pan, Dahua Lin, and Zi- wei Liu. 3dtopia-xl: High-quality 3d pbr asset generation via primitive diffusion. arXiv preprint arXiv:2409.12957,

    arXiv

  4. [12]

    Text-to-3d using gaussian splatting

    Zilong Chen, Feng Wang, Yikai Wang, and Huaping Liu. Text-to-3d using gaussian splatting. In CVPR, 2024. 1, 2

    2024

  5. [13]

    V3d: Video diffusion models are effective 3d generators

    Zilong Chen, Yikai Wang, Feng Wang, Zhengyi Wang, and Huaping Liu. V3d: Video diffusion models are effective 3d generators. arXiv preprint arXiv:2403.06738, 2024. 1, 2

    2024 arXiv

  6. [14]

    Tuvf: Learning generalizable texture uv radiance fields

    An-Chieh Cheng, Xueting Li, Sifei Liu, and Xiaolong Wang. Tuvf: Learning generalizable texture uv radiance fields. arXiv preprint arXiv:2305.03040, 2023. 2

    2023 arXiv

  7. [15]

    Abo: Dataset and benchmarks for real-world 3d ob- ject understanding

    Jasmine Collins, Shubham Goel, Kenan Deng, Achlesh- war Luthra, Leon Xu, Erhan Gundogdu, Xi Zhang, Tomas F Yago Vicente, Thomas Dideriksen, Himanshu Arora, et al. Abo: Dataset and benchmarks for real-world 3d ob- ject understanding. In Proceedings of the IEEE/CVF Con- ference ...

    2022

  8. [16]

    Obja- verse: A universe of annotated 3d objects

    Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, and Ali Farhadi. Obja- verse: A universe of annotated 3d objects. arXiv preprint arXiv:2212.08051, 2022. 4, 1

    2022 arXiv

  9. [17]

    Objaverse: A universe of annotated 3d objects

    Matt Deitke, Dustin Schwenk, Jordi Salvador, Luca Weihs, Oscar Michel, Eli VanderBilt, Ludwig Schmidt, Kiana Ehsani, Aniruddha Kembhavi, and Ali Farhadi. Objaverse: A universe of annotated 3d objects. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Rec...

    2023

  10. [18]

    Flashtex: Fast relightable mesh texturing with lightcontrolnet

    Kangle Deng, Timothy Omernick, Alexander Weiss, Deva Ramanan, Jun-Yan Zhu, Tinghui Zhou, and Maneesh Agrawala. Flashtex: Fast relightable mesh texturing with lightcontrolnet. arXiv preprint arXiv: 2402.13251, 2024. 2

    2024 arXiv

  11. [19]

    Google scanned objects: A high-quality dataset of 3d scanned household items

    Laura Downs, Anthony Francis, Nate Koenig, Bran- don Kinman, Ryan Michael Hickman, Krista Reymann, Thomas Barlow McHugh, and Vincent Vanhoucke. Google scanned objects: A high-quality dataset of 3d scanned household items. 2022 International Conference on Robotics and Automatio...

    2022

  12. [20]

    Mesh to sdf implemented with cuda

    eliphatfs. Mesh to sdf implemented with cuda. https: //github.com/eliphatfs/cumesh2sdf, 2023. 1

    2023

  13. [21]

    Scaling rectified flow transformers for high-resolution image synthesis

    Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas M ¨uller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, Dustin Podell, Tim Dockhorn, Zion English, Kyle Lacey, Alex Goodwin, Yan- nik Marek, and Robin Rombach. Scaling rectified flow tr...

    2024 arXiv

  14. [22]

    3dgen: Triplane latent diffusion for textured mesh generation

    Anchit Gupta, Wenhan Xiong, Yixin Nie, Ian Jones, and Barlas O ˘guz. 3dgen: Triplane latent diffusion for textured mesh generation. arXiv preprint arXiv:2303.05371, 2023. 1, 2

    2023 arXiv

  15. [23]

    3dtopia: Large text-to-3d genera- tion model with hybrid diffusion priors

    Fangzhou Hong, Jiaxiang Tang, Ziang Cao, Min Shi, Tong Wu, Zhaoxi Chen, Tengfei Wang, Liang Pan, Dahua Lin, and Ziwei Liu. 3dtopia: Large text-to-3d genera- tion model with hybrid diffusion priors. arXiv preprint arXiv:2403.02234, 2024. 1, 2, 4

    2024 arXiv

  16. [24]

    LRM: large reconstruction model for single image to 3d

    Yicong Hong, Kai Zhang, Jiuxiang Gu, Sai Bi, Yang Zhou, Difan Liu, Feng Liu, Kalyan Sunkavalli, Trung Bui, and Hao Tan. LRM: large reconstruction model for single image to 3d. CoRR, abs/2311.04400, 2023. 1, 2, 6 10

    2023 arXiv

  17. [25]

    Animate anyone: Consistent and controllable image-to-video synthesis for character animation

    Li Hu, Xin Gao, Peng Zhang, Ke Sun, Bang Zhang, and Liefeng Bo. Animate anyone: Consistent and controllable image-to-video synthesis for character animation. arXiv preprint arXiv:2311.17117, 2023. 2

    2023 arXiv

  18. [26]

    Barron, Pieter Abbeel, and Ben Poole

    Ajay Jain, Ben Mildenhall, Jonathan T. Barron, Pieter Abbeel, and Ben Poole. Zero-shot text-guided object gener- ation with dream fields. In IEEE/CVF Conference on Com- puter Vision and Pattern Recognition, CVPR 2022, New Or- leans, LA, USA, June 18-24, 2022 , pages 857–866. IEEE,

    2022

  19. [27]

    Flexitex: Enhancing tex- ture generation with visual guidance

    DaDong Jiang, Xianghui Yang, Zibo Zhao, Sheng Zhang, Jiaao Yu, Zeqiang Lai, Shaoxiong Yang, Chunchao Guo, Xiaobo Zhou, and Zhihui Ke. Flexitex: Enhancing tex- ture generation with visual guidance. arXiv preprint arXiv: 2409.12431, 2024. 2

    2024 arXiv

  20. [28]

    Shap-e: Generat- ing conditional 3d implicit functions

    Heewoo Jun and Alex Nichol. Shap-e: Generat- ing conditional 3d implicit functions. arXiv preprint arXiv:2305.02463, 2023. 2

    2023 arXiv

  21. [29]

    Ln3diff: Scalable latent neural fields diffusion for speedy 3d generation

    Yushi Lan, Fangzhou Hong, Shuai Yang, Shangchen Zhou, Xuyi Meng, Bo Dai, Xingang Pan, and Chen Change Loy. Ln3diff: Scalable latent neural fields diffusion for speedy 3d generation. In ECCV, 2024. 6, 7

    2024

  22. [31]

    Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model

    Jiahao Li, Hao Tan, Kai Zhang, Zexiang Xu, Fujun Luan, Yinghao Xu, Yicong Hong, Kalyan Sunkavalli, Greg Shakhnarovich, and Sai Bi. Instant3d: Fast text-to-3d with sparse-view generation and large reconstruction model. CoRR, abs/2311.06214, 2023. 2, 6

    2023 arXiv

  23. [32]

    Era3d: High-resolution multiview diffusion using efficient row-wise attention

    Peng Li, Yuan Liu, Xiaoxiao Long, Feihu Zhang, Cheng Lin, Mengfei Li, Xingqun Qi, Shanghang Zhang, Wenhan Luo, Ping Tan, et al. Era3d: High-resolution multiview diffusion using efficient row-wise attention. arXiv preprint arXiv:2405.11616, 2024. 2

    2024 arXiv

  24. [33]

    Sweet- dreamer: Aligning geometric priors in 2d diffusion for con- sistent text-to-3d

    Weiyu Li, Rui Chen, Xuelin Chen, and Ping Tan. Sweet- dreamer: Aligning geometric priors in 2d diffusion for con- sistent text-to-3d. arxiv:2310.02596, 2023. 2

    2023 arXiv

  25. [34]

    Craftsman: High-fidelity mesh generation with 3d native generation and interactive geometry refiner

    Weiyu Li, Jiarui Liu, Rui Chen, Yixun Liang, Xuelin Chen, Ping Tan, and Xiaoxiao Long. Craftsman: High-fidelity mesh generation with 3d native generation and interactive geometry refiner. arXiv preprint arXiv:2405.14979, 2024. 1, 2, 3, 6, 7, 9

    2024 arXiv

  26. [35]

    3d compat: Composition of materials on parts of 3d things

    Yuchen Li, Ujjwal Upadhyay, Habib Slim, Ahmed Abdelre- heem, Arpit Prajapati, Suhail Pothigara, Peter Wonka, and Mohamed Elhoseiny. 3d compat: Composition of materials on parts of 3d things. InEuropean Conference on Computer Vision, pages 110–127. Springer, 2022. 2

    2022

  27. [36]

    Magic3d: High- resolution text-to-3d content creation

    Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, and Tsung-Yi Lin. Magic3d: High- resolution text-to-3d content creation. In IEEE Confer- ence on Computer Vision and Pattern Recognition (CVPR),

  28. [37]

    One-2-3-45++: Fast single image to 3d objects with consistent multi-view generation and 3d diffusion

    Minghua Liu, Ruoxi Shi, Linghao Chen, Zhuoyang Zhang, Chao Xu, Xinyue Wei, Hansheng Chen, Chong Zeng, Ji- ayuan Gu, and Hao Su. One-2-3-45++: Fast single image to 3d objects with consistent multi-view generation and 3d diffusion. arXiv preprint arXiv:2311.07885, 2023. 2, 6, 7

    2023 arXiv

  29. [38]

    One-2-3-45: Any single image to 3d mesh in 45 seconds without per-shape optimization

    Minghua Liu, Chao Xu, Haian Jin, Linghao Chen, Zexiang Xu, Hao Su, et al. One-2-3-45: Any single image to 3d mesh in 45 seconds without per-shape optimization. arXiv preprint arXiv:2306.16928, 2023. 2

    2023 arXiv

  30. [39]

    Meshformer: High-quality mesh generation with 3d-guided reconstruction model

    Minghua Liu, Chong Zeng, Xinyue Wei, Ruoxi Shi, Ling- hao Chen, Chao Xu, Mengqi Zhang, Zhaoning Wang, Xi- aoshuai Zhang, Isabella Liu, Hongzhi Wu, and Hao Su. Meshformer: High-quality mesh generation with 3d-guided reconstruction model. arXiv preprint arXiv:2408.10198 ,

    arXiv

  31. [40]

    Flow straight and fast: Learning to generate and transfer data with rectified flow.arXiv preprint arXiv:2209.03003, 2022

    Xingchao Liu, Chengyue Gong, and Qiang Liu. Flow straight and fast: Learning to generate and transfer data with rectified flow.arXiv preprint arXiv:2209.03003, 2022. 5, 1

    2022 arXiv

  32. [41]

    Hyperhuman: Hyper-realistic hu- man generation with latent structural diffusion

    Xian Liu, Jian Ren, Aliaksandr Siarohin, Ivan Sko- rokhodov, Yanyu Li, Dahua Lin, Xihui Liu, Ziwei Liu, and Sergey Tulyakov. Hyperhuman: Hyper-realistic hu- man generation with latent structural diffusion. In The Twelfth International Conference on Learning Representa- tions, ...

    2024

  33. [42]

    Syncdreamer: Generating multiview-consistent images from a single-view image

    Yuan Liu, Cheng Lin, Zijiao Zeng, Xiaoxiao Long, Lingjie Liu, Taku Komura, and Wenping Wang. Syncdreamer: Generating multiview-consistent images from a single-view image. arXiv preprint arXiv:2309.03453, 2023. 1, 2

    2023 arXiv

  34. [43]

    Unidream: Unifying diffusion priors for relightable text-to-3d generation, 2023

    Zexiang Liu, Yangguang Li, Youtian Lin, Xin Yu, Sida Peng, Yan-Pei Cao, Xiaojuan Qi, Xiaoshui Huang, Ding Liang, and Wanli Ouyang. Unidream: Unifying diffusion priors for relightable text-to-3d generation, 2023. 2

    2023

  35. [44]

    Wonder3d: Single image to 3d using cross-domain diffusion

    Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, et al. Wonder3d: Single image to 3d using cross-domain diffusion. arXiv preprint arXiv:2310.15008, 2023. 1, 2

    arXiv

  36. [45]

    Direct2.5: Diverse text-to-3d generation via multi- view 2.5d diffusion

    Yuanxun Lu, Jingyang Zhang, Shiwei Li, Tian Fang, David McKinnon, Yanghai Tsin, Long Quan, Xun Cao, and Yao Yao. Direct2.5: Diverse text-to-3d generation via multi- view 2.5d diffusion. ArXiv, abs/2311.15980, 2023. 2

    2023 arXiv

  37. [46]

    Scalable 3d captioning with pretrained models

    Tiange Luo, Chris Rockwell, Honglak Lee, and Justin John- son. Scalable 3d captioning with pretrained models. arXiv preprint arXiv:2306.07279, 2023. 2

    2023 arXiv

  38. [47]

    Point-e: A system for generat- ing 3d point clouds from complex prompts

    Alex Nichol, Heewoo Jun, Prafulla Dhariwal, Pamela Mishkin, and Mark Chen. Point-e: A system for generat- ing 3d point clouds from complex prompts. arXiv preprint arXiv:2212.08751, 2022. 2

    2022 arXiv

  39. [48]

    Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V . V o, Marc Szafraniec, Vasil Khalidov, Pierre Fer- nandez, Daniel HAZIZA, Francisco Massa, Alaaeldin El- Nouby, Mido Assran, Nicolas Ballas, Wojciech Galuba, Russell Howes, Po-Yao Huang, Shang-Wen Li, Ishan Misra, Mich...

    2024

  40. [49]

    Easi-tex: Edge-aware mesh texturing from single image

    Sai Raj Kishore Perla, Yizhi Wang, Ali Mahdavi-Amiri, and Hao Zhang. Easi-tex: Edge-aware mesh texturing from single image. ACM Transactions on Graphics (Proceedings of SIGGRAPH), 43(4), 2024. 7

    2024

  41. [50]

    Barron, and Ben Milden- hall

    Ben Poole, Ajay Jain, Jonathan T. Barron, and Ben Milden- hall. Dreamfusion: Text-to-3d using 2d diffusion. In The Eleventh International Conference on Learning Represen- tations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. Open- Review.net, 2023. 1, 2

    2023

  42. [51]

    Richdreamer: A gen- eralizable normal-depth diffusion model for detail richness in text-to-3d

    Lingteng Qiu, Guanying Chen, Xiaodong Gu, Qi Zuo, Mutian Xu, Yushuang Wu, Weihao Yuan, Zilong Dong, Liefeng Bo, and Xiaoguang Han. Richdreamer: A gen- eralizable normal-depth diffusion model for detail richness in text-to-3d. In Proceedings of the IEEE/CVF Conference on Comput...

    2024

  43. [52]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, and Ilya Sutskever. Learning transferable visual models from natural language supervision. In Proceedings of th...

    2021

  44. [53]

    On the spectral bias of neural networks

    Nasim Rahaman, Aristide Baratin, Devansh Arpit, Felix Draxler, Min Lin, Fred Hamprecht, Yoshua Bengio, and Aaron Courville. On the spectral bias of neural networks. In International conference on machine learning, pages 5301–

  45. [54]

    Xcube: Large-scale 3d generative modeling using sparse voxel hierarchies

    Xuanchi Ren, Jiahui Huang, Xiaohui Zeng, Ken Museth, Sanja Fidler, and Francis Williams. Xcube: Large-scale 3d generative modeling using sparse voxel hierarchies. InPro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024. 2

    2024

  46. [55]

    Texture: Text-guided texturing of 3d shapes

    Elad Richardson, Gal Metzer, Yuval Alaluf, Raja Giryes, and Daniel Cohen-Or. Texture: Text-guided texturing of 3d shapes. In ACM SIGGRAPH 2023 Conference Proceed- ings, SIGGRAPH 2023, Los Angeles, CA, USA, August 6- 10, 2023, pages 54:1–54:11. ACM, 2023. 2

    2023

  47. [56]

    High-resolution im- age synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution im- age synthesis with latent diffusion models. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022 , pages 1067...

    2022

  48. [57]

    Clip-forge: To- wards zero-shot text-to-shape generation

    Aditya Sanghi, Hang Chu, Joseph G Lambourne, Ye Wang, Chin-Yi Cheng, and Marco Fumero. Clip-forge: To- wards zero-shot text-to-shape generation. arXiv preprint arXiv:2110.02624, 2021. 2

    2021 arXiv

  49. [58]

    Wavelet latent dif- fusion (wala): Billion-parameter 3d generative model with compact wavelet encodings, 2024

    Aditya Sanghi, Aliasghar Khani, Pradyumna Reddy, Ari- anna Rampini, Derek Cheung, Kamal Rahimi Malekshan, Kanika Madan, and Hooman Shayani. Wavelet latent dif- fusion (wala): Billion-parameter 3d generative model with compact wavelet encodings, 2024. 3, 9

    2024

  50. [59]

    Let 2d diffusion model know 3d- consistency for robust text-to-3d generation

    Junyoung Seo, Wooseok Jang, Min-Seop Kwak, Jaehoon Ko, Hyeonsu Kim, Junho Kim, Jin-Hwa Kim, Jiyoung Lee, and Seungryong Kim. Let 2d diffusion model know 3d- consistency for robust text-to-3d generation. arXiv preprint arXiv:2303.07937, 2023. 1

    2023 arXiv

  51. [60]

    Flexible isosur- face extraction for gradient-based mesh optimization

    Tianchang Shen, Jacob Munkberg, Jon Hasselgren, Kangxue Yin, Zian Wang, Wenzheng Chen, Zan Gojcic, Sanja Fidler, Nicholas Sharp, and Jun Gao. Flexible isosur- face extraction for gradient-based mesh optimization. ACM Trans. Graph., 42(4), 2023. 2

    2023

  52. [61]

    Zero123++: a single image to consistent multi- view diffusion base model, 2023

    Ruoxi Shi, Hansheng Chen, Zhuoyang Zhang, Minghua Liu, Chao Xu, Xinyue Wei, Linghao Chen, Chong Zeng, and Hao Su. Zero123++: a single image to consistent multi- view diffusion base model, 2023. 2

    2023

  53. [62]

    Mvdream: Multi-view diffusion for 3d generation

    Yichun Shi, Peng Wang, Jianglong Ye, Long Mai, Kejie Li, and Xiao Yang. Mvdream: Multi-view diffusion for 3d generation. arXiv:2308.16512, 2023. 2

    2023 arXiv

  54. [63]

    Texturify: Generating textures on 3d shape surfaces

    Yawar Siddiqui, Justus Thies, Fangchang Ma, Qi Shan, Matthias Nießner, and Angela Dai. Texturify: Generating textures on 3d shape surfaces. In European Conference on Computer Vision, pages 72–88. Springer, 2022. 2

    2022

  55. [64]

    Dreamcraft3d: Hierarchi- cal 3d generation with bootstrapped diffusion prior

    Jingxiang Sun, Bo Zhang, Ruizhi Shao, Lizhen Wang, Wen Liu, Zhenda Xie, and Yebin Liu. Dreamcraft3d: Hierarchi- cal 3d generation with bootstrapped diffusion prior. arXiv preprint arXiv:2310.16818, 2023. 2

    2023 arXiv

  56. [65]

    Freeplane: Unlock- ing free lunch in triplane-based sparse-view reconstruction models

    Wenqiang Sun, Zhengyi Wang, Shuo Chen, Yikai Wang, Zilong Chen, Jun Zhu, and Jun Zhang. Freeplane: Unlock- ing free lunch in triplane-based sparse-view reconstruction models. arXiv preprint arXiv:2406.00750, 2024. 1

    2024 arXiv

  57. [66]

    Splatter image: Ultra-fast single-view 3d recon- struction

    Stanislaw Szymanowicz, Christian Rupprecht, and Andrea Vedaldi. Splatter image: Ultra-fast single-view 3d recon- struction. In arXiv, 2023. 2

    2023

  58. [67]

    Dreamgaussian: Generative gaussian splat- ting for efficient 3d content creation

    Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, and Gang Zeng. Dreamgaussian: Generative gaussian splat- ting for efficient 3d content creation. arXiv preprint arXiv:2309.16653, 2023. 1, 2

    2023 arXiv

  59. [68]

    Lgm: Large multi- view gaussian model for high-resolution 3d content cre- ation

    Jiaxiang Tang, Zhaoxi Chen, Xiaokang Chen, Tengfei Wang, Gang Zeng, and Ziwei Liu. Lgm: Large multi- view gaussian model for high-resolution 3d content cre- ation. arXiv preprint arXiv:2402.05054, 2024. 1, 2, 6, 7

    2024 arXiv

  60. [69]

    Mvdiffusion++: A dense high-resolution multi-view diffusion model for sin- gle or sparse-view 3d object reconstruction

    Shitao Tang, Jiacheng Chen, Dilin Wang, Chengzhou Tang, Fuyang Zhang, Yuchen Fan, Vikas Chandra, Yasu- taka Furukawa, and Rakesh Ranjan. Mvdiffusion++: A dense high-resolution multi-view diffusion model for sin- gle or sparse-view 3d object reconstruction. arXiv preprint arXiv...

    2024 arXiv

  61. [70]

    Triposr: Fast 3d object reconstruction from a single image

    Dmitry Tochilkin, David Pankratz, Zexiang Liu, Zixuan Huang, , Adam Letts, Yangguang Li, Ding Liang, Christian Laforte, Varun Jampani, and Yan-Pei Cao. Triposr: Fast 3d object reconstruction from a single image. arXiv preprint arXiv:2403.02151, 2024. 2, 6, 7

    2024 arXiv

  62. [71]

    Sv3d: Novel multi-view synthesis and 3d generation from a single image using la- tent video diffusion

    Vikram V oleti, Chun-Han Yao, Mark Boss, Adam Letts, David Pankratz, Dmitry Tochilkin, Christian Laforte, Robin Rombach, and Varun Jampani. Sv3d: Novel multi-view synthesis and 3d generation from a single image using la- tent video diffusion. arXiv preprint arXiv: 2403.12008 ,

    arXiv

  63. [72]

    Imagedream: Image-prompt multi-view diffusion for 3d generation

    Peng Wang and Yichun Shi. Imagedream: Image-prompt multi-view diffusion for 3d generation. arXiv preprint arXiv:2312.02201, 2023. 2 12

    2023 arXiv

  64. [73]

    Taming mode collapse in score distillation for text-to-3d generation.arXiv preprint: 2401.00909, 2023

    Peihao Wang, Dejia Xu, Zhiwen Fan, Dilin Wang, Sreyas Mohan, Forrest Iandola, Rakesh Ranjan, Yilei Li, Qiang Liu, Zhangyang Wang, and Vikas Chandra. Taming mode collapse in score distillation for text-to-3d generation.arXiv preprint: 2401.00909, 2023. 1

    2023 arXiv

  65. [74]

    RODIN: A generative model for sculpting 3d digital avatars using dif- fusion

    Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jian- min Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, and Baining Guo. RODIN: A generative model for sculpting 3d digital avatars using dif- fusion. In IEEE/CVF Conference on Computer Vision and Patt...

    2023

  66. [75]

    Prolificdreamer: High- fidelity and diverse text-to-3d generation with variational score distillation

    Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongx- uan Li, Hang Su, and Jun Zhu. Prolificdreamer: High- fidelity and diverse text-to-3d generation with variational score distillation. arXiv preprint arXiv:2305.16213, 2023. 1, 2

    2023 arXiv

  67. [76]

    Crm: Single image to 3d textured mesh with convolutional reconstruction model

    Zhengyi Wang, Yikai Wang, Yifei Chen, Chendong Xi- ang, Shuo Chen, Dajiang Yu, Chongxuan Li, Hang Su, and Jun Zhu. Crm: Single image to 3d textured mesh with convolutional reconstruction model. arXiv preprint arXiv:2403.05034, 2024. 2, 6, 7

    2024 arXiv

  68. [77]

    Neumanifold: Neural watertight manifold reconstruction with efficient and high-quality rendering support

    Xinyue Wei, Fanbo Xiang, Sai Bi, Anpei Chen, Kalyan Sunkavalli, Zexiang Xu, and Hao Su. Neumanifold: Neural watertight manifold reconstruction with efficient and high-quality rendering support. arXiv preprint arXiv:2305.17134, 2023. 3

    2023 arXiv

  69. [78]

    Meshlrm: Large reconstruction model for high- quality mesh

    Xinyue Wei, Kai Zhang, Sai Bi, Hao Tan, Fujun Luan, Valentin Deschaintre, Kalyan Sunkavalli, Hao Su, and Zex- iang Xu. Meshlrm: Large reconstruction model for high- quality mesh. arXiv preprint arXiv: 2404.12385 , 2024. 1, 2, 3, 7, 6, 8

    2024 arXiv

  70. [79]

    Unique3d: High-quality and efficient 3d mesh generation from a single image, 2024

    Kailu Wu, Fangfu Liu, Zhihan Cai, Runjie Yan, Hanyang Wang, Yating Hu, Yueqi Duan, and Kaisheng Ma. Unique3d: High-quality and efficient 3d mesh generation from a single image, 2024. 2

    2024

  71. [80]

    Direct3d: Scalable image-to-3d generation via 3d latent diffusion transformer

    Shuang Wu, Youtian Lin, Feihu Zhang, Yifei Zeng, Jingxi Xu, Philip Torr, Xun Cao, and Yao Yao. Direct3d: Scalable image-to-3d generation via 3d latent diffusion transformer. arXiv preprint arXiv: 2405.14832, 2024. 1, 2, 3

    2024 arXiv

  72. [81]

    Omniobject3d: Large- vocabulary 3d object dataset for realistic perception, re- construction and generation

    Tong Wu, Jiarui Zhang, Xiao Fu, Yuxin Wang, Liang Pan Jiawei Ren, Wayne Wu, Lei Yang, Jiaqi Wang, Chen Qian, Dahua Lin, and Ziwei Liu. Omniobject3d: Large- vocabulary 3d object dataset for realistic perception, re- construction and generation. In IEEE/CVF Conference on Compute...

    2023

  73. [82]

    Agg: Amor- tized generative 3d gaussians for single image to 3d

    Dejia Xu, Ye Yuan, Morteza Mardani, Sifei Liu, Jiaming Song, Zhangyang Wang, and Arash Vahdat. Agg: Amor- tized generative 3d gaussians for single image to 3d. arXiv preprint arXiv: 2401.04099, 2024. 2

    2024 arXiv

  74. [83]

    Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models

    Jiale Xu, Weihao Cheng, Yiming Gao, Xintao Wang, Shenghua Gao, and Ying Shan. Instantmesh: Efficient 3d mesh generation from a single image with sparse-view large reconstruction models. arXiv preprint arXiv:2404.07191 ,

    arXiv

  75. [84]

    Dmv3d: Denoising multi- view diffusion using 3d large reconstruction model

    Yinghao Xu, Hao Tan, Fujun Luan, Sai Bi, Peng Wang, Jiahao Li, Zifan Shi, Kalyan Sunkavalli, Gordon Wetzstein, Zexiang Xu, and Kai Zhang. Dmv3d: Denoising multi- view diffusion using 3d large reconstruction model. ArXiv, abs/2311.09217, 2023. 2

    2023 arXiv

  76. [85]

    Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models

    Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models. 2023. 5

    2023

  77. [86]

    Plenoxels: Radiance fields without neural networks

    Alex Yu, Sara Fridovich-Keil, Matthew Tancik, Qinhong Chen, Benjamin Recht, and Angjoo Kanazawa. Plenoxels: Radiance fields without neural networks. arXiv preprint arXiv:2112.05131, 2021. 4

    2021 arXiv

  78. [87]

    Learning texture generators for 3d shape collections from internet photo sets

    Rui Yu, Yue Dong, Pieter Peers, and Xin Tong. Learning texture generators for 3d shape collections from internet photo sets. In British Machine Vision Conference , 2021. 2

    2021

  79. [88]

    Texture generation on 3d meshes with point- uv diffusion

    Xin Yu, Peng Dai, Wenbo Li, Lan Ma, Zhengzhe Liu, and Xiaojuan Qi. Texture generation on 3d meshes with point- uv diffusion. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 4206–4216, 2023. 2

    2023

  80. [89]

    Paint3d: Paint anything 3d with lighting-less texture dif- fusion models, 2023

    Xianfang Zeng, Xin Chen, Zhongqi Qi, Wen Liu, Zibo Zhao, Zhibin Wang, BIN FU, Yong Liu, and Gang Yu. Paint3d: Paint anything 3d with lighting-less texture dif- fusion models, 2023. 2, 7

    2023

  81. [90]

    Rgb¡-¿x: Image decomposition and syn- thesis using material- and lighting-aware diffusion models

    Zheng Zeng, Valentin Deschaintre, Iliyan Georgiev, Yan- nick Hold-Geoffroy, Yiwei Hu, Fujun Luan, Ling-Qi Yan, and Miloˇs Haˇsan. Rgb¡-¿x: Image decomposition and syn- thesis using material- and lighting-aware diffusion models. In ACM SIGGRAPH 2024 Conference Papers, New York,...

    2024

  82. [91]

    3dshape2vecset: A 3d shape representation for neural fields and generative diffusion models

    Biao Zhang, Jiapeng Tang, Matthias Nießner, and Peter Wonka. 3dshape2vecset: A 3d shape representation for neural fields and generative diffusion models. ACM Trans. Graph., 42(4), 2023. 2, 3, 6, 8, 1

    2023

  83. [92]

    Reference-only control

    Lyumin Zhang. Reference-only control. https : / / github . com / Mikubill / sd - webui - controlnet / discussions / 1236, 2023. 5, 2

    2023

  84. [93]

    Adding conditional control to text-to-image diffusion models, 2023

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models, 2023. 4, 5, 2, 3

    2023

  85. [94]

    Ic-light github page, 2024

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Ic-light github page, 2024. 4, 1

    2024

  86. [95]

    Clay: A controllable large-scale generative model for creating high-quality 3d assets

    Longwen Zhang, Ziyu Wang, Qixuan Zhang, Qiwei Qiu, Anqi Pang, Haoran Jiang, Wei Yang, Lan Xu, and Jingyi Yu. Clay: A controllable large-scale generative model for creating high-quality 3d assets. ACM Transactions on Graphics (TOG), 43(4):1–20, 2024. 1, 2, 3, 6

    2024

  87. [96]

    Efros, Eli Shecht- man, and Oliver Wang

    Richard Zhang, Phillip Isola, Alexei A. Efros, Eli Shecht- man, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In 2018 IEEE Confer- ence on Computer Vision and Pattern Recognition, CVPR 2018, Salt Lake City, UT, USA, June 18-22, 2018 ,...

    2018

  88. [97]

    Egsde: Unpaired image-to-image translation via energy-guided stochastic differential equations

    Min Zhao, Fan Bao, Chongxuan Li, and Jun Zhu. Egsde: Unpaired image-to-image translation via energy-guided stochastic differential equations. Advances in Neural In- formation Processing Systems, 35:3609–3623, 2022. 1 13

    2022

  89. [98]

    Identifying and solv- ing conditional image leakage in image-to-video diffusion model

    Min Zhao, Hongzhou Zhu, Chendong Xiang, Kaiwen Zheng, Chongxuan Li, and Jun Zhu. Identifying and solv- ing conditional image leakage in image-to-video diffusion model. arXiv preprint arXiv:2406.15735, 2024

    2024 arXiv

  90. [99]

    Riflex: A free lunch for length extrapolation in video diffusion transformers

    Min Zhao, Guande He, Yixiao Chen, Hongzhou Zhu, Chongxuan Li, and Jun Zhu. Riflex: A free lunch for length extrapolation in video diffusion transformers. arXiv preprint arXiv:2502.15894, 2025. 1

    2025 arXiv

  91. [100]

    Sdf-stylegan: Implicit sdf-based stylegan for 3d shape generation

    Xin-Yang Zheng, Yang Liu, Peng-Shuai Wang, and Xin Tong. Sdf-stylegan: Implicit sdf-based stylegan for 3d shape generation. In Comput. Graph. Forum (SGP), 2022. 3

    2022

  92. [101]

    Triplane meets gaussian splatting: Fast and generalizable single- view 3d reconstruction with transformers

    Zi-Xin Zou, Zhipeng Yu, Yuan-Chen Guo, Yangguang Li, Ding Liang, Yan-Pei Cao, and Song-Hai Zhang. Triplane meets gaussian splatting: Fast and generalizable single- view 3d reconstruction with transformers. arXiv preprint arXiv:2312.09147, 2023. 1

    2023 arXiv

  93. [102]

    Connected components labeling for pytorch

    zsef123. Connected components labeling for pytorch. https : / / github . com / zsef123 / Connected _ components_PyTorch, 2022. 1 14 MeshGen: Generating PBR Textured Mesh with Render-Enhanced Auto-Encoder and Generative Data Augmentation Supplementary Material A. Implementation...

    2022

  94. [104]

    metallic

    The whole training process lasts 6 days on 8 NVIDIA A100 GPUs. A.2. Image-to-shape diffusion model Generative rendering augmentation. In generative ren- dering data augmentation, to enhance the similarity between the generated images and the original image, in addition to usin...

  95. [105]

    Due to the limited resolution of multi-view diffusion generation and the constraints of the auto-encoder used, 4 our texture model struggles to accurately reproduce high-frequency details, such as the text on the box in the left part of Fig. 13. We believe that using more adva...

  96. [106]

    Our texture model finds it challenging to accurately cap- ture textures and lighting effects from input images when dealing with objects with complex high-frequency infor- mation and lighting conditions, as shown by the face in the center of Fig. 13

  97. [107]

    Our geometry and texture generation model currently cannot effectively handle transparent objects, as illus- trated by the object on the right in Fig. 13. Addressing these limitations will be the focus of our future research. 5 MeshLRMMeshFormerOursInstantMeshInput Figure 10. ...

  98. [5123]

    Then, we use the marching cubes algorithm with a threshold of 2/512 to extract the isosurface. To avoid thin surfaces inside and thin surfaces, we mark all parts not con- nected to the outermost region as internal, which can be quickly achieved using a connected component labe...

Pith tools

Reviewed August 15, 2026 · model on record in the stance chip above.