Pith. sign in

REVIEW 3 major objections 6 minor 1 cited by

GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generators

T0 review · 3 major / 6 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A pre-trained 3D generator can be adapted to a new style from a text prompt or a single image, without first generating and filtering a target dataset.

desk verdict A plausible and useful new method for one-shot image-guided 3D GAN adaptation, but the headline pose-accuracy numbers rest on an unvalidated metric and need a stronger evaluation. read the letter →

arxiv 2412.15491 v1 pith:LJUAA743 submitted 2024-12-20 cs.CV

Hengjia Li , Yang Liu , Yibo Zhao , Haoran Cheng , Yang Yang , Linxuan Xia , Zekai Luo , Qibo Qiu
show 4 more authors
Boxi Wu Tu Zheng Zheng Yang Deng Cai
This is my paper · ORCID
classification cs.CV
keywords 3Dgenerativedomainadaptationscoredistillationsamplingone-shotimage-guidedposeconsistencyidentitydepth-awareconditioninghierarchicalspatialEG3D
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper is trying to establish that a pre-trained 3D generator (faces, cats) can be adapted to a target style—Pixar, anime, Super Mario, lion—directly from a text prompt or a single reference image, skipping the expensive generate-and-filter dataset pipeline used by prior 3D adaptation methods. It claims this direct route avoids the pose bias and identity bias that synthetic datasets introduce, and that a non-adversarial fine-tune of about 20,000 iterations (roughly one-tenth of the pipeline baseline's training) is enough. The core move is to make score distillation depth-aware and to add a spatial alignment term that keeps the adapted generator's outputs posed and identified like the source generator's. If this is right, 3D content customization no longer needs large posed datasets or text-only targets, and one reference image is enough to define a new domain.

What carries the argument

The machinery is a pair of losses. The first, DSDS, is the objective $\mathcal{L}_{\mathrm{DSDS}}$ in which the pretrained diffusion denoiser sees the target text or image embedding, a depth map rendered by the source generator, and a foreground mask from the target generator; this transfers the domain while keeping geometry anchored in source depth. The second, HSC, is the contrastive loss $\mathcal{L}_{\mathrm{HSC}}$ that aligns multi-scale patch tokens from MViTv2 between source-branch and target-branch images synthesized from the same latent code. The full objective is $\mathcal{L}_{\mathrm{DSDS}} + \lambda \mathcal{L}_{\mathrm{HSC}}$, and the paper's ablations show each component contributes: depth and mask improve spatial consistency and diversity, while HSC gives the large pose-accuracy jump, with pose error dropping from 3.928 to 0.749 when all components are active.

What would settle it

Render adapted-generator images at known camera poses and feed them through the same pose estimator; if its predictions drift or collapse to frontal on stylized faces while true angles vary, the headline pose-error numbers are measurement artifacts rather than evidence about the method's pose accuracy.

Watch

Extended reading notes

Core claim

The central claim is that GCA-3D delivers generalized and consistent 3D domain adaptation without dataset generation. The paper introduces a multi-modal depth-aware score distillation sampling loss (DSDS) that drives adaptation with a frozen text/image-conditioned diffusion model, using per-instance depth maps from the source generator's volume renderer as ControlNet conditioning to prevent overfitting, plus a foreground mask that focuses adaptation on the object and preserves background. It then adds a hierarchical spatial consistency loss (HSC) that aligns MViTv2 patch tokens of source and target images generated from the same noise in a coarse-to-fine contrastive manner, transferring spatial structure and thereby maintaining pose and identity. The paper reports that with these two losses the adapted EG3D generator outperforms prior text- and image-guided 3D adaptation baselines on pose accuracy, spatial consistency, reference alignment, and diversity, and does so at roughly one-tenth of the training iterations of pipeline methods.

Load-bearing premise

The load-bearing premise is that the face-pose estimator used to score pose accuracy gives valid measurements on heavily stylized target faces; if it fails on Pixar, Super Mario, or anime imagery, the reported pose-error gap could be partly an artifact of the metric rather than a true pose advantage.

Editorial extensions

If this is right

  • GCA-3D eliminates the synthetic-dataset pipeline for 3D domain adaptation, so target domains are defined by a prompt or one image rather than by thousands of generated and filtered samples.
  • One-shot image-guided 3D adaptation becomes feasible: a single reference image can shift the domain, which the paper demonstrates for faces and cats.
  • In the reported metrics, pose accuracy improves sharply: text-guided pose error drops from 4.403 (NADA) and 6.102 (DATID) to 0.768, and image-guided from 7.815 (DATID) to 0.926, while spatial consistency and diversity also increase.
  • The foreground mask plus depth conditioning keeps background content and sample diversity, so the adapted generator does not collapse toward the reference image's accidental attributes such as closed eyes.
  • The HSC coefficient lambda sets a user-controllable trade-off between target-domain alignment and source-domain consistency, letting practitioners tune pose fidelity against style fidelity.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • An obvious stress-test the paper does not run is multi-reference or few-shot image guidance; since IP-Adapter can encode multiple images, extending DSDS to a small set of references is a natural next step and would test whether identity consistency degrades with more conditions.
  • The reported pose numbers should be re-verified with a stylization-robust pose measure or with synthetic known-pose renders; until then, the large advantage over baselines is a claim about the evaluation as much as about the method.
  • If the depth-conditioned SDS recipe transfers, it could shorten the path from a single concept image to game-ready or film-style 3D avatar generators, since studios already own posed 3D generators and need only a style reference.
  • Because HSC aligns patch tokens across source and target images from the same latent, the loss amounts to an implicit 3D-aware regularizer; the same idea could apply to other neural-field generators without redesigning the diffusion guidance.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 6 minor

Summary. The paper proposes GCA-3D, a non-adversarial method for adapting a pre-trained 3D-aware generator (EG3D) to a new domain, supporting both text-guided and one-shot image-guided adaptation without generating a synthetic training dataset. The method combines a multi-modal depth-aware Score Distillation Sampling loss (DSDS), which uses per-instance depth maps from the source generator as ControlNet conditioning and a foreground mask from the target generator, with a Hierarchical Spatial Consistency loss (HSC) that aligns MViTv2 patch tokens between source and target generators sharing the same noise. Experiments on FFHQ and AFHQ show improved pose accuracy, spatial consistency, reference alignment, and diversity relative to adapted baselines, with a user study and ablations supporting the design choices.

Significance. If the reported results are reliable, GCA-3D addresses a genuine limitation of existing 3D domain adaptation methods: the expensive and bias-prone pipeline of generating and filtering synthetic datasets. The extension to one-shot image-guided adaptation is a useful and non-obvious contribution, and the proposed DSDS loss with depth and mask conditioning is a sensible way to mitigate overfitting in SDS-based fine-tuning. The paper also provides ablations showing each component contributes, reports an efficiency gain (1 hour vs. 9 hours for DATID-3D), and states that code will be released. However, the central quantitative claims rest on a pose metric that is not validated on the stylized target domains, and the reported numbers come from single runs without error bars, so the strength of the empirical evidence is currently below the bar for the claims made.

major comments (3)
  1. [Section 4.1, Table 2] The pose accuracy metric is computed with the face reconstruction network of Deng et al. [6], which was trained on photorealistic faces, but the target domains include Pixar, Super Mario, anime, Orc, and Werewolf. The paper provides no calibration of this estimator on such stylized inputs, no alternative pose metric, and no qualitative or quantitative check that the estimated poses are meaningful. Because GCA-3D's HSC loss explicitly enforces spatial alignment with the photorealistic source image, its outputs may be structurally closer to real faces than those of CLIP-guided baselines, so the large reported gaps (e.g., 0.768 vs. 4.403 in the text-guided setting) could partly reflect differential estimator bias rather than true pose accuracy. This is load-bearing for the paper's headline claim, and the authors should validate the pose metric on stylized faces (e.g., by comparing against a different estimator or against known camera poses from rendered 3D shapes) or report pose accuracy with a metric that is robust across domains.
  2. [Section 3.4, Eq. (3), and Section 4.1, SCS metric] The HSC loss optimizes contrastive alignment of MViTv2 patch tokens between source and target images at the same spatial positions, while the evaluation metric 'spatial consistency score (SCS)' is taken from [58], which is itself a measure of spatial structural consistency between source and target images. If SCS is computed with a similar patch-wise correspondence objective, then the reported SCS improvements are not an independent evaluation of the method but rather a reflection of the training loss itself. The paper should clarify exactly how SCS is computed, describe whether its feature extractor and matching procedure overlap with the MViTv2 tokens used in HSC, and, if there is overlap, treat the SCS numbers as a training-objective diagnostic rather than as an independent quality metric.
  3. [Section 4, Tables 2 and 3] All quantitative results are reported without error bars, confidence intervals, or multiple seeds. Given that the fine-tuning procedure is stochastic (random noise, diffusion timesteps) and that the differences between methods in some columns are small (e.g., CLIP score 29.5 vs. 29.17 in the text-guided setting), a single run is insufficient to establish that GCA-3D significantly outperforms the baselines. The authors should provide mean and standard deviation over at least three independent runs, or otherwise justify why single-run results are sufficient for the claimed improvements.
minor comments (6)
  1. [Section 3.1] The term 'Score Sampling Distillation' appears where 'Score Distillation Sampling' is meant; the abbreviation SDS and reference [42] are correct, but the expanded name should be fixed.
  2. [Table 1] The table uses only checkmarks and exclamation marks without a legend explaining that '!!' indicates a positive result and '%' indicates a negative or missing result. Adding a footnote would improve readability.
  3. [Section 4.1] The 3D extensions of the 2D baselines (StyleGAN-NADA*, StyleGAN-DiFa*, StyleGAN-Fusion*) are described as '3D extension version' but no details are given about how the extension was implemented or whether it was independently verified. If these baselines are author-implemented, this should be stated clearly, and if possible the code or a detailed description should be provided.
  4. [Section 6.2 (Supplementary)] The implementation details state that Stable Diffusion v1.5 is used, but the main text does not mention which specific diffusion checkpoint or which IP-Adapter variant is used. Providing this information is important for reproducibility.
  5. [Table 2 and Section 4.2] The comparison with DATID-3D in the image-guided setting uses 'DATID-3D with IP-Adapter' as a baseline, but it is unclear whether this extension was implemented by the authors or is a standard method; the paper should describe how this baseline was constructed and whether it was tuned equivalently to the proposed method.
  6. [Section 5] The limitation paragraph is brief and only mentions dependence on pre-trained diffusion models. It would be useful to also mention the reliance on a pretrained depth estimator and face pose estimator, since those are components whose failures on out-of-distribution domains would affect the method's performance and evaluation.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity: GCA-3D's losses are evaluated against external metrics and benchmarks, not against its own fitted parameters.

full rationale

GCA-3D's derivation chain is empirical rather than definitional. The two proposed losses (DSDS in Eq. 2 and HSC in Eq. 3) are optimized during fine-tuning, and the headline claims (pose accuracy, identity consistency, diversity) are measured with external benchmarks: pose is estimated by Deng et al. [6], spatial consistency uses the SCS score of Xiao et al. [58], reference alignment uses CLIP score, and diversity uses IS and a user study. The pose metric is a pretrained face-reconstruction network from an outside group, so the pose claim does not reduce to any parameter fitted in this paper. The HSC loss and SCS metric are both concerned with spatial correspondence, but the paper does not define the metric in terms of its own loss or report any equation equating Eq. 3 with the SCS computation; without that exhibited reduction, this is an objective-alignment concern rather than circularity. The paper's self-citations ([21,22,23]) appear only in the related-work survey and are not load-bearing for the method's validity. No fitted value is renamed as a prediction, no uniqueness theorem is imported from the authors, and no ansatz is smuggled in via citation. The stated limitation that performance depends on pretrained diffusion models is an external dependency, not a circular input. The correct finding is therefore no significant circularity.

Assumptions & free parameters 1 free parameters · 3 assumptions · 0 invented entities

No new physical entities or forces are postulated. The method introduces no invented entity. The main free parameter is the HSC weight lambda, tuned empirically. The central claim rests on assumptions about the reliability of the diffusion prior, the spatial correspondence of shared latents, and the validity of the pose metric on stylized faces.

free parameters (1)
  • lambda (HSC loss weight) = 3
    Selected empirically based on the trade-off in Table 5 (pose vs CLIP score); not derived from theory.
assumptions (3)
  • domain assumption Pre-trained Stable Diffusion v1.5 with ControlNet and IP-Adapter provides reliable guidance for arbitrary text and one-shot image target domains.
    DSDS loss in Eq. (2) relies on the diffusion model's conditional noise prediction; the paper's own limitation section admits performance depends on the pre-trained diffusion models.
  • domain assumption The same latent code z in source and target generators corresponds to the same spatial structure after adaptation, making cross-branch contrastive alignment meaningful.
    HSC loss in Eq. (3) aligns MViTv2 tokens from GS and GT given the same z; if fine-tuning destroys this correspondence, the positive pairs would not represent the same pose or identity.
  • domain assumption The pose estimator of Deng et al. [6] is valid on stylized target-domain images.
    Pose accuracy numbers in Tables 2 and 3 are computed with this estimator; no validation on non-photorealistic domains is provided.

how reviews work

0 comments
Cite this review

Pith. "Pith review of GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generators." pith.science (2026). https://pith.science/paper/LJUAA743

@misc{pith2026241215491,
  author       = {Pith},
  title        = {Pith review of: GCA-3D: Towards Generalized and Consistent Domain Adaptation of 3D Generators},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LJUAA743}},
  note         = {Machine review of arXiv:2412.15491}
}
read the original abstract

Recently, 3D generative domain adaptation has emerged to adapt the pre-trained generator to other domains without collecting massive datasets and camera pose distributions. Typically, they leverage large-scale pre-trained text-to-image diffusion models to synthesize images for the target domain and then fine-tune the 3D model. However, they suffer from the tedious pipeline of data generation, which inevitably introduces pose bias between the source domain and synthetic dataset. Furthermore, they are not generalized to support one-shot image-guided domain adaptation, which is more challenging due to the more severe pose bias and additional identity bias introduced by the single image reference. To address these issues, we propose GCA-3D, a generalized and consistent 3D domain adaptation method without the intricate pipeline of data generation. Different from previous pipeline methods, we introduce multi-modal depth-aware score distillation sampling loss to efficiently adapt 3D generative models in a non-adversarial manner. This multi-modal loss enables GCA-3D in both text prompt and one-shot image prompt adaptation. Besides, it leverages per-instance depth maps from the volume rendering module to mitigate the overfitting problem and retain the diversity of results. To enhance the pose and identity consistency, we further propose a hierarchical spatial consistency loss to align the spatial structure between the generated images in the source and target domain. Experiments demonstrate that GCA-3D outperforms previous methods in terms of efficiency, generalization, pose accuracy, and identity consistency.

Figures

Figures reproduced from arXiv: 2412.15491 by the authors.

Figure 1
Figure 1. GCA-3D is generalized to both text-guided and image-guided 3D generative domain adaptation. It successfully generate diverse [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. Bias issues in the synthetic dataset of pipeline meth [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗
Figure 3
Figure 3. Overview of GCA-3D. Given the source generator 3D generator [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (8 more)
Figure 4
Figure 4. Figure 4: Qualitative comparison with existing image-guided domain adaptation methods. Our GCA-3D significantly surpasses baseline [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: Qualitative comparison with image-guided adversarial adaptation method. We extend DATID-3D with IP-Adapter to enable [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]
Figure 6
Figure 6. Figure 6: Qualitative comparison with existing text-guided domain adaptation methods. Our GCA-3D yields diverse samples with robust [PITH_FULL_IMAGE:figures/full_fig_p006_6.png]
Figure 7
Figure 7. Figure 7: Wide range of generalized adaption results including FFHQ and AFHQ-Cat. [PITH_FULL_IMAGE:figures/full_fig_p007_7.png]
Figure 8
Figure 8. Figure 8: Comparison between GCA-3D and 2D image editing with image-to-3D approach. Specifically, we use StyleCLIP [ [PITH_FULL_IMAGE:figures/full_fig_p008_8.png]
Figure 9
Figure 9. Figure 9: Qualitative ablation study of our method. Here we use the same image reference in Fig. [PITH_FULL_IMAGE:figures/full_fig_p008_9.png]
Figure 10
Figure 10. Figure 10: More qualitative results for image-driven domain adaptation. [PITH_FULL_IMAGE:figures/full_fig_p013_10.png]
Figure 11
Figure 11. Figure 11: More qualitative results for text-driven domain adaptation. [PITH_FULL_IMAGE:figures/full_fig_p013_11.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Visual Instance-aware Prompt Tuning

    cs.CV 2025-07 conditional novelty 5.0 of 10

    ViaPT generates instance-aware prompts per image, fuses them with dataset-level prompts, and applies PCA compression to outperform VPT-Deep and other PEFT baselines on FGVC, HTA, and VTAB-1k.

Reference graph

Works this paper leans on

73 extracted references · 43 canonical work pages · cited by 1 Pith paper

  1. [6]

    Accurate 3d face reconstruction with weakly- supervised learning: From single image to image set

    Yu Deng, Jiaolong Yang, Sicheng Xu, Dong Chen, Yunde Jia, and Xin Tong. Accurate 3d face reconstruction with weakly- supervised learning: From single image to image set. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, pages 0–0, 2019. 6

    work page 2019

  2. [58]

    Few shot generative model adaption via relaxed spatial structural alignment

    Jiayu Xiao, Liang Li, Chaofei Wang, Zheng-Jun Zha, and Qingming Huang. Few shot generative model adaption via relaxed spatial structural alignment. In Proceedings of the IEEE/CVF conference on computer vision and pattern recog- nition, pages 11204–11213, 2022. 3, 6

    work page 2022

  3. [1]

    3da- vatargan: Bridging domains for personalized editable avatars

    Rameen Abdal, Hsin-Ying Lee, Peihao Zhu, Menglei Chai, Aliaksandr Siarohin, Peter Wonka, and Sergey Tulyakov. 3da- vatargan: Bridging domains for personalized editable avatars. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4552–4562, 2023. 3

    work page 2023

  4. [2]

    HyperDomainNet: Universal Domain Adaptation for Generative Adversarial Networks

    Aibek Alanov, Vadim Titov, and Dmitry Vetrov. Hyperdo- mainnet: Universal domain adaptation for generative adver- sarial networks. arXiv preprint arXiv:2210.08884, 2022. 2, 3

    work page Pith review arXiv 2022

  5. [3]

    Styledomain: Efficient and lightweight parameteriza- tions of stylegan for one-shot and few-shot domain adaptation

    Aibek Alanov, Vadim Titov, Maksim Nakhodnov, and Dmitry Vetrov. Styledomain: Efficient and lightweight parameteriza- tions of stylegan for one-shot and few-shot domain adaptation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 2184–2194, 2023. 3

    work page 2023

  6. [4]

    pi-gan: Periodic implicit generative adversarial networks for 3d-aware image synthesis

    Eric R Chan, Marco Monteiro, Petr Kellnhofer, Jiajun Wu, and Gordon Wetzstein. pi-gan: Periodic implicit generative adversarial networks for 3d-aware image synthesis. In Pro- ceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5799–5809, 2021. 3

    2021

  7. [5]

    Efficient geometry-aware 3d generative adversarial networks

    Eric R Chan, Connor Z Lin, Matthew A Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas J Guibas, Jonathan Tremblay, Sameh Khamis, et al. Efficient geometry-aware 3d generative adversarial networks. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 16123–16133, 2022. 1, 3, 6

    work page 2022

  8. [7]

    Wedit- gan: Few-shot image generation via latent space relocation

    Yuxuan Duan, Li Niu, Yan Hong, and Liqing Zhang. Wedit- gan: Few-shot image generation via latent space relocation. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 1653–1661, 2024. 3

    work page 2024

Show all 73 references
  1. [8]

    Multiscale vision transformers

    Haoqi Fan, Bo Xiong, Karttikeya Mangalam, Yanghao Li, Zhicheng Yan, Jitendra Malik, and Christoph Feichten- hofer. Multiscale vision transformers. In Proceedings of the IEEE/CVF international conference on computer vision, pages 6824–6835, 2021. 2, 5

    2021

  2. [9]

    Stylegan-nada: Clip-guided domain adap- tation of image generators

    Rinon Gal, Or Patashnik, Haggai Maron, Gal Chechik, and Daniel Cohen-Or. Stylegan-nada: Clip-guided domain adap- tation of image generators. arXiv preprint arXiv:2108.00946,

    arXiv

  3. [10]

    Stylenerf: A style-based 3d aware generator for high- resolution image synthesis

    Jiatao Gu, Lingjie Liu, Peng Wang, and Christian Theobalt. Stylenerf: A style-based 3d aware generator for high- resolution image synthesis. In International Conference on Learning Representations, 2022. 3

    2022

  4. [11]

    Vector quan- tized diffusion model for text-to-image synthesis

    Shuyang Gu, Dong Chen, Jianmin Bao, Fang Wen, Bo Zhang, Dongdong Chen, Lu Yuan, and Baining Guo. Vector quan- tized diffusion model for text-to-image synthesis. In Proceed- ings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10696–10706, 2022. 3

    2022

  5. [12]

    Style aligned image generation via shared at- tention

    Amir Hertz, Andrey V oynov, Shlomi Fruchter, and Daniel Cohen-Or. Style aligned image generation via shared at- tention. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4775–4785,

  6. [13]

    Denoising diffu- sion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffu- sion probabilistic models. arXiv preprint arXiv:2006.11239,

    2006 arXiv

  7. [14]

    Wonjoon Jin, Nuri Ryu, Geonung Kim, Seung-Hwan Baek, and Sunghyun Cho. Dr. 3d: Adapting 3d gans to artistic drawings. In SIGGRAPH Asia 2022 Conference Papers, pages 1–8, 2022. 3

    2022

  8. [15]

    A style-based generator architecture for generative adversarial networks

    Tero Karras, Samuli Laine, and Timo Aila. A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4401–4410, 2019. 6

    2019

  9. [16]

    Analyzing and improv- ing the image quality of stylegan

    Tero Karras, Samuli Laine, Miika Aittala, Janne Hellsten, Jaakko Lehtinen, and Timo Aila. Analyzing and improv- ing the image quality of stylegan. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8110–8119, 2020. 1, 3

    2020

  10. [17]

    Datid-3d: Diversity- preserved domain adaptation using text-to-image diffusion for 3d generative model

    Gwanghyun Kim and Se Young Chun. Datid-3d: Diversity- preserved domain adaptation using text-to-image diffusion for 3d generative model. arXiv preprint arXiv:2211.16374,

    arXiv

  11. [18]

    Podia- 3d: Domain adaptation of 3d generative model across large domain gap using pose-preserved text-to-image diffusion

    Gwanghyun Kim, Ji Ha Jang, and Se Young Chun. Podia- 3d: Domain adaptation of 3d generative model across large domain gap using pose-preserved text-to-image diffusion. In Proceedings of the IEEE/CVF international conference on computer vision, pages 22603–22612, 2023. 2, 3, 4

    2023

  12. [19]

    Diffface: Diffusion-based face swapping with facial guidance

    Kihong Kim, Yunho Kim, Seokju Cho, Junyoung Seo, Jisu Nam, Kychul Lee, Seungryong Kim, and KwangHee Lee. Diffface: Diffusion-based face swapping with facial guidance. arXiv preprint arXiv:2212.13344, 2022. 3

    2022 arXiv

  13. [20]

    Diffusiongan3d: Boosting text-guided 3d generation and domain adaptation by combining 3d gans and diffusion priors

    Biwen Lei, Kai Yu, Mengyang Feng, Miaomiao Cui, and Xuansong Xie. Diffusiongan3d: Boosting text-guided 3d generation and domain adaptation by combining 3d gans and diffusion priors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 104...

    2024

  14. [21]

    Few-shot hybrid domain adaptation of image gen- erator

    Hengjia Li, Yang Liu, Linxuan Xia, Yuqi Lin, Wenxiao Wang, Tu Zheng, Zheng Yang, Xiaohui Zhong, Xiaobo Ren, and Xiaofei He. Few-shot hybrid domain adaptation of image gen- erator. In The Twelfth International Conference on Learning Representations, 2023. 3

    2023

  15. [22]

    Unihda: Towards universal hybrid domain adaptation of image generators

    Hengjia Li, Yang Liu, Yuqi Lin, Zhanwei Zhang, Yibo Zhao, Tu Zheng, Zheng Yang, Yuchun Jiang, Boxi Wu, Deng Cai, et al. Unihda: Towards universal hybrid domain adaptation of image generators. arXiv preprint arXiv:2401.12596, 2024. 3

    2024 arXiv

  16. [23]

    Personalvideo: High id-fidelity video customization without dynamic and semantic degradation

    Hengjia Li, Haonan Qiu, Shiwei Zhang, Xiang Wang, Yu- jie Wei, Zekun Li, Yingya Zhang, Boxi Wu, and Deng Cai. Personalvideo: High id-fidelity video customization without dynamic and semantic degradation. arXiv preprint arXiv:2411.17048, 2024. 3

    2024 arXiv

  17. [24]

    Few-shot image generation with elastic weight consolidation

    Yijun Li, Richard Zhang, Jingwan Lu, and Eli Shechtman. Few-shot image generation with elastic weight consolidation. arXiv preprint arXiv:2012.02780, 2020. 3

    2012 arXiv

  18. [25]

    Towards unsupervised learning of generative mod- els for 3d controllable image synthesis

    Yiyi Liao, Katja Schwarz, Lars Mescheder, and Andreas Geiger. Towards unsupervised learning of generative mod- els for 3d controllable image synthesis. In Proceedings of 9 the IEEE/CVF conference on computer vision and pattern recognition, pages 5871–5880, 2020. 1, 3

    2020

  19. [26]

    Text-driven generative domain adaptation with spectral consistency regularization

    Zhenhuan Liu, Liang Li, Jiayu Xiao, Zheng-Jun Zha, and Qingming Huang. Text-driven generative domain adaptation with spectral consistency regularization. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 7019–7029, 2023. 3

    2023

  20. [27]

    Deltaedit: Exploring text-free training for text-driven image manipulation

    Yueming Lyu, Tianwei Lin, Fu Li, Dongliang He, Jing Dong, and Tieniu Tan. Deltaedit: Exploring text-free training for text-driven image manipulation. In 2023 IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition (CVPR), pages 6894–6903. IEEE, 2023. 3

    2023

  21. [28]

    Nerf: Representing scenes as neural radiance fields for view synthesis

    B Mildenhall, PP Srinivasan, M Tancik, JT Barron, R Ra- mamoorthi, and R Ng. Nerf: Representing scenes as neural radiance fields for view synthesis. In European conference on computer vision, 2020. 3

    2020

  22. [29]

    Nerf: Representing scenes as neural radiance fields for view syn- thesis

    Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. Nerf: Representing scenes as neural radiance fields for view syn- thesis. Communications of the ACM , 65(1):99–106, 2021. 3

    2021

  23. [30]

    Freeze the discriminator: a simple baseline for fine-tuning gans

    Sangwoo Mo, Minsu Cho, and Jinwoo Shin. Freeze the discriminator: a simple baseline for fine-tuning gans. arXiv preprint arXiv:2002.10964, 2020. 3

    2002 arXiv

  24. [31]

    Freecontrol: Training- free spatial control of any text-to-image diffusion model with any condition

    Sicheng Mo, Fangzhou Mu, Kuan Heng Lin, Yanli Liu, Bochen Guan, Yin Li, and Bolei Zhou. Freecontrol: Training- free spatial control of any text-to-image diffusion model with any condition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pa...

    2024

  25. [32]

    Few-shot cross-domain image generation via inference-time latent-code learning

    Arnab Kumar Mondal, Piyush Tiwary, Parag Singla, and AP Prathosh. Few-shot cross-domain image generation via inference-time latent-code learning. In The Eleventh Interna- tional Conference on Learning Representations, 2023. 3

    2023

  26. [33]

    T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models

    Chong Mou, Xintao Wang, Liangbin Xie, Jian Zhang, Zhon- gang Qi, Ying Shan, and Xiaohu Qie. T2i-adapter: Learning adapters to dig out more controllable ability for text-to-image diffusion models. arXiv preprint arXiv:2302.08453, 2023. 3

    2023 arXiv

  27. [34]

    Blockgan: Learning 3d object-aware scene representations from unlabelled images

    Thu H Nguyen-Phuoc, Christian Richardt, Long Mai, Yongliang Yang, and Niloy Mitra. Blockgan: Learning 3d object-aware scene representations from unlabelled images. Advances in Neural Information Processing Systems, 33:6767– 6778, 2020. 3

    2020

  28. [35]

    Improved denoising diffu- sion probabilistic models

    Alex Nichol and Prafulla Dhariwal. Improved denoising diffu- sion probabilistic models. arXiv preprint arXiv:2102.09672,

    arXiv

  29. [36]

    Glide: Towards photorealistic image generation and editing with text-guided diffusion models

    Alex Nichol, Prafulla Dhariwal, Aditya Ramesh, Pranav Shyam, Pamela Mishkin, Bob McGrew, Ilya Sutskever, and Mark Chen. Glide: Towards photorealistic image generation and editing with text-guided diffusion models. arXiv preprint arXiv:2112.10741, 2021. 3

    2021 arXiv

  30. [37]

    Giraffe: Represent- ing scenes as compositional generative neural feature fields

    Michael Niemeyer and Andreas Geiger. Giraffe: Represent- ing scenes as compositional generative neural feature fields. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11453–11464, 2021. 1, 3

    2021

  31. [38]

    Domain expansion of image generators

    Yotam Nitzan, Micha¨el Gharbi, Richard Zhang, Taesung Park, Jun-Yan Zhu, Daniel Cohen-Or, and Eli Shechtman. Domain expansion of image generators. 2023. 2, 3

    2023

  32. [39]

    Few-shot image generation via cross-domain correspondence

    Utkarsh Ojha, Yijun Li, Jingwan Lu, Alexei A Efros, Yong Jae Lee, Eli Shechtman, and Richard Zhang. Few-shot image generation via cross-domain correspondence. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10743–10752, 2021. 3

    2021

  33. [40]

    Repre- sentation learning with contrastive predictive coding

    Aaron van den Oord, Yazhe Li, and Oriol Vinyals. Repre- sentation learning with contrastive predictive coding. arXiv preprint arXiv:1807.03748, 2018. 5

    2018 arXiv

  34. [41]

    Styleclip: Text-driven manipulation of stylegan imagery

    Or Patashnik, Zongze Wu, Eli Shechtman, Daniel Cohen-Or, and Dani Lischinski. Styleclip: Text-driven manipulation of stylegan imagery. arXiv preprint arXiv:2103.17249, 2021. 7, 8

    2021 arXiv

  35. [42]

    Dreamfusion: Text-to-3d using 2d diffusion

    Ben Poole, Ajay Jain, Jonathan T Barron, and Ben Mildenhall. Dreamfusion: Text-to-3d using 2d diffusion. arXiv preprint arXiv:2209.14988, 2022. 2, 3, 4

    2022 arXiv

  36. [43]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. arXiv preprint arXiv:2103.00020, 2021. 2, 3, 6

    2021 arXiv

  37. [44]

    Exploring the limits of transfer learning with a unified text-to-text transformer

    Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J Liu. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of machine learning research, 21(140):1–67, 2020. 3

    2020

  38. [45]

    Hierarchical text-conditional image genera- tion with clip latents

    Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. Hierarchical text-conditional image genera- tion with clip latents. arXiv preprint arXiv:2204.06125, 2022. 3

    2022 arXiv

  39. [46]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj ¨orn Ommer. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10684–10695, 2022. 2, 3, 4

    2022

  40. [47]

    Dreambooth: Fine tuning text-to-image diffusion models for subject-driven gen- eration

    Nataniel Ruiz, Yuanzhen Li, Varun Jampani, Yael Pritch, Michael Rubinstein, and Kfir Aberman. Dreambooth: Fine tuning text-to-image diffusion models for subject-driven gen- eration. In Proceedings of the IEEE/CVF conference on com- puter vision and pattern recognition , pages ...

  41. [48]

    Photorealistic text-to-image diffusion models with deep language understanding

    Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily Denton, Seyed Kamyar Seyed Ghasemipour, Burcu Karagol Ayan, S Sara Mahdavi, Rapha Gontijo Lopes, et al. Photorealistic text-to-image diffusion models with deep language understanding. arXiv preprint arXiv...

    arXiv

  42. [49]

    Improved techniques for training gans

    Tim Salimans, Ian Goodfellow, Wojciech Zaremba, Vicki Cheung, Alec Radford, and Xi Chen. Improved techniques for training gans. Advances in neural information processing systems, 29, 2016. 6

    2016

  43. [50]

    Graf: Generative radiance fields for 3d-aware im- age synthesis

    Katja Schwarz, Yiyi Liao, Michael Niemeyer, and Andreas Geiger. Graf: Generative radiance fields for 3d-aware im- age synthesis. Advances in Neural Information Processing Systems, 33:20154–20166, 2020. 3 10

    2020

  44. [51]

    Diffusion guided domain adaptation of image generators

    Kunpeng Song, Ligong Han, Bingchen Liu, Dimitris Metaxas, and Ahmed Elgammal. Diffusion guided domain adaptation of image generators. arXiv preprint arXiv:2212.04473, 2022. 2, 3, 6

    2022 arXiv

  45. [52]

    Score-based generative modeling through stochastic differential equations

    Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Ab- hishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equations. arXiv preprint arXiv:2011.13456, 2020. 3

    2011 arXiv

  46. [53]

    Designing an encoder for stylegan image manipulation

    Omer Tov, Yuval Alaluf, Yotam Nitzan, Or Patashnik, and Daniel Cohen-Or. Designing an encoder for stylegan image manipulation. ACM Transactions on Graphics (TOG), 40(4): 1–14, 2021. 3

    2021

  47. [54]

    Sv3d: Novel multi-view syn- thesis and 3d generation from a single image using latent video diffusion

    Vikram V oleti, Chun-Han Yao, Mark Boss, Adam Letts, David Pankratz, Dmitry Tochilkin, Christian Laforte, Robin Rombach, and Varun Jampani. Sv3d: Novel multi-view syn- thesis and 3d generation from a single image using latent video diffusion. In European Conference on Computer...

    2025

  48. [55]

    Sketch- guided text-to-image diffusion models

    Andrey V oynov, Kfir Aberman, and Daniel Cohen-Or. Sketch- guided text-to-image diffusion models. In ACM SIGGRAPH 2023 Conference Proceedings, pages 1–11, 2023. 3

    2023

  49. [56]

    Domain re-modulation for few-shot generative domain adaptation

    Yi Wu, Ziqiang Li, Chaoyue Wang, Heliang Zheng, Shanshan Zhao, Bin Li, and Dacheng Tao. Domain re-modulation for few-shot generative domain adaptation. Advances in Neural Information Processing Systems, 36, 2024. 3

    2024

  50. [57]

    Fastcomposer: Tuning-free multi- subject image generation with localized attention

    Guangxuan Xiao, Tianwei Yin, William T Freeman, Fr ´edo Durand, and Song Han. Fastcomposer: Tuning-free multi- subject image generation with localized attention. arXiv preprint arXiv:2305.10431, 2023. 3

    2023 arXiv

  51. [59]

    Boxdiff: Text-to-image synthesis with training-free box-constrained diffusion

    Jinheng Xie, Yuexiang Li, Yawen Huang, Haozhe Liu, Wen- tian Zhang, Yefeng Zheng, and Mike Zheng Shou. Boxdiff: Text-to-image synthesis with training-free box-constrained diffusion. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 7452–7461, 2023. 3

    2023

  52. [60]

    Lora-composer: Leveraging low-rank adapta- tion for multi-concept customization in training-free diffusion models

    Yang Yang, Wen Wang, Liang Peng, Chaotian Song, Yao Chen, Hengjia Li, Xiaolong Yang, Qinglin Lu, Deng Cai, Boxi Wu, et al. Lora-composer: Leveraging low-rank adapta- tion for multi-concept customization in training-free diffusion models. arXiv preprint arXiv:2403.11627, 2024. 3

    2024 arXiv

  53. [61]

    Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models

    Hu Ye, Jun Zhang, Sibo Liu, Xiao Han, and Wei Yang. Ip- adapter: Text compatible image prompt adapter for text-to- image diffusion models. arXiv preprint arXiv:2308.06721,

    arXiv

  54. [62]

    Styleavatar3d: Leveraging image-text diffusion models for high-fidelity 3d avatar generation

    Chi Zhang, Yiwen Chen, Yijun Fu, Zhenglin Zhou, Gang Yu, Billzb Wang, Bin Fu, Tao Chen, Guosheng Lin, and Chun- hua Shen. Styleavatar3d: Leveraging image-text diffusion models for high-fidelity 3d avatar generation. arXiv preprint arXiv:2305.19012, 2023. 3

    2023 arXiv

  55. [63]

    Deformtoon3d: Deformable neural radiance fields for 3d toonification

    Junzhe Zhang, Yushi Lan, Shuai Yang, Fangzhou Hong, Quan Wang, Chai Kiat Yeo, Ziwei Liu, and Chen Change Loy. Deformtoon3d: Deformable neural radiance fields for 3d toonification. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 9144–9154, 2023. 3

    2023

  56. [64]

    Adding conditional control to text-to-image diffusion models

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3836–3847, 2023. 3, 4

    2023

  57. [65]

    Towards diverse and faithful one-shot adaption of generative adversarial networks

    Yabo Zhang, mingshuai Yao, Yuxiang Wei, Zhilong Ji, Jin- feng Bai, and Wangmeng Zuo. Towards diverse and faithful one-shot adaption of generative adversarial networks. In Ad- vances in Neural Information Processing Systems, 2022. 2, 3, 6

    2022

  58. [66]

    Uni- controlnet: All-in-one control to text-to-image diffusion mod- els

    Shihao Zhao, Dongdong Chen, Yen-Chun Chen, Jianmin Bao, Shaozhe Hao, Lu Yuan, and Kwan-Yee K Wong. Uni- controlnet: All-in-one control to text-to-image diffusion mod- els. Advances in Neural Information Processing Systems, 36,

  59. [67]

    Few-shot image gen- eration via adaptation-aware kernel modulation

    Yunqing Zhao, Keshigeyan Chandrasegaran, Milad Abdol- lahzadeh, and Ngai-Man Man Cheung. Few-shot image gen- eration via adaptation-aware kernel modulation. Advances in Neural Information Processing Systems, 35:19427–19440,

  60. [68]

    A closer look at few-shot image generation

    Yunqing Zhao, Henghui Ding, Houjing Huang, and Ngai- Man Cheung. A closer look at few-shot image generation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 9140–9150, 2022. 3

    2022

  61. [69]

    Local conditional controlling for text-to-image diffusion models

    Yibo Zhao, Liang Peng, Yang Yang, Zekai Luo, Hengjia Li, Yao Chen, Zheng Yang, Xiaofei He, Wei Zhao, Boxi Wu, et al. Local conditional controlling for text-to-image diffusion models. arXiv preprint arXiv:2312.08768, 2023. 3

    2023 arXiv

  62. [70]

    Cips-3d: A 3d-aware generator of gans based on conditionally-independent pixel synthesis

    Peng Zhou, Lingxi Xie, Bingbing Ni, and Qi Tian. Cips-3d: A 3d-aware generator of gans based on conditionally-independent pixel synthesis. arXiv preprint arXiv:2110.09788, 2021. 3

    2021 arXiv

  63. [71]

    Mind the gap: Domain gap control for single shot domain adaptation for generative adversarial networks

    Peihao Zhu, Rameen Abdal, John Femiani, and Peter Wonka. Mind the gap: Domain gap control for single shot domain adaptation for generative adversarial networks. arXiv preprint arXiv:2110.08398, 2021. 2, 3

    2021 arXiv

  64. [72]

    One model to edit them all: Free-form text-driven image manipu- lation with semantic modulations

    Yiming Zhu, Hongyu Liu, Yibing Song, Ziyang Yuan, Xin- tong Han, Chun Yuan, Qifeng Chen, and Jue Wang. One model to edit them all: Free-form text-driven image manipu- lation with semantic modulations. Advances in Neural Infor- mation Processing Systems, 35:25146–25159, 2022. 3...

    2022

  65. [73]

    Yoda” “WereWolf

    Appendix 6.1. Additional Results User Study. In the user study, 15 volunteers were asked to evaluate each fine-tuned model on a scale of 1 to 5 across three dimensions: pose accuracy, reference correspondence, image quality, and diversity. We use the EG3D pre-trained in FFHQ a...

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.