Pith. sign in

REVIEW 4 major objections 5 minor 2 cited by

Pippo: High-Resolution Multi-View Humans from a Single Image

T0 review · 4 major / 5 minor · reviewed 2026-08-08 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read Pippo turns a single casual photo of a person into a dense 1K-resolution multi-view turnaround video, without fitted body models or input camera parameters.

desk verdict Well-engineered, honestly reported system paper whose attention-biasing trick is genuinely useful, but the headline 'outperforms' claim is under-supported by a pairwise consistency metric and qualitative-only comparisons to human baselines. read the letter →

arxiv 2502.07785 v1 pith:5NXONU3R submitted 2025-02-11 cs.CV cs.GR

Yash Kant , Ethan Weber , Jin Kyu Kim , Rawal Khirodkar , Su Zhaoen , Julieta Martinez , Igor Gilitschenski , Shunsuke Saito
show 1 more author
Timur Bagautdinov
This is my paper · ORCID
classification cs.CVcs.GR
keywords multi-viewhumangenerationdiffusiontransformersingle-imagetovideoattentionbiasing3Dconsistencymetricreprojectionerrorspatialanchorhuman-centricpre-training
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Pippo claims that one casually taken photo of a person is enough to generate a dense, 1K-resolution turnaround video—dozens of sharp, multi-view-consistent images circling the subject—without a fitted parametric body model, depth map, or input-camera calibration. The paper builds a single multi-view diffusion transformer and trains it in three stages: caption-free pre-training on roughly three billion human images, low-resolution multi-view mid-training on studio captures, and high-resolution post-training with pixel-aligned spatial controls. At inference, an attention-biasing rule scales the softmax temperature with the number of generated views, allowing the model to emit more than five times as many views as it saw jointly during training. The same paper introduces a ground-truth-free 3D-consistency metric, RE@SG, that triangulates keypoint matches and reports reprojection error. If these claims hold, test-time studio capture is replaced by a single photo plus a user-supplied spatial anchor.

What carries the argument

The load-bearing machinery is a DiT-style multi-view diffusion transformer whose blocks run self-attention jointly over noisy latent tokens, the reference image, and its face crop; camera viewpoints enter as Plücker coordinates processed through a SIREN layer, and a lightweight ControlMLP injects scale-and-shift modulations along with a projected spatial anchor. The spatial anchor is an oriented 3D point encoding head position and gaze direction, projected into each target view, and it carries most of the viewpoint-placement signal: ablations show removing it raises reprojection error from 3.3 to 11.5 at 128×128. The second mechanism is attention biasing, a training-free inference rule that grows the softmax scale with the ratio of inference to training tokens as $\lambda=\sqrt{\frac{1}{d}\gamma\frac{\log N_i}{\log N_t}}$ with tuned growth factor $\gamma\approx1.4$, offsetting entropy growth when generating more than five times as many views as during training. The third is RE@SG, a no-ground-truth consistency metric that matches SuperPoint and SuperGlue keypoints across generated views, triangulates them with DLT, and reports average reprojection error normalized by image resolution.

What would settle it

Run Pippo on its iPhone test set with an automatic head-pose estimator instead of a hand-placed spatial anchor. If RE@SG rises well above the reported 3.0 for head-only or 1.7 for full-body, or face similarity falls below 58.0, then the casually clicked photo claim holds only with manual anchoring, and the real-world usability premise fails.

Watch

Extended reading notes

Core claim

The central claim is that 3D-consistent, 1K-resolution multi-view human generation from a single image is achievable with one diffusion transformer, provided it is pre-trained on billions of unlabeled human images, mid-trained jointly on dense studio multi-view captures at 128×128, and post-trained at up to 1024×1024 with a minimal spatial anchor—an oriented 3D point specifying head position and gaze direction—together with Plücker-ray pixel-aligned controls. The paper further claims that this combination preserves identity and 3D consistency on unseen studio subjects and on casually captured iPhone photos, outperforming published multi-view human and multi-view diffusion baselines. The mechanism that makes large-view inference practical is attention biasing: because attention entropy grows logarithmically with token count, the softmax scale is increased during inference using $\lambda=\sqrt{\frac{1}{d}\gamma\frac{\log N_i}{\log N_t}}$ with $\gamma\approx1.4$, which keeps generations sharp at more than five times the joint-view count seen in training.

Load-bearing premise

The person using Pippo must supply a correct spatial anchor—where the subject's head is located in 3D and which way the gaze points—because the model has no automatic estimator; a missing anchor typically makes the model emit an empty image, and only a 90-degree anchor rotation is tested.

Editorial extensions

If this is right

  • A single casual photo—phone capture, studio frame, or face crop—can be expanded into a dense 1K-resolution turnaround video without SMPL fitting, depth estimation, or input-camera calibration.
  • Attention biasing lets inference generate more than five times as many joint views as the model saw during training (for example, 60 views from a model post-trained on 12 views), with a tuned growth factor $\gamma\approx1.4$.
  • The multi-stage recipe transfers studio-capture fidelity to in-the-wild photos: iPhone-input generations show reprojection errors comparable to studio inputs in the paper's experiments.
  • 3D consistency can be measured without ground truth by matching keypoints, triangulating them, and reprojecting (RE@SG), allowing fair comparison of outputs that legitimately differ from reference views.
  • Ablations identify pretraining scale, mid-training, self-attention reference conditioning, Plücker/SIREN controls, and the spatial anchor as each necessary for the reported consistency and identity preservation.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A practical deployment of Pippo needs an automatic head-pose estimator for the spatial anchor; the paper's own appendix shows a missing anchor yields an empty image, so anchor estimation is the natural next component.
  • Attention biasing is a token-count-scaled softmax temperature and should transfer to other multi-view or long-context diffusion models—objects, scenes, or video—where the number of jointly denoised tokens grows.
  • RE@SG is an instantiation of the metric with specific matchers; numeric scores will shift if stronger matchers such as MAST3R or Sapiens are substituted, so comparisons across papers must name the estimator.
  • The outputs are consistent 2D views, not verified geometry; reconstructing a NeRF or Gaussian splatting from them is plausible, but the paper does not show that the triangulated points are metrically accurate.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper presents Pippo, a multi-view diffusion transformer that generates dense, up-to-1K-resolution turnarounds of a person from a single image. The method trains in three stages: image-only pretraining on a large proprietary human image collection, multi-view mid-training at low resolution with up to 48 views, and high-resolution post-training with pixel-aligned controls (Plücker rays and a user-provided spatial anchor). The authors also propose an attention-biasing technique to generate more than five times as many views at inference as seen during training, and introduce a new metric, RE@SG, for evaluating 3D consistency without ground truth. Experiments are reported on internal studio data, a proprietary iPhone test set, and the public Ava-256 and Goliath datasets, with comparisons to MV-Adapter, Era3D, and Wonder3D.

Significance. If the stated claims were fully supported, Pippo would be a noteworthy advance in single-image multi-view human synthesis: the three-stage recipe combining large-scale web data with studio multi-view data is well motivated, and the attention-biasing idea for long-context generation is interesting and potentially reusable beyond this task. The paper is also transparent about many design choices and includes ablations, public-dataset benchmarks (Ava-256, Goliath), and a plan to release the RE@SG metric code. However, the evaluation as presented has load-bearing gaps: the proposed consistency metric is explicitly pairwise, the headline comparative claim against existing works omits the two most relevant human-specific baselines, and the requirement of a user-provided spatial anchor conflicts with the 'no additional inputs' framing. These issues prevent the current evidence from supporting the abstract's strong claims.

major comments (4)
  1. [Sec 3.5 and Appendix G ('Is Reprojection Error (RE) pairwise...')]
  2. [Sec 4.3 'Quantitative comparisons and baselines']
  3. [Sec 3.2 'Target Spatial Anchor' and Appendix G 'Ablation with Missing or Inconsistent spatial anchor']
  4. [Tables 3, 4, 6 and Sec 4.3]
minor comments (5)
  1. [Sec 3.2 vs Sec 3.4]
  2. [Sec 4.3, text after Table 6]
  3. [Abstract and Sec 3.5]
  4. [Appendix G, Figure 12 caption]
  5. [Sec 3.5 and Appendix G 'Is Reprojection Error (RE) pairwise...']

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity; the central multi-view generation claim is anchored to external baselines and public datasets, and the new RE@SG metric is an evaluation device rather than a training input or fitted output.

full rationale

Pippo's derivation chain is not circular. The model is trained with a diffusion denoising objective (Eqs. 1-2) on 3B in-the-wild images plus studio multiview captures; the conditioning inputs (reference image, face crop, target cameras, Plücker rays, spatial anchor) are external to the model and are not fitted to the evaluation metric. The headline comparisons (Tables 3-5, Fig. 6) use external baselines (MV-Adapter, Era3D, Wonder3D, DiffPortrait3D, SiTH) and public datasets (Ava-256, Goliath), so the claim that Pippo outperforms existing works rests on shared benchmarks rather than on a self-referential construction. The new RE@SG metric is introduced by the paper, but it is not a training loss or a fitted output: it is computed with off-the-shelf SuperPoint/SuperGlue correspondences and ground-truth camera poses, and the paper additionally reports PSNR, SSIM, LPIPS, and identity similarity on public data. The author-overlapping citation to Sapiens is used only for background segmentation of iPhone evaluation images, so it is not load-bearing. The FAQ's admission that RE@SG is computed pairwise on random non-overlapping view pairs is a genuine limitation for certifying global 360-degree consistency, but it is an evaluation-validity concern, not a circularity: no equation or fitted parameter reduces the reported result to its own inputs. Attention biasing (Eq. 6) is explicitly adapted from prior work [35] with an added, empirically tuned growth factor, and the timestep rescaling is derived from stated uncertainty-coupling assumptions, so neither constitutes self-definition. Overall, the paper's claims are independently supported by external benchmarks and public datasets, and no load-bearing circular step is present.

Assumptions & free parameters 4 free parameters · 5 assumptions · 1 invented entities

The central claims rest on proprietary data and hand-tuned design choices. No free parameter is fitted to the final test metric in a formal sense, but gamma, CFG ranges, and the m/n ratio are selected empirically. The main invented conditioning entity is the Spatial Anchor, which is user-supplied at inference. Most load-bearing assumptions are domain assumptions about transfer from studio to in-the-wild data and about the reliability of off-the-shelf keypoint matchers.

free parameters (4)
  • Attention growth factor gamma = 1.4 (tuned in [1.0, 2.0])
    Introduced in Eq. 6 to control entropy growth; the value 1.4 is chosen by visual inspection of generated views, not derived from the entropy analysis.
  • CFG bump-function start and peak = start CFG in [7.0, 9.0], peak CFG in [15.0, 19.0]
    Hand-tuned ranges in Appendix B for per-azimuth classifier-free guidance; no fitting procedure or validation method is described.
  • Timestep reweighting m/n ratio = slightly lower than the actual resolution ratio
    Appendix B sets the ratio heuristically following SD3; the paper derives the DDPM mapping but then adjusts m/n empirically.
  • SuperGlue match threshold and minimum match count = confidence > 0.2, at least 5 matches per pair
    Appendix G sets these thresholds for the reprojection-error metric; changing them changes the reported errors.
assumptions (5)
  • standard math Attention entropy grows logarithmically with token count, Ent(A_i) ~ log N, as derived in [35] for softmax attention.
    Sec 3.4, Eq. 5, cites [35] and adopts the result without re-deriving it for multi-view DiT with reference tokens; this is load-bearing for the attention-biasing method.
  • standard math The DDPM forward process and noise model with T=1000 timesteps is the correct training objective.
    Sec 3.1, Eq. 1; standard diffusion background assumed without proof.
  • domain assumption Studio multi-view captures provide a sufficiently complete and accurate 3D-consistency signal for training.
    Sec 3.2 and Sec 4.1; the whole post-training stage depends on this data, but the studio distribution may not cover all in-the-wild poses, clothing, and occlusions.
  • domain assumption SuperPoint and SuperGlue correspondences are accurate enough on generated human images to measure 3D consistency.
    Sec 3.5; the RE metric relies on these off-the-shelf matchers, and the paper calibrates only with real-image baselines, not on generated images with known ground truth.
  • domain assumption Large-scale in-the-wild pre-training transfers to multi-view consistency for unseen identities.
    Sec 4.3, Tab 6 Row 8 and Tab 7; the causal role of 3B-image pre-training is inferred from ablations on internal data, with no external replication.
invented entities (1)
  • Spatial Anchor (oriented 3D head anchor projected to 2D)
    purpose: Provides scale, position, and head orientation for target views without input camera parameters or body priors
    Introduced in Sec 3.2; only internal ablations (Tab 6 Row 5 and Appendix G) show it matters. There is no external validation, no automatic estimator, and no public implementation, so the entity lacks independent evidence beyond this paper.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Pippo: High-Resolution Multi-View Humans from a Single Image." pith.science (2026). https://pith.science/paper/5NXONU3R

@misc{pith2026250207785,
  author       = {Pith},
  title        = {Pith review of: Pippo: High-Resolution Multi-View Humans from a Single Image},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/5NXONU3R}},
  note         = {Machine review of arXiv:2502.07785}
}
read the original abstract

We present Pippo, a generative model capable of producing 1K resolution dense turnaround videos of a person from a single casually clicked photo. Pippo is a multi-view diffusion transformer and does not require any additional inputs - e.g., a fitted parametric model or camera parameters of the input image. We pre-train Pippo on 3B human images without captions, and conduct multi-view mid-training and post-training on studio captured humans. During mid-training, to quickly absorb the studio dataset, we denoise several (up to 48) views at low-resolution, and encode target cameras coarsely using a shallow MLP. During post-training, we denoise fewer views at high-resolution and use pixel-aligned controls (e.g., Spatial anchor and Plucker rays) to enable 3D consistent generations. At inference, we propose an attention biasing technique that allows Pippo to simultaneously generate greater than 5 times as many views as seen during training. Finally, we also introduce an improved metric to evaluate 3D consistency of multi-view generations, and show that Pippo outperforms existing works on multi-view human generation from a single image.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. MoGA: 3D Generative Avatar Prior for Monocular Gaussian Avatar Reconstruction

    cs.CV 2025-07 conditional novelty 6.0 of 10

    Fitting a learned 3D Gaussian avatar prior to six diffusion-hallucinated views reconstructs an animatable, high-fidelity avatar from a single image.

  2. GAS: Generative Avatar Synthesis from a Single Image

    cs.CV 2025-02 conditional novelty 6.0 of 10

    GAS generates view-consistent, temporally coherent avatars from a single image by feeding NeRF renderings of the target view plus SMPL normal maps into a video diffusion model.

Reference graph

Works this paper leans on

113 extracted references · 42 canonical work pages · cited by 2 Pith papers

  1. [1]

    Ogras, and Linjie Luo

    Sizhe An, Hongyi Xu, Yichun Shi, Guoxian Song, Umit Y. Ogras, and Linjie Luo. Panohead: Geometry-aware 3d full-head synthesis in 360deg. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 20950–20959, June 2023

    2023

  2. [2]

    Entropy-based attention regularization frees unintended bias mitigation from lists, 2022.https://arxiv.org/abs/2203.09192

    Giuseppe Attanasio, Debora Nozza, Dirk Hovy, and Elena Baralis. Entropy-based attention regularization frees unintended bias mitigation from lists, 2022.https://arxiv.org/abs/2203.09192

    arXiv 2022

  3. [3]

    Driving-signal aware full-body avatars.ACM Transactions on Graphics (TOG), 40(4):1–17, 2021

    Timur Bagautdinov, Chenglei Wu, Tomas Simon, Fabián Prada, Takaaki Shiratori, Shih-En Wei, Weipeng Xu, Yaser Sheikh, and Jason Saragih. Driving-signal aware full-body avatars.ACM Transactions on Graphics (TOG), 40(4):1–17, 2021

    2021

  4. [4]

    Vd3d: Taming large video diffusion transformers for 3d camera control.arXiv preprint arXiv:2407.12781, 2024

    Sherwin Bahmani, Ivan Skorokhodov, Aliaksandr Siarohin, Willi Menapace, Guocheng Qian, Michael Vasilkovsky, Hsin-Ying Lee, Chaoyang Wang, Jiaxu Zou, Andrea Tagliasacchi, et al. Vd3d: Taming large video diffusion transformers for 3d camera control.arXiv preprint arXiv:2407.12781, 2024

    arXiv 2024

  5. [5]

    Stable video diffusion: Scaling latent video diffusion models to large datasets.arXiv preprint arXiv:2311.15127, 2023

    Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Mendelevitch, Maciej Kilian, Dominik Lorenz, Yam Levi, Zion English, Vikram Voleti, Adam Letts, et al. Stable video diffusion: Scaling latent video diffusion models to large datasets.arXiv preprint arXiv:2311.15127, 2023

    arXiv 2023

  6. [6]

    Parkhi, and Andrew Zisserman

    Qiong Cao, Li Shen, Weidi Xie, Omkar M. Parkhi, and Andrew Zisserman. Vggface2: A dataset for recognising faces across pose and age. In 2018 13th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2018), pages 67–74, 2018

    2018

  7. [7]

    Chan, Connor Z

    Eric R. Chan, Connor Z. Lin, Matthew A. Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas Guibas, Jonathan Tremblay, Sameh Khamis, Tero Karras, and Gordon Wetzstein. Efficient geometry- aware 3D generative adversarial networks. InCVPR, 2022

    2022

  8. [8]

    Ray conditioning: Trading photo-consistency for photo-realism in multi-view image generation.arXiv preprint arXiv:2304.13681, 2023

    Eric Ming Chen, Sidhanth Holalkere, Ruyu Yan, Kai Zhang, and Abe Davis. Ray conditioning: Trading photo-consistency for photo-realism in multi-view image generation.arXiv preprint arXiv:2304.13681, 2023

    arXiv 2023

Show all 113 references
  1. [9]

    Fantasia3d: Disentangling geometry and appearance for high-quality text-to-3d content creation

    Rui Chen, Yongwei Chen, Ningxin Jiao, and Kui Jia. Fantasia3d: Disentangling geometry and appearance for high-quality text-to-3d content creation. InICCV, 2023

    2023

  2. [10]

    On the importance of noise scheduling for diffusion models.arXiv preprint arXiv:2301.10972, 2023

    Ting Chen. On the importance of noise scheduling for diffusion models.arXiv preprint arXiv:2301.10972, 2023

    2023 arXiv

  3. [11]

    Dna-rendering: A diverse neural actor repository for high-fidelity human-centric rendering.arXiv preprint, arXiv:2307.10173, 2023

    Wei Cheng, Ruixiang Chen, Wanqi Yin, Siming Fan, Keyu Chen, Honglin He, Huiwen Luo, Zhongang Cai, Jingbo Wang, Yang Gao, Zhengming Yu, Zhengyu Lin, Daxuan Ren, Lei Yang, Ziwei Liu, Chen Change Loy, Chen Qian, Wayne Wu, Dahua Lin, Bo Dai, and Kwan-Yee Lin. Dna-rendering: A dive...

    2023 arXiv

  4. [12]

    Vision transformers need registers, 2023

    Timothée Darcet, Maxime Oquab, Julien Mairal, and Piotr Bojanowski. Vision transformers need registers, 2023

    2023

  5. [13]

    Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matth...

    2023

  6. [14]

    Nerdi: Single-view nerf synthesis with language-guided diffusion as general image priors

    Congyue Deng, Chiyu Jiang, Charles R Qi, Xinchen Yan, Yin Zhou, Leonidas Guibas, Dragomir Anguelov, et al. Nerdi: Single-view nerf synthesis with language-guided diffusion as general image priors. InCVPR, 2023

    2023

  7. [15]

    Imagenet: A large-scale hierarchical image database

    Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. Imagenet: A large-scale hierarchical image database. InCVPR, 2009

    2009

  8. [16]

    Superpoint: Self-supervised interest point detection and description

    Daniel DeTone, Tomasz Malisiewicz, and Andrew Rabinovich. Superpoint: Self-supervised interest point detection and description. InProceedings of the IEEE conference on computer vision and pattern recognition workshops, pages 224–236, 2018

    2018

  9. [17]

    Megaportraits: One-shot megapixel neural head avatars

    Nikita Drobyshev, Jenya Chelishev, Taras Khakhulin, Aleksei Ivakhnenko, Victor Lempitsky, and Egor Zakharov. Megaportraits: One-shot megapixel neural head avatars. InACM MM, 2022

    2022

  10. [18]

    Emoportraits: Emotion-enhanced multimodal one-shot head avatars

    Nikita Drobyshev, Antoni Bigata Casademunt, Konstantinos Vougioukas, Zoe Landgraf, Stavros Petridis, and Maja Pantic. Emoportraits: Emotion-enhanced multimodal one-shot head avatars. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 84...

    2024

  11. [19]

    Scaling rectified flow transformers for high-resolution image synthesis

    Patrick Esser, Sumith Kulal, Andreas Blattmann, Rahim Entezari, Jonas Müller, Harry Saini, Yam Levi, Dominik Lorenz, Axel Sauer, Frederic Boesel, et al. Scaling rectified flow transformers for high-resolution image synthesis. In Forty-first International Conference on Machine ...

    2024

  12. [20]

    Scenescape: Text-driven consistent scene generation

    Rafail Fridman, Amit Abecasis, Yoni Kasten, and Tali Dekel. Scenescape: Text-driven consistent scene generation. Advances in Neural Information Processing Systems, 36, 2024

    2024

  13. [21]

    Multiresolution tree networks for 3d point cloud processing

    Matheus Gadelha, Rui Wang, and Subhransu Maji. Multiresolution tree networks for 3d point cloud processing. In ECCV, 2018

    2018

  14. [22]

    Cat3d: Create anything in 3d with multi-view diffusion models.arXiv preprint arXiv:2405.10314, 2024

    Ruiqi Gao, Aleksander Holynski, Philipp Henzler, Arthur Brussee, Ricardo Martin-Brualla, Pratul Srinivasan, Jonathan T Barron, and Ben Poole. Cat3d: Create anything in 3d with multi-view diffusion models.arXiv preprint arXiv:2405.10314, 2024

    2024 arXiv

  15. [23]

    What does attention in neural machine translation pay attention to? arXiv preprint arXiv:1710.03348, 2017

    Hamidreza Ghader and Christof Monz. What does attention in neural machine translation pay attention to? arXiv preprint arXiv:1710.03348, 2017

    2017 arXiv

  16. [24]

    Diffportrait3d: Controllable diffusion for zero-shot portrait view synthesis

    Yuming Gu, Hongyi Xu, You Xie, Guoxian Song, Yichun Shi, Di Chang, Jing Yang, and Linjie Luo. Diffportrait3d: Controllable diffusion for zero-shot portrait view synthesis. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10456–10465, 2024

    2024

  17. [25]

    Animatediff: Animate your personalized text-to-image diffusion models without specific tuning

    Yuwei Guo, Ceyuan Yang, Anyi Rao, Zhengyang Liang, Yaohui Wang, Yu Qiao, Maneesh Agrawala, Dahua Lin, and Bo Dai. Animatediff: Animate your personalized text-to-image diffusion models without specific tuning. International Conference on Learning Representations, 2024

    2024

  18. [26]

    R. I. Hartley and A. Zisserman.Multiple View Geometry in Computer Vision. Cambridge University Press, ISBN: 0521540518, second edition, 2004

    2004

  19. [27]

    Cameractrl: Enabling camera control for text-to-video generation.arXiv preprint arXiv:2404.02101, 2024

    Hao He, Yinghao Xu, Yuwei Guo, Gordon Wetzstein, Bo Dai, Hongsheng Li, and Ceyuan Yang. Cameractrl: Enabling camera control for text-to-video generation.arXiv preprint arXiv:2404.02101, 2024

    2024 arXiv

  20. [28]

    Gans trained by a two time-scale update rule converge to a local nash equilibrium

    Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. Gans trained by a two time-scale update rule converge to a local nash equilibrium. 2017

    2017

  21. [29]

    Sith: Single-view textured human reconstruction with image-conditioned diffusion

    I Ho, Jie Song, Otmar Hilliges, et al. Sith: Single-view textured human reconstruction with image-conditioned diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 538–549, 2024

    2024

  22. [30]

    Classifier-free diffusion guidance

    Jonathan Ho and Tim Salimans. Classifier-free diffusion guidance. InNeurIPS 2021 Workshop on Deep Generative Models and Downstream Applications, 2022

    2021

  23. [31]

    Denoising diffusion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. 2020

    2020

  24. [32]

    Mv-adapter: Multi-view consistent image generation made easy.arXiv preprint arXiv:2412.03632, 2024

    Zehuan Huang, Yuanchen Guo, Haoran Wang, Ran Yi, Lizhuang Ma, Yan-Pei Cao, and Lu Sheng. Mv-adapter: Multi-view consistent image generation made easy.arXiv preprint arXiv:2412.03632, 2024

    2024 arXiv

  25. [33]

    Epidiff: Enhancing multi-view synthesis via localized epipolar-constrained diffusion

    Zehuan Huang, Hao Wen, Junting Dong, Yaohui Wang, Yangguang Li, Xinyuan Chen, Yan-Pei Cao, Ding Liang, Yu Qiao, Bo Dai, et al. Epidiff: Enhancing multi-view synthesis via localized epipolar-constrained diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and...

    2024

  26. [34]

    Humanrf: High-fidelity neural radiance fields for humans in motion.ACM Transactions on Graphics (TOG), 42(4):1–12, 2023

    Mustafa Işık, Martin Rünz, Markos Georgopoulos, Taras Khakhulin, Jonathan Starck, Lourdes Agapito, and Matthias Nießner. Humanrf: High-fidelity neural radiance fields for humans in motion.ACM Transactions on Graphics (TOG), 42(4):1–12, 2023. doi: 10.1145/3592415.https://doi.or...

    2023 doi

  27. [35]

    Training-free diffusion model adaptation for variable-sized text-to-image synthesis, 2023.https://arxiv.org/abs/2306.08645

    Zhiyu Jin, Xuli Shen, Bin Li, and Xiangyang Xue. Training-free diffusion model adaptation for variable-sized text-to-image synthesis, 2023.https://arxiv.org/abs/2306.08645

    2023 arXiv

  28. [36]

    invs: Repurposing diffusion inpainters for novel view synthesis

    Yash Kant, Aliaksandr Siarohin, Michael Vasilkovsky, Riza Alp Guler, Jian Ren, Sergey Tulyakov, and Igor Gilitschenski. invs: Repurposing diffusion inpainters for novel view synthesis. In SIGGRAPH Asia 2023 Conference Papers, 2023

    2023

  29. [37]

    Spad: Spatially aware multi-view diffusers

    Yash Kant, Aliaksandr Siarohin, Ziyi Wu, Michael Vasilkovsky, Guocheng Qian, Jian Ren, Riza Alp Guler, Bernard Ghanem, Sergey Tulyakov, and Igor Gilitschenski. Spad: Spatially aware multi-view diffusers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern ...

    2024

  30. [38]

    A style-based generator architecture for generative adversarial networks

    Tero Karras, Samuli Laine, and Timo Aila. A style-based generator architecture for generative adversarial networks. InCVPR, 2019

    2019

  31. [39]

    Sapiens: Foundation for human vision models

    Rawal Khirodkar, Timur Bagautdinov, Julieta Martinez, Su Zhaoen, Austin James, Peter Selednik, Stuart Anderson, and Shunsuke Saito. Sapiens: Foundation for human vision models. InEuropean Conference on Computer Vision, pages 206–228. Springer, 2025

    2025

  32. [40]

    Nersemble: Multi-view radiance field reconstruction of human heads.ACM Transactions on Graphics (TOG), 42(4):1–14, 2023

    Tobias Kirschstein, Shenhan Qian, Simon Giebenhain, Tim Walter, and Matthias Nießner. Nersemble: Multi-view radiance field reconstruction of human heads.ACM Transactions on Graphics (TOG), 42(4):1–14, 2023

    2023

  33. [41]

    Flux model, 2024.https://github.com/black-forest-labs/flux

    Black Forest Labs. Flux model, 2024.https://github.com/black-forest-labs/flux. Accessed: 2024-11-10

    2024

  34. [42]

    Grounding image matching in 3d with mast3r, 2024

    Vincent Leroy, Yohann Cabon, and Jerome Revaud. Grounding image matching in 3d with mast3r, 2024

    2024

  35. [43]

    Spherehead: Stable 3d full-head synthesis with spherical tri-plane representation

    Heyuan Li, Ce Chen, Tianhao Shi, Yuda Qiu, Sizhe An, Guanying Chen, and Xiaoguang Han. Spherehead: Stable 3d full-head synthesis with spherical tri-plane representation. InEuropean Conference on Computer Vision, pages 324–341. Springer, 2025

    2025

  36. [44]

    Era3d: High-resolution multiview diffusion using efficient row-wise attention, 2024.https://arxiv.org/abs/2405.11616

    Peng Li, Yuan Liu, Xiaoxiao Long, Feihu Zhang, Cheng Lin, Mengfei Li, Xingqun Qi, Shanghang Zhang, Wenhan Luo, Ping Tan, Wenping Wang, Qifeng Liu, and Yike Guo. Era3d: High-resolution multiview diffusion using efficient row-wise attention, 2024.https://arxiv.org/abs/2405.11616. 17

    2024 arXiv

  37. [45]

    Magic3d: High-resolution text-to-3d content creation

    Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, and Tsung-Yi Lin. Magic3d: High-resolution text-to-3d content creation. InCVPR, 2023

    2023

  38. [46]

    Coco-gan: Generation by parts via conditional coordinating

    Chieh Hubert Lin, Chia-Che Chang, Yu-Sheng Chen, Da-Cheng Juan, Wei Wei, and Hwann-Tzong Chen. Coco-gan: Generation by parts via conditional coordinating. InICCV, 2019

    2019

  39. [47]

    Zero-1-to-3: Zero-shot one image to 3d object

    Ruoshi Liu, Rundi Wu, Basile Van Hoorick, Pavel Tokmakov, Sergey Zakharov, and Carl Vondrick. Zero-1-to-3: Zero-shot one image to 3d object. InICCV, 2023

    2023

  40. [48]

    Wonder3d: Single image to 3d using cross-domain diffusion, 2023

    Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, and Wenping Wang. Wonder3d: Single image to 3d using cross-domain diffusion, 2023. https://arxiv.org/abs/2310.15008

    2023 arXiv

  41. [49]

    Jewett, Simon Venshtain, Christopher Heilman, Yueh-Tung Chen, Sidi Fu, Mohamed Ezzeldin A

    Julieta Martinez, Emily Kim, Javier Romero, Timur Bagautdinov, Shunsuke Saito, Shoou-I Yu, Stuart Anderson, Michael Zollhöfer, Te-Li Wang, Shaojie Bai, Chenghui Li, Shih-En Wei, Rohan Joshi, Wyatt Borsos, Tomas Simon, Jason Saragih, Paul Theodosis, Alexander Greene, Anjani Jos...

    2024

  42. [50]

    Diffrf: Rendering-guided 3d radiance field diffusion

    Norman Müller, Yawar Siddiqui, Lorenzo Porzi, Samuel Rota Bulo, Peter Kontschieder, and Matthias Nießner. Diffrf: Rendering-guided 3d radiance field diffusion. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4328–4338, 2023

    2023

  43. [51]

    Multidiff: Consistent novel view synthesis from a single image

    Norman Müller, Katja Schwarz, Barbara Rössle, Lorenzo Porzi, Samuel Rota Bulò, Matthias Nießner, and Peter Kontschieder. Multidiff: Consistent novel view synthesis from a single image. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1...

    2024

  44. [52]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timothée Darcet, Théo Moutakanni, Huy Vo, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023

    2023 arXiv

  45. [53]

    RenderMe-360: Large digital asset library and benchmark towards high-fidelity head avatars

    Dongwei Pan, Long Zhuo, Jingtan Piao, Huiwen Luo, Wei Cheng, Yuxin Wang, Siming Fan, Shengqi Liu, Lei Yang, Bo Dai, Ziwei Liu, Chen Change Loy, Chen Qian, Wayne Wu, Dahua Lin, and Kwan-Yee Lin. RenderMe-360: Large digital asset library and benchmark towards high-fidelity head ...

    2023

  46. [54]

    Nerfies: Deformable neural radiance fields

    Keunhong Park, Utkarsh Sinha, Jonathan T Barron, Sofien Bouaziz, Dan B Goldman, Steven M Seitz, and Ricardo Martin-Brualla. Nerfies: Deformable neural radiance fields. InICCV, 2021

    2021

  47. [55]

    Scalable diffusion models with transformers

    William Peebles and Saining Xie. Scalable diffusion models with transformers. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 4195–4205, 2023

    2023

  48. [56]

    Yarn: Efficient context window extension of large language models.arXiv preprint arXiv:2309.00071, 2023

    Bowen Peng, Jeffrey Quesnelle, Honglu Fan, and Enrico Shippole. Yarn: Efficient context window extension of large language models.arXiv preprint arXiv:2309.00071, 2023

    2023 arXiv

  49. [57]

    Barron, and Ben Mildenhall

    Ben Poole, Ajay Jain, Jonathan T. Barron, and Ben Mildenhall. Dreamfusion: Text-to-3d using 2d diffusion. In ICLR, 2023

    2023

  50. [58]

    3dgs-avatar: Animatable avatars via deformable 3d gaussian splatting

    Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, and Siyu Tang. 3dgs-avatar: Animatable avatars via deformable 3d gaussian splatting. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 5020–5030, 2024

    2024

  51. [59]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. 2021

    2021

  52. [60]

    Dreambooth3d: Subject-driven text-to-3d generation

    Amit Raj, Srinivas Kaza, Ben Poole, Michael Niemeyer, Nataniel Ruiz, Ben Mildenhall, Shiran Zada, Kfir Aberman, Michael Rubinstein, Jonathan Barron, et al. Dreambooth3d: Subject-driven text-to-3d generation. arXiv preprint arXiv:2303.13508, 2023

    2023 arXiv

  53. [61]

    Hierarchical text-conditional image generation with clip latents.arXiv preprint arXiv:2204.06125, 2022

    Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, and Mark Chen. Hierarchical text-conditional image generation with clip latents.arXiv preprint arXiv:2204.06125, 2022

    2022 arXiv

  54. [62]

    High-resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High-resolution image synthesis with latent diffusion models. InCVPR, 2022

    2022

  55. [63]

    Pifu: Pixel-aligned implicit function for high-resolution clothed human digitization

    Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Morishima, Angjoo Kanazawa, and Hao Li. Pifu: Pixel-aligned implicit function for high-resolution clothed human digitization. InCVPR, 2019. 18

    2019

  56. [64]

    Pifuhd: Multi-level pixel-aligned implicit function for high-resolution 3d human digitization

    Shunsuke Saito, Tomas Simon, Jason Saragih, and Hanbyul Joo. Pifuhd: Multi-level pixel-aligned implicit function for high-resolution 3d human digitization. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 84–93, 2020

    2020

  57. [65]

    Zeronvs: Zero-shot 360-degree view synthesis from a single real image

    Kyle Sargent, Zizhang Li, Tanmay Shah, Charles Herrmann, Hong-Xing Yu, Yunzhi Zhang, Eric Ryan Chan, Dmitry Lagun, Li Fei-Fei, Deqing Sun, et al. Zeronvs: Zero-shot 360-degree view synthesis from a single real image. arXiv preprint arXiv:2310.17994, 2023

    arXiv

  58. [66]

    Superglue: Learning feature matching with graph neural networks

    Paul-Edouard Sarlin, Daniel DeTone, Tomasz Malisiewicz, and Andrew Rabinovich. Superglue: Learning feature matching with graph neural networks. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4938–4947, 2020

    2020

  59. [67]

    Structure-from-motion revisited

    Johannes Lutz Schönberger and Jan-Michael Frahm. Structure-from-motion revisited. InCVPR, 2016

    2016

  60. [68]

    Facenet: A unified embedding for face recognition and clustering

    Florian Schroff, Dmitry Kalenichenko, and James Philbin. Facenet: A unified embedding for face recognition and clustering. InProceedings of the IEEE conference on computer vision and pattern recognition, pages 815–823, 2015

    2015

  61. [69]

    Laion-5b: An open large-scale dataset for training next generation image-text models

    Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, et al. Laion-5b: An open large-scale dataset for training next generation image-text models. 2022

    2022

  62. [70]

    Diffhuman: Probabilistic photorealistic 3d reconstruction of humans

    Akash Sengupta, Thiemo Alldieck, Nikos Kolotouros, Enric Corona, Andrei Zanfir, and Cristian Sminchisescu. Diffhuman: Probabilistic photorealistic 3d reconstruction of humans. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 1439–1449, 2024

    2024

  63. [71]

    Genwarp: Single image to novel views with semantic-preserving generative warping

    Junyoung Seo, Kazumi Fukuda, Takashi Shibuya, Takuya Narihira, Naoki Murata, Shoukang Hu, Chieh-Hsin Lai, Seungryong Kim, and Yuki Mitsufuji. Genwarp: Single image to novel views with semantic-preserving generative warping. arXiv preprint arXiv:2405.17251, 2024

    2024 arXiv

  64. [72]

    Anything-3d: Towards single-view anything reconstruction in the wild

    Qiuhong Shen, Xingyi Yang, and Xinchao Wang. Anything-3d: Towards single-view anything reconstruction in the wild. arXiv preprint arXiv:2304.10261, 2023

    2023 arXiv

  65. [73]

    Mvdream: Multi-view diffusion for 3d generation

    Yichun Shi, Peng Wang, Jianglong Ye, Mai Long, Kejie Li, and Xiao Yang. Mvdream: Multi-view diffusion for 3d generation. arXiv preprint arXiv:2308.16512, 2023

    2023 arXiv

  66. [74]

    Implicit neural representations with periodic activation functions

    Vincent Sitzmann, Julien Martel, Alexander Bergman, David Lindell, and Gordon Wetzstein. Implicit neural representations with periodic activation functions. 2020

    2020

  67. [75]

    Light field networks: Neural scene representations with single-evaluation rendering

    Vincent Sitzmann, Semon Rezchikov, Bill Freeman, Josh Tenenbaum, and Fredo Durand. Light field networks: Neural scene representations with single-evaluation rendering. 2021

    2021

  68. [76]

    Deep unsupervised learning using nonequilibrium thermodynamics

    Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli. Deep unsupervised learning using nonequilibrium thermodynamics. 2015

    2015

  69. [77]

    Danbo: Disentangled articulated neural body repre- sentations via graph neural networks

    Shih-Yang Su, Timur Bagautdinov, and Helge Rhodin. Danbo: Disentangled articulated neural body repre- sentations via graph neural networks. InEuropean Conference on Computer Vision, pages 107–124. Springer, 2022

    2022

  70. [78]

    Npc: Neural point characters from video

    Shih-Yang Su, Timur Bagautdinov, and Helge Rhodin. Npc: Neural point characters from video. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 14795–14805, 2023

    2023

  71. [79]

    Variational autoencoders for deforming 3d mesh models

    Qingyang Tan, Lin Gao, Yu-Kun Lai, and Shihong Xia. Variational autoencoders for deforming 3d mesh models. In CVPR, 2018

    2018

  72. [80]

    Make-it-3d: High-fidelity 3d creation from a single image with diffusion prior

    Junshu Tang, Tengfei Wang, Bo Zhang, Ting Zhang, Ran Yi, Lizhuang Ma, and Dong Chen. Make-it-3d: High-fidelity 3d creation from a single image with diffusion prior. 2023

    2023

  73. [81]

    Textmesh: Generation of realistic 3d meshes from text prompts

    Christina Tsalicoglou, Fabian Manhardt, Alessio Tonioni, Michael Niemeyer, and Federico Tombari. Textmesh: Generation of realistic 3d meshes from text prompts. 2023

    2023

  74. [82]

    Attention is all you need.Advances in Neural Information Processing Systems, 2017

    A Vaswani. Attention is all you need.Advances in Neural Information Processing Systems, 2017

    2017

  75. [83]

    softmax is not enough (for sharp out-of-distribution), 2024.https://arxiv.org/abs/2410.01104

    Petar Veličković, Christos Perivolaropoulos, Federico Barbero, and Razvan Pascanu. softmax is not enough (for sharp out-of-distribution), 2024.https://arxiv.org/abs/2410.01104

    2024 arXiv

  76. [84]

    Dust3r: Geometric 3d vision made easy

    Shuzhe Wang, Vincent Leroy, Yohann Cabon, Boris Chidlovskii, and Jerome Revaud. Dust3r: Geometric 3d vision made easy. InCVPR, 2024

    2024

  77. [85]

    Rodin: A generative model for sculpting 3d digital avatars using diffusion

    Tengfei Wang, Bo Zhang, Ting Zhang, Shuyang Gu, Jianmin Bao, Tadas Baltrusaitis, Jingjing Shen, Dong Chen, Fang Wen, Qifeng Chen, et al. Rodin: A generative model for sculpting 3d digital avatars using diffusion. In CVPR, 2023

    2023

  78. [86]

    4d-dress: A 4d dataset of real-world human clothing with semantic annotations

    Wenbo Wang, Hsuan-I Ho, Chen Guo, Boxiang Rong, Artur Grigorev, Jie Song, Juan Jose Zarate, and Otmar Hilliges. 4d-dress: A 4d dataset of real-world human clothing with semantic annotations. InProceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024

    2024

  79. [87]

    Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distillation

    Zhengyi Wang, Cheng Lu, Yikai Wang, Fan Bao, Chongxuan Li, Hang Su, and Jun Zhu. Prolificdreamer: High-fidelity and diverse text-to-3d generation with variational score distillation. 2023

    2023

  80. [88]

    Motionctrl: A unified and flexible motion controller for video generation

    Zhouxia Wang, Ziyang Yuan, Xintao Wang, Yaowei Li, Tianshui Chen, Menghan Xia, Ping Luo, and Ying Shan. Motionctrl: A unified and flexible motion controller for video generation. InACM SIGGRAPH 2024 Conference Papers, pages 1–11, 2024. 19

    2024

  81. [89]

    Gomavatar: Efficient animatable human modeling from monocular video using gaussians-on-mesh

    Jing Wen, Xiaoming Zhao, Zhongzheng Ren, Alexander G Schwing, and Shenlong Wang. Gomavatar: Efficient animatable human modeling from monocular video using gaussians-on-mesh. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2059–2069, 2024

    2024

  82. [90]

    Humannerf: Free-viewpoint rendering of moving people from monocular video

    Chung-Yi Weng, Brian Curless, Pratul P Srinivasan, Jonathan T Barron, and Ira Kemelmacher-Shlizerman. Humannerf: Free-viewpoint rendering of moving people from monocular video. InCVPR, 2022

    2022

  83. [91]

    Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling

    Jiajun Wu, Chengkai Zhang, Tianfan Xue, Bill Freeman, and Josh Tenenbaum. Learning a probabilistic latent space of object shapes via 3d generative-adversarial modeling. 2016

    2016

  84. [92]

    Detectron2.https://github

    Yuxin Wu, Alexander Kirillov, Francisco Massa, Wan-Yen Lo, and Ross Girshick. Detectron2.https://github. com/facebookresearch/detectron2, 2019

    2019

  85. [93]

    Learning descriptor networks for 3d shape synthesis and analysis

    Jianwen Xie, Zilong Zheng, Ruiqi Gao, Wenguan Wang, Song-Chun Zhu, and Ying Nian Wu. Learning descriptor networks for 3d shape synthesis and analysis. InCVPR, 2018

    2018

  86. [94]

    Mvhumannet: A large-scale dataset of multi-view daily dressing human captures

    Zhangyang Xiong, Chenghong Li, Kenkun Liu, Hongjie Liao, Jianqiao Hu, Junyi Zhu, Shuliang Ning, Lingteng Qiu, Chongjie Wang, Shijie Wang, et al. Mvhumannet: A large-scale dataset of multi-view daily dressing human captures. In Proceedings of the IEEE/CVF Conference on Computer...

    2024

  87. [95]

    Neurallift-360: Lifting an in-the-wild 2d photo to a 3d object with 360deg views

    Dejia Xu, Yifan Jiang, Peihao Wang, Zhiwen Fan, Yi Wang, and Zhangyang Wang. Neurallift-360: Lifting an in-the-wild 2d photo to a 3d object with 360deg views. InCVPR, 2023

    2023

  88. [96]

    Vasa-1: Lifelike audio-driven talking faces generated in real time.arXiv preprint arXiv:2404.10667, 2024

    Sicheng Xu, Guojun Chen, Yu-Xiao Guo, Jiaolong Yang, Chong Li, Zhenyu Zang, Yizhong Zhang, Xin Tong, and Baining Guo. Vasa-1: Lifelike audio-driven talking faces generated in real time.arXiv preprint arXiv:2404.10667, 2024

    2024 arXiv

  89. [97]

    FaceScape: A large-scale high quality 3D face dataset and detailed riggable 3D face prediction

    Haotian Yang, Hao Zhu, Yanru Wang, Mingkai Huang, Qiu Shen, Ruigang Yang, and Xun Cao. FaceScape: A large-scale high quality 3D face dataset and detailed riggable 3D face prediction. InProceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 2020

    2020

  90. [98]

    i3DMM: Deep implicit 3D morphable model of human heads

    T Yenamandra, A Tewari, F Bernard, HP Seidel, M Elgharib, D Cremers, and C Theobalt. i3DMM: Deep implicit 3D morphable model of human heads. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 2021

    2021

  91. [99]

    Long-term photometric consistent novel view synthesis with diffusion models

    Jason J Yu, Fereshteh Forghani, Konstantinos G Derpanis, and Marcus A Brubaker. Long-term photometric consistent novel view synthesis with diffusion models. InICCV, 2023

    2023

  92. [100]

    HUMBI: A large multiview dataset of human body expressions

    Zhixuan Yu, Jae Shin Yoon, In Kyu Lee, Prashanth Venkatesh, Jaesik Park, Jihun Yu, and Hyun Soo Park. HUMBI: A large multiview dataset of human body expressions. InProceedings of IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 2020

    2020

  93. [101]

    Scaling vision transformers

    Xiaohua Zhai, Alexander Kolesnikov, Neil Houlsby, and Lucas Beyer. Scaling vision transformers. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 12104–12113, 2022

    2022

  94. [102]

    Metaportrait: Identity-preserving talking head generation with fast personalized adaptation

    Bowen Zhang, Chenyang Qi, Pan Zhang, Bo Zhang, HsiangTao Wu, Dong Chen, Qifeng Chen, Yong Wang, and Fang Wen. Metaportrait: Identity-preserving talking head generation with fast personalized adaptation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern R...

    2023

  95. [103]

    Adding conditional control to text-to-image diffusion models, 2023

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models, 2023

    2023

  96. [104]

    Attention entropy is a key factor: An analysis of parallel context encoding with full-attention-based pre-trained language models, 2024.https://arxiv.org/abs/2412.16545

    Zhisong Zhang, Yan Wang, Xinting Huang, Tianqing Fang, Hongming Zhang, Chenlong Deng, Shuaiyi Li, and Dong Yu. Attention entropy is a key factor: An analysis of parallel context encoding with full-attention-based pre-trained language models, 2024.https://arxiv.org/abs/2412.16545

    2024 arXiv

  97. [105]

    Drivable 3d gaussian avatars.arXiv preprint arXiv:2311.08581, 2023

    Wojciech Zielonka, Timur Bagautdinov, Shunsuke Saito, Michael Zollhöfer, Justus Thies, and Javier Romero. Drivable 3d gaussian avatars.arXiv preprint arXiv:2311.08581, 2023. 20 Appendix A DiT Architecture and Training Architecture. We use a Diffusion Transfomer with28 DiT + Co...

    2023 arXiv

  98. [106]

    Pretrained (P 1@256) 1 2.51

  99. [107]

    Pretrained (P 1@512) 1 2.59

  100. [108]

    Mid-trained (M 2@128) 4 6

  101. [109]

    Mid-trained (M 2@128) 48 14

  102. [110]

    Post-trained (P 3@512) 4 40

  103. [111]

    Post-trained (P 3@512) 48 490

  104. [112]

    Post-trained (P 3@1K) 4 185

  105. [113]

    We show inference speed without any optimizations (using bfloat16) against varying resolution and number of views being generated

    Post-trained (P 3@1K) 12 622 Table 8 Inference Speed of Pippo. We show inference speed without any optimizations (using bfloat16) against varying resolution and number of views being generated. Attention Biasing. To compute the entropy (shown in Fig. 4), we use the first, midd...

Pith tools

Reviewed August 8, 2026 · model on record in the stance chip above.