REVIEW 4 major objections 4 minor 1 cited by
The authors claim that distilling a 2D diffusion-based facial animator into a feed-forward Gaussian-splatting avatar resolves the portrait-animation trilemma: expressive detail, 3D consistency, and real-time speed (over 100 FPS) from a sing
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
A single-photo avatar encoder with per-Gaussian feature-space deformation animates faces at 107 FPS with expression quality competitive with diffusion models.
T0 review reviewed 2026-08-03 challenge →
load-bearing objection Solid systems paper that convincingly shows a 3D Gaussian avatar can hit 107 FPS with diffusion-level expression transfer, but the cross-reenactment generalization of the motion decoder is under-tested and the evaluation reporting could be tighter. the 4 major comments →
Instant Expressive Gaussian Head Avatars at Over 100 FPS
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
Core claim
The central discovery is that expression transfer quality does not require expensive global feature fusion or spatial deformation of Gaussians. Instead, the authors show that deforming each Gaussian's high-dimensional feature vector—conditioned on a per-Gaussian learned motion basis and a frozen motion encoder's 512-dim expression coefficients—captures asymmetric expressions, wrinkles, and shadow changes that spatial deformation misses. The same feature-space deformation also makes animation cheap, so the full pipeline—encoding a single image once, then re-animating it—runs at 107 FPS with state-of-the-art 3D consistency (MEt3R 0.028) and expression-transfer metrics (EMO 0.771, AED 0.745) on
What carries the argument
The load-bearing object is the per-Gaussian motion basis vector, a learned 48-dim code stored alongside each sampled 3D Gaussian, which plays the role of a personalized, spatially-localized 'muscle/PCA basis.' A lightweight motion decoder—a single adaptive-layer-norm modulation followed by a one-hidden-layer MLP—combines this fixed basis with the source and driving expression coefficients (from a frozen pre-trained motion encoder) to predict a residual feature vector, which is added to the Gaussian's triplane-sampled feature before the attribute decoder produces positions, scales, rotations, opacities, and colors. This local, per-primitive fusion avoids the global attention mechanisms used b
Load-bearing premise
The load-bearing premise is that the frozen motion encoder's 512-dimensional expression embedding is expressive and invariant enough to capture every facial motion the avatar must produce—if the encoder collapses two distinct expressions to the same code, the rest of the pipeline cannot recover the difference.
What would settle it
Feed two visually distinct expressions that are perceptibly different but very close in the motion encoder's embedding space into the pipeline (e.g., a one-sided smirk vs. a pursed-lip smile). If the avatar renders them nearly identically, and a human observer cannot tell them apart, then the encoder is the bottleneck and the method's claim of diffusion-level expressiveness is falsified. A more direct check: measure pairwise distances in the 512-dim embedding across a set of diverse expressions; if two clearly different expressions have near-zero distance, the expressiveness ceiling is proven.
If this is right
- If the central claim is correct, real-time applications like telepresence and digital twins can finally use diffusion-level facial expressiveness from a single photo, at interactive rates.
- The same architecture suggests that expensive attention-based global feature fusion is unnecessary for animation; a local per-Gaussian deformation in feature space can carry the full motion signal.
- Since the animation is driven only by a 512-dim motion coefficient vector, the driving signal can be swapped from images to audio or text without changing the 3D representation.
- The 20ms one-time encoding time means the method can bootstrap an avatar for a new identity essentially instantly, removing per-subject optimization or tracking.
Where Pith is reading between the lines
- A corollary the authors leave implicit: the method's expressiveness ceiling is set entirely by the frozen motion encoder, so future improvements to that encoder could be dropped into the pipeline with no retraining of the 3D decoder—making the architecture a modular front-end for expression extraction.
- The feature-space deformation principle may transfer to other structured deformable objects (hands, bodies, cloth), where deforming in learned latent space could be more expressive and cheaper than deforming in physical space.
- One testable extension: the learned motion basis vectors appear semantically localized (similar vectors for mouth/eye regions across subjects), raising the possibility of using them for targeted editing—e.g., suppressing or exaggerating expressions in a face region.
- Because the synthetic training data comes from a diffusion model, the method inherits that model's biases in identity and expression distribution; a real-world deployment would likely need to verify generalization across demographics.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a feed-forward, single-image portrait animation method that converts an input image into an animatable set of 3D Gaussians. The core design is a decoupled animation representation: each Gaussian is associated with a learned motion basis vector, and a lightweight motion decoder predicts per-Gaussian residual features in the triplane feature space, conditioned on 512-D motion coefficients extracted by a frozen X-NeMo encoder. Training distills X-NeMo by constructing a synthetic dataset of frontalized identities with synthesized expressions, then performing self-reenactment with multi-view supervision. The method reports 107.31 FPS for animation and pose control, and Table 1 claims state-of-the-art cross-reenactment MEt3R, EMO, and AED scores among all compared 2D and 3D baselines, with large speedups over diffusion-based methods.
Significance. If the claims hold, the paper addresses a real trilemma in portrait animation: 3D consistency, expression detail, and speed. The proposed feature-space deformation and motion basis vectors are an elegant and relatively simple alternative to expensive global attention-based fusion, and the speed/memory numbers are striking. The paper also includes a substantial empirical comparison, retrains two 3D baselines on the same synthetic data to control for training-set effects, and reports ablations isolating the motion encoder, the synthetic distillation, and the deformation space. These are genuine strengths. However, the central 'best' claims currently rest on single-run aggregate metrics without statistical support, and the cross-reenactment pipeline assumes identity-invariance of a frozen 2D motion encoder in a way that is acknowledged as a theoretical bound but never directly measured.
major comments (4)
- [Table 1 / §5.1] The headline 'best' claims rely on single-run aggregate metrics with no error bars or statistical tests. Several differences are numerically small (cross-reenactment MEt3R 0.028 ties InvertAvatar), while other metrics favor baselines: SSIM 0.8294 vs. 0.8456 and LPIPS 0.1864 vs. 0.1592 for InvertAvatar. Please report per-sequence paired differences, standard deviations across seeds, or bootstrapped confidence intervals for at least MEt3R, EMO, AED, ID, SSIM, and LPIPS, and state which differences are significant. Without this, the 'state-of-the-art' claim is not supportable.
- [§4.1–§4.2 / §5.1] Training uses only same-identity (source, driving) pairs, but the claimed cross-reenactment performance is evaluated on identity-mismatched pairs. The frozen X-NeMo motion encoder M is assumed to be sufficiently identity-invariant and expression-complete for the motion decoder Ψ to transfer expressions across identities; §5.1 only states that the method is 'theoretically bounded by the identity consistency of X-NeMo' without measuring it. This is load-bearing for the central cross-reenactment claim. Please add a controlled test, e.g., same expression and pose across different identities, measure the distance of M(Is), M(Id), or train with cross-identity synthetic pairs to quantify identity leakage and the self-to-cross distribution-shift penalty.
- [§5.2 / Table 2] The ablation that supports the core representation choice—feature-space deformation vs. spatial deformation (AED 0.634 vs. 0.507)—reports no variance or per-sequence statistics. Similarly, the motion-encoder ablation (DINO-v2, AED 0.597) and the real-dataset ablation (AED 0.543) are single numbers. Since these differences are relatively small and the ablation is run at 128×128 without adversarial loss, repeated runs or paired tests are needed to confirm the improvements are not noise.
- [Table 1 / Abstract] The FPS comparison is underspecified. The 107.31 FPS figure appears to be animation-only after a one-time 20 ms encoding, while diffusion baselines at 0.01–0.03 FPS may be measured without sequence amortization, and GAGAvatar/InvertAvatar FPS exclude their morphable-model fitting. Please report the exact measurement protocol: resolution, batch size, GPU (e.g., RTX 6000 Ada), whether the 20 ms encoding is included for all feed-forward methods, and give end-to-end FPS for every baseline. This is necessary to support the '3–4 orders of magnitude' speedup claim.
minor comments (4)
- [§4.1] Typo: '3D Guassians' should be '3D Gaussians'. Also, 'X-Nemo' and 'X-NeMo' are used inconsistently throughout.
- [§4.2] 'over 60,000 real identities from the FFHQ dataset' is imprecise—FFHQ contains 70,000 images, not necessarily identities. Clarify how identities were defined or rephrase as 'images'.
- [Figure 6 / Table 1] The method [98] is called 'HYPortrait' in Fig. 6/Table 1 but 'HunyuanPortrait' in the text; unify the notation.
- [§5.1] The sentence 'we also achieve state-of-the-art MEt3R, EMO, and AED scores across all methods' should acknowledge that MEt3R is tied with InvertAvatar (0.028) rather than strictly better.
Circularity Check
No significant circularity: the distillation teacher bound is explicit and the evaluation is external.
full rationale
The paper's derivation chain is a standard teacher-student distillation: X-NeMo [113] generates a synthetic self-reenactment dataset, the frozen X-NeMo motion encoder M provides motion coefficients, and the learned motion decoder Psi predicts per-Gaussian feature residuals optimized against image-space losses (Eq. 3). None of these steps is defined in terms of the target evaluation quantities. The use of X-NeMo's M at inference does not make the rendered output equal to its input by construction; it sets a teacher-quality upper bound, which the authors explicitly acknowledge: "Our method is also theoretically bounded by the identity consistency of X-NeMo, and the image and 3D quality of LP3D, because of using a synthetic dataset generated from it" (Sec. 5.1). This is an honest limitation of distillation, not a circular reduction. The evaluation is performed on real VOODOO-XP videos with external metrics (SMIRK-based AED, EmoNet EMO, MEt3R, ArcFace ID), not on the training distribution or on the teacher's own outputs. The comparisons against GAGAvatar† and Portrait4D-v2† trained on the same synthetic dataset isolate the contribution of the proposed animation representation. The self-citations, notably [80] (LP3D backbone) and [108] (Gaussian sampling density), refer to published, code-released methods and are not load-bearing justifications of the central claim; no fitted parameter is renamed as a prediction, no uniqueness theorem is imported, and no ansatz is smuggled in via citation. The identity-invariance concern about M raised in the skeptical note is a correctness/generalization risk, not a circularity: it concerns whether the frozen teacher code is expressive and identity-invariant, which is an empirical assumption, not a logical equivalence. Overall, the paper is self-contained against external benchmarks, and no circular step meeting the quoted-evidence standard was found.
Axiom & Free-Parameter Ledger
free parameters (9)
- triplane_channels =
96
- sampling_resolution =
64x64
- rendering_resolution =
512x512
- hidden_units =
96
- loss_weights =
λ_L1=1, λ_LPIPS=1, λ_ID=0.1, λ_Detail=0.1, λ_Norm=0.001, λ_adv=0.025
- learning_rate =
0.0001
- batch_size =
32
- synthetic_dataset_size =
60,000 identities × 8 expressions
- motion_coefficient_dim =
512
axioms (5)
- domain assumption X-NeMo's frozen motion encoder M and its synthetic outputs provide a sufficiently expressive and generalizable motion prior.
- domain assumption LP3D [80] can frontalize images and estimate multi-view images accurately enough to provide consistent 3D supervision.
- domain assumption Self-reenactment on synthetic same-identity pairs generalizes to cross-reenactment and real test distributions.
- domain assumption The local per-Gaussian feature-space deformation is expressive enough to capture facial details such as wrinkles and asymmetric expressions.
- standard math Standard mathematical background of neural rendering, Gaussian splatting, and deep learning optimization.
invented entities (2)
-
Motion basis vector m_i
no independent evidence
-
Feature-space deformation
no independent evidence
Cite this review
Pith. "Pith review of Instant Expressive Gaussian Head Avatars at Over 100 FPS." pith.science (2026). https://pith.science/paper/ED7OVDRY
@misc{pith2026251216893,
author = {Pith},
title = {Pith review of: Instant Expressive Gaussian Head Avatars at Over 100 FPS},
year = {2026},
howpublished = {\url{https://pith.science/paper/ED7OVDRY}},
note = {Machine review of arXiv:2512.16893}
}
read the original abstract
Portrait animation has witnessed tremendous quality improvements thanks to recent advances in video diffusion models. However, these 2D methods often compromise 3D consistency and speed, limiting their applicability in real-world scenarios, such as digital twins or telepresence. In contrast, 3D-aware feedforward facial animation methods -- built upon 3D representations, such as neural radiance fields or Gaussian splatting -- ensure 3D consistency and achieve faster inference speed, but come with inferior expression details. In this paper, we address this portrait animation trilemma (speed, 3D consistency, and expressiveness) and propose a pipeline that instantly converts an in-the-wild single image into a 3D-consistent, fast yet expressive animatable representation via a feed-forward encoder. Unlike previous computationally intensive global fusion mechanisms (e.g., multiple attention layers) for fusing 3D structural and animation information, our design employs an efficient lightweight local fusion strategy to achieve high animation expressivity. Furthermore, our animation representation is decoupled from the face's 3D representation and learns motion implicitly from data, eliminating the dependency on pre-defined parametric models that often constrain animation capabilities. Our method runs at 107.31 FPS for animation and pose control, representing a 3-4 order of magnitude speedup versus the state of the art while achieving comparable animation quality, thus surpassing alternative designs that trade speed for quality or vice versa.
Figures
Forward citations
Cited by 1 Pith paper
-
Split and Drive: Dual-Axis Disentanglement for Real-Time Gaussian Head Avatars
A single-image 3DGS head avatar with internalized motion encoding and three region-specialized Gaussian branches runs real-time end-to-end and matches or beats recent baselines on reenactment metrics.
Reference graph
Works this paper leans on
-
[1]
Scaffoldavatar: High-fidelity gaussian avatars with patch expressions
Shivangi Aneja, Sebastian Weiss, Irene Baeza, Prashanth Chandran, Gaspard Zoss, Matthias Nießner, and Derek Bradley. Scaffoldavatar: High-fidelity gaussian avatars with patch expressions. InProceedings of the Special Interest Group on Computer Graphics and Interactive Techniques Conference Conference Papers, pages 1–11, 2025. 2, 3
2025
-
[2]
Met3r: Measuring multi-view consistency in generated images
Mohammad Asim, Christopher Wewer, Thomas Wimmer, Bernt Schiele, and Jan Eric Lenssen. Met3r: Measuring multi-view consistency in generated images. InComputer Vision and Pattern Recognition (CVPR), 2024. 6
2024
-
[3]
Gaussian splatting de- coder for 3d-aware generative adversarial networks
Florian Barthel, Arian Beckmann, Wieland Morgenstern, Anna Hilsmann, and Peter Eisert. Gaussian splatting de- coder for 3d-aware generative adversarial networks. InPro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7963–7972, 2024. 4
2024
-
[4]
A morphable model for the synthesis of 3d faces
V olker Blanz and Thomas Vetter. A morphable model for the synthesis of 3d faces. InProceedings of SIGGRAPH,
-
[5]
Neural head reenactment with latent pose descriptors
Egor Burkov, Igor Pasechnik, Artur Grigorev, and Vic- tor Lempitsky. Neural head reenactment with latent pose descriptors. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 13786– 13795, 2020. 2
2020
-
[6]
Hexplane: A fast representa- tion for dynamic scenes
Ang Cao and Justin Johnson. Hexplane: A fast representa- tion for dynamic scenes. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 130–141, 2023. 3
2023
-
[7]
Chenjie Cao, Jingkai Zhou, Shikai Li, Jingyun Liang, Chaohui Yu, Fan Wang, Xiangyang Xue, and Yanwei Fu. Uni3c: Unifying precisely 3d-enhanced camera and hu- man motion controls for video generation.arXiv preprint arXiv:2504.14899, 2025. 2
arXiv 2025
-
[8]
Efficient geometry-aware 3d generative adversar- ial networks
Eric R Chan, Connor Z Lin, Matthew A Chan, Koki Nagano, Boxiao Pan, Shalini De Mello, Orazio Gallo, Leonidas J Guibas, Jonathan Tremblay, Sameh Khamis, et al. Efficient geometry-aware 3d generative adversar- ial networks. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 16123– 16133, 2022. 2, 3, 4
2022
-
[9]
Echomimic: Lifelike audio-driven por- trait animations through editable landmark conditions
Zhiyuan Chen, Jiajiong Cao, Zhiquan Chen, Yuming Li, and Chenguang Ma. Echomimic: Lifelike audio-driven por- trait animations through editable landmark conditions. In Proceedings of the AAAI Conference on Artificial Intelli- gence, pages 2403–2410, 2025. 3
2025
-
[10]
Gang Cheng, Xin Gao, Li Hu, Siqi Hu, Mingyang Huang, Chaonan Ji, Ju Li, Dechao Meng, Jinwei Qi, Penchong Qiao, et al. Wan-animate: Unified character animation and replacement with holistic replication.arXiv preprint arXiv:2509.14055, 2025. 2
arXiv 2025
-
[11]
Generalizable and ani- matable gaussian head avatar.Advances in Neural Informa- tion Processing Systems, 37:57642–57670, 2024
Xuangeng Chu and Tatsuya Harada. Generalizable and ani- matable gaussian head avatar.Advances in Neural Informa- tion Processing Systems, 37:57642–57670, 2024. 1, 2, 3, 4, 7, 8
2024
-
[12]
Gpavatar: Generaliz- able and precise head avatar from image(s)
Xuangeng Chu, Yu Li, Ailing Zeng, Tianyu Yang, Lijian Lin, Yunfei Liu, and Tatsuya Harada. Gpavatar: Generaliz- able and precise head avatar from image(s). 2024. 2
2024
-
[13]
Hallo3: Highly dynamic and realistic portrait image animation with video diffusion transformer
Jiahao Cui, Hui Li, Yun Zhan, Hanlin Shang, Kaihui Cheng, Yuqi Ma, Shan Mu, Hang Zhou, Jingdong Wang, and Siyu Zhu. Hallo3: Highly dynamic and realistic portrait image animation with video diffusion transformer. InProceed- ings of the Computer Vision and Pattern Recognition Con- ference, pages 21086–21095, 2025. 2, 3
2025
-
[14]
Arcface: Additive angular margin loss for deep face recognition
Jiankang Deng, Jia Guo, Niannan Xue, and Stefanos Zafeiriou. Arcface: Additive angular margin loss for deep face recognition. InProceedings of the IEEE/CVF con- ference on computer vision and pattern recognition, pages 4690–4699, 2019. 6
2019
-
[15]
Learning one-shot 4d head avatar synthe- sis using synthetic data.arXiv preprint arXiv:2311.18729,
Yu Deng, Duomin Wang, Xiaohang Ren, Xingyu Chen, and Baoyuan Wang. Learning one-shot 4d head avatar synthe- sis using synthetic data.arXiv preprint arXiv:2311.18729,
-
[16]
Portrait4d- v2: Pseudo multi-view data creates better 4d head synthe- sizer.arXiv, 2024
Yu Deng, Duomin Wang, and Baoyuan Wang. Portrait4d- v2: Pseudo multi-view data creates better 4d head synthe- sizer.arXiv, 2024. 1, 2, 3, 4, 5, 7, 8
2024
-
[17]
Headgan: One-shot neural head synthesis and editing
Michail Christos Doukas, Stefanos Zafeiriou, and Viktoriia Sharmanska. Headgan: One-shot neural head synthesis and editing. InProceedings of the IEEE/CVF International con- ference on Computer Vision, pages 14398–14407, 2021. 2
2021
-
[18]
Megaportraits: One-shot megapixel neural head avatars
Nikita Drobyshev, Jenya Chelishev, Taras Khakhulin, Alek- sei Ivakhnenko, Victor Lempitsky, and Egor Zakharov. Megaportraits: One-shot megapixel neural head avatars. In Proceedings of the 30th ACM International Conference on Multimedia, pages 2663–2671, 2022
2022
-
[19]
Emoportraits: Emotion-enhanced multimodal one- shot head avatars
Nikita Drobyshev, Antoni Bigata Casademunt, Konstanti- nos V ougioukas, Zoe Landgraf, Stavros Petridis, and Maja Pantic. Emoportraits: Emotion-enhanced multimodal one- shot head avatars. InProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 8498–8507, 2024. 2, 5
2024
-
[20]
3d morphable face models—past, present, and future.ACM Transactions on Graphics (ToG), 39(5):1–38,
Bernhard Egger, William AP Smith, Ayush Tewari, Ste- fanie Wuhrer, Michael Zollhoefer, Thabo Beeler, Florian Bernard, Timo Bolkart, Adam Kortylewski, Sami Romd- hani, et al. 3d morphable face models—past, present, and future.ACM Transactions on Graphics (ToG), 39(5):1–38,
-
[21]
Fast dynamic radiance fields with time-aware neural vox- els
Jiemin Fang, Taoran Yi, Xinggang Wang, Lingxi Xie, Xi- aopeng Zhang, Wenyu Liu, Matthias Nießner, and Qi Tian. Fast dynamic radiance fields with time-aware neural vox- els. InSIGGRAPH Asia 2022 Conference Papers, pages 1–9, 2022. 3
2022
-
[22]
High-fidelity and freely controllable talking head video generation
Yue Gao, Yuan Zhou, Jinglu Wang, Xiao Li, Xiang Ming, and Yan Lu. High-fidelity and freely controllable talking head video generation. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5609–5619, 2023. 2 9
2023
-
[23]
Mononphm: Dynamic head reconstruction from monocular videos
Simon Giebenhain, Tobias Kirschstein, Markos Geor- gopoulos, Martin R ¨unz, Lourdes Agapito, and Matthias Nießner. Mononphm: Dynamic head reconstruction from monocular videos. InProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 10747–10758, 2024. 3
2024
-
[24]
Npga: Neural para- metric gaussian avatars.arXiv preprint arXiv:2405.19331,
Simon Giebenhain, Tobias Kirschstein, Martin R ¨unz, Lour- des Agapito, and Matthias Nießner. Npga: Neural para- metric gaussian avatars.arXiv preprint arXiv:2405.19331,
-
[25]
Generative adversarial nets.Advances in neural information processing systems, 27, 2014
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets.Advances in neural information processing systems, 27, 2014. 2
2014
-
[26]
Jianzhu Guo, Dingyun Zhang, Xiaoqiang Liu, Zhizhou Zhong, Yuan Zhang, Pengfei Wan, and Di Zhang. Live- portrait: Efficient portrait animation with stitching and re- targeting control.arXiv preprint arXiv:2407.03168, 2024. 1, 2, 7
Pith/arXiv arXiv 2024
-
[27]
Yisheng He, Xiaodong Gu, Xiaodan Ye, Chao Xu, Zhengyi Zhao, Yuan Dong, Weihao Yuan, Zilong Dong, and Liefeng Bo. Lam: Large avatar model for one-shot animatable gaus- sian head.arXiv preprint arXiv:2502.17796, 2025. 3
Pith/arXiv arXiv 2025
-
[28]
Denoising dif- fusion probabilistic models.Advances in neural informa- tion processing systems, 33:6840–6851, 2020
Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising dif- fusion probabilistic models.Advances in neural informa- tion processing systems, 33:6840–6851, 2020. 2
2020
-
[29]
Sc-gs: Sparse-controlled gaussian splatting for editable dynamic scenes
Yi-Hua Huang, Yang-Tian Sun, Ziyi Yang, Xiaoyang Lyu, Yan-Pei Cao, and Xiaojuan Qi. Sc-gs: Sparse-controlled gaussian splatting for editable dynamic scenes. InProceed- ings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4220–4230, 2024. 4
2024
-
[30]
Distilling diffusion models into conditional gans
Minguk Kang, Richard Zhang, Connelly Barnes, Sylvain Paris, Suha Kwak, Jaesik Park, Eli Shechtman, Jun-Yan Zhu, and Taesung Park. Distilling diffusion models into conditional gans. InEuropean Conference on Computer Vision, pages 428–447. Springer, 2024. 3
2024
-
[31]
A style-based generator architecture for generative adversarial networks
Tero Karras, Samuli Laine, and Timo Aila. A style-based generator architecture for generative adversarial networks. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 4401–4410, 2019. 5
2019
-
[32]
3d gaussian splatting for real-time radiance field rendering.ACM Trans
Bernhard Kerbl, Georgios Kopanas, Thomas Leimk ¨uhler, and George Drettakis. 3d gaussian splatting for real-time radiance field rendering.ACM Trans. Graph., 42(4):139–1,
-
[33]
Taekyung Ki, Dongchan Min, and Gyeongsu Chae. Learn- ing to generate conditional tri-plane for 3d-aware ex- pression controllable portrait animation.arXiv preprint arXiv:2404.00636, 2024. 3
arXiv 2024
-
[34]
Adam: A method for stochastic opti- mization.arXiv preprint arXiv:1412.6980, 2014
Diederik P Kingma. Adam: A method for stochastic opti- mization.arXiv preprint arXiv:1412.6980, 2014. 6
Pith/arXiv arXiv 2014
-
[35]
Gghead: Fast and generalizable 3d gaussian heads
Tobias Kirschstein, Simon Giebenhain, Jiapeng Tang, Markos Georgopoulos, and Matthias Nießner. Gghead: Fast and generalizable 3d gaussian heads. InSIGGRAPH Asia 2024 Conference Papers, pages 1–11, 2024. 4
2024
-
[36]
Avat3r: Large ani- matable gaussian reconstruction model for high-fidelity 3d head avatars, 2025
Tobias Kirschstein, Javier Romero, Artem Sevastopolsky, Matthias Nießner, and Shunsuke Saito. Avat3r: Large ani- matable gaussian reconstruction model for high-fidelity 3d head avatars, 2025. 2, 3, 4
2025
-
[37]
StyleGAN3 Synthetic Image Detection,
Nagano Koki. StyleGAN3 Synthetic Image Detection,
-
[38]
Wetzstein
Zhengfei Kuang, Shengqu Cai, Hao He, Yinghao Xu, Hongsheng Li, Leonidas Guibas, and Gordon. Wetzstein. Collaborative video diffusion: Consistent multi-video gen- eration with camera control. InarXiv, 2024. 2
2024
-
[39]
J. P. Lewis, Ken Anjyo, Taehyun Rhee, Mengjie Zhang, Fred Pighin, and Zhigang Deng. Practice and Theory of Blendshape Facial Models. InEurographics 2014 - State of the Art Reports, 2014. 5
2014
-
[40]
Tianye Li, Timo Bolkart, Michael. J. Black, Hao Li, and Javier Romero. Learning a model of facial shape and ex- pression from 4D scans.ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), 36(6):194:1–194:17, 2017. 2, 7
2017
-
[41]
Black, Hao Li, and Javier Romero
Tianye Li, Timo Bolkart, Michael J. Black, Hao Li, and Javier Romero. Learning a model of facial shape and ex- pression from 4d scans.ACM Trans. Graph., 36(6), 2017. 3
2017
-
[42]
One-shot high- fidelity talking-head synthesis with deformable neural ra- diance field
Weichuang Li, Longhao Zhang, Dong Wang, Bin Zhao, Zhigang Wang, Mulin Chen, Bang Zhang, Zhongjian Wang, Liefeng Bo, and Xuelong Li. One-shot high- fidelity talking-head synthesis with deformable neural ra- diance field. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 17969– 17978, 2023. 3
2023
-
[43]
Generalizable one-shot 3d neu- ral head avatar.Advances in Neural Information Processing Systems, 36, 2024
Xueting Li, Shalini De Mello, Sifei Liu, Koki Nagano, Umar Iqbal, and Jan Kautz. Generalizable one-shot 3d neu- ral head avatar.Advances in Neural Information Processing Systems, 36, 2024. 2, 3
2024
-
[44]
Expressive talking head generation with granular audio-visual control
Borong Liang, Yan Pan, Zhizhi Guo, Hang Zhou, Zhibin Hong, Xiaoguang Han, Junyu Han, Jingtuo Liu, Errui Ding, and Jingdong Wang. Expressive talking head generation with granular audio-visual control. In2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 3377–3386, 2022. 2
2022
-
[45]
Movies: Motion-aware 4d dynamic view synthesis in one second
Chenguo Lin, Yuchen Lin, Panwang Pan, Yifan Yu, Hon- glei Yan, Katerina Fragkiadaki, and Yadong Mu. Movies: Motion-aware 4d dynamic view synthesis in one second. arXiv preprint arXiv:2507.10065, 2025. 2
arXiv 2025
-
[46]
Align your gaussians: Text-to-4d with dynamic 3d gaussians and composed diffusion models
Huan Ling, Seung Wook Kim, Antonio Torralba, Sanja Fi- dler, and Karsten Kreis. Align your gaussians: Text-to-4d with dynamic 3d gaussians and composed diffusion models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8576–8588, 2024. 3, 5, 8
2024
-
[47]
Isabella Liu, Hao Su, and Xiaolong Wang. Dynamic gaus- sians mesh: Consistent mesh reconstruction from monocu- lar videos.arXiv preprint arXiv:2404.12379, 2024. 2, 3, 5, 8
Pith/arXiv arXiv 2024
-
[48]
To- wards a simultaneous and granular identity-expression con- trol in personalized face generation
Renshuai Liu, Bowen Ma, Wei Zhang, Zhipeng Hu, Changjie Fan, Tangjie Lv, Yu Ding, and Xuan Cheng. To- wards a simultaneous and granular identity-expression con- trol in personalized face generation. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2114–2123, 2024. 3
2024
-
[49]
Follow-your-emoji: Fine- controllable and expressive freestyle portrait animation
Yue Ma, Hongyu Liu, Hongfa Wang, Heng Pan, Yingqing He, Junkun Yuan, Ailing Zeng, Chengfei Cai, Heung- Yeung Shum, Wei Liu, et al. Follow-your-emoji: Fine- controllable and expressive freestyle portrait animation. arXiv preprint arXiv:2406.01900, 2024. 2, 3
Pith/arXiv arXiv 2024
-
[50]
Implicit warping for animation with image sets.Advances in Neural Information Processing Systems, 35:22438–22450, 2022
Arun Mallya, Ting-Chun Wang, and Ming-Yu Liu. Implicit warping for animation with image sets.Advances in Neural Information Processing Systems, 35:22438–22450, 2022. 2 10
2022
-
[51]
Srinivasan, Matthew Tancik, Jonathan T
Ben Mildenhall, Pratul P. Srinivasan, Matthew Tancik, Jonathan T. Barron, Ravi Ramamoorthi, and Ren Ng. Nerf: Representing scenes as neural radiance fields for view syn- thesis. InECCV, 2020. 1, 3, 4
2020
-
[52]
Maxime Oquab, Timoth ´ee Darcet, Theo Moutakanni, Huy V . V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernan- dez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Russell Howes, Po-Yao Huang, Hu Xu, Vasu Sharma, Shang-Wen Li, Wojciech Galuba, Mike Rabbat, Mido Ass- ran, Nicolas Ballas, Gabriel Synnaeve, Ishan Misra, Herve Jegou, Julien Mairal, Patric...
2023
-
[53]
Dpe: Dis- entanglement of pose and expression for general video por- trait editing
Youxin Pang, Yong Zhang, Weize Quan, Yanbo Fan, Xi- aodong Cun, Ying Shan, and Dong-ming Yan. Dpe: Dis- entanglement of pose and expression for general video por- trait editing. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 427– 436, 2023. 2
2023
-
[54]
Nerfies: Deformable neural radiance fields
Keunhong Park, Utkarsh Sinha, Jonathan T Barron, Sofien Bouaziz, Dan B Goldman, Steven M Seitz, and Ricardo Martin-Brualla. Nerfies: Deformable neural radiance fields. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 5865–5874, 2021. 3
2021
-
[55]
Keunhong Park, Utkarsh Sinha, Peter Hedman, Jonathan T Barron, Sofien Bouaziz, Dan B Goldman, Ricardo Martin- Brualla, and Steven M Seitz. Hypernerf: A higher- dimensional representation for topologically varying neural radiance fields.arXiv preprint arXiv:2106.13228, 2021. 3
Pith/arXiv arXiv 2021
-
[56]
A unified and interpretable emotion representation and expression gen- eration
Reni Paskaleva, Mykyta Holubakha, Andela Ilic, Saman Motamed, Luc Van Gool, and Danda Paudel. A unified and interpretable emotion representation and expression gen- eration. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2447– 2456, 2024. 3
2024
-
[57]
Avatar fingerprinting for au- thorized use of synthetic talking-head videos.ECCV, 2024
Ekta Prashnani, Koki Nagano, Shalini De Mello, David Luebke, and Orazio Gallo. Avatar fingerprinting for au- thorized use of synthetic talking-head videos.ECCV, 2024. 9
2024
-
[58]
D-NeRF: Neural radiance fields for dynamic scenes.https://arxiv.org/abs/2011.13961,
Albert Pumarola, Enric Corona, Gerard Pons-Moll, and Francesc Moreno-Noguer. D-NeRF: Neural radiance fields for dynamic scenes.https://arxiv.org/abs/2011.13961,
Pith/arXiv arXiv 2011
-
[59]
Di Qiu, Zhengcong Fei, Rui Wang, Jialin Bai, Changqian Yu, Mingyuan Fan, Guibin Chen, and Xiang Wen. Skyreels-a1: Expressive portrait animation in video diffu- sion transformers.arXiv preprint arXiv:2502.10841, 2025. 2, 3
Pith/arXiv arXiv 2025
-
[60]
Gen3c: 3d-informed world-consistent video generation with precise camera con- trol
Xuanchi Ren, Tianchang Shen, Jiahui Huang, Huan Ling, Yifan Lu, Merlin Nimier-David, Thomas M ¨uller, Alexan- der Keller, Sanja Fidler, and Jun Gao. Gen3c: 3d-informed world-consistent video generation with precise camera con- trol. InProceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition, 2025. 2
2025
-
[61]
Pirenderer: Controllable portrait image generation via semantic neural rendering
Yurui Ren, Ge Li, Yuanqi Chen, Thomas H Li, and Shan Liu. Pirenderer: Controllable portrait image generation via semantic neural rendering. InProceedings of the IEEE/CVF international conference on computer vision, pages 13759– 13768, 2021. 2
2021
-
[62]
3d facial expressions through analysis- by-neural-synthesis
George Retsinas, Panagiotis P Filntisis, Radek Danecek, Victoria F Abrevaya, Anastasios Roussos, Timo Bolkart, and Petros Maragos. 3d facial expressions through analysis- by-neural-synthesis. InProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 2490–2501, 2024. 6
2024
-
[63]
Lynx: Towards high-fidelity personalized video generation.arXiv preprint arXiv:2509.15496, 2025
Shen Sang, Tiancheng Zhi, Tianpei Gu, Jing Liu, and Lin- jie Luo. Lynx: Towards high-fidelity personalized video generation.arXiv preprint arXiv:2509.15496, 2025. 2
arXiv 2025
-
[64]
Fast high- resolution image synthesis with latent adversarial diffusion distillation
Axel Sauer, Frederic Boesel, Tim Dockhorn, Andreas Blattmann, Patrick Esser, and Robin Rombach. Fast high- resolution image synthesis with latent adversarial diffusion distillation. InSIGGRAPH Asia 2024 Conference Papers, pages 1–11, 2024. 3
2024
-
[65]
Adversarial diffusion distillation
Axel Sauer, Dominik Lorenz, Andreas Blattmann, and Robin Rombach. Adversarial diffusion distillation. In European Conference on Computer Vision, pages 87–103. Springer, 2024. 3
2024
-
[66]
Animating arbitrary objects via deep motion transfer
Aliaksandr Siarohin, St ´ephane Lathuili `ere, Sergey Tulyakov, Elisa Ricci, and Nicu Sebe. Animating arbitrary objects via deep motion transfer. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 2377–2386, 2019. 2
2019
-
[67]
First order mo- tion model for image animation.Advances in neural information processing systems, 32, 2019
Aliaksandr Siarohin, St ´ephane Lathuili `ere, Sergey Tulyakov, Elisa Ricci, and Nicu Sebe. First order mo- tion model for image animation.Advances in neural information processing systems, 32, 2019. 2
2019
-
[68]
Unsupervised volumetric animation
Aliaksandr Siarohin, Willi Menapace, Ivan Skorokhodov, Kyle Olszewski, Hsin-Ying Lee, Jian Ren, Menglei Chai, and Sergey Tulyakov. Unsupervised volumetric animation. arXiv preprint arXiv:2301.11326, 2023. 3
Pith/arXiv arXiv 2023
-
[69]
Generative modeling by estimating gradients of the data distribution.Advances in neural information processing systems, 32, 2019
Yang Song and Stefano Ermon. Generative modeling by estimating gradients of the data distribution.Advances in neural information processing systems, 32, 2019. 2
2019
-
[70]
Ai-mediated 3d video conferencing
Michael Stengel, Koki Nagano, Chao Liu, Matthew Chan, Alex Trevithick, Shalini De Mello, Jonghyun Kim, and David Luebke. Ai-mediated 3d video conferencing. In ACM SIGGRAPH Emerging Technologies, 2023. 5
2023
-
[71]
Next3d: Genera- tive neural texture rasterization for 3d-aware head avatars
Jingxiang Sun, Xuan Wang, Lizhen Wang, Xiaoyu Li, Yong Zhang, Hongwen Zhang, and Yebin Liu. Next3d: Genera- tive neural texture rasterization for 3d-aware head avatars. InProceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 20991–21002, 2023. 2, 3
2023
-
[72]
3dfaceshop: Explic- itly controllable 3d-aware portrait generation.IEEE Trans- actions on Visualization and Computer Graphics, 2023
Junshu Tang, Bo Zhang, Binxin Yang, Ting Zhang, Dong Chen, Lizhuang Ma, and Fang Wen. 3dfaceshop: Explic- itly controllable 3d-aware portrait generation.IEEE Trans- actions on Visualization and Computer Graphics, 2023. 3
2023
-
[73]
Gaf: Gaussian avatar reconstruction from monocular videos via multi-view dif- fusion
Jiapeng Tang, Davide Davoli, Tobias Kirschstein, Liam Schoneveld, and Matthias Niessner. Gaf: Gaussian avatar reconstruction from monocular videos via multi-view dif- fusion. InProceedings of the Computer Vision and Pattern Recognition Conference, pages 5546–5558, 2025. 2, 3
2025
-
[74]
Felix Taubner, Ruihang Zhang, Mathieu Tuli, Sherwin Bah- mani, and David B. Lindell. MVP4D: Multi-view portrait video diffusion for animatable 4D avatars, 2025. 3
2025
-
[75]
Cap4d: Creating animatable 4d portrait avatars with morphable multi-view diffusion models
Felix Taubner, Ruihang Zhang, Mathieu Tuli, and David B Lindell. Cap4d: Creating animatable 4d portrait avatars with morphable multi-view diffusion models. In2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 5318–5330. IEEE Computer Society, 2025. 2, 3 11
2025
-
[76]
Emo: Emote portrait alive generating expressive portrait videos with audio2video diffusion model under weak conditions
Linrui Tian, Qi Wang, Bang Zhang, and Liefeng Bo. Emo: Emote portrait alive generating expressive portrait videos with audio2video diffusion model under weak conditions. InEuropean Conference on Computer Vision, pages 244–
-
[77]
Estimation of continuous valence and arousal levels from faces in naturalistic condi- tions.Nature Machine Intelligence, 2021
Antoine Toisoul, Jean Kossaifi, Adrian Bulat, Georgios Tz- imiropoulos, and Maja Pantic. Estimation of continuous valence and arousal levels from faces in naturalistic condi- tions.Nature Machine Intelligence, 2021. 7
2021
-
[78]
Phong Tran, Egor Zakharov, Long-Nhat Ho, Liwen Hu, Adilbek Karmanov, Aviral Agarwal, McLean Goldwhite, Ariana Bermudez Venegas, Anh Tuan Tran, and Hao Li. V oodoo xp: Expressive one-shot head reenactment for vr telepresence.arXiv preprint arXiv:2405.16204, 2024. 1, 2, 3, 4, 5, 6, 7, 8
Pith/arXiv arXiv 2024
-
[79]
V oodoo 3d: V olumetric por- trait disentanglement for one-shot 3d head reenactment
Phong Tran, Egor Zakharov, Long-Nhat Ho, Anh Tuan Tran, Liwen Hu, and Hao Li. V oodoo 3d: V olumetric por- trait disentanglement for one-shot 3d head reenactment. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 10336–10348, 2024. 2, 3, 5
2024
-
[80]
Chan, Chao Liu, Zhiding Yu, Sameh Khamis, Manmohan Chandraker, Ravi Ramamoorthi, and Koki Nagano
Alex Trevithick, Matthew Chan, Michael Stengel, Eric R. Chan, Chao Liu, Zhiding Yu, Sameh Khamis, Manmohan Chandraker, Ravi Ramamoorthi, and Koki Nagano. Real- time radiance fields for single-image portrait view synthe- sis. InACM Transactions on Graphics (SIGGRAPH), 2023. 2, 3, 4, 5, 6
2023
This paper was first reviewed by deepseek-v4-flash on August 3, 2026.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.