Pith. sign in

REVIEW 3 major objections 5 minor 1 cited by

PERSONA: Personalized Whole-Body 3D Avatar with Pose-Driven Deformations from a Single Image

T0 review · 3 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read PERSONA builds a personalized whole-body 3D avatar with pose-driven clothing deformation from a single image by training on diffusion-generated videos.

desk verdict A genuinely new training-data pipeline for single-image avatars, with an honest evaluation that needs a clearer train/test pose-disjointness statement. read the letter →

arxiv 2508.09973 v1 pith:SGHQKMO2 submitted 2025-08-13 cs.CV

Geonhee Sim , Gyeongsik Moon This is my paper
classification cs.CV
keywords 3DavatarGaussiansplattingSMPL-Xpose-drivendeformationdiffusionvideogenerationidentitypreservationsingle-imagereconstructionwhole-bodyanimation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

PERSONA combines the two dominant avatar-building strategies: 3D optimization, which preserves identity but needs pose-rich video, and diffusion-based animation, which learns deformations but loses identity. The paper's central proposal is to use a diffusion animator to synthesize pose-rich training videos from a single input image, then optimize a 3D Gaussian avatar on that footage. Two correctives make this transfer work: balanced sampling oversamples the input image to hold identity, and geometry-weighted optimization down-weights unreliable image textures in favor of stable geometry maps. If correct, this gives a scalable route to personalized, animatable whole-body avatars with natural cloth deformation from one casual photo, and the paper reports that it outperforms all existing single-image methods on NeuMan and X-Humans benchmarks.

What carries the argument

The central object is a hybrid surface-mesh/3D-Gaussian body model anchored to SMPL-X: each template vertex carries an isotropic 3D Gaussian, and pose-driven deformation is produced by MLPs that take triplane canonical features plus the 3D poses of only 4-ring neighboring joints and output mean offsets (translations) to Gaussian positions before LBS animation and Mip-Splatting rendering. The mean-offset MLPs are the mechanism that generates non-rigid cloth movement; balanced sampling and geometry-weighted optimization are the two correctives that keep the MLPs learning from reliable identity and geometry signals rather than diffusion artifacts.

What would settle it

Take one photo of a person in a loose skirt; generate MimicMotion videos; build PERSONA; then drive the avatar through a real motion-captured sequence where the skirt should flare. Compare the rendered skirt mask to a real video of the same person in the same motion: if the mask IoU does not improve over the diffusion generator's own frames, or if identity embedding distance to the input photo exceeds the generator's drift, the central claim of pose-driven deformation with preserved identity is falsified.

Watch

Extended reading notes

Core claim

The core claim is that a personalized whole-body 3D avatar with pose-driven non-rigid deformations can be obtained from a single image by optimizing a hybrid SMPL-X/3D-Gaussian avatar against diffusion-generated pose-rich videos. The paper argues that this requires two mechanisms: balanced sampling, which oversamples the input image and uses Sobel-detected seam boundaries plus albedo supervision to prevent identity drift and baked-in shadows; and geometry-weighted optimization, which sets low image-loss weights and high geometry-loss weights (masks, depth, normals, part segmentations) because geometry remains reliable where generated textures are inconsistent. It further claims that modeling

Load-bearing premise

The diffusion-generated videos must preserve both the identity and the pose-dependent appearance (cloth deformation, geometry) of the input subject closely enough that optimizing an avatar against them transfers real deformation behavior instead of generator artifacts.

Editorial extensions

If this is right

  • A single, casually captured photo becomes a fully animatable whole-body avatar, eliminating per-subject multi-view, 3D-scan, or pose-diverse video capture.
  • Pose-driven deformations like cloth lifting with raised arms are learned explicitly, avoiding the baked-in input deformations seen in prior single-image 3D methods.
  • Identity (face, clothing patterns) is preserved across novel poses better than the underlying diffusion animator, thanks to balanced sampling.
  • Rendering stays sharp in novel poses because deformation uses only mean offsets, and geometry supervision anchors optimization where textures are unreliable.
  • The pipeline renders in real time (about 25.6 fps on an A6000) after roughly one hour of video generation plus 30 minutes of avatar optimization.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The framework's ceiling is set by the diffusion generator: a generator with stronger identity preservation would shrink the benefit of balanced sampling, while a generator producing 3D-consistent multi-view output could relax the geometry-weighted loss and preserve fine wrinkles.
  • Because only Gaussian means are shifted, the method trades away relighting, dynamic cloth/hair motion, and fine wrinkles; adding separate garment and hair layers that also update scales and colors is the natural next step.
  • The same 'synthesize pose-rich training data, then optimize a 3D representation' recipe should transfer to other single-image articulated 3D tasks, such as animals or deformable objects, where pose-varied footage is the bottleneck.
  • A practical test of the identity-preservation claim: run the pipeline with animators of different identity fidelity and measure how the avatar's identity distance to the input scales, quantifying how much of the gain is balanced sampling versus generator quality.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. PERSONA proposes a single-image whole-body avatar pipeline that combines SMPL-X/3DGS with diffusion-generated pose-rich training videos. The paper generates training videos with MimicMotion using target 3D poses extracted from public videos, then optimizes an ExAvatar-style Gaussian avatar using balanced sampling and geometry-weighted optimization. Experiments on NeuMan and X-Humans report state-of-the-art results among single-image methods, with ablations, a user study, runtime comparisons, and a limitations section. The central idea is to obtain pose-driven deformations without per-subject pose-rich video capture.

Significance. If the results hold, PERSONA is a practical and scalable contribution: it transfers pose-driven deformation knowledge from a diffusion-based animator into an explicit 3D avatar while preserving identity through sampling and geometry-weighted losses. The paper ships strong evidence in the form of quantitative comparisons on two benchmarks using official implementations, multi-component ablations, a 40-participant user study, and candid limitation statements. However, two evaluation-hygiene issues currently temper confidence in the main quantitative claim: the target motion pool is not shown to be disjoint from the benchmark test poses, and the loss weights are selected on the NeuMan test set. These are fixable protocol gaps rather than flaws in the core derivation.

major comments (3)
  1. [Sec. 4.2 / Sec. 7.1] The paper does not establish that the target motion pool used for diffusion-generated training videos is disjoint from the NeuMan and X-Humans test sequences used in Tables 2 and 3. Section 4.2 states that target 3D poses are "extracted in advance from public videos using the ExAvatar fitting process," and Section 7.1 gives an explicit disjointness guarantee only for the qualitative in-the-wild dance videos ("different from our training set"). If the motion pool includes poses from the NeuMan/X-Humans test sets, PERSONA is optimized on generated frames at evaluation poses while single-image baselines are not, so the reported pose-deformation gains could partly reflect exposure rather than generalization. Please state the source of the motion pool, its overlap with the benchmark test sequences, and either release the pool or rerun with a provably disjoint pool.
  2. [Sec. 7.3 / Table S2] Table S2 reports loss-weight tuning directly on the NeuMan test set ("Effect of loss weights ... on the NeuMan test set"), with the chosen row marked ours. Table 3 then reports NeuMan results under this configuration. Thus the NeuMan comparison is not a fully held-out evaluation for the image-loss weight, and the reported 29.20 dB may be optimistically selected. Please select hyperparameters on a validation split or report sensitivity on both benchmarks with a fixed, pre-registered configuration. The balanced-sampling ratio deserves the same treatment: it is currently supported only by the qualitative Figure S8.
  3. [Tables 2 and 3] The quantitative comparisons are reported without variance or the number of runs, although the pipeline involves stochastic diffusion-generated training videos (Sec. 4.1) and stochastic optimization. Some margins are modest, e.g., 0.80 dB over AniGS on X-Humans 00028 and less than 1 dB over the no-deformation ablation on NeuMan. It is therefore unclear whether the ranking is stable. Please report mean and standard deviation over at least three independent generation/training runs, or justify why the variance is negligible.
minor comments (5)
  1. [Fig. 1, Fig. 6, Fig. S2, Fig. S8] Several figure labels contain untranslated Korean characters or garbled text (e.g., "정국 127" in Fig. 1 and similar artifacts in later figures). The camera-ready version should use English labels throughout.
  2. [Sec. 5.1] The phrase "we regularize these regions using separate RGBs" is not defined in the architecture description. Please clarify whether these are additional optimizable color features, a separate rendered color branch, or simply a masking of the image loss.
  3. [Sec. 7.2 / Fig. 9] The baseline "Ours wo. pose-driven deform." is not precisely specified. State exactly which modules are removed (mean-offset MLPs, triplane conditioning, geometry-weighted losses, or all of these) so the ablation is reproducible.
  4. [Sec. 7.1] The statement "All comparisons exclude background pixels" should specify how the foreground mask is obtained and whether the same mask is applied to every method. This is needed for a fair comparison of the reported PSNR/SSIM/LPIPS values.
  5. [Table S4] The generator comparison would be more informative if the paper stated whether the same target pose set and the same number of generated frames were used for all generators. Otherwise the small differences may reflect motion content rather than generator quality.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: PERSONA is optimized on externally generated videos and evaluated on held-out real frames; reused ExAvatar components are architectural, not load-bearing.

full rationale

The derivation chain is: input image -> MimicMotion-generated pose-rich videos -> optimization of a 3D Gaussian avatar with image and geometry losses -> animation under novel poses. None of these steps defines the output in terms of the evaluation target. The pose-driven deformation MLPs are optimized against generated frames, while the quantitative evaluation uses held-out real frames from NeuMan and X-Humans; there is no fitted parameter that is later relabeled as a prediction. The reuse of ExAvatar [37] (hybrid surface-mesh/Gaussian representation, the ExAvatar fitting process for target poses, and Laplacian regularization) is architectural inheritance from prior work by one of the authors, but it does not by itself assert or force the PERSONA result; it is not invoked as a uniqueness theorem or as a substitute for the reported experiments. The appended limitations in Sec. S4 (lack of dynamics, lack of fine wrinkles, blurry invisible regions) are honest scope statements, not hidden circularity. The only substantive concern is a transparency gap: Sec. 4.2 states that target motions are 'extracted in advance from public videos using the ExAvatar [37] fitting process,' and Sec. 7.1 states only that qualitative dance videos are 'different from our training set.' The paper does not explicitly state that the motion pool used for generated training videos is disjoint from the NeuMan/X-Humans test sequences used in Tables 2 and 3. If overlapping motions were used, the measured pose-deformation gains could partly reflect exposure to test poses rather than a learned deformation model. That would be an evaluation-contamination issue, not an instance of the derivation reducing to its inputs by construction, so it does not raise the circularity score.

Assumptions & free parameters 2 free parameters · 4 assumptions · 0 invented entities

The paper introduces no new physical entities. Its central claim rests on the fidelity of diffusion-generated training videos and of geometry estimators, plus a small set of hand-tuned hyperparameters.

free parameters (2)
  • Balanced sampling ratio = 1:1 (input image to generated frames)
    Selected by hand and shown via qualitative ablation (Figure S8); affects identity preservation and artifact baking.
  • Image and geometry loss weights = geometry=1.0, image=0.1
    Tuned on NeuMan test set per Table S2; directly controls the balance between texture and geometry supervision.
assumptions (4)
  • domain assumption MimicMotion-generated videos faithfully reproduce the subject's pose-dependent appearance and identity.
    Section 4.1 uses these videos as training data; the entire pose-driven deformation module is supervised by them.
  • domain assumption SAM and Sapiens provide accurate masks, depth, normals, and part segmentation in the generated frames.
    Geometry-weighted optimization (Section 5.2) treats these estimates as stable and reliable supervision.
  • domain assumption SMPL-X with isotropic Gaussians and LBS is an adequate representation for the claimed pose-driven deformations.
    The representation (Section 3) limits what can be expressed; the paper's own limitations note missing garment layers and relighting.
  • domain assumption Pretrained external models (MimicMotion, Sapiens, SAM) are used as-is and their outputs are trusted.
    The pipeline depends on these models' outputs without re-verification; errors propagate into the avatar.

how reviews work

0 comments
Cite this review

Pith. "Pith review of PERSONA: Personalized Whole-Body 3D Avatar with Pose-Driven Deformations from a Single Image." pith.science (2026). https://pith.science/paper/SGHQKMO2

@misc{pith2026250809973,
  author       = {Pith},
  title        = {Pith review of: PERSONA: Personalized Whole-Body 3D Avatar with Pose-Driven Deformations from a Single Image},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/SGHQKMO2}},
  note         = {Machine review of arXiv:2508.09973}
}
read the original abstract

Two major approaches exist for creating animatable human avatars. The first, a 3D-based approach, optimizes a NeRF- or 3DGS-based avatar from videos of a single person, achieving personalization through a disentangled identity representation. However, modeling pose-driven deformations, such as non-rigid cloth deformations, requires numerous pose-rich videos, which are costly and impractical to capture in daily life. The second, a diffusion-based approach, learns pose-driven deformations from large-scale in-the-wild videos but struggles with identity preservation and pose-dependent identity entanglement. We present PERSONA, a framework that combines the strengths of both approaches to obtain a personalized 3D human avatar with pose-driven deformations from a single image. PERSONA leverages a diffusion-based approach to generate pose-rich videos from the input image and optimizes a 3D avatar based on them. To ensure high authenticity and sharp renderings across diverse poses, we introduce balanced sampling and geometry-weighted optimization. Balanced sampling oversamples the input image to mitigate identity shifts in diffusion-generated training videos. Geometry-weighted optimization prioritizes geometry constraints over image loss, preserving rendering quality in diverse poses.

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. VRGaussianAvatar: Integrating 3D Gaussian Avatars into VR

    cs.CV 2026-02 conditional novelty 7.0 of 10

    VRGaussianAvatar enables real-time full-body 3D Gaussian Splatting avatars in VR from HMD tracking alone via inverse kinematics and binocular batching for efficient stereo rendering, outperforming mesh baselines in pe...

Reference graph

Works this paper leans on

70 extracted references · 60 canonical work pages · cited by 1 Pith paper

  1. [1]

    Video based reconstruction of 3D people models

    Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, and Gerard Pons-Moll. Video based reconstruction of 3D people models. In CVPR, 2018. 3

    work page 2018

  2. [2]

    Photorealistic monocular 3D reconstruction of humans wear- ing clothing

    Thiemo Alldieck, Mihai Zanfir, and Cristian Sminchisescu. Photorealistic monocular 3D reconstruction of humans wear- ing clothing. In CVPR, 2022. 3

    work page 2022

  3. [3]

    Driving-signal aware full-body avatars

    Timur Bagautdinov, Chenglei Wu, Tomas Simon, Fabian Prada, Takaaki Shiratori, Shih-En Wei, Weipeng Xu, Yaser Sheikh, and Jason Saragih. Driving-signal aware full-body avatars. ACM TOG, 2021. 3

    work page 2021

  4. [4]

    Stable Video Diffusion: Scaling latent video diffusion models to large datasets

    Andreas Blattmann, Tim Dockhorn, Sumith Kulal, Daniel Mendelevitch, Maciej Kilian, Dominik Lorenz, Yam Levi, Zion English, Vikram V oleti, Adam Letts, et al. Stable Video Diffusion: Scaling latent video diffusion models to large datasets. arXiv preprint arXiv:2311.15127, 2023. 2, 3

    arXiv 2023

  5. [5]

    Intrinsic image decomposi- tion via ordinal shading

    Chris Careaga and Ya ˘gız Aksoy. Intrinsic image decomposi- tion via ordinal shading. ACM TOG, 2023. 4

    work page 2023

  6. [6]

    Pose2Mesh: Graph convolutional network for 3D human pose and mesh recovery from a 2D human pose

    Hongsuk Choi, Gyeongsik Moon, and Kyoung Mu Lee. Pose2Mesh: Graph convolutional network for 3D human pose and mesh recovery from a 2D human pose. In ECCV,

    work page

  7. [7]

    MonoNHR: Monocular neural human renderer

    Hongsuk Choi, Gyeongsik Moon, Matthieu Armando, Vincent Leroy, Kyoung Mu Lee, and Gr ´egory Rogez. MonoNHR: Monocular neural human renderer. In 3DV,

    work page

  8. [8]

    RAM-Avatar: Real-time photo-realistic avatar from monoc- ular videos with full-body control

    Xiang Deng, Zerong Zheng, Yuxiang Zhang, Jingxiang Sun, Chao Xu, Xiaodong Yang, Lizhen Wang, and Yebin Liu. RAM-Avatar: Real-time photo-realistic avatar from monoc- ular videos with full-body control. In CVPR, 2024. 3

    work page 2024

Show all 70 references
  1. [9]

    Vid2Avatar: 3D avatar reconstruction from videos in the wild via self-supervised scene decomposition

    Chen Guo, Tianjian Jiang, Xu Chen, Jie Song, and Otmar Hilliges. Vid2Avatar: 3D avatar reconstruction from videos in the wild via self-supervised scene decomposition. In CVPR, 2023. 1, 3, 8

    2023

  2. [10]

    DeepCap: Monocu- lar human performance capture using weak supervision

    Marc Habermann, Weipeng Xu, Michael Zollhofer, Gerard Pons-Moll, and Christian Theobalt. DeepCap: Monocu- lar human performance capture using weak supervision. In CVPR, 2020. 3

    2020

  3. [11]

    SiTH: Single- view textured human reconstruction with image-conditioned diffusion

    Hsuan-I Ho, Jie Song, and Otmar Hilliges. SiTH: Single- view textured human reconstruction with image-conditioned diffusion. In CVPR, 2024. 8

    2024

  4. [12]

    Denoising diffu- sion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffu- sion probabilistic models. In NeurIPS, 2020. 2, 3

    2020

  5. [13]

    Expressive gaussian human avatars from monocular rgb video

    Hezhen Hu, Zhiwen Fan, Tianhao Wu, Yihan Xi, Seoyoung Lee, Georgios Pavlakos, and Zhangyang Wang. Expressive gaussian human avatars from monocular rgb video. arXiv preprint arXiv:2407.03204, 2024. 3

    2024 arXiv

  6. [14]

    GaussianAvatar: Towards realistic human avatar modeling from a single video via animatable 3D gaussians

    Liangxiao Hu, Hongwen Zhang, Yuxiang Zhang, Boyao Zhou, Boning Liu, Shengping Zhang, and Liqiang Nie. GaussianAvatar: Towards realistic human avatar modeling from a single video via animatable 3D gaussians. arXiv preprint arXiv:2312.02134, 2023. 1, 2, 3, 4, 6, 8

    2023 arXiv

  7. [15]

    Animate Anyone: Consistent and controllable image-to-video synthesis for character animation

    Li Hu, Xin Gao, Peng Zhang, Ke Sun, Bang Zhang, and Liefeng Bo. Animate Anyone: Consistent and controllable image-to-video synthesis for character animation. In CVPR,

  8. [16]

    TeCH: Text-guided reconstruction of lifelike clothed humans

    Yangyi Huang, Hongwei Yi, Yuliang Xiu, Tingting Liao, Ji- axiang Tang, Deng Cai, and Justus Thies. TeCH: Text-guided reconstruction of lifelike clothed humans. In 3DV, 2024. 3, 8

    2024

  9. [17]

    ARCH: Animatable reconstruction of clothed humans

    Zeng Huang, Yuanlu Xu, Christoph Lassner, Hao Li, and Tony Tung. ARCH: Animatable reconstruction of clothed humans. In CVPR, 2020. 3

    2020

  10. [18]

    In- stantAvatar: Learning avatars from monocular video in 60 seconds

    Tianjian Jiang, Xu Chen, Jie Song, and Otmar Hilliges. In- stantAvatar: Learning avatars from monocular video in 60 seconds. In CVPR, 2023. 1, 3, 8

    2023

  11. [19]

    NeuMan: Neural human radiance field from a single video

    Wei Jiang, Kwang Moo Yi, Golnoosh Samei, Oncel Tuzel, and Anurag Ranjan. NeuMan: Neural human radiance field from a single video. In ECCV, 2022. 1, 3, 6, 8

    2022

  12. [20]

    End-to-end recovery of human shape and pose

    Angjoo Kanazawa, Michael J Black, David W Jacobs, and Jitendra Malik. End-to-end recovery of human shape and pose. In CVPR, 2018. 3

    2018

  13. [21]

    3D gaussian splatting for real-time radiance field rendering

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimk ¨uhler, and George Drettakis. 3D gaussian splatting for real-time radiance field rendering. ACM TOG, 2023. 1, 3

    2023

  14. [22]

    Sapiens: Foundation for human vision mod- els

    Rawal Khirodkar, Timur Bagautdinov, Julieta Martinez, Su Zhaoen, Austin James, Peter Selednik, Stuart Anderson, and Shunsuke Saito. Sapiens: Foundation for human vision mod- els. In ECCV, 2024. 5, 14

    2024

  15. [23]

    Segment any- thing

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer White- head, Alexander C Berg, Wan-Yen Lo, et al. Segment any- thing. In ICCV, 2023. 5

    2023

  16. [24]

    HUGS: Human gaussian splatting

    Muhammed Kocabas, Jen-Hao Rick Chang, James Gabriel, Oncel Tuzel, and Anurag Ranjan. HUGS: Human gaussian splatting. In CVPR, 2024. 1, 3

    2024

  17. [25]

    Learning to reconstruct 3D human pose and shape via model-fitting in the loop

    Nikos Kolotouros, Georgios Pavlakos, Michael J Black, and Kostas Daniilidis. Learning to reconstruct 3D human pose and shape via model-fitting in the loop. In ICCV, 2019. 3

    2019

  18. [26]

    Instant 3d human avatar generation using image diffusion models

    Nikos Kolotouros, Thiemo Alldieck, Enric Corona, Ed- uard Gabriel Bazavan, and Cristian Sminchisescu. Instant 3d human avatar generation using image diffusion models. In ECCV, 2024. 3

    2024

  19. [27]

    Neural Human Performer: Learning generalizable radiance fields for human performance rendering

    Youngjoong Kwon, Dahun Kim, Duygu Ceylan, and Henry Fuchs. Neural Human Performer: Learning generalizable radiance fields for human performance rendering. NeurIPS,

  20. [28]

    DELIFFAS: Deformable light fields for fast avatar synthesis

    Youngjoong Kwon, Lingjie Liu, Henry Fuchs, Marc Haber- mann, and Christian Theobalt. DELIFFAS: Deformable light fields for fast avatar synthesis. NeurIPS, 2024

    2024

  21. [29]

    Ani- matable Gaussians: Learning pose-dependent gaussian maps for high-fidelity human avatar modeling

    Zhe Li, Zerong Zheng, Lizhen Wang, and Yebin Liu. Ani- matable Gaussians: Learning pose-dependent gaussian maps for high-fidelity human avatar modeling. In CVPR, 2024. 3

    2024

  22. [30]

    End-to-end hu- man pose and mesh reconstruction with transformers

    Kevin Lin, Lijuan Wang, and Zicheng Liu. End-to-end hu- man pose and mesh reconstruction with transformers. In CVPR, 2021. 3

    2021

  23. [31]

    GEA: Reconstructing expressive 3D gaussian avatar from monocular video

    Xinqi Liu, Chenming Wu, Xing Liu, Jialun Liu, Jinbo Wu, Chen Zhao, Haocheng Feng, Errui Ding, and Jingdong Wang. GEA: Reconstructing expressive 3D gaussian avatar from monocular video. arXiv preprint arXiv:2402.16607 ,

    arXiv

  24. [32]

    Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. SMPL: A skinned multi- person linear model. ACM TOG, 2015. 1, 3

    2015

  25. [33]

    MIMO: Controllable character video synthesis with spatial decomposed modeling

    Yifang Men, Yuan Yao, Miaomiao Cui, and Liefeng Bo. MIMO: Controllable character video synthesis with spatial decomposed modeling. arXiv preprint arXiv:2409.16160 ,

    arXiv

  26. [34]

    NeRF: Representing scenes as neural radiance fields for view syn- thesis

    Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. NeRF: Representing scenes as neural radiance fields for view syn- thesis. Communications of the ACM, 2021. 1

    2021

  27. [35]

    I2L-MeshNet: Image-to-lixel prediction network for accurate 3D human pose and mesh estimation from a single RGB image

    Gyeongsik Moon and Kyoung Mu Lee. I2L-MeshNet: Image-to-lixel prediction network for accurate 3D human pose and mesh estimation from a single RGB image. In ECCV, 2020. 3

    2020

  28. [36]

    Ac- curate 3D hand pose estimation for whole-body 3D human mesh estimation

    Gyeongsik Moon, Hongsuk Choi, and Kyoung Mu Lee. Ac- curate 3D hand pose estimation for whole-body 3D human mesh estimation. In CVPRW, 2022. 3

    2022

  29. [37]

    Expressive whole-body 3D gaussian avatar

    Gyeongsik Moon, Takaaki Shiratori, and Shunsuke Saito. Expressive whole-body 3D gaussian avatar. In ECCV, 2024. 1, 2, 3, 4, 5, 6, 8

    2024

  30. [38]

    Human gaussian splatting: Real-time rendering of animatable avatars

    Arthur Moreau, Jifei Song, Helisa Dhamo, Richard Shaw, Yiren Zhou, and Eduardo P ´erez-Pellitero. Human gaussian splatting: Real-time rendering of animatable avatars. In CVPR, 2024. 3

    2024

  31. [39]

    ASH: Animatable gaus- sian splats for efficient and photoreal human rendering

    Haokai Pang, Heming Zhu, Adam Kortylewski, Christian Theobalt, and Marc Habermann. ASH: Animatable gaus- sian splats for efficient and photoreal human rendering. In CVPR, 2024. 3

    2024

  32. [40]

    Expressive body capture: 3D hands, face, and body from a single image

    Georgios Pavlakos, Vasileios Choutas, Nima Ghorbani, Timo Bolkart, Ahmed AA Osman, Dimitrios Tzionas, and Michael J Black. Expressive body capture: 3D hands, face, and body from a single image. In CVPR, 2019. 1, 3

    2019

  33. [41]

    Ani- matable neural radiance fields for modeling dynamic human bodies

    Sida Peng, Junting Dong, Qianqian Wang, Shangzhan Zhang, Qing Shuai, Xiaowei Zhou, and Hujun Bao. Ani- matable neural radiance fields for modeling dynamic human bodies. In ICCV, 2021. 1, 3

    2021

  34. [42]

    Neural Body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans

    Sida Peng, Yuanqing Zhang, Yinghao Xu, Qianqian Wang, Qing Shuai, Hujun Bao, and Xiaowei Zhou. Neural Body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans. In CVPR,

  35. [43]

    3DGS-Avatar: Animatable avatars via deformable 3d gaussian splatting

    Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, and Siyu Tang. 3DGS-Avatar: Animatable avatars via deformable 3d gaussian splatting. In CVPR, 2024. 1, 8

    2024

  36. [44]

    LHM: Large animat- able human reconstruction model from a single image in sec- onds

    Lingteng Qiu, Xiaodong Gu, Peihao Li, Qi Zuo, Weichao Shen, Junfei Zhang, Kejie Qiu, Weihao Yuan, Guanying Chen, Zilong Dong, and Liefeng Bo. LHM: Large animat- able human reconstruction model from a single image in sec- onds. In ICCV, 2025. 1, 2, 7, 8, 9, 10, 14, 15

    2025

  37. [45]

    AniGS: Animatable gaussian avatar from a single image with inconsistent gaussian reconstruction

    Lingteng Qiu, Shenhao Zhu, Qi Zuo, Xiaodong Gu, Yuan Dong, Junfei Zhang, Chao Xu, Zhe Li, Weihao Yuan, Liefeng Bo, et al. AniGS: Animatable gaussian avatar from a single image with inconsistent gaussian reconstruction. In CVPR, 2025. 1, 2, 3, 6, 7, 8, 9, 10

    2025

  38. [46]

    High-resolution image syn- thesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Bj¨orn Ommer. High-resolution image syn- thesis with latent diffusion models. In CVPR, 2022. 2, 3

    2022

  39. [47]

    Frankmocap: A monocular 3D whole-body pose estimation system via re- gression and integration

    Yu Rong, Takaaki Shiratori, and Hanbyul Joo. Frankmocap: A monocular 3D whole-body pose estimation system via re- gression and integration. In ICCVW, 2021. 3

    2021

  40. [48]

    PIFu: Pixel-aligned implicit function for high-resolution clothed human digitiza- tion

    Shunsuke Saito, Zeng Huang, Ryota Natsume, Shigeo Mor- ishima, Angjoo Kanazawa, and Hao Li. PIFu: Pixel-aligned implicit function for high-resolution clothed human digitiza- tion. In ICCV, 2019. 3

    2019

  41. [49]

    PIFuHD: Multi-level pixel-aligned implicit function for high-resolution 3D human digitization

    Shunsuke Saito, Tomas Simon, Jason Saragih, and Hanbyul Joo. PIFuHD: Multi-level pixel-aligned implicit function for high-resolution 3D human digitization. In CVPR, 2020. 3

    2020

  42. [50]

    SCANimate: Weakly supervised learning of skinned clothed avatar networks

    Shunsuke Saito, Jinlong Yang, Qianli Ma, and Michael J Black. SCANimate: Weakly supervised learning of skinned clothed avatar networks. In CVPR, 2021. 3

    2021

  43. [51]

    SplattingAvatar: Realistic real-time human avatars with mesh-embedded gaussian splatting

    Zhijing Shao, Zhaolong Wang, Zhuang Li, Duotun Wang, Xiangru Lin, Yu Zhang, Mingming Fan, and Zeyu Wang. SplattingAvatar: Realistic real-time human avatars with mesh-embedded gaussian splatting. In CVPR, 2024. 3

    2024

  44. [52]

    X- Avatar: Expressive human avatars

    Kaiyue Shen, Chen Guo, Manuel Kaufmann, Juan Jose Zarate, Julien Valentin, Jie Song, and Otmar Hilliges. X- Avatar: Expressive human avatars. In CVPR, 2023. 6, 8, 14

    2023

  45. [53]

    Canonical- Fusion: Generating drivable 3D human avatars from multiple images

    Jisu Shin, Junmyeong Lee, Seongmin Lee, Min-Gyu Park, Ju-Mi Kang, Ju Hong Yoon, and Hae-Gon Jeon. Canonical- Fusion: Generating drivable 3D human avatars from multiple images. In ECCV, 2024. 3

    2024

  46. [54]

    Denois- ing diffusion implicit models

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denois- ing diffusion implicit models. In ICLR, 2021. 2, 3

    2021

  47. [55]

    Improved techniques for training score-based generative models

    Yang Song and Stefano Ermon. Improved techniques for training score-based generative models. NeurIPS, 2020

    2020

  48. [56]

    Score-based generative modeling through stochastic differential equa- tions

    Yang Song, Jascha Sohl-Dickstein, Diederik P Kingma, Ab- hishek Kumar, Stefano Ermon, and Ben Poole. Score-based generative modeling through stochastic differential equa- tions. In ICLR, 2021

    2021

  49. [57]

    Consistency models

    Yang Song, Prafulla Dhariwal, Mark Chen, and Ilya Sutskever. Consistency models. In ICML, 2023. 2, 3

    2023

  50. [58]

    StableAnimator: High- quality identity-preserving human image animation

    Shuyuan Tu, Zhen Xing, Xintong Han, Zhi-Qi Cheng, Qi Dai, Chong Luo, and Zuxuan Wu. StableAnimator: High- quality identity-preserving human image animation. arXiv preprint arXiv:2411.17697, 2024. 2, 3, 4, 8, 9, 11

    2024 arXiv

  51. [59]

    Hu- manNeRF: Free-viewpoint rendering of moving people from monocular video

    Chung-Yi Weng, Brian Curless, Pratul P Srinivasan, Jonathan T Barron, and Ira Kemelmacher-Shlizerman. Hu- manNeRF: Free-viewpoint rendering of moving people from monocular video. In CVPR, 2022. 8

    2022

  52. [60]

    ICON: Implicit clothed humans obtained from nor- mals

    Yuliang Xiu, Jinlong Yang, Dimitrios Tzionas, and Michael J Black. ICON: Implicit clothed humans obtained from nor- mals. In CVPR, 2022. 3

    2022

  53. [61]

    ECON: Explicit clothed humans optimized via normal integration

    Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, and Michael J Black. ECON: Explicit clothed humans optimized via normal integration. In CVPR, 2023. 3

    2023

  54. [62]

    PuzzleAvatar: Assembling 3D avatars from personal albums

    Yuliang Xiu, Yufei Ye, Zhen Liu, Dimitrios Tzionas, and Michael J Black. PuzzleAvatar: Assembling 3D avatars from personal albums. ACM TOG, 2024. 3

    2024

  55. [63]

    MagicAnimate: Temporally consistent human image animation using diffusion model

    Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Hanshu Yan, Jia-Wei Liu, Chenxu Zhang, Jiashi Feng, and Mike Zheng Shou. MagicAnimate: Temporally consistent human image animation using diffusion model. In CVPR, 2024. 1, 2, 3

    2024

  56. [64]

    Mip-Splatting: Alias-free 3D gaussian splatting

    Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler, and Andreas Geiger. Mip-Splatting: Alias-free 3D gaussian splatting. In CVPR, 2024. 3

    2024

  57. [65]

    The unreasonable effectiveness of deep features as a perceptual metric

    Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In CVPR, 2018. 6

    2018

  58. [66]

    Mimicmo- tion: High-quality human motion video generation with confidence-aware pose guidance

    Yuang Zhang, Jiaxi Gu, Li-Wen Wang, Han Wang, Junqi Cheng, Yuefeng Zhu, and Fangyuan Zou. Mimicmo- tion: High-quality human motion video generation with confidence-aware pose guidance. In International Confer- ence on Machine Learning, 2025. 1, 2, 3, 4, 8, 9, 11

    2025

  59. [67]

    PaMIR: Parametric model-conditioned implicit representa- tion for image-based human reconstruction

    Zerong Zheng, Tao Yu, Yebin Liu, and Qionghai Dai. PaMIR: Parametric model-conditioned implicit representa- tion for image-based human reconstruction. TPAMI, 2021. 3

    2021

  60. [68]

    AvatarRex: Real-time expressive full- body avatars

    Zerong Zheng, Xiaochen Zhao, Hongwen Zhang, Boning Liu, and Yebin Liu. AvatarRex: Real-time expressive full- body avatars. ACM TOG, 2023. 3

    2023

  61. [69]

    Champ: Controllable and consistent human image ani- mation with 3D parametric guidance

    Shenhao Zhu, Junming Leo Chen, Zuozhuo Dai, Zilong Dong, Yinghui Xu, Xun Cao, Yao Yao, Hao Zhu, and Siyu Zhu. Champ: Controllable and consistent human image ani- mation with 3D parametric guidance. In ECCV, 2024. 2, 3, 8, 9, 11

    2024

  62. [70]

    IDOL: Instant photorealistic 3D human creation from a sin- gle image

    Yiyu Zhuang, Jiaxi Lv, Hao Wen, Qing Shuai, Ailing Zeng, Hao Zhu, Shifeng Chen, Yujiu Yang, Xun Cao, and Wei Liu. IDOL: Instant photorealistic 3D human creation from a sin- gle image. arXiv preprint arXiv:2412.14963 , 2024. 1, 2, 3

    2024 arXiv

Pith tools

Reviewed August 5, 2026 · model on record in the stance chip above.