Pith. sign in

REVIEW 3 major objections 5 minor 40 references

Free-viewpoint Human Animation with Pose-correlated Reference Selection

T0 review · 3 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash

Pith's one-line read A pose-correlated reference selection network uses multiple reference images to animate humans under large viewpoint changes.

desk verdict A solid multi-reference human animation paper with a real dataset and a coherent selection mechanism, but the headline SOTA claim rests on an uncontrolled baseline comparison. read the letter →

arxiv 2412.17290 v2 pith:CSETESKQ submitted 2024-12-23 cs.CV

classification cs.CV
keywords humananimationfree-viewpointvideosynthesisdiffusionmodelsmultiplereferenceimagesposecorrelationadaptiveselectionnovelviewcharacter
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper tries to establish that reference-based human animation can survive large viewpoint and camera-distance changes if the network is allowed to look at several reference images instead of one, and if it is told which parts of those references are relevant for the target pose. The authors argue that a single image simply lacks the appearance information needed for close-up and wide-shot variations, so they add a pose correlation module that compares target and reference poses and an adaptive selection that keeps only the most relevant reference features. On a new multi-shot dataset of public talks and on the DyMVHumans benchmark, they report that their model with the same number of references outperforms current single-reference methods under large viewpoint change, and that quality improves as more references are added. If true, this would make camera control and shot-type planning possible for image-driven human animation without relying on 3D reconstruction.

What carries the argument

The load-bearing mechanism is the pose correlation module paired with adaptive reference selection. For each reference pose $P^i_{\text{ref}}$ and target pose $P^j_{\text{tgt}}$, two separate pose encoders produce features $F^i_{\text{ref}}$ and $F^j_{\text{tgt}}$; a transformer with cross-attention then builds a correlation map $R_{i,j} = f_{\text{zero}} \circ T(W_q F^i_{\text{ref}}, W_k F^j_{\text{tgt}}, W_v F^j_{\text{tgt}})$ that scores how informative each spatial region of the reference is for the target viewpoint. These scores are flattened and concatenated, and the top-$K_l$ reference tokens are selected and multiplied by their correlation values before being injected into each denoising UNet layer. A uniform-sampling companion term during training keeps the non-differentiable argsort from trapping the network in a poor local minimum.

What would settle it

Take the trained model and replace the top-K correlation selection at test time with a random selection of the same number of reference feature tokens. If L1, PSNR, LPIPS, MOVIE, and FVD on the large-viewpoint test splits of both datasets stay essentially unchanged, then pose-correlated selection is not what drives the quality gains, and the evidence would shift to the multiple-reference training alone. A second check is to inspect whether the top-K tokens' spatial locations match the reference regions a human would call informative, such as head, hands, and visible torso, across clips with zoom-in and zoom-out; the current qualitative support is a single visualization.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central discovery is that the bottleneck for free-viewpoint human animation is not the diffusion model's capacity but the information supplied by a single reference image. The authors show that a double-UNet diffusion architecture can be extended to accept $N$ reference images at roughly constant cost if a learned pose correlation module produces a correlation map $R_{i,j}$ between each reference pose and the target pose, and a top-$K$ selection step keeps only the most correlated reference feature tokens. They further show that training with multiple references improves results even when only one reference is available at inference, and that the correlation map visually concentrates on informative regions such as the head and hands. The quantitative claim is that, with the same number of reference images, this design performs favorably against current single-reference methods under large viewpoint change.

Load-bearing premise

The argument depends on the pose correlation module's cross-attention producing meaningful similarity scores between target and reference pose features even when the poses are not spatially aligned; if those scores do not localize the informative reference regions under large viewpoint changes, the top-K selection would keep near-random tokens and the reported gains would disappear.

Editorial extensions

If this is right

  • If the reported comparisons hold, adding more reference images improves video quality under viewpoint change, with measurable gains from one to two references on both evaluated datasets.
  • If the reported comparisons hold, training on multiple references transfers to single-reference inference, so even users who provide one image get better appearance consistency than single-reference baselines.
  • If the reported comparisons hold, the top-$K$ selection keeps inference cost roughly independent of the number of references, allowing up to ten reference images in the reported experiments.
  • If the reported comparisons hold, the new multi-shot dataset supplies an in-the-wild benchmark with both viewpoint and camera-distance variation, which the authors say no previous public dataset provided.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Beyond the paper, correlation-guided token pruning could generalize to any multi-view conditioning task where a cheap geometric signal such as pose, depth, or camera parameters stands in for dense appearance correspondence, not just human animation.
  • Beyond the paper, the design implies a testable separation: because top-K selection is only needed to control cost, one could ablate the correlation module against random selection under a fixed compute budget; if random tokens perform equally, the module's benefit would be attributable to the multiple-reference training rather than to pose-correlated selection.
  • Beyond the paper, since the correlation maps encode which reference body regions match a target viewpoint, they could be reused as soft correspondences for camera or viewpoint estimation, a use the paper does not explore.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper proposes a diffusion-based human animation method that accepts multiple reference images to handle large viewpoint and camera-distance changes. A pose correlation module computes correlation maps between target and reference poses, and an adaptive reference selection strategy feeds only the top-K reference features into the denoising UNet to bound computational cost. The authors introduce MSTed, a new multi-shot TED-talk dataset of 1,084 identities with large viewpoint/distance variation, and evaluate on MSTed and DyMVHumans against MagicAnimate, AnimateAnyone, and Champ. The main claim is that, with the same number of reference images, the proposed model outperforms these SOTA methods under large viewpoint change, and that increasing the number of references further improves quality. The paper also includes ablations showing the contributions of the multiple-reference mechanism, pose correlation module, and reference selection.

Significance. If the reported results hold, the paper makes a useful contribution: it identifies a real limitation of single-reference human animation under viewpoint/camera-distance changes and proposes a practical multi-reference mechanism with a selection strategy that avoids unbounded growth in the denoising network's input. The MSTed dataset is a potentially valuable resource for training and benchmarking free-viewpoint human animation, with real-world zoom-in/zoom-out variation that existing multi-view studio datasets lack. The paper also provides quantitative tables, qualitative comparisons, and ablations. However, the central superiority claim depends on an evaluation protocol that is not fully specified, and no uncertainty estimates are given, so the strength of the evidence is currently limited.

major comments (3)
  1. [Section 4.2, Tables 2-3] The manuscript does not state whether MagicAnimate, AnimateAnyone, and Champ were retrained on the MSTed and DyMVHumans training splits or evaluated using their released checkpoints. Because MSTed contains substantially larger viewpoint and camera-distance variation than the typical training data of these single-reference methods, a released checkpoint may be at a large, unquantified disadvantage due to domain shift. The abstract's claim that "with the same number of reference images, our model performs favorably" is therefore confounded by training-data exposure unless the baselines are trained under the same protocol. Please specify the evaluation protocol explicitly; ideally, retrain or fine-tune all baselines on the same training data and report those numbers alongside the current ones.
  2. [Tables 2-4] No error bars, confidence intervals, or multiple-seed runs are reported for any metric. While some gaps (e.g., Table 2 LPIPS 0.2045 vs. 0.4618) are large, other comparisons (e.g., Table 3 FVD Ours(R=1) 9.047 vs. AnimateAnyone 12.300; Ours(R=2) PSNR 32.49 vs. Ours(R=1) 32.18) are smaller and could lie within run-to-run variability. Please report mean and standard deviation over at least three random seeds, or bootstrap confidence intervals, and state the number of test clips used. This is necessary to assess whether the reported improvements are meaningful.
  3. [Section 3.3 and Figure 6] The central mechanism of pose-correlated reference selection is validated only through a single qualitative visualization (Figure 6) plus an ablation (Table 4). The paper would be substantially strengthened by a quantitative evaluation of the selection mechanism itself, for example: (i) compare the selected top-K tokens against ground-truth visible body-part annotations on a subset of data; (ii) sweep K and show the effect on quality and computational cost; or (iii) compare against alternative selection strategies (random selection, uniform attention, or full-feature concatenation without selection). As written, the reader cannot tell whether the correlation map actually localizes informative regions or merely acts as a learned soft gate with no specific pose-correspondence semantics.
minor comments (5)
  1. [Abstract and Section 3.3] The abstract says the method "eliminate[s] the computational cost" of multiple references, but the reference UNet still encodes all N reference images and the pose correlation module computes N×T correlation maps. Only the denoising UNet's input is bounded by top-K selection. Please rephrase to "reduces the marginal cost in the denoising UNet" to avoid overclaiming.
  2. [Section 4.3, Table 4] The caption of Table 4 does not state which dataset the ablation is performed on; please add this information, as the conclusion "Ours (R=2) achieves the best results" may not transfer to DyMVHumans.
  3. [Section 3.4] Training details are minimal: the paper only says "We follow the training manner as in AnimateAnyone and Champ." Please provide key hyperparameters, the value of M (maximum reference count during training), the value of K_l per layer, the number of GPUs, training iterations, and the resolution used, so that the experiments can be reproduced.
  4. [Figure 4] The caption contains a typo: "Ground True" should be "Ground Truth."
  5. [Section 2 (Related Work)] There is a typo: "keypoitns pairs" should be "keypoint pairs." Also, some references (e.g., Champ) are cited in a preprint form without publication venue; please update if a published version exists.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: the method is a learned generative model trained end-to-end, evaluated against external baselines, and no fitted quantity is renamed as a prediction.

full rationale

No circular step is present. The paper's central components, the pose correlation module (Eqs. 1-2) and the adaptive reference selection strategy (Eqs. 4-6), are trainable network modules optimized with the diffusion noise-prediction objective; their outputs are not defined in terms of the evaluation metrics, and no quantity reduces by construction to a fitted input. The claimed improvements are measured against ground-truth videos using standard metrics (L1, PSNR, LPIPS, MOVIE, FVD), and the ablations in Table 4 provide a controlled comparison of the baseline with and without the proposed modules. The comparisons with MagicAnimate, AnimateAnyone, and Champ use external published baselines, and the authors' prior talking-head papers are cited only as related work, not as load-bearing support for the central claim. The acknowledged limitation in Section 6, that performance relies on reference image quality, is an honest scope statement rather than an input-output equivalence. Therefore the derivation chain is self-contained and the score is 0.

Assumptions & free parameters 2 free parameters · 3 assumptions · 0 invented entities

The central claim rests on the quality of the new MSTed dataset, on the sufficiency of 2D pose as a viewpoint signal, and on the learned comparability of pose features across viewpoints. These are domain assumptions that are plausible but not proven, and they are distinct from the empirical claim of SOTA performance.

free parameters (2)
  • K_l (number of selected reference tokens per layer) = not reported
    The top-K selection in Eq. (5) depends on K_l, but its value is never specified, which affects both quality and computational cost.
  • M (maximum number of reference images during training) = not reported
    Training samples a random number of references between 1 and M; M is not stated, yet the model is tested with up to 10 references, leaving this generalization unquantified.
assumptions (3)
  • domain assumption The MSTed dataset, built via DINOv2 shot segmentation and YOLO filtering, contains clips of the same identity across varied viewpoints and camera distances.
    The model's ability to learn viewpoint generalization rests on this data premise; errors in automatic segmentation or identity association would introduce spurious training targets. See Section 3.5.
  • domain assumption A 2D target pose sequence (DWpose) is sufficient to specify the desired viewpoint and camera-to-subject distance.
    The method has no explicit camera parameters or 3D structure; free-viewpoint control is encoded entirely through 2D skeletons. See Section 3.1 and the description of driving signals.
  • ad hoc to paper The pose encoders E^P_ref and E^P_tgt produce features that are comparable across non-aligned viewpoints.
    The pose correlation module (Eq. 2) is built on this assumption; if the features are not compatible, the correlation maps and selection are meaningless. This is the key modeling premise of the paper.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Free-viewpoint Human Animation with Pose-correlated Reference Selection." pith.science (2026). https://pith.science/paper/CSETESKQ

@misc{pith2026241217290,
  author       = {Pith},
  title        = {Pith review of: Free-viewpoint Human Animation with Pose-correlated Reference Selection},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/CSETESKQ}},
  note         = {Machine review of arXiv:2412.17290}
}
read the original abstract

Diffusion-based human animation aims to animate a human character based on a source human image as well as driving signals such as a sequence of poses. Leveraging the generative capacity of diffusion model, existing approaches are able to generate high-fidelity poses, but struggle with significant viewpoint changes, especially in zoom-in/zoom-out scenarios where camera-character distance varies. This limits the applications such as cinematic shot type plan or camera control. We propose a pose-correlated reference selection diffusion network, supporting substantial viewpoint variations in human animation. Our key idea is to enable the network to utilize multiple reference images as input, since significant viewpoint changes often lead to missing appearance details on the human body. To eliminate the computational cost, we first introduce a novel pose correlation module to compute similarities between non-aligned target and source poses, and then propose an adaptive reference selection strategy, utilizing the attention map to identify key regions for animation generation. To train our model, we curated a large dataset from public TED talks featuring varied shots of the same character, helping the model learn synthesis for different perspectives. Our experimental results show that with the same number of reference images, our model performs favorably compared to the current SOTA methods under large viewpoint change. We further show that the adaptive reference selection is able to choose the most relevant reference regions to generate humans under free viewpoints.

Figures

Figures reproduced from arXiv: 2412.17290 by the authors.

Figure 1
Figure 1. In this work, we aim to address the challenging task of [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. The illustration of our framework. Our framework feed a reference set [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. The illustration of pose correlation module ( [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (3 more)
Figure 4
Figure 4. Figure 4: Qualitative results in Multi-Shot Ted dataset and DyMVHuman dataset. Compared with compared methods, our model can [PITH_FULL_IMAGE:figures/full_fig_p007_4.png]
Figure 5
Figure 5. Figure 5: The visualization of our ablation study. [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]
Figure 6
Figure 6. Figure 6: Illustration of our learned correlation map. Our corre [PITH_FULL_IMAGE:figures/full_fig_p008_6.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

40 extracted references · 25 canonical work pages

  1. [1]

    Generative novel view synthesis with 3d-aware diffusion models

    Eric R Chan, Koki Nagano, Matthew A Chan, Alexander W Bergman, Jeong Joon Park, Axel Levy, Miika Aittala, Shalini De Mello, Tero Karras, and Gordon Wetzstein. Generative novel view synthesis with 3d-aware diffusion models. In ICCV, 2023. 3

  2. [2]

    Motion-conditioned diffu- sion model for controllable video synthesis

    Tsai-Shien Chen, Chieh Hubert Lin, Hung-Yu Tseng, Tsung- Yi Lin, and Ming-Hsuan Yang. Motion-conditioned diffu- sion model for controllable video synthesis. arXiv preprint arXiv:2304.14404, 2023. 2

  3. [3]

    Generative adversarial nets

    Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. Generative adversarial nets. NeurIPS, 2014. 2

  4. [4]

    Denoising diffu- sion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffu- sion probabilistic models. In NeurIPS, 2020. 1

  5. [5]

    Implicit identity representation conditioned memory compensation network for talking head video generation

    Fa-Ting Hong and Dan Xu. Implicit identity representation conditioned memory compensation network for talking head video generation. In ICCV, 2023. 2

  6. [6]

    Depth-aware generative adversarial network for talking head video generation

    Fa-Ting Hong, Longhao Zhang, Li Shen, and Dan Xu. Depth-aware generative adversarial network for talking head video generation. In CVPR, 2022. 2

  7. [7]

    Dagan++: Depth- aware generative adversarial network for talking head video generation

    Fa-Ting Hong, Li Shen, and Dan Xu. Dagan++: Depth- aware generative adversarial network for talking head video generation. IEEE TPAMI, 2023. 2

  8. [8]

    DreamHead: Learning Spatial-Temporal Correspondence via Hierarchical Diffusion for Audio-driven Talking Head Synthesis

    Fa-Ting Hong, Yunfei Liu, Yu Li, Changyin Zhou, Fei Yu, and Dan Xu. Dreamhead: Learning spatial-temporal corre- spondence via hierarchical diffusion for audio-driven talking head synthesis. arXiv preprint arXiv:2409.10281, 2024. 1

Show all 40 references
  1. [9]

    Animate anyone: Consistent and controllable image- to-video synthesis for character animation

    Li Hu. Animate anyone: Consistent and controllable image- to-video synthesis for character animation. In CVPR, pages 8153–8163, 2024. 1, 2, 3, 4, 5, 6

  2. [10]

    Surmo: Surface- based 4d motion modeling for dynamic human rendering

    Tao Hu, Fangzhou Hong, and Ziwei Liu. Surmo: Surface- based 4d motion modeling for dynamic human rendering. In CVPR, 2024. 3

  3. [11]

    Dreampose: Fashion image-to-video synthesis via stable diffusion

    Johanna Karras, Aleksander Holynski, Ting-Chun Wang, and Ira Kemelmacher-Shlizerman. Dreampose: Fashion image-to-video synthesis via stable diffusion. In ICCV,

  4. [12]

    HUGS: Human gaussian splatting

    Muhammed Kocabas, Jen-Hao Rick Chang, James Gabriel, Oncel Tuzel, and Anurag Ranjan. HUGS: Human gaussian splatting. In 2024 IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition (CVPR), 2024. 3

  5. [13]

    Vivid-1-to-3: Novel view synthesis with video diffusion models

    Jeong-gi Kwak, Erqun Dong, Yuhe Jin, Hanseok Ko, Shweta Mahajan, and Kwang Moo Yi. Vivid-1-to-3: Novel view synthesis with video diffusion models. In CVPR, 2024. 3

  6. [14]

    Liquid warping gan: A unified framework for human motion imitation, appearance transfer and novel view synthesis

    Wen Liu, Zhixin Piao, Jie Min, Wenhan Luo, Lin Ma, and Shenghua Gao. Liquid warping gan: A unified framework for human motion imitation, appearance transfer and novel view synthesis. In ICCV, 2019. 3

  7. [15]

    Smpl: A skinned multi- person linear model

    Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black. Smpl: A skinned multi- person linear model. In Seminal Graphics Papers: Pushing the Boundaries, Volume 2, pages 851–866. 2023. 2

  8. [16]

    Nerf: Representing scenes as neural radiance fields for view syn- thesis

    Ben Mildenhall, Pratul P Srinivasan, Matthew Tancik, Jonathan T Barron, Ravi Ramamoorthi, and Ren Ng. Nerf: Representing scenes as neural radiance fields for view syn- thesis. Communications of the ACM , 65(1):99–106, 2021. 3

  9. [17]

    Maxime Oquab, Timoth ´ee Darcet, Theo Moutakanni, Huy V . V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haziza, Francisco Massa, Alaaeldin El-Nouby, Rus- sell Howes, Po-Yao Huang, Hu Xu, Vasu Sharma, Shang- Wen Li, Wojciech Galuba, Mike Rabbat, Mido Assran, Ni...

  10. [18]

    Neural body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans

    Sida Peng, Yuanqing Zhang, Yinghao Xu, Qianqian Wang, Qing Shuai, Hujun Bao, and Xiaowei Zhou. Neural body: Implicit neural representations with structured latent codes for novel view synthesis of dynamic humans. In CVPR,

  11. [19]

    You only look once: Unified, real-time object detection

    J Redmon. You only look once: Unified, real-time object detection. In CVPR, 2016. 6

  12. [20]

    Dreamgaussian4d: Genera- tive 4d gaussian splatting

    Jiawei Ren, Liang Pan, Jiaxiang Tang, Chi Zhang, Ang Cao, Gang Zeng, and Ziwei Liu. Dreamgaussian4d: Genera- tive 4d gaussian splatting. arXiv preprint arXiv:2312.17142,

  13. [21]

    Motion tuned spatio-temporal quality assessment of natural videos

    Kalpana Seshadrinathan and Alan Conrad Bovik. Motion tuned spatio-temporal quality assessment of natural videos. IEEE TIP, 19(2):335–350, 2009. 6

  14. [22]

    Human4dit: 360-degree human video gen- eration with 4d diffusion transformer

    Ruizhi Shao, Youxin Pang, Zerong Zheng, Jingxiang Sun, and Yebin Liu. Human4dit: 360-degree human video gen- eration with 4d diffusion transformer. ACM Transactions on Graphics (TOG), 43(6), 2024. 1, 3

  15. [23]

    First order motion model for image animation

    Aliaksandr Siarohin, St ´ephane Lathuili`ere, Sergey Tulyakov, Elisa Ricci, and Nicu Sebe. First order motion model for image animation. Advances in neural information processing systems, 32, 2019. 2

  16. [24]

    Denoising diffusion implicit models

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502, 2020. 1

  17. [25]

    Structure-aware motion transfer with deformable anchor model

    Jiale Tao, Biao Wang, Borun Xu, Tiezheng Ge, Yuning Jiang, Wen Li, and Lixin Duan. Structure-aware motion transfer with deformable anchor model. In CVPR, 2022. 2

  18. [26]

    Learn- ing motion refinement for unsupervised face animation

    Jiale Tao, Shuhang Gu, Wen Li, and Lixin Duan. Learn- ing motion refinement for unsupervised face animation. NeurIPS, 2024. 2

  19. [27]

    Edge: Editable dance generation from music

    Jonathan Tseng, Rodrigo Castellon, and Karen Liu. Edge: Editable dance generation from music. In CVPR, 2023. 5

  20. [28]

    Disco: Disentangled control for realistic human dance generation

    Tan Wang, Linjie Li, Kevin Lin, Yuanhao Zhai, Chung- Ching Lin, Zhengyuan Yang, Hanwang Zhang, Zicheng Liu, 9 and Lijuan Wang. Disco: Disentangled control for realistic human dance generation. In CVPR, 2024. 2

  21. [29]

    Novel view synthesis with diffusion models

    Daniel Watson, William Chan, Ricardo Martin-Brualla, Jonathan Ho, Andrea Tagliasacchi, and Mohammad Norouzi. Novel view synthesis with diffusion models. arXiv preprint arXiv:2210.04628, 2022. 3

  22. [30]

    Srinivasan, Jonathan T

    Chung-Yi Weng, Brian Curless, Pratul P. Srinivasan, Jonathan T. Barron, and Ira Kemelmacher-Shlizerman. Hu- manNeRF: Free-viewpoint rendering of moving people from monocular video. In Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition (CVPR) ,

  23. [31]

    Recent advances in 3d gaussian splatting

    Tong Wu, Yu-Jie Yuan, Ling-Xiao Zhang, Jie Yang, Yan- Pei Cao, Ling-Qi Yan, and Lin Gao. Recent advances in 3d gaussian splatting. Computational Visual Media, 10(4):613– 642, 2024. 3

  24. [32]

    Aniportraitgan: ani- matable 3d portrait generation from 2d image collections

    Yue Wu, Sicheng Xu, Jianfeng Xiang, Fangyun Wei, Qifeng Chen, Jiaolong Yang, and Xin Tong. Aniportraitgan: ani- matable 3d portrait generation from 2d image collections. In SIGGRAPH Asia, 2023. 3

  25. [33]

    Mvhumannet: A large- scale dataset of multi-view daily dressing human captures

    Zhangyang Xiong, Chenghong Li, Kenkun Liu, Hongjie Liao, Jianqiao Hu, Junyi Zhu, Shuliang Ning, Lingteng Qiu, Chongjie Wang, Shijie Wang, et al. Mvhumannet: A large- scale dataset of multi-view daily dressing human captures. In CVPR, 2024. 5

  26. [34]

    Magicanimate: Temporally consistent human image animation using diffusion model

    Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Hanshu Yan, Jia-Wei Liu, Chenxu Zhang, Jiashi Feng, and Mike Zheng Shou. Magicanimate: Temporally consistent human image animation using diffusion model. In CVPR, pages 1481– 1490, 2024. 1, 2, 4, 6

  27. [35]

    Effec- tive whole-body pose estimation with two-stages distillation

    Zhendong Yang, Ailing Zeng, Chun Yuan, and Yu Li. Effec- tive whole-body pose estimation with two-stages distillation. In ICCV, 2023. 2

  28. [36]

    Mim- icmotion: High-quality human motion video generation with confidence-aware pose guidance

    Yuang Zhang, Jiaxi Gu, Li-Wen Wang, Han Wang, Junqi Cheng, Yuefeng Zhu, and Fangyuan Zou. Mim- icmotion: High-quality human motion video generation with confidence-aware pose guidance. arXiv preprint arXiv:2406.19680, 2024. 2

  29. [37]

    Thin-plate spline motion model for image animation

    Jian Zhao and Hui Zhang. Thin-plate spline motion model for image animation. In CVPR, 2022. 2

  30. [38]

    Pku- dymvhumans: A multi-view video benchmark for high- fidelity dynamic human modeling

    Xiaoyun Zheng, Liwei Liao, Xufeng Li, Jianbo Jiao, Rongjie Wang, Feng Gao, Shiqi Wang, and Ronggang Wang. Pku- dymvhumans: A multi-view video benchmark for high- fidelity dynamic human modeling. CVPR, 2024. 2, 5, 6

  31. [39]

    Zero-shot high-fidelity and pose- controllable character animation

    Bingwen Zhu, Fanyi Wang, Tianyi Lu, Peng Liu, Jing- wen Su, Jinxiu Liu, Yanhao Zhang, Zuxuan Wu, Guo-Jun Qi, and Yu-Gang Jiang. Zero-shot high-fidelity and pose- controllable character animation. In IJCAI, 2024. 1

  32. [40]

    Champ: Controllable and consistent human image animation with 3d parametric guidance

    Shenhao Zhu, Junming Leo Chen, Zuozhuo Dai, Yinghui Xu, Xun Cao, Yao Yao, Hao Zhu, and Siyu Zhu. Champ: Controllable and consistent human image animation with 3d parametric guidance. arXiv preprint arXiv:2403.14781 ,

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.