Pith. sign in

REVIEW 5 major objections 5 minor 3 cited by

MotionWavelet: Human Motion Prediction via Wavelet Manifold Learning

T0 review · 5 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper claims that predicting future human motion is more accurate when a diffusion model is trained and sampled in a wavelet manifold rather than in raw pose or phase space, and backs the claim with error scores on two standard…

desk verdict A plausible wavelet-diffusion combination for human motion prediction, but the inference-time conditioning padding is unspecified and one ablation row appears to copy a baseline; the accuracy claims need major revision before they can be trusted. read the letter →

arxiv 2411.16964 v2 pith:FFO4EIRK submitted 2024-11-25 cs.CV cs.GRcs.RO

Yuming Feng , Zhiyang Dou , Ling-Hao Chen , Yuan Liu , Tianyu Li , Jingbo Wang , Zeyu Cao , Wenping Wang
show 2 more authors
Taku Komura Lingjie Liu
This is my paper · ORCID
classification cs.CVcs.GRcs.RO
keywords humanmotionpredictiondiscretewavelettransformdiffusionmodelmanifoldnon-stationaryattentionguidancecontrollable
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

MotionWavelet sets out to improve short-horizon human motion prediction by moving the prediction problem out of raw pose space into a wavelet manifold. The paper argues that a discrete wavelet transform along both time and joint axes separates a motion into low- and high-frequency subbands, so a diffusion model trained on these subbands can represent subtle transitions and non-stationary dynamics that Fourier-phase or DCT representations miss. The reported experiments support this by showing the method outperforming earlier approaches on HumanEva-I and Human3.6M on final displacement error and multi-modal accuracy metrics, and by demonstrating controllable joint-level and motion-switch prediction. A sympathetic reader would care because the same frequency-domain framing might transfer to other problems where short observations must be extrapolated into structured, temporally coherent outputs.

What carries the argument

The load-bearing object is the Motion Wavelet Manifold, defined as the concatenation of the four subbands from a 2-D discrete wavelet transform of a motion sequence: approximation, temporal detail, spatial detail, and spatio-temporal detail. It carries the argument because it is the space in which the diffusion model trains and samples, and because its explicit separation of high- and low-frequency content is what the paper claims lets the model handle non-stationary, abrupt motion. Two auxiliary mechanisms keep denoising on that manifold: Wavelet Manifold Shaping Guidance applies iDWT followed by DWT after every denoising step, and Temporal Attention-Based Guidance uses the denoiser's self-attention maps to re-noise temporally salient frames.

What would settle it

Re-run the released system on Human3.6M with two different padding choices for the observed frames, zero padding and replication of the boundary values, keeping everything else fixed, and compare final displacement error. If the difference exceeds the gap between MotionWavelet and the second-best method, the reported accuracy gain is not attributable to wavelet manifold learning alone.

Watch

Extended reading notes

Core claim

The paper's central claim is that human motion prediction improves when a diffusion model operates on a manifold built from the 2-D discrete wavelet transform of the full observed-plus-future sequence. The motion tensor $x \in \mathbb{R}^{(H+F)\times 3J}$ is decomposed into four subbands $y_{h,v}$ by low- and high-pass filtering along time and joints; concatenating them defines the wavelet manifold. A DDIM-style diffusion model is trained to denoise these latent coefficients conditional on the DWT of the observed history, and at sampling two mechanisms steer the denoising: Wavelet Manifold Shaping Guidance, which re-projects each intermediate denoised latent through iDWT then DWT to keep it on the manifold, and Temporal Attention-Based Guidance, which re-noises frames whose attention scores exceed a threshold so the model emphasizes temporally coherent motion. The paper reports best or second-best accuracy on both benchmarks, with the Bior2.8 wavelet, a small classifier-free guidance scale, and a cosine noise schedule.

Load-bearing premise

The load-bearing premise is that the observed frames are padded to the full sequence length identically when training the diffusion model and when sampling from it; the paper does not state the padding scheme.

Editorial extensions

If this is right

  • On HumanEva-I, MotionWavelet reports the lowest final displacement error, multi-modal ADE, and multi-modal FDE among the compared methods.
  • On Human3.6M, it reports the best FDE and MMFDE while keeping diversity, measured by APD, comparable to leading methods.
  • Predicted motions track ground truth through abrupt transitions such as sudden stops and starts, a regime where periodic phase models are expected to fail.
  • The denoising process can accept a mask blending ground-truth or target motion at chosen joints or frames, yielding controllable motion prediction.
  • The method works best with a small classifier-free guidance scale ($w<1$), which the paper ties to the wavelet manifold's explicit high-frequency noise representation.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Inference: the same wavelet-manifold construction could be applied to other structured extrapolation problems, such as hand motion, instrumented trajectories, or partially observed navigation paths, where abrupt transitions matter; the paper only evaluates full-body mocap.
  • Inference: the wavelet-basis sweep suggests a testable trade-off: a smoother basis may fit slow, fluid motions while a sharper basis captures impacts and stops, and pairing basis choice to motion style is not examined in the paper.
  • Inference: since controllable prediction is demonstrated by masking at joint or frame level, a natural next step is interactive editing of predicted motion, where a user can specify target joints or target frames after sampling.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

5 major / 5 minor

Summary. The paper proposes MotionWavelet, a human motion prediction method that transforms motion sequences into a wavelet-domain manifold via a 2D discrete wavelet transform, trains a DDIM-based diffusion model on this manifold conditioned on the wavelet coefficients of the observed history, and adds two inference-time mechanisms: Wavelet Manifold Shaping Guidance (WMSG), which projects each denoised latent through an iDWT followed by a DWT, and Temporal Attention-Based Guidance (TABG), which re-noises and denoises temporally attended regions under an attention mask. Experiments on HumanEva-I and Human3.6M report improved FDE, MMADE, and MMFDE over prior methods, along with ablations on wavelet bases, diffusion schedulers, and guidance hyperparameters.

Significance. The central idea of performing diffusion in a wavelet-domain latent space is plausible and potentially useful: it explicitly separates frequency bands and may help capture non-stationary motion transitions. The manuscript contains a fairly extensive set of ablations, and the authors commit to releasing code and models, which would help reproducibility. However, the current evidence is weakened by an apparent data inconsistency in Table 2, an underspecified conditioning-padding protocol that directly affects the classifier-free guidance input, an ambiguous sampling algorithm, and an overstated accuracy claim on the ADE metric. These issues need to be resolved before the empirical claims can be accepted.

major comments (5)
  1. [Section 4.7.1, Table 2] The row labeled 'Wavelet' in Table 2 reports APD=6.301, ADE=0.369, FDE=0.480, which are exactly the HumanMAC baseline numbers from Table 1 (APD=6.301, ADE=0.369, FDE=0.480), not the proposed MotionWavelet numbers (APD=6.506, ADE=0.376, FDE=0.408). Consequently, Table 2 does not demonstrate that the wavelet representation outperforms the phase representation; it appears to compare a phase-based variant with an unrelated published baseline. This undermines the conclusion of Section 4.7.1 and must be corrected with the actual MotionWavelet results.
  2. [Section 3.2.2 and Algorithm 1] The conditioning input is not defined consistently. Training uses y(0)=DWT(x1:H) (Eq. 5), whose temporal dimension is roughly K_H=floor((H+l-1)/2), while the noisy latent y(t) has temporal dimension K=floor((H+F+l-1)/2). Algorithm 1 refers to 'Conditioning padded history y(0)_pad' but never states how the H observed frames are padded to the full H+F length before applying the DWT, or how the wavelet-domain condition is padded to length K. Because the DWT in Eq. (3) is a convolution followed by downsampling, DWT of a zero-padded history is not equal to the zero-padding of DWT(x1:H). If training and inference use different padding schemes, the classifier-free guidance term in Eq. (7) is evaluated with a condition distribution the network never saw, and the reported gains could be artifacts of the padding scheme rather than of wavelet manifold learning. The paper must specify the exact padding procedure and confirm that it is identical in training and inference.
  3. [Section 3.2.2 and Algorithm 1] The sampling algorithm is internally ambiguous: the final return statement 'x = iDWT(y(0))' uses y(0) as if it were the predicted clean latent, but y(0) was defined earlier as the conditioning latent DWT(x1:H). The loop does not assign a new value to y(0), so it is unclear which latent is decoded to produce the final prediction. Please rename the conditioning variable, insert the missing assignment, and state explicitly how the final prediction is obtained.
  4. [Section 4.5.1 and Table 1] The statement 'MotionWavelet achieves the overall best performance' is not supported by Table 1. On HumanEva-I, HumanMAC has lower ADE (0.209 vs 0.235); on Human3.6M, CoMotion (0.350) and HumanMAC (0.369) both have lower ADE than MotionWavelet (0.376). Claiming consistent superiority in accuracy requires more than winning FDE, MMADE, and MMFDE, especially since ADE is the primary whole-sequence accuracy metric in this literature. In addition, Table 1 reports no error bars or number of seeds, so the differences cannot be assessed statistically. Please report mean and standard deviation over multiple runs and revise the claim accordingly.
  5. [Tables 2 and 3] The RMSE values in Tables 2 and 3 (e.g., 3.572e-8 for Position RMSE in Table 3) are physically implausible for pose coordinates and are not explained anywhere in the text. If these quantities are computed on normalized wavelet coefficients rather than on reconstructed positions, the metric definition and normalization must be stated explicitly; otherwise the ablation claims involving these values cannot be interpreted or reproduced.
minor comments (5)
  1. [Algorithm 1 and Eq. (11)] The notation for the noise predictor is inconsistent: Eq. (11) writes ϵθ(ˆy(t)) while Algorithm 1 writes ϵθ(ˆy(t), t). Please unify the notation.
  2. [Section 3.2.2, Eq. (5)] The symbol y(0) is overloaded: it denotes both the clean target wavelet DWT(x) and the conditioning wavelet DWT(x1:H). Please use a distinct symbol, such as c, for the condition.
  3. [Appendix A] Appendix A states that for HumanEva-I, TABG and WMSG are not applied, while the abstract and introduction present both as core components of the method. Please state clearly which final results use which components and whether the ablation conclusions transfer to HumanEva-I.
  4. [Section 4.6] The controllable prediction section blends in ground-truth motion during inference, so it should be explicitly framed as an editing/control demonstration rather than as a prediction task.
  5. [Section 3.2.1] Appendix A mentions that the decomposition level is set to 1, but this detail is not present in the method section. Adding it to Section 3.2.1 would aid reproducibility.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: predictions are evaluated on held-out subjects and the wavelet conditioning is a fixed transform, not a fitted quantity.

full rationale

MotionWavelet is an empirical method paper. Its central claims (lower ADE, FDE, MMADE, MMFDE on HumanEva-I and Human3.6M) are evaluated on held-out subjects (S9, S11 for Human3.6M) against external baselines, so no fitted parameter is relabeled as a prediction. The conditioning used in training, y(0) = DWT(x1:H), is a fixed linear transform with stated filters and zero padding, not a quantity fitted to the evaluation metrics. The Wavelet Manifold Shaping Guidance operation y(t-1) = DWT(iDWT(y(t-1))) is an architectural projection onto the range of the wavelet transform; because the DWT output dimension K x 4D generally exceeds the input dimension under the stated zero-padding and Bior2.8 filters, this is not an identity by construction, and its benefit is validated by ablation rather than assumed as a derived result. The reuse of the TransLinear architecture from HumanMAC [7] is a normal citation of prior published work; it is also a comparison baseline, and the authors do not invoke any uniqueness theorem or self-citation to forbid alternatives. The paper does contain a reproducibility gap: Algorithm 1 refers to a 'Conditioning padded history y(0)_pad' without specifying how the H observed frames are extended to the full H+F length, and Appendix A only states that the padding mode is zero. This is an implementation detail that could affect the conditioning distribution, but it is not circular reasoning, because the conditioning is not a fitted parameter and the reported gains are not a mathematical consequence of the definitions. Overall, the derivation chain is self-contained and empirically grounded, so no circular step is present.

Assumptions & free parameters 6 free parameters · 4 assumptions · 1 invented entities

The central claim depends on the DWT being a faithful representation, on the chosen hyperparameters, and on the benchmark protocol. No code is released.

free parameters (6)
  • CFG guidance scale w = not reported (stated w < 1)
    Controls balance between conditional and unconditional predictions; chosen by observation, no value given in the paper.
  • TABG scale s = 1.0
    Selected via ablation in Table 4.
  • TABG noise scale sigma = 2.5
    Selected via ablation in Table 4.
  • Attention threshold phi = not reported
    Used in Algorithm 1 to threshold attention masks; no numerical value is given in the main text.
  • Neighbor mask width m = not reported
    Used in TABG to mask m neighboring frames; value not specified.
  • Wavelet base = Bior2.8
    Selected by comparing reconstruction RMSE in Table 3, not by prediction metrics.
assumptions (4)
  • domain assumption DWT followed by iDWT reconstructs the motion sequence, so WMSG is a valid projection onto the wavelet manifold.
    Invoked in Eq. (8) of Sec. 3.3; with zero padding and Bior2.8 the reconstruction is only approximate at boundaries.
  • domain assumption The noise predictor TransLinear's self-attention maps encode temporal coherence of motion.
    Sec. 3.3 and Fig. 2; transferred from image-domain self-attention guidance [26] to motion.
  • standard math DDIM and classifier-free guidance equations hold in the wavelet coefficient space.
    Eqs. (5)-(7) in Sec. 3.2.2 follow standard diffusion results.
  • domain assumption Human motion is well represented by a single-level 2D DWT with zero padding.
    Sec. 3.2.1 and Appendix A; no analysis of level or padding effects beyond one ablation.
invented entities (1)
  • Motion Wavelet Manifold
    purpose: Latent representation for the diffusion model; the concatenated DWT subbands are called a manifold.
    It is the output of a fixed linear transform, not a learned structure, and the paper provides no falsifiable handle outside its own pipeline.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MotionWavelet: Human Motion Prediction via Wavelet Manifold Learning." pith.science (2026). https://pith.science/paper/FFO4EIRK

@misc{pith2026241116964,
  author       = {Pith},
  title        = {Pith review of: MotionWavelet: Human Motion Prediction via Wavelet Manifold Learning},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/FFO4EIRK}},
  note         = {Machine review of arXiv:2411.16964}
}
read the original abstract

Modeling temporal characteristics and the non-stationary dynamics of body movement plays a significant role in predicting human future motions. However, it is challenging to capture these features due to the subtle transitions involved in the complex human motions. This paper introduces MotionWavelet, a human motion prediction framework that utilizes Wavelet Transformation and studies human motion patterns in the spatial-frequency domain. In MotionWavelet, a Wavelet Diffusion Model (WDM) learns a Wavelet Manifold by applying Wavelet Transformation on the motion data therefore encoding the intricate spatial and temporal motion patterns. Once the Wavelet Manifold is built, WDM trains a diffusion model to generate human motions from Wavelet latent vectors. In addition to the WDM, MotionWavelet also presents a Wavelet Space Shaping Guidance mechanism to refine the denoising process to improve conformity with the manifold structure. WDM also develops Temporal Attention-Based Guidance to enhance prediction accuracy. Extensive experiments validate the effectiveness of MotionWavelet, demonstrating improved prediction accuracy and enhanced generalization across various benchmarks. Our code and models will be released upon acceptance.

Figures

Figures reproduced from arXiv: 2411.16964 by the authors.

Figure 1
Figure 1. System overview. Our method first converts motion from spatial space to Wavelet mani [PITH_FULL_IMAGE:figures/full_fig_p003_1.png] view at source ↗
Figure 2
Figure 2. Temporal Attention-Based Guidance (TABG). The sequence [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. Qualitative comparisons. The upper part shows predictions for Human3.6M[ [PITH_FULL_IMAGE:figures/full_fig_p008_3.png] view at source ↗
Figures from the paper (8 more)
Figure 4
Figure 4. Figure 4: More qualitative results of MotionWavelet, where the green-purple skeletons represent the [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]
Figure 5
Figure 5. Figure 5: More qualitative results of MotionWavelet, where the green-purple skeletons represent [PITH_FULL_IMAGE:figures/full_fig_p009_5.png]
Figure 6
Figure 6. Figure 6: Visualization of GT and predicted motion curves of the left wrist for “Walking Dog” and [PITH_FULL_IMAGE:figures/full_fig_p010_6.png]
Figure 7
Figure 7. Figure 7: Visualizations showcasing the joint-level control motion prediction results of Motion [PITH_FULL_IMAGE:figures/full_fig_p012_7.png]
Figure 8
Figure 8. Figure 8: Controllable Motion Prediction: Motion Switching. Visualizations showcasing the motion [PITH_FULL_IMAGE:figures/full_fig_p013_8.png]
Figure 9
Figure 9. Figure 9: Controllable Motion Prediction: Motion Switching. Visualizations showcasing the motion [PITH_FULL_IMAGE:figures/full_fig_p014_9.png]
Figure 11
Figure 11. Figure 11: Comparison of prediction results between [PITH_FULL_IMAGE:figures/full_fig_p015_11.png]
Figure 12
Figure 12. Figure 12: Visualization of the attention vectors. The horizontal axis represents the wavelet [PITH_FULL_IMAGE:figures/full_fig_p016_12.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 3 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Go to Zero: Towards Zero-shot Motion Generation with Million-scale Data

    cs.CV 2025-07 conditional novelty 6.0 of 10

    A 7B text-to-motion model trained on the new 2M-clip MotionMillion dataset is reported to generalize zero-shot to complex, out-of-domain prompts.

  2. LuKAN: A Kolmogorov-Arnold Network Framework for 3D Human Motion Prediction

    cs.CV 2025-08 conditional novelty 5.0 of 10

    LuKAN matches state-of-the-art 3D human motion prediction accuracy using a KAN with Lucas polynomial activations and wavelet encoding, with marginal measured gains.

  3. Multi-Stage Knowledge-Distilled VGAE and GAT for Robust Controller-Area-Network Intrusion Detection

    cs.LG 2025-08 unverdicted novelty 4.0 of 10

    A knowledge-distilled graph attention student, trained on VGAE-selected samples, is claimed to improve CAN intrusion detection F1 by 16.2% on average and up to 55% on imbalanced datasets.

Reference graph

Works this paper leans on

87 extracted references · 50 canonical work pages · cited by 3 Pith papers

  1. [1]

    Belfusion: Latent diffusion for behavior-driven human motion prediction

    German Barquero, Sergio Escalera, and Cristina Palmero. Belfusion: Latent diffusion for behavior-driven human motion prediction. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 2317–2327, 2023

    2023

  2. [2]

    best of many

    Apratim Bhattacharyya, Bernt Schiele, and Mario Fritz. Accurate and diverse sampling of sequences based on a “best of many” sample objective. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 8485–8493, 2018

    2018

  3. [3]

    Behavior-driven synthesis of human dynamics

    Andreas Blattmann, Timo Milbich, Michael Dorkenwald, and Bjorn Ommer. Behavior-driven synthesis of human dynamics. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12236–12246, 2021

    2021

  4. [4]

    Motion signal processing

    Armin Bruderlin and Lance Williams. Motion signal processing. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, pages 97–104, 1995

    1995

  5. [5]

    Smpler-x: Scaling up expressive human pose and shape estimation

    Zhongang Cai, Wanqi Yin, Ailing Zeng, Chen Wei, Qingping Sun, Wang Yanjun, Hui En Pang, Haiyi Mei, Mingyuan Zhang, Lei Zhang, et al. Smpler-x: Scaling up expressive human pose and shape estimation. Advances in Neural Information Processing Systems, 36, 2024

    2024

  6. [6]

    Motionclr: Motion generation and training-free editing via understanding attention mechanisms

    Ling-Hao Chen, Wenxun Dai, Xuan Ju, Shunlin Lu, and Lei Zhang. Motionclr: Motion generation and training-free editing via understanding attention mechanisms. arXiv preprint arXiv:2410.18977, 2024

    arXiv 2024

  7. [7]

    Hu- manmac: Masked motion completion for human motion prediction

    Ling-Hao Chen, Jiawei Zhang, Yewen Li, Yiren Pang, Xiaobo Xia, and Tongliang Liu. Hu- manmac: Masked motion completion for human motion prediction. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 9544–9555, 2023

    2023

  8. [8]

    Executing your commands via motion diffusion in latent space

    Xin Chen, Biao Jiang, Wen Liu, Zilong Huang, Bin Fu, Tao Chen, and Gang Yu. Executing your commands via motion diffusion in latent space. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 18000–18010, 2023

    2023

Show all 87 references
  1. [9]

    Purposive learn- ing: Robot reasoning about the meanings of human activities

    Gordon Cheng, Karinne Ramirez-Amaro, Michael Beetz, and Yasuo Kuniyoshi. Purposive learn- ing: Robot reasoning about the meanings of human activities. Science Robotics, 4(26):eaav1530, 2019

    2019

  2. [10]

    Learning phrase representations using rnn encoder-decoder for statistical machine translation

    Kyunghyun Cho. Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078, 2014

    2014 arXiv

  3. [11]

    Mo- tionlcm: Real-time controllable motion generation via latent consistency model

    Wenxun Dai, Ling-Hao Chen, Jingbo Wang, Jinpeng Liu, Bo Dai, and Yansong Tang. Mo- tionlcm: Real-time controllable motion generation via latent consistency model. In European Conference on Computer Vision, pages 390–408. Springer, 2025. 17

    2025

  4. [12]

    Diverse human motion prediction via gumbel-softmax sampling from an auxiliary space

    Lingwei Dang, Yongwei Nie, Chengjiang Long, Qing Zhang, and Guiqing Li. Diverse human motion prediction via gumbel-softmax sampling from an auxiliary space. In Proceedings of the 30th ACM International Conference on Multimedia, pages 5162–5171, 2022

    2022

  5. [13]

    Evidence for a spinal central pattern generator in humans a

    Milan R Dimitrijevic, Yuri Gerasimenko, and Michaela M Pinter. Evidence for a spinal central pattern generator in humans a. Annals of the New York Academy of Sciences, 860(1):360–376, 1998

    1998

  6. [14]

    C· ase: Learning conditional adversarial skill embeddings for physics-based characters

    Zhiyang Dou, Xuelin Chen, Qingnan Fan, Taku Komura, and Wenping Wang. C· ase: Learning conditional adversarial skill embeddings for physics-based characters. In SIGGRAPH Asia 2023 Conference Papers, pages 1–11, 2023

    2023

  7. [15]

    Tore: Token reduction for efficient human mesh recovery with transformer

    Zhiyang Dou, Qingxuan Wu, Cheng Lin, Zeyu Cao, Qiangqiang Wu, Weilin Wan, Taku Komura, and Wenping Wang. Tore: Token reduction for efficient human mesh recovery with transformer. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 15143– 15155, 2023

    2023

  8. [16]

    Neuromechanics of human movement

    Roger M Enoka. Neuromechanics of human movement. Human kinetics, 2008

    2008

  9. [17]

    Musclevae: Model-based controllers of muscle-actuated characters

    Yusen Feng, Xiyan Xu, and Libin Liu. Musclevae: Model-based controllers of muscle-actuated characters. In SIGGRAPH Asia 2023 Conference Papers, pages 1–11, 2023

    2023

  10. [18]

    Recurrent network models for human dynamics

    Katerina Fragkiadaki, Sergey Levine, Panna Felsen, and Jitendra Malik. Recurrent network models for human dynamics. In Proceedings of the IEEE international conference on computer vision, pages 4346–4354, 2015

    2015

  11. [19]

    So pre- dictable! continuous 3d hand trajectory prediction in virtual reality

    Nisal Menuka Gamage, Deepana Ishtaweera, Martin Weigel, and Anusha Withana. So pre- dictable! continuous 3d hand trajectory prediction in virtual reality. In The 34th Annual ACM Symposium on User Interface Software and Technology, pages 332–343, 2021

    2021

  12. [20]

    Multi-transmotion: Pre-trained model for human motion prediction

    Yang Gao, Po-Chien Luan, and Alexandre Alahi. Multi-transmotion: Pre-trained model for human motion prediction. In 8th Annual Conference on Robot Learning, 2024

    2024

  13. [21]

    Generating sequences with recurrent neural networks

    Alex Graves. Generating sequences with recurrent neural networks. arXiv preprint arXiv:1308.0850, 2013

    2013 arXiv

  14. [22]

    Deligan: Generative adversarial networks for diverse and limited data

    Swaminathan Gurumurthy, Ravi Kiran Sarvadevabhatla, and R Venkatesh Babu. Deligan: Generative adversarial networks for diverse and limited data. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 166–174, 2017

    2017

  15. [23]

    Effect of epidural stimulation of the lumbosacral spinal cord on voluntary movement, standing, and assisted stepping after motor complete paraplegia: a case study

    Susan Harkema, Yury Gerasimenko, Jonathan Hodes, Joel Burdick, Claudia Angeli, Yangsheng Chen, Christie Ferreira, Andrea Willhite, Enrico Rejc, Robert G Grossman, et al. Effect of epidural stimulation of the lumbosacral spinal cord on voluntary movement, standing, and assisted...

    1938

  16. [24]

    Denoising diffusion probabilistic models

    Jonathan Ho, Ajay Jain, and Pieter Abbeel. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33:6840–6851, 2020

    2020

  17. [25]

    Phase-functioned neural networks for character control

    Daniel Holden, Taku Komura, and Jun Saito. Phase-functioned neural networks for character control. ACM Transactions on Graphics (TOG), 36(4):1–13, 2017

    2017

  18. [26]

    Improving sample quality of diffusion models using self-attention guidance

    Susung Hong, Gyuseong Lee, Wooseok Jang, and Seungryong Kim. Improving sample quality of diffusion models using self-attention guidance. InProceedings of the IEEE/CVF International Conference on Computer Vision, pages 7462–7471, 2023

    2023

  19. [27]

    Head and body motion pre- diction to enable mobile vr experiences with low latency

    Xueshi Hou, Jianzhong Zhang, Madhukar Budagavi, and Sujit Dey. Head and body motion pre- diction to enable mobile vr experiences with low latency. In2019 IEEE Global Communications Conference (GLOBECOM), pages 1–7. IEEE, 2019

    2019

  20. [28]

    Como: Controllable motion generation through language guided pose code editing

    Yiming Huang, Weilin Wan, Yue Yang, Chris Callison-Burch, Mark Yatskar, and Lingjie Liu. Como: Controllable motion generation through language guided pose code editing. In European Conference on Computer Vision, pages 180–196. Springer, 2025

    2025

  21. [29]

    Catalin Ionescu, Dragos Papava, Vlad Olaru, and Cristian Sminchisescu. Human3. 6m: Large- scale datasets and predictive methods for 3d human sensing in natural environments. IEEE transactions on pattern analysis and machine intelligence, 36(7):1325–1339, 2013

    2013

  22. [30]

    Drop: Dynamics responses from human motion prior and projective dynamics

    Yifeng Jiang, Jungdam Won, Yuting Ye, and C Karen Liu. Drop: Dynamics responses from human motion prior and projective dynamics. In SIGGRAPH Asia 2023 Conference Papers, pages 1–11, 2023. 18

    2023

  23. [31]

    Musculoskeletal model-based inverse dynamic analysis under ambulatory conditions using inertial motion capture

    Angelos Karatsidis, Moonki Jung, H Martin Schepers, Giovanni Bellusci, Mark de Zee, Peter H Veltink, and Michael Skipper Andersen. Musculoskeletal model-based inverse dynamic analysis under ambulatory conditions using inertial motion capture. Medical engineering & physics, 65:...

    2019

  24. [32]

    Pedestrian intention prediction for autonomous driving using a multiple stakeholder perspective model

    Kyungdo Kim, Yoon Kyung Lee, Hyemin Ahn, Sowon Hahn, and Songhwai Oh. Pedestrian intention prediction for autonomous driving using a multiple stakeholder perspective model. In 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 7957–7962. IEEE, 2020

    2020

  25. [33]

    Anticipating human activities for reactive robotic response

    Hema Swetha Koppula and Ashutosh Saxena. Anticipating human activities for reactive robotic response. In IROS, volume 2071. Tokyo, 2013

    2013

  26. [34]

    Robot cooperative behavior learning using single-shot learning from demonstration and parallel hidden markov models

    Jean-Francois Lafleche, Shane Saunderson, and Goldie Nejat. Robot cooperative behavior learning using single-shot learning from demonstration and parallel hidden markov models. IEEE Robotics and Automation Letters, 4(2):193–200, 2018

    2018

  27. [35]

    Hybrik: A hybrid analytical-neural inverse kinematics solution for 3d human pose and shape estimation

    Jiefeng Li, Chao Xu, Zhicun Chen, Siyuan Bian, Lixin Yang, and Cewu Lu. Hybrik: A hybrid analytical-neural inverse kinematics solution for 3d human pose and shape estimation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 3383–3393, 2021

    2021

  28. [36]

    Walkthedog: Cross- morphology motion alignment via phase manifolds

    Peizhuo Li, Sebastian Starke, Yuting Ye, and Olga Sorkine-Hornung. Walkthedog: Cross- morphology motion alignment via phase manifolds. In ACM SIGGRAPH 2024 Conference Papers, pages 1–10, 2024

    2024

  29. [37]

    Auto-conditioned recur- rent networks for extended complex human motion synthesis

    Zimo Li, Yi Zhou, Shuangjiu Xiao, Chong He, Zeng Huang, and Hao Li. Auto-conditioned recur- rent networks for extended complex human motion synthesis. arXiv preprint arXiv:1707.05363, 2017

    2017 arXiv

  30. [38]

    Magic3d: High-resolution text-to-3d content creation

    Chen-Hsuan Lin, Jun Gao, Luming Tang, Towaki Takikawa, Xiaohui Zeng, Xun Huang, Karsten Kreis, Sanja Fidler, Ming-Yu Liu, and Tsung-Yi Lin. Magic3d: High-resolution text-to-3d content creation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognitio...

    2023

  31. [39]

    Motion-x: A large-scale 3d expressive whole-body human motion dataset

    Jing Lin, Ailing Zeng, Shunlin Lu, Yuanhao Cai, Ruimao Zhang, Haoqian Wang, and Lei Zhang. Motion-x: A large-scale 3d expressive whole-body human motion dataset. Advances in Neural Information Processing Systems, 36, 2024

    2024

  32. [40]

    End-to-end human pose and mesh reconstruction with transformers

    Kevin Lin, Lijuan Wang, and Zicheng Liu. End-to-end human pose and mesh reconstruction with transformers. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 1954–1963, 2021

    1954

  33. [41]

    Multimodal motion prediction with stacked transformers

    Yicheng Liu, Jinghuai Zhang, Liangji Fang, Qinhong Jiang, and Bolei Zhou. Multimodal motion prediction with stacked transformers. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 7577–7586, 2021

    2021

  34. [42]

    Hierarchical spacetime control

    Zicheng Liu, Steven J Gortler, and Michael F Cohen. Hierarchical spacetime control. In Proceedings of the 21st annual conference on Computer graphics and interactive techniques, pages 35–42, 1994

    1994

  35. [43]

    Wonder3d: Single image to 3d using cross-domain diffusion

    Xiaoxiao Long, Yuan-Chen Guo, Cheng Lin, Yuan Liu, Zhiyang Dou, Lingjie Liu, Yuexin Ma, Song-Hai Zhang, Marc Habermann, Christian Theobalt, et al. Wonder3d: Single image to 3d using cross-domain diffusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Patter...

    2024

  36. [44]

    Humantomato: Text-aligned whole-body motion generation

    Shunlin Lu, Ling-Hao Chen, Ailing Zeng, Jing Lin, Ruimao Zhang, Lei Zhang, and Heung- Yeung Shum. Humantomato: Text-aligned whole-body motion generation. In Forty-first International Conference on Machine Learning, 2023

    2023

  37. [45]

    Generating smooth pose sequences for diverse human motion prediction

    Wei Mao, Miaomiao Liu, and Mathieu Salzmann. Generating smooth pose sequences for diverse human motion prediction. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 13309–13318, 2021

    2021

  38. [46]

    Learning trajectory dependen- cies for human motion prediction

    Wei Mao, Miaomiao Liu, Mathieu Salzmann, and Hongdong Li. Learning trajectory dependen- cies for human motion prediction. In Proceedings of the IEEE/CVF international conference on computer vision, pages 9489–9497, 2019. 19

    2019

  39. [47]

    A survey of motion planning and control techniques for self-driving urban vehicles

    Brian Paden, Michal ˇCáp, Sze Zheng Yong, Dmitry Yershov, and Emilio Frazzoli. A survey of motion planning and control techniques for self-driving urban vehicles. IEEE Transactions on intelligent vehicles, 1(1):33–55, 2016

    2016

  40. [48]

    Bidirectional gaitnet: A bidirectional prediction model of human gait and anatomical conditions

    Jungnam Park, Moon Seok Park, Jehee Lee, and Jungdam Won. Bidirectional gaitnet: A bidirectional prediction model of human gait and anatomical conditions. In ACM SIGGRAPH 2023 Conference Proceedings, pages 1–9, 2023

    2023

  41. [49]

    Ase: Large-scale reusable adversarial skill embeddings for physically simulated characters

    Xue Bin Peng, Yunrong Guo, Lina Halper, Sergey Levine, and Sanja Fidler. Ase: Large-scale reusable adversarial skill embeddings for physically simulated characters. ACM Transactions On Graphics (TOG), 41(4):1–17, 2022

    2022

  42. [50]

    Amp: Adversarial motion priors for stylized physics-based character control

    Xue Bin Peng, Ze Ma, Pieter Abbeel, Sergey Levine, and Angjoo Kanazawa. Amp: Adversarial motion priors for stylized physics-based character control. ACM Transactions on Graphics (ToG), 40(4):1–20, 2021

    2021

  43. [51]

    A literature review on the prediction of pedestrian behavior in urban scenarios

    Daniela Ridel, Eike Rehder, Martin Lauer, Christoph Stiller, and Denis Wolf. A literature review on the prediction of pedestrian behavior in urban scenarios. In 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pages 3105–3112. IEEE, 2018

    2018

  44. [52]

    High- resolution image synthesis with latent diffusion models

    Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. High- resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 10684–10695, 2022

    2022

  45. [53]

    Photorealistic text-to-image diffusion models with deep language understanding

    Chitwan Saharia, William Chan, Saurabh Saxena, Lala Li, Jay Whang, Emily L Denton, Kamyar Ghasemipour, Raphael Gontijo Lopes, Burcu Karagol Ayan, Tim Salimans, et al. Photorealistic text-to-image diffusion models with deep language understanding. Advances in neural information...

    2022

  46. [54]

    Motron: Multimodal probabilistic human motion forecasting

    Tim Salzmann, Marco Pavone, and Markus Ryll. Motron: Multimodal probabilistic human motion forecasting. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 6457–6466, 2022

    2022

  47. [55]

    Muscles in time: Learning to understand human motion by simulating muscle activations

    David Schneider, Simon Reiß, Marco Kugler, Alexander Jaus, Kunyu Peng, Susanne Sutschet, M Saquib Sarfraz, Sven Matthiesen, and Rainer Stiefelhagen. Muscles in time: Learning to understand human motion by simulating muscle activations. arXiv preprint arXiv:2411.00128, 2024

    2024 arXiv

  48. [56]

    Human motion diffusion as a generative prior

    Yonatan Shafir, Guy Tevet, Roy Kapon, and Amit H Bermano. Human motion diffusion as a generative prior. arXiv preprint arXiv:2303.01418, 2023

    2023 arXiv

  49. [57]

    Humaneva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion

    Leonid Sigal, Alexandru O Balan, and Michael J Black. Humaneva: Synchronized video and motion capture dataset and baseline algorithm for evaluation of articulated human motion. International journal of computer vision, 87(1):4–27, 2010

    2010

  50. [58]

    Deep unsuper- vised learning using nonequilibrium thermodynamics

    Jascha Sohl-Dickstein, Eric Weiss, Niru Maheswaranathan, and Surya Ganguli. Deep unsuper- vised learning using nonequilibrium thermodynamics. In International conference on machine learning, pages 2256–2265. PMLR, 2015

    2015

  51. [59]

    Denoising diffusion implicit models

    Jiaming Song, Chenlin Meng, and Stefano Ermon. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502, 2020

    2010 arXiv

  52. [60]

    Motion in-betweening with phase manifolds

    Paul Starke, Sebastian Starke, Taku Komura, and Frank Steinicke. Motion in-betweening with phase manifolds. Proceedings of the ACM on Computer Graphics and Interactive Techniques, 6(3):1–17, 2023

    2023

  53. [61]

    Deepphase: Periodic autoencoders for learning motion phase manifolds

    Sebastian Starke, Ian Mason, and Taku Komura. Deepphase: Periodic autoencoders for learning motion phase manifolds. ACM Transactions on Graphics (TOG), 41(4):1–13, 2022

    2022

  54. [62]

    Neural state machine for character- scene interactions

    Sebastian Starke, He Zhang, Taku Komura, and Jun Saito. Neural state machine for character- scene interactions. ACM Trans. Graph., 38(6):209–1, 2019

    2019

  55. [63]

    Local motion phases for learning multi-contact character movements

    Sebastian Starke, Yiwei Zhao, Taku Komura, and Kazi Zaman. Local motion phases for learning multi-contact character movements. ACM Transactions on Graphics (TOG), 39(4):54–1, 2020

    2020

  56. [64]

    Towards consistent stochastic human motion prediction via motion diffusion

    Jiarui Sun and Girish Chowdhary. Towards consistent stochastic human motion prediction via motion diffusion. arXiv preprint arXiv:2305.12554, 2023

    2023 arXiv

  57. [65]

    Lgm: Large multi-view gaussian model for high-resolution 3d content creation

    Jiaxiang Tang, Zhaoxi Chen, Xiaokang Chen, Tengfei Wang, Gang Zeng, and Ziwei Liu. Lgm: Large multi-view gaussian model for high-resolution 3d content creation. In European Conference on Computer Vision, pages 1–18. Springer, 2025. 20

    2025

  58. [66]

    Fourier principles for emotion-based human figure animation

    Munetoshi Unuma, Ken Anjyo, and Ryozo Takeuchi. Fourier principles for emotion-based human figure animation. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, pages 91–96, 1995

    1995

  59. [67]

    Attention is all you need

    A Vaswani. Attention is all you need. Advances in Neural Information Processing Systems, 2017

    2017

  60. [68]

    Tlcontrol: Trajectory and language control for human motion synthesis

    Weilin Wan, Zhiyang Dou, Taku Komura, Wenping Wang, Dinesh Jayaraman, and Lingjie Liu. Tlcontrol: Trajectory and language control for human motion synthesis. arXiv preprint arXiv:2311.17135, 2023

    2023 arXiv

  61. [69]

    Learn to predict how humans manipulate large-sized objects from interactive motions

    Weilin Wan, Lei Yang, Lingjie Liu, Zhuoying Zhang, Ruixing Jia, Yi-King Choi, Jia Pan, Christian Theobalt, Taku Komura, and Wenping Wang. Learn to predict how humans manipulate large-sized objects from interactive motions. IEEE Robotics and Automation Letters, 7(2):4702– 4709, 2022

    2022

  62. [70]

    Disentangled clothed avatar generation from text descriptions

    Jionghao Wang, Yuan Liu, Zhiyang Dou, Zhengming Yu, Yongqing Liang, Cheng Lin, Xin Li, Wenping Wang, Rong Xie, and Li Song. Disentangled clothed avatar generation from text descriptions. arXiv preprint arXiv:2312.05295, 2023

    2023 arXiv

  63. [71]

    Human joint kinematics diffusion-refinement for stochastic motion prediction

    Dong Wei, Huaijiang Sun, Bin Li, Jianfeng Lu, Weiqing Li, Xiaoning Sun, and Shengxiang Hu. Human joint kinematics diffusion-refinement for stochastic motion prediction. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 37, pages 6110–6118, 2023

    2023

  64. [72]

    Addbiomechanics dataset: Capturing the physics of human motion at scale

    Keenon Werling, Janelle Kaneda, Alan Tan, Rishi Agarwal, Six Skov, Tom Van Wouwe, Scott Uhlrich, Nicholas Bianco, Carmichael Ong, Antoine Falisse, et al. Addbiomechanics dataset: Capturing the physics of human motion at scale. arXiv preprint arXiv:2406.18537, 2024

    2024 arXiv

  65. [73]

    Gibson env: Real-world perception for embodied agents

    Fei Xia, Amir R Zamir, Zhiyang He, Alexander Sax, Jitendra Malik, and Silvio Savarese. Gibson env: Real-world perception for embodied agents. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 9068–9079, 2018

    2018

  66. [74]

    Learning semantic latent directions for accurate and controllable human motion prediction

    Guowei Xu, Jiale Tao, Wen Li, and Lixin Duan. Learning semantic latent directions for accurate and controllable human motion prediction. In European Conference on Computer Vision, pages 56–73. Springer, 2025

    2025

  67. [75]

    Diverse human motion prediction guided by multi-level spatial-temporal anchors

    Sirui Xu, Yu-Xiong Wang, and Liang-Yan Gui. Diverse human motion prediction guided by multi-level spatial-temporal anchors. In European Conference on Computer Vision , pages 251–269. Springer, 2022

    2022

  68. [76]

    Surf-d: Generating high-quality surfaces of arbitrary topologies using diffusion models

    Zhengming Yu, Zhiyang Dou, Xiaoxiao Long, Cheng Lin, Zekun Li, Yuan Liu, Norman Müller, Taku Komura, Marc Habermann, Christian Theobalt, et al. Surf-d: Generating high-quality surfaces of arbitrary topologies using diffusion models. In European Conference on Computer Vision, p...

    2025

  69. [77]

    Diverse trajectory forecasting with determinantal point processes

    Ye Yuan and Kris Kitani. Diverse trajectory forecasting with determinantal point processes. arXiv preprint arXiv:1907.04967, 2019

    1907 arXiv

  70. [78]

    Dlow: Diversifying latent flows for diverse human motion prediction

    Ye Yuan and Kris Kitani. Dlow: Diversifying latent flows for diverse human motion prediction. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part IX 16, pages 346–364. Springer, 2020

    2020

  71. [79]

    Physdiff: Physics-guided human motion diffusion model

    Ye Yuan, Jiaming Song, Umar Iqbal, Arash Vahdat, and Jan Kautz. Physdiff: Physics-guided human motion diffusion model. In Proceedings of the IEEE/CVF international conference on computer vision, pages 16010–16021, 2023

    2023

  72. [80]

    Spectral style transfer for human motion between independent actions

    M Ersin Yumer and Niloy J Mitra. Spectral style transfer for human motion between independent actions. ACM Transactions on Graphics (TOG), 35(4):1–8, 2016

    2016

  73. [81]

    The cortex as a central pattern generator

    Rafael Yuste, Jason N MacLean, Jeffrey Smith, and Anders Lansner. The cortex as a central pattern generator. Nature Reviews Neuroscience, 6(6):477–483, 2005

    2005

  74. [82]

    Mode-adaptive neural networks for quadruped motion control

    He Zhang, Sebastian Starke, Taku Komura, and Jun Saito. Mode-adaptive neural networks for quadruped motion control. ACM Transactions on Graphics (TOG), 37(4):1–11, 2018

    2018

  75. [83]

    Clay: A controllable large-scale generative model for creating high-quality 3d assets

    Longwen Zhang, Ziyu Wang, Qixuan Zhang, Qiwei Qiu, Anqi Pang, Haoran Jiang, Wei Yang, Lan Xu, and Jingyi Yu. Clay: A controllable large-scale generative model for creating high-quality 3d assets. ACM Transactions on Graphics (TOG), 43(4):1–20, 2024

    2024

  76. [84]

    Adding conditional control to text-to-image diffusion models

    Lvmin Zhang, Anyi Rao, and Maneesh Agrawala. Adding conditional control to text-to-image diffusion models. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 3836–3847, 2023. 21

    2023

  77. [85]

    Motiondiffuse: Text-driven human motion generation with diffusion model

    Mingyuan Zhang, Zhongang Cai, Liang Pan, Fangzhou Hong, Xinying Guo, Lei Yang, and Ziwei Liu. Motiondiffuse: Text-driven human motion generation with diffusion model. arXiv preprint arXiv:2208.15001, 2022

    2022 arXiv

  78. [86]

    We are more than our joints: Predicting how 3d bodies move

    Yan Zhang, Michael J Black, and Siyu Tang. We are more than our joints: Predicting how 3d bodies move. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 3372–3382, 2021

    2021

  79. [87]

    Emdm: Efficient motion diffusion model for fast and high-quality motion generation

    Wenyang Zhou, Zhiyang Dou, Zeyu Cao, Zhouyingcheng Liao, Jingbo Wang, Wenjia Wang, Yuan Liu, Taku Komura, Wenping Wang, and Lingjie Liu. Emdm: Efficient motion diffusion model for fast and high-quality motion generation. In European Conference on Computer Vision, pages 18–38. ...

    2025

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.