Pith. sign in

REVIEW 2 major objections 6 minor 1 cited by

Emotion Recognition from Skeleton Data: A Comprehensive Survey

T0 review · 2 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read This survey unifies posture- and gait-based skeleton emotion recognition into one four-paradigm taxonomy and benchmarks the field across public datasets.

desk verdict Useful survey with a practical taxonomy, but the central dataset table has multiple internal contradictions and the benchmark rankings ignore evaluation protocols. read the letter →

arxiv 2507.18026 v1 pith:73GASNRX submitted 2025-07-24 cs.CV

Haifeng Lu , Jiuyi Chen , Zhen Zhang , Ruida Liu , Runhao Zeng , Xiping Hu This is my paper · ORCID
classification cs.CV
keywords skeleton-basedemotionrecognitionbodymovementanalysisgaitpostureaffectivecomputing3Dskeletondatasetsgraphconvolutionalnetworkstaxonomy
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Skeleton-based emotion recognition usually splits into two literatures: posture (how a person stands, gestures, or moves during an action) and gait (how a person walks). This survey argues that the split is artificial, because both input types are the same 3D skeleton data and differ mainly in how fast the motion changes over time. It proposes a unified taxonomy that sorts every existing method into four technical paradigms: traditional handcrafted features with machine-learning classifiers, handcrafted features fed to neural networks (Feat2Net), handcrafted features fused into deep models (FeatFusionNet), and end-to-end networks that learn directly from raw skeletons (End2EndNet). The payoff, if the taxonomy holds, is that methods, datasets, and applications from the two subfields can be compared and reused under one roof. The survey also assembles the public datasets, benchmark tables, and clinical applications (depression, autism, abnormal behavior) that make this a practical organizing reference.

What carries the argument

The load-bearing object is the proposed taxonomy itself: four technical paradigms (Traditional, Feat2Net, FeatFusionNet, End2EndNet) applied uniformly inside two overarching categories (posture-based and gait-based). The taxonomy organizes the survey's review of methods, its benchmark tables, and its claims about field evolution. Supporting machinery includes the skeleton sequence as the shared data representation, psychological emotion models (discrete, dimensional, componential) that frame the labeling schemes, and the public datasets listed in the survey's data tables, which provide the empirical ground for accuracy comparisons.

What would settle it

Running one representative method from the taxonomy (for example the multi-scale spatiotemporal network or an attention-enhanced ST-GCN) on both posture datasets (EGBM, KDAE, Emilya) and gait datasets (E-Gait, EMOGAIT) under identical train/test splits, and cross-checking Table 4 against the original dataset sources (UCLIC sample count, BML joint count, Emilya frame rate), would settle whether the unification claim and the reported rankings hold.

Watch

Extended reading notes

Core claim

On the paper's own terms, the central claim is that posture-based and gait-based emotion recognition should be treated as a single research problem rather than as separate modalities. The paper states that both stem from the same underlying skeleton data and therefore share representations, feature extraction methods, and modeling strategies, with the primary difference being temporal dynamics. To support this, it proposes a unified taxonomy with four technical paradigms: Traditional approaches (handcrafted affective features plus classifiers such as SVM or random forests), Feat2Net (handcrafted features with neural networks used only for classification), FeatFusionNet (handcrafted features injected into deep-model training), and End2EndNet (raw skeleton sequences straight into deep networks). It reviews representative works in each category, benchmarks them on datasets such as EGBM, KDAE, Emilya, E-Gait, and EMOGAIT, and extends the framework to gait-based detection of depression, autism, and abnormal behavior. The survey concludes that graph-based and attention-augmented deep models are becoming dominant while handcrafted-feature methods remain competitive on small datasets, and that the next wave will move toward efficient, interpretable, multimodal, and large-model-based systems.

Load-bearing premise

The survey's method rankings rest on assuming that accuracy numbers reported on different datasets with different evaluation protocols (10-fold, hold-out, 5-fold, or unspecified) can be compared head-to-head, and that the transcribed dataset statistics in its tables match the original sources.

Editorial extensions

If this is right

  • A method developed for posture-based emotion recognition can in principle be transferred to gait-based recognition, since both operate on the same skeleton representation with different temporal windows.
  • The benchmark tables give newcomers a direct map of which methods to try first: handcrafted-feature plus fully connected networks currently lead on EGBM and KDAE, while attention-enhanced GCNs lead on E-Gait and EMOGAIT.
  • Skeleton-based emotion recognition is positioned as a privacy-preserving alternative to facial or physiological sensing, which matters for real-world deployment in healthcare monitoring, human-computer interaction, and public safety.
  • The same skeleton pipeline can be repurposed for clinical screening applications, specifically depression risk and autism detection, because gait and posture carry mood- and disorder-related information.
  • The four-paradigm taxonomy provides a stable vocabulary for future papers, allowing new methods to be positioned as extensions of one paradigm rather than as disconnected contributions.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The accuracy numbers reproduced in the benchmark tables come from different evaluation protocols (10-fold, 5-fold, hold-out, or unspecified), so the rankings are suggestive rather than strictly comparable; a standardized evaluation harness would be needed to confirm them.
  • Some dataset statistics in the tables conflict with the text (for example the UCLIC sample count and BML joint count differ between Table 4 and the prose), which suggests that a careful re-verification of the source datasets is needed before the comparisons are used as ground truth.
  • If the taxonomy becomes the field's standard, a natural next step would be a unified benchmark that scores all four paradigms on identical train/test splits, which would likely change some of the method rankings reported here.
  • The convergence toward end-to-end graph models, combined with the survey's call for large-model reasoning, suggests that future systems may treat skeleton emotion recognition as a language-compatible input, generating textual explanations alongside predictions rather than only labels.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

2 major / 6 minor

Summary. The paper surveys skeleton-based emotion recognition, organizing the field into posture-based and gait-based categories and proposing a four-paradigm taxonomy (Traditional, Feat2Net, FeatFusionNet, and End2EndNet). It reviews psychological emotion models, body-movement expression literature, publicly available datasets, representative methods with benchmark results, task-specific applications (depression, autism, abnormal behavior), and open challenges. The survey aims to be a unified, systematic reference that bridges posture and gait research under a single framework.

Significance. If its factual content and comparisons are reliable, the survey would be a valuable organizing reference for a growing field, with a useful taxonomy and broad coverage that includes recent deep learning, self-supervised, and large-language-model approaches. The explicit unification of posture- and gait-based methods and the inclusion of application areas are strengths. However, the paper's utility as a reference depends critically on the accuracy of its dataset summary and the comparability of its benchmark tables, both of which currently have unresolved issues that undercut the survey's central claim to be a comprehensive and reliable resource. The taxonomy and narrative structure are sound and worth publishing after the factual inconsistencies are corrected and the comparative claims are made protocol-aware.

major comments (2)
  1. [Table 4 and Sections 3.3–3.4] Table 4 contradicts the prose in Sections 3.3–3.4 on multiple dataset statistics: UCLIC samples are listed as 183 in the table but 108 in Section 3.3; BML joints are 30 in the table but 16 in Section 3.3; Emilya frame rate is 125 Hz in the table but 120 Hz in Section 3.3; KDAE frame rate is 120 Hz in the table but 125 Hz in Section 3.3; and MEBED joints are 23 in the table, whereas Section 3.3 states the sequences have 28 joints with ten lower-body joints excluded, which should yield 18 usable joints, not 23. In addition, the E-Gait subset labels are swapped: Table 4 labels the 1,835-sample set as E-Gait I and the 342-sample set as E-Gait II, while Section 3.4 defines Subset A as 342 and Subset B as 1,835, and the joint counts (21 vs. 16) are inconsistent with the statement that both subsets were standardized to 16 joints. Because Section 6.1 and the survey's comparative narrative rely on Table 4 as the authoritative dataset summary, these discrepancies directly undermine the paper's claim to be a reliable organizing reference and must be corrected and verified against the original sources.
  2. [Tables 7–12 and Sections 4.1.5, 4.2.6] The method-comparison tables mix evaluation protocols within the same table: for example, Table 7 on EGBM reports 10-fold results for RNN/AS-LSTM/Wang et al. but a hold-out result for EAI-LLM; Table 8 on KDAE similarly mixes 10-fold and hold-out; Table 9 on Emilya mixes 5-fold, 10-fold, and hold-out; and Table 11 on E-Gait mixes hold-out, 5-fold, 10-fold, and N/A. The accompanying text draws ordinal conclusions across these heterogeneous protocols, such as 'MSA-GCN achieving the highest reported accuracy of 93.51%' (§4.2.6) and the general claim that handcrafted-feature-based approaches remain highly competitive (§4.1.5). Without protocol-controlled comparisons or explicit caveats about non-comparability, these rankings and conclusions are not supported. The paper should group results by evaluation protocol, report protocol as a moderating factor, or reframe the tables as descriptive summaries rather than ordinal rankings.
minor comments (6)
  1. [Section 1] The sentence 'this paper is structured in Fig. 1' should be rephrased, for example as 'the paper is structured as shown in Fig. 1.'
  2. [Section 4.3] The statement that the method of Lu et al. [95] 'trails slightly' in classification accuracy is quantitatively inaccurate: in Tables 7–8, EAI-LLM achieves 66.97% and 71.17% versus 95–97% for the leading methods, a substantial gap; 'slightly' should be replaced with a more precise characterization.
  3. [Table 11] The word 'Transfromer' in the table (TNTC row) is a typo and should be 'Transformer.'
  4. [General / typesetting] The CCS Concepts line still contains the placeholder 'Do Not Use This Code → Generate the Correct Terms for Your Paper,' which indicates a template artifact that should be removed or replaced with valid indexing terms.
  5. [Article metadata] The footer 'Received 20 February 2007; revised 12 March 2009; accepted 5 June 2009' appears to be a leftover template line and should be corrected to the actual submission dates or removed.
  6. [Section 3.4] The sentence 'The Body Motion-Emotion dataset (BME), dataset [60] dataset involves two experiments' contains a duplicated 'dataset' and should be rewritten for clarity.

Circularity Check

0 steps flagged · score 1.0 of 10

No significant circularity; the survey's taxonomy and narrative are self-contained, with only minor non-load-bearing self-citations.

full rationale

The paper is a survey, not a derivation: its central claims are that it organizes skeleton-based emotion recognition into a unified taxonomy (Traditional, Feat2Net, FeatFusionNet, End2EndNet) and provides a comparative review of datasets and methods. No equation or fitted parameter is renamed as a prediction. The taxonomy is an organizational scheme applied post hoc to existing literature; it does not define itself circularly, because the categories are described by architectural traits (e.g., 'Feat2Net approaches extract handcrafted features from skeleton sequences and employ neural networks solely for classification') rather than by the survey's own conclusions. The dataset comparison tables (Tables 4–12) report external accuracies; they contain internal inconsistencies (e.g., UCLIC sample count 108 vs 183, BML joints 16 vs 30, Emilya frame rate 120 vs 125 Hz), but such transcription errors are correctness risks, not circularity. Several cited works are by the same authors ([95], [120], [124], [129], [130], [133], [153]), yet none of the survey's load-bearing statements depends on those citations for evidence: they are surveyed items like any other, and the survey's comparative assessments (e.g., 'EAI-LLM trails slightly in classification accuracy' in Section 4.3) treat them as external results. There is no imported uniqueness theorem, no ansatz smuggled via citation, and no empirical prediction derived by construction from its own inputs. Consequently, the survey's organizing contribution is self-contained and its reliability issues are factual accuracy issues rather than circular reasoning.

Assumptions & free parameters 0 free parameters · 3 assumptions · 0 invented entities

As a survey, the paper introduces no free parameters or invented entities. Its load-bearing assumptions are the emotion-body link, the completeness of its taxonomy, and the reliability of the reported benchmarks.

assumptions (3)
  • domain assumption Full-body movements reliably convey emotional states.
    The survey's premise, invoked in Section 2.2 and supported by cited psychology literature, but not independently verified in this paper.
  • ad hoc to paper The four-paradigm taxonomy (Traditional, Feat2Net, FeatFusionNet, End2EndNet) is exhaustive and useful for organizing all methods.
    The taxonomy is introduced by the authors in Section 4 without a formal derivation or validation against alternative taxonomies.
  • domain assumption Accuracy numbers in the cited papers are accurately transcribed and comparable across protocols.
    The comparison tables in Sections 4.1.5 and 4.2.6 aggregate reported numbers without re-running experiments; internal inconsistencies suggest this assumption is fragile.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Emotion Recognition from Skeleton Data: A Comprehensive Survey." pith.science (2026). https://pith.science/paper/73GASNRX

@misc{pith2026250718026,
  author       = {Pith},
  title        = {Pith review of: Emotion Recognition from Skeleton Data: A Comprehensive Survey},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/73GASNRX}},
  note         = {Machine review of arXiv:2507.18026}
}
read the original abstract

Emotion recognition through body movements has emerged as a compelling and privacy-preserving alternative to traditional methods that rely on facial expressions or physiological signals. Recent advancements in 3D skeleton acquisition technologies and pose estimation algorithms have significantly enhanced the feasibility of emotion recognition based on full-body motion. This survey provides a comprehensive and systematic review of skeleton-based emotion recognition techniques. First, we introduce psychological models of emotion and examine the relationship between bodily movements and emotional expression. Next, we summarize publicly available datasets, highlighting the differences in data acquisition methods and emotion labeling strategies. We then categorize existing methods into posture-based and gait-based approaches, analyzing them from both data-driven and technical perspectives. In particular, we propose a unified taxonomy that encompasses four primary technical paradigms: Traditional approaches, Feat2Net, FeatFusionNet, and End2EndNet. Representative works within each category are reviewed and compared, with benchmarking results across commonly used datasets. Finally, we explore the extended applications of emotion recognition in mental health assessment, such as detecting depression and autism, and discuss the open challenges and future research directions in this rapidly evolving field.

Figures

Figures reproduced from arXiv: 2507.18026 by the authors.

Figure 1
Figure 1. The overall structure of our survey Despite increasing research interest in this field, a comprehensive and unified survey of skeleton￾based emotion recognition is still lacking. Existing reviews tend to adopt fragmented perspectives, often overlooking a key insight: both posture and gait stem from the same underlying skeleton data and therefore share common representations, feature extraction methods, and modeling … view at source ↗
Figure 2
Figure 2. Various emotion models A well-known example is Plutchik’s model (see [PITH_FULL_IMAGE:figures/full_fig_p005_2.png] view at source ↗
Figure 3
Figure 3. Comparison of different data collection scenarios [PITH_FULL_IMAGE:figures/full_fig_p008_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Common methods for capturing 3D human skeleton data [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]
Figure 5
Figure 5. Figure 5: Comparison of different technical approaches [PITH_FULL_IMAGE:figures/full_fig_p013_5.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Learning Emotion from Motion: Kinetic Multi-Stream Skeleton Modeling with Metadata-Conditioned Weak Label Distributions

    cs.CV 2026-07 conditional novelty 5.0 of 10

    A three-branch ensemble of rotation-, kinetic-, and weak-label-distribution models raises skeleton-based emotion recognition Macro-F1 from 0.252 to 0.353 in leave-performer-out cross-validation.

Reference graph

Works this paper leans on

162 extracted references · 79 canonical work pages · cited by 1 Pith paper

  1. [1]

    Emotion recognition and its applications,

    A. Kołakowska, A. Landowska, M. Szwoch, W. Szwoch, and M. R. Wrobel, “Emotion recognition and its applications, ” Human-Computer Systems Interaction: Backgrounds and Applications 3 , pp. 51–62, 2014

    2014

  2. [2]

    R. W. Picard, Affective computing. MIT press, 2000

    2000

  3. [3]

    Emotion detection: a technology review,

    J. M. Garcia-Garcia, V. M. Penichet, and M. D. Lozano, “Emotion detection: a technology review, ” inProceedings of the XVIII international conference on human computer interaction , 2017, pp. 1–8

    2017

  4. [4]

    Deep facial expression recognition: A survey,

    S. Li and W. Deng, “Deep facial expression recognition: A survey, ”IEEE Transactions on Affective Computing , vol. 13, no. 3, pp. 1195–1215, 2022

    2022

  5. [5]

    Speech emotion recognition using deep learning techniques: A review,

    R. A. Khalil, E. Jones, M. I. Babar, T. Jan, M. H. Zafar, and T. Alhussain, “Speech emotion recognition using deep learning techniques: A review, ”IEEE access, vol. 7, pp. 117 327–117 345, 2019

    2019

  6. [6]

    A survey of state-of-the-art approaches for emotion recognition in text,

    N. Alswaidan and M. E. B. Menai, “A survey of state-of-the-art approaches for emotion recognition in text, ”Knowledge and Information Systems, vol. 62, no. 8, pp. 2937–2987, 2020. J. ACM, Vol. 37, No. 4, Article 111. Publication date: August 2025. Emotion Recognition from Skeleton Data: A Comprehensive Survey 111:29

    2020

  7. [7]

    A review of emotion recognition using physiological signals,

    L. Shu, J. Xie, M. Yang, Z. Li, Z. Li, D. Liao, X. Xu, and X. Yang, “A review of emotion recognition using physiological signals, ”Sensors, vol. 18, no. 7, p. 2074, 2018

    2018

  8. [8]

    Human emotion recognition: Review of sensors and methods,

    A. Dzedzickis, A. Kaklauskas, and V. Bucinskas, “Human emotion recognition: Review of sensors and methods, ” Sensors, vol. 20, no. 3, 2020. [Online]. Available: https://www.mdpi.com/1424-8220/20/3/592

    2020

Show all 162 references
  1. [9]

    Affective body expression perception and recognition: A survey,

    A. Kleinsmith and N. Bianchi-Berthouze, “Affective body expression perception and recognition: A survey, ”IEEE Transactions on Affective Computing , vol. 4, no. 1, pp. 15–33, 2012

    2012

  2. [10]

    Survey on emotional body gesture recognition,

    F. Noroozi, C. A. Corneanu, D. Kamińska, T. Sapiński, S. Escalera, and G. Anbarjafari, “Survey on emotional body gesture recognition, ”IEEE transactions on affective computing , vol. 12, no. 2, pp. 505–523, 2018

    2018

  3. [11]

    The identification of emotions from gait information,

    J. M. Montepare, S. B. Goldstein, and A. Clausen, “The identification of emotions from gait information, ”Journal of Nonverbal Behavior, vol. 11, no. 1, pp. 33–42, 1987

    1987

  4. [12]

    Embodiment of sadness and depres- sion—gait patterns associated with dysphoric mood,

    J. Michalak, N. F. Troje, J. Fischer, P. Vollmar, T. Heidenreich, and D. Schulte, “Embodiment of sadness and depres- sion—gait patterns associated with dysphoric mood, ”Psychosomatic medicine, vol. 71, no. 5, pp. 580–587, 2009

    2009

  5. [13]

    From emotions to mood disorders: A survey on gait analysis methodology,

    F. Deligianni, Y. Guo, and G.-Z. Yang, “From emotions to mood disorders: A survey on gait analysis methodology, ” IEEE Journal of Biomedical and Health Informatics , vol. 23, no. 6, pp. 2302–2316, 2019

    2019

  6. [14]

    Emotion recognition from full-body motion using multiscale spatio-temporal network,

    T. Wang, S. Liu, F. He, W. Dai, M. Du, Y. Ke, and D. Ming, “Emotion recognition from full-body motion using multiscale spatio-temporal network, ”IEEE Transactions on Affective Computing , vol. 15, no. 3, pp. 898–912, 2024

    2024

  7. [15]

    Microsoft kinect sensor and its effect,

    Z. Zhang, “Microsoft kinect sensor and its effect, ” IEEE multimedia, vol. 19, no. 2, pp. 4–10, 2012

    2012

  8. [16]

    A dual-augmentor framework for domain generalization in 3d human pose estimation,

    Q. Peng, C. Zheng, and C. Chen, “A dual-augmentor framework for domain generalization in 3d human pose estimation, ” inCVPR, 2024, pp. 2240–2249

    2024

  9. [17]

    Deep learning-based human pose estimation: A survey,

    C. Zheng, W. Wu, C. Chen, T. Yang, S. Zhu, J. Shen, N. Kehtarnavaz, and M. Shah, “Deep learning-based human pose estimation: A survey, ”ACM Computing Surveys, 2023

    2023

  10. [18]

    Skeleton-based explainable bodily expressed emotion recognition through graph convolutional networks,

    E. Ghaleb, A. Mertens, S. Asteriadis, and G. Weiss, “Skeleton-based explainable bodily expressed emotion recognition through graph convolutional networks, ” inFG, 2021, pp. 1–8

    2021

  11. [19]

    Emotion recognition from body movements with as-lstm,

    H. Zhang, P. Yi, R. Liu, and D. Zhou, “Emotion recognition from body movements with as-lstm, ” in2021 IEEE 7th International Conference on Virtual Reality , 2021, pp. 26–32

    2021

  12. [20]

    Modeling multiple temporal scales of full-body movements for emotion classification,

    C. Beyan, S. Karumuri, G. Volpe, A. Camurri, and R. Niewiadomski, “Modeling multiple temporal scales of full-body movements for emotion classification, ”IEEE Transactions on Affective Computing , vol. 14, no. 2, pp. 1070–1081, 2023

    2023

  13. [21]

    Emotion recognition from gait analyses: Current research and future directions,

    S. Xu, J. Fang, X. Hu, E. Ngai, Y. Guo, V. Leung, J. Cheng, and B. Hu, “Emotion recognition from gait analyses: Current research and future directions, ”arXiv preprint arXiv:2003.11461, 2020

    2003 arXiv

  14. [22]

    Emotion expression in human body posture and movement: A survey on intelligible motion factors, quantification and validation,

    M.-A. Mahfoudi, A. Meyer, T. Gaudin, A. Buendia, and S. Bouakaz, “Emotion expression in human body posture and movement: A survey on intelligible motion factors, quantification and validation, ”IEEE Transactions on Affective Computing, vol. 14, no. 4, pp. 2697–2721, 2023

    2023

  15. [23]

    Emotion recognition based on brain-computer interface systems,

    T. S. Rached and A. Perkusich, “Emotion recognition based on brain-computer interface systems, ”Brain-computer interface systems-Recent progress and future prospects , pp. 253–270, 2013

    2013

  16. [24]

    The emotional brain,

    T. Dalgleish, “The emotional brain, ”Nature Reviews Neuroscience, vol. 5, no. 7, pp. 583–589, 2004

    2004

  17. [25]

    Modeling emotions for affect-aware applications,

    A. Kołakowska, A. Landowska, M. Szwoch, W. Szwoch, and M. R. Wróbel, “Modeling emotions for affect-aware applications, ”Information Systems Development and Applications , pp. 55–69, 2015

    2015

  18. [26]

    Universals and cultural differences in facial expressions of emotion

    P. Ekman, “Universals and cultural differences in facial expressions of emotion. ” inNebraska symposium on motivation. University of Nebraska Press, 1971

    1971

  19. [27]

    Emotion representation, analysis and synthesis in continuous space: A survey,

    H. Gunes, B. Schuller, M. Pantic, and R. Cowie, “Emotion representation, analysis and synthesis in continuous space: A survey, ” in2011 IEEE International Conference on Automatic Face & Gesture Recognition (FG) . IEEE, 2011, pp. 827–834

    2011

  20. [28]

    Automatic affect perception based on body gait and posture: A survey,

    B. Stephens-Fripp, F. Naghdy, D. Stirling, and G. Naghdy, “Automatic affect perception based on body gait and posture: A survey, ”International Journal of Social Robotics , vol. 9, pp. 617–641, 2017

    2017

  21. [29]

    Evidence for a three-factor theory of emotions,

    J. A. Russell and A. Mehrabian, “Evidence for a three-factor theory of emotions, ”Journal of research in Personality , vol. 11, no. 3, pp. 273–294, 1977

    1977

  22. [30]

    Affective judgment and psychophysiological response: dimensional covariation in the evaluation of pictorial stimuli

    M. K. Greenwald, E. W. Cook, and P. J. Lang, “Affective judgment and psychophysiological response: dimensional covariation in the evaluation of pictorial stimuli. ”Journal of psychophysiology, 1989

    1989

  23. [31]

    Real-time assessment of mental workload using psychophysiological measures and artificial neural networks,

    G. F. Wilson and C. A. Russell, “Real-time assessment of mental workload using psychophysiological measures and artificial neural networks, ”Human factors, vol. 45, no. 4, pp. 635–644, 2003

    2003

  24. [32]

    Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament,

    A. Mehrabian, “Pleasure-arousal-dominance: A general framework for describing and measuring individual differences in temperament, ”Current Psychology, vol. 14, pp. 261–292, 1996

    1996

  25. [33]

    The effect of emotion on movement smoothness during gait in healthy young adults,

    G. E. Kang and M. M. Gross, “The effect of emotion on movement smoothness during gait in healthy young adults, ” Journal of biomechanics, vol. 49, no. 16, pp. 4022–4027, 2016

    2016

  26. [34]

    Emotional influences on sit-to-walk in healthy young adults,

    ——, “Emotional influences on sit-to-walk in healthy young adults, ”Human movement science, vol. 40, pp. 341–351, 2015

    2015

  27. [35]

    Expression of emotion in the kinematics of locomotion,

    A. Barliya, L. Omlor, M. A. Giese, A. Berthoz, and T. Flash, “Expression of emotion in the kinematics of locomotion, ” Experimental brain research, vol. 225, pp. 159–176, 2013. J. ACM, Vol. 37, No. 4, Article 111. Publication date: August 2025. 111:30 Lu et al

    2013

  28. [36]

    The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice,

    R. Plutchik, “The nature of emotions: Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice, ”American scientist, vol. 89, no. 4, pp. 344–350, 2001

    2001

  29. [37]

    Bodily expression of emotion,

    H. G. Wallbott, “Bodily expression of emotion, ”European journal of social psychology , vol. 28, no. 6, pp. 879–896, 1998

    1998

  30. [38]

    Visual perception of expressiveness in musicians’ body movements,

    S. Dahl and A. Friberg, “Visual perception of expressiveness in musicians’ body movements, ”Music Perception, vol. 24, no. 5, pp. 433–454, 2007

    2007

  31. [39]

    Methodology for assessing bodily expression of emotion,

    M. M. Gross, E. A. Crane, and B. L. Fredrickson, “Methodology for assessing bodily expression of emotion, ”Journal of Nonverbal Behavior, vol. 34, pp. 223–248, 2010

    2010

  32. [40]

    Emotion expression in body action and posture

    N. Dael, M. Mortillaro, and K. R. Scherer, “Emotion expression in body action and posture. ”Emotion, vol. 12, no. 5, p. 1085, 2012

    2012

  33. [41]

    Emotion recognition system using short-term monitoring of physiological signals,

    K. H. Kim, S. W. Bang, and S. R. Kim, “Emotion recognition system using short-term monitoring of physiological signals, ”Medical and biological engineering and computing , vol. 42, pp. 419–427, 2004

    2004

  34. [42]

    Effort-shape and kinematic assessment of bodily expression of emotion during gait,

    M. M. Gross, E. A. Crane, and B. L. Fredrickson, “Effort-shape and kinematic assessment of bodily expression of emotion during gait, ”Human movement science, vol. 31, no. 1, pp. 202–221, 2012

    2012

  35. [43]

    A motion capture library for the study of identity, gender, and emotion perception from biological motion,

    Y. Ma, H. M. Paterson, and F. E. Pollick, “A motion capture library for the study of identity, gender, and emotion perception from biological motion, ”Behavior research methods, vol. 38, no. 1, pp. 134–141, 2006

    2006

  36. [44]

    DanceMotion Capture Database (DMCD),

    “DanceMotion Capture Database (DMCD), ” http://dancedb.eu/, 2021, [Online; accessed April 16, 2025]

    2021

  37. [45]

    Perception of emotions and body movement in the emilya database,

    N. Fourati and C. Pelachaud, “Perception of emotions and body movement in the emilya database, ”IEEE Transactions on Affective Computing, vol. 9, no. 1, pp. 90–101, 2016

    2016

  38. [46]

    Kinematic dataset of actors expressing emotions,

    M. Zhang, L. Yu, K. Zhang, B. Du, B. Zhan, S. Chen, X. Jiang, S. Guo, J. Zhao, Y. Wanget al., “Kinematic dataset of actors expressing emotions, ”Scientific data, vol. 7, no. 1, p. 292, 2020

    2020

  39. [47]

    The mpi emotional body expressions database for narrative scenarios,

    E. Volkova, S. De La Rosa, H. H. Bülthoff, and B. Mohler, “The mpi emotional body expressions database for narrative scenarios, ”PloS one, vol. 9, no. 12, p. e113647, 2014

    2014

  40. [48]

    Emotion detection from natural walking,

    L. Cui, S. Li, and T. Zhu, “Emotion detection from natural walking, ” inHuman Centered Computing: Second International Conference, HCC 2016, Colombo, Sri Lanka, January 7-9, 2016, Revised Selected Papers 2 . Springer, 2016, pp. 23–33

    2016

  41. [49]

    Emotion recognition using kinect motion capture data of human gaits,

    S. Li, L. Cui, C. Zhu, B. Li, N. Zhao, and T. Zhu, “Emotion recognition using kinect motion capture data of human gaits, ”PeerJ, vol. 4, p. e2364, 2016

    2016

  42. [50]

    Gait-based emotion recognition using spatial temporal graph convolutional networks,

    S. Yu and X. Li, “Gait-based emotion recognition using spatial temporal graph convolutional networks, ” in 2021 International Conference on Computer Information Science and Artificial Intelligence (CISAI) , 2021, pp. 190–193

    2021

  43. [51]

    Realtime multi-person 2d pose estimation using part affinity fields,

    Z. Cao, T. Simon, S.-E. Wei, and Y. Sheikh, “Realtime multi-person 2d pose estimation using part affinity fields, ” in CVPR, 2017, pp. 7291–7299

    2017

  44. [52]

    Deep high-resolution representation learning for human pose estimation,

    K. Sun, B. Xiao, D. Liu, and J. Wang, “Deep high-resolution representation learning for human pose estimation, ” in CVPR, 2019, pp. 5693–5703

    2019

  45. [53]

    Vnect: Real-time 3d human pose estimation with a single rgb camera,

    D. Mehta, S. Sridhar, O. Sotnychenko, H. Rhodin, M. Shafiei, H.-P. Seidel, W. Xu, and C. Theobalt, “Vnect: Real-time 3d human pose estimation with a single rgb camera, ” inACM Transactions on Graphics (TOG) , vol. 36, no. 4. ACM New York, NY, USA, 2017, pp. 1–14

    2017

  46. [54]

    The liar’s walk: Detecting deception with gait and gesture,

    T. Randhavane, U. Bhattacharya, K. Kapsaskis, K. Gray, A. Bera, and D. Manocha, “The liar’s walk: Detecting deception with gait and gesture, ”arXiv preprint arXiv:1912.06874, 2019

    1912 arXiv

  47. [55]

    The role of computational and subjective features in emotional body expressions,

    M. Poyo Solanas, M. J. Vaessen, and B. de Gelder, “The role of computational and subjective features in emotional body expressions, ”Scientific reports, vol. 10, no. 1, p. 6202, 2020

    2020

  48. [56]

    Multimodal database of emotional speech, video and gestures,

    T. Sapiński, D. Kamińska, A. Pelikant, C. Ozcinar, E. Avots, and G. Anbarjafari, “Multimodal database of emotional speech, video and gestures, ” inICPR Workshops. Springer, 2019, pp. 153–163

    2019

  49. [57]

    Cross-cultural differences in recognizing affect from body posture,

    A. Kleinsmith, P. R. De Silva, and N. Bianchi-Berthouze, “Cross-cultural differences in recognizing affect from body posture, ”Interacting with computers, vol. 18, no. 6, pp. 1371–1389, 2006

    2006

  50. [58]

    Step: Spatial temporal graph convolutional networks for emotion perception from gaits,

    U. Bhattacharya, T. Mittal, R. Chandra, T. Randhavane, A. Bera, and D. Manocha, “Step: Spatial temporal graph convolutional networks for emotion perception from gaits, ” inAAAI, 2020, p. 1342–1350

    2020

  51. [59]

    A recurrent variational autoencoder for human motion synthesis,

    I. Habibie, D. Holden, J. Schwarz, J. Yearsley, and T. Komura, “A recurrent variational autoencoder for human motion synthesis, ” in28th British Machine Vision Conference , 2017

    2017

  52. [60]

    Hicheur, H

    H. Hicheur, H. Kadone, J. Grèzes, and A. Berthoz, The Combined Role of Motion-Related Cues and Upper Body Posture for the Expression of Emotions during Human Walking . Berlin, Heidelberg: Springer Berlin Heidelberg, 2013, pp. 71–85. [Online]. Available: https://doi.org/10.1007...

    2013 doi

  53. [61]

    Multi-task learning for gait-based identity recognition and emotion recognition using attention enhanced temporal graph convolutional network,

    W. Sheng and X. Li, “Multi-task learning for gait-based identity recognition and emotion recognition using attention enhanced temporal graph convolutional network, ”Pattern Recognition, vol. 114, p. 107868, 2021

    2021

  54. [62]

    Emilya: Emotional body expression in daily actions database

    N. Fourati and C. Pelachaud, “Emilya: Emotional body expression in daily actions database. ” in LREC, 2014, pp. 3486–3493

    2014

  55. [63]

    Motion recognition of self and others on realistic 3d avatars,

    S. Narang, A. Best, A. Feng, S.-h. Kang, D. Manocha, and A. Shapiro, “Motion recognition of self and others on realistic 3d avatars, ”Computer Animation and Virtual Worlds, vol. 28, no. 3-4, p. e1762, 2017. J. ACM, Vol. 37, No. 4, Article 111. Publication date: August 2025. Em...

    2017

  56. [64]

    Cmu graphics lab motion capture database,

    C. M. U. G. Lab, “Cmu graphics lab motion capture database, ” 2003, accessed: 2025-04-21. [Online]. Available: http://mocap.cs.cmu.edu/

    2003

  57. [65]

    Human3.6m: Large scale datasets and predictive methods for 3d human sensing in natural environments,

    C. Ionescu, D. Papava, V. Olaru, and C. Sminchisescu, “Human3.6m: Large scale datasets and predictive methods for 3d human sensing in natural environments, ”IEEE Transactions on Pattern Analysis and Machine Intelligence , vol. 36, no. 7, pp. 1325–1339, 2014

    2014

  58. [66]

    Gesture-based affective computing on motion capture data,

    A. Kapur, A. Kapur, N. Virji-Babul, G. Tzanetakis, and P. F. Driessen, “Gesture-based affective computing on motion capture data, ” inAffective Computing and Intelligent Interaction: First International Conference, ACII 2005, Beijing, China, October 22-24, 2005. Proceedings 1 ...

    2005

  59. [67]

    Detecting affect from non-stylised body motions,

    D. Bernhardt and P. Robinson, “Detecting affect from non-stylised body motions, ” in International conference on affective computing and intelligent interaction . Springer, 2007, pp. 59–70

    2007

  60. [68]

    Multi-level classification of emotional body expression,

    N. Fourati and C. Pelachaud, “Multi-level classification of emotional body expression, ” in2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG) , vol. 1, 2015, pp. 1–8

    2015

  61. [69]

    Relevant body cues for the classification of emotional body expression in daily actions,

    ——, “Relevant body cues for the classification of emotional body expression in daily actions, ” in2015 International Conference on Affective Computing and Intelligent Interaction (ACII) . IEEE, 2015, pp. 267–273

    2015

  62. [70]

    Contribution of temporal and multi-level body cues to emotion classification,

    N. Fourati, C. Pelachaud, and P. Darmon, “Contribution of temporal and multi-level body cues to emotion classification, ” in 2019 8th International Conference on Affective Computing and Intelligent Interaction , 2019, pp. 116–122

    2019

  63. [71]

    Body expression recognition from animated 3d skeleton,

    A. Crenn, R. A. Khan, A. Meyer, and S. Bouakaz, “Body expression recognition from animated 3d skeleton, ” in International Conference on 3D Imaging , 2016, pp. 1–7

    2016

  64. [72]

    Toward an efficient body expression recognition based on the synthesis of a neutral movement,

    A. Crenn, A. Meyer, R. A. Khan, H. Konik, and S. Bouakaz, “Toward an efficient body expression recognition based on the synthesis of a neutral movement, ” in Proceedings of the 19th ACM International Conference on Multimodal Interaction, ser. ICMI ’17. New York, NY, USA: Assoc...

    2017

  65. [73]

    Generic body expression recognition based on synthesis of realistic neutral motion,

    A. Crenn, A. Meyer, H. Konik, R. A. Khan, and S. Bouakaz, “Generic body expression recognition based on synthesis of realistic neutral motion, ”IEEE Access, vol. 8, pp. 207 758–207 767, 2020

    2020

  66. [74]

    A study on emotion recognition from body gestures using kinect sensor,

    S. Saha, S. Datta, A. Konar, and R. Janarthanan, “A study on emotion recognition from body gestures using kinect sensor, ” in2014 international conference on communication and signal processing . IEEE, 2014, pp. 056–060

    2014

  67. [75]

    Adaptive body gesture representation for automatic emotion recognition,

    S. Piana, A. Staglianò, F. Odone, and A. Camurri, “Adaptive body gesture representation for automatic emotion recognition, ”ACM Transactions on Interactive Intelligent Systems , vol. 6, no. 1, pp. 1–31, 2016

    2016

  68. [76]

    Affective movement recognition based on generative and discriminative stochastic dynamic models,

    A.-A. Samadani, R. Gorbet, and D. Kulić, “Affective movement recognition based on generative and discriminative stochastic dynamic models, ”IEEE Transactions on Human-Machine Systems , vol. 44, no. 4, pp. 454–467, 2014

    2014

  69. [77]

    Collection and characterization of emotional body behaviors,

    N. Fourati and C. Pelachaud, “Collection and characterization of emotional body behaviors, ” inProceedings of the 2014 International Workshop on Movement and Computing , 2014, pp. 49–54

    2014

  70. [78]

    Automatic recognition of non-acted affective postures,

    A. Kleinsmith, N. Bianchi-Berthouze, and A. Steed, “Automatic recognition of non-acted affective postures, ”IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) , vol. 41, no. 4, pp. 1027–1038, 2011

    2011

  71. [79]

    Continuous recognition of player’s affective body expression as dynamic quality of aesthetic experience,

    N. Savva, A. Scarinzi, and N. Bianchi-Berthouze, “Continuous recognition of player’s affective body expression as dynamic quality of aesthetic experience, ”IEEE Transactions on Computational Intelligence and AI in games , vol. 4, no. 3, pp. 199–212, 2012

    2012

  72. [80]

    Using body movement and posture for emotion detection in non-acted scenarios,

    M. Garber-Barron and M. Si, “Using body movement and posture for emotion detection in non-acted scenarios, ” in 2012 IEEE International Conference on Fuzzy Systems . IEEE, 2012, pp. 1–8

    2012

  73. [81]

    Emotion recognition from body movement,

    F. Ahmed, A. H. Bari, and M. L. Gavrilova, “Emotion recognition from body movement, ” IEEE Access, vol. 8, pp. 11 761–11 781, 2019

    2019

  74. [82]

    Technique for automatic emotion recognition by body gesture analysis,

    D. Glowinski, A. Camurri, G. Volpe, N. Dael, and K. Scherer, “Technique for automatic emotion recognition by body gesture analysis, ” inCVPR Workshops, 2008, pp. 1–6

    2008

  75. [83]

    The geneva multimodal emotion portrayals (gemep) corpus,

    Swiss Center for Affective Sciences, University of Geneva, “The geneva multimodal emotion portrayals (gemep) corpus, ” https://www.unige.ch/cisa/gemep, 2025, accessed: 2025-06-23

    2025

  76. [84]

    Toward a minimal representation of affective gestures,

    D. Glowinski, N. Dael, A. Camurri, G. Volpe, M. Mortillaro, and K. Scherer, “Toward a minimal representation of affective gestures, ”IEEE Transactions on Affective Computing , vol. 2, no. 2, pp. 106–118, 2011

    2011

  77. [85]

    Deep temporal analysis for non-acted body affect recognition,

    D. Avola, L. Cinque, A. Fagioli, G. L. Foresti, and C. Massaroni, “Deep temporal analysis for non-acted body affect recognition, ”IEEE Transactions on Affective Computing , vol. 13, no. 3, pp. 1366–1377, 2020

    2020

  78. [86]

    Emotion recognition by skeleton-based spatial and temporal analysis,

    A. Oğuz and Ö. F. Ertuğrul, “Emotion recognition by skeleton-based spatial and temporal analysis, ”Expert Systems with Applications, vol. 238, p. 121981, 2024

    2024

  79. [87]

    Affective body expression recognition framework based on temporal and spatial fusion features,

    T. Wang, S. Liu, F. He, M. Du, W. Dai, Y. Ke, and D. Ming, “Affective body expression recognition framework based on temporal and spatial fusion features, ”Knowledge-Based Systems, vol. 308, p. 112744, 2025

    2025

  80. [88]

    Emotion recognition from skeletal movements,

    T. Sapiński, D. Kamińska, A. Pelikant, and G. Anbarjafari, “Emotion recognition from skeletal movements, ”Entropy, vol. 21, no. 7, p. 646, 2019

    2019

  81. [89]

    From motions to emotions: classification of affect from dance movements using deep learning,

    S. Karumuri, R. Niewiadomski, G. Volpe, and A. Camurri, “From motions to emotions: classification of affect from dance movements using deep learning, ” inExtended Abstracts of the 2019 CHI Conference on Human Factors in Computing J. ACM, Vol. 37, No. 4, Article 111. Publicatio...

    2019

  82. [90]

    Emotion recognition of human body’s posture in open environment,

    C. Mingming, F. Jiandong, and Z. Yudong, “Emotion recognition of human body’s posture in open environment, ” in 2020 Chinese Control And Decision Conference (CCDC) . Ieee, 2020, pp. 3294–3299

    2020

  83. [91]

    Emotion recognition based on multi-view body gestures,

    Z. Shen, J. Cheng, X. Hu, and Q. Dong, “Emotion recognition based on multi-view body gestures, ” in 2019 ieee international conference on image processing (icip) . IEEE, 2019, pp. 3317–3321

    2019

  84. [92]

    Skeleton-based emotion recognition based on two-stream self-attention enhanced spatial-temporal graph convolutional network,

    J. Shi, C. Liu, C. T. Ishi, and H. Ishiguro, “Skeleton-based emotion recognition based on two-stream self-attention enhanced spatial-temporal graph convolutional network, ” Sensors, vol. 21, no. 1, 2021. [Online]. Available: https://www.mdpi.com/1424-8220/21/1/205

    2021

  85. [93]

    Dynamic emotion modeling with learnable graphs and graph inception network,

    A. Shirian, S. Tripathi, and T. Guha, “Dynamic emotion modeling with learnable graphs and graph inception network, ” IEEE Transactions on Multimedia , vol. 24, pp. 780–790, 2021

    2021

  86. [94]

    Skelett-skeleton-to-emotion transfer transformer,

    P. V. Paiva, J. J. Ramos, M. Gavrilova, and M. A. Carvalho, “Skelett-skeleton-to-emotion transfer transformer, ”IEEE Access, 2025

    2025

  87. [95]

    Understanding emotional body expressions via large language models,

    H. Lu, J. Chen, F. Liang, M. Tan, R. Zeng, and X. Hu, “Understanding emotional body expressions via large language models, ”Proceedings of the AAAI Conference on Artificial Intelligence , vol. 39, no. 2, pp. 1447–1455, Apr. 2025. [Online]. Available: https://ojs.aaai.org/index...

    2025

  88. [96]

    Extraction of spatio-temporal primitives of emotional body expressions,

    L. Omlor and M. A. Giese, “Extraction of spatio-temporal primitives of emotional body expressions, ”Neurocomputing, vol. 70, no. 10, pp. 1938–1942, 2007, computational Neuroscience: Trends in Research 2007. [Online]. Available: https://www.sciencedirect.com/science/article/pii...

    1938

  89. [97]

    Human characterization and emotion characterization from gait,

    G. Venture, “Human characterization and emotion characterization from gait, ” in2010 Annual International Conference of the IEEE Engineering in Medicine and Biology , 2010, pp. 1292–1295

    2010

  90. [98]

    Recognizing emotions conveyed by human gait,

    G. Venture, H. Kadone, T. Zhang, J. Grèzes, A. Berthoz, and H. Hicheur, “Recognizing emotions conveyed by human gait, ”International Journal of Social Robotics , vol. 6, pp. 621–632, 2014

    2014

  91. [99]

    Recognition of affect based on gait patterns,

    M. Karg, K. Kühnlenz, and M. Buss, “Recognition of affect based on gait patterns, ”IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) , vol. 40, no. 4, pp. 1050–1061, 2010

    2010

  92. [100]

    A comparison of pca, kpca and lda for feature extraction to recognize affect in gait kinematics,

    M. Karg, R. Jenke, W. Seiberl, K. Kühnlenz, A. Schwirtz, and M. Buss, “A comparison of pca, kpca and lda for feature extraction to recognize affect in gait kinematics, ” in2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops. IEEE,...

    2009

  93. [101]

    A two-fold pca-approach for inter-individual recognition of emotions in natural walking

    M. Karg, R. Jenke, K. Kühnlenz, and M. Buss, “A two-fold pca-approach for inter-individual recognition of emotions in natural walking. ” inMLDM posters, 2009, pp. 51–61

    2009

  94. [102]

    Emotion recognition by body movement representation on the manifold of symmetric positive definite matrices,

    M. Daoudi, S. Berretti, P. Pala, Y. Delevoye, and A. D. Bimbo, “Emotion recognition by body movement representation on the manifold of symmetric positive definite matrices, ” inInternational Conference on Image Analysis and Processing , 2017, pp. 550–560

    2017

  95. [103]

    Identifying emotions from non-contact gaits information based on microsoft kinects,

    B. Li, C. Zhu, S. Li, and T. Zhu, “Identifying emotions from non-contact gaits information based on microsoft kinects, ” IEEE Transactions on Affective Computing , vol. 9, no. 4, pp. 585–591, 2016

    2016

  96. [104]

    Score and rank-level fusion for emotion recognition using genetic algorithm,

    F. Ahmed, B. Sieu, and M. L. Gavrilova, “Score and rank-level fusion for emotion recognition using genetic algorithm, ” in 2018 IEEE 17th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC) , 2018, pp. 46–53

    2018

  97. [105]

    Emotion recognition based on customized smart bracelet with built-in accelerometer,

    Z. Zhang, Y. Song, L. Cui, X. Liu, and T. Zhu, “Emotion recognition based on customized smart bracelet with built-in accelerometer, ”PeerJ, vol. 4, p. e2258, Jul. 2016. [Online]. Available: https://doi.org/10.7717/peerj.2258

    2016 doi

  98. [106]

    Emotion recognition using smart watch sensor data: Mixed-design study,

    J. C. Quiroz, E. Geangu, and M. H. Yong, “Emotion recognition using smart watch sensor data: Mixed-design study, ” JMIR Ment Health, vol. 5, no. 3, p. e10153, Aug 2018. [Online]. Available: http://mental.jmir.org/2018/3/e10153/

    2018

  99. [107]

    Emotion-recognition using smart watch accelerometer data: Preliminary findings,

    J. C. Quiroz, M. H. Yong, and E. Geangu, “Emotion-recognition using smart watch accelerometer data: Preliminary findings, ” inProceedings of the 2017 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2017 ACM International Symposiu...

    2017

  100. [108]

    Emotion recognition through gait on mobile devices,

    M. Chiu, J. Shu, and P. Hui, “Emotion recognition through gait on mobile devices, ” in2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops) , 2018, pp. 800–805

    2018

  101. [109]

    Identifying emotions from walking using affective and deep features,

    T. Randhavane, U. Bhattacharya, K. Kapsaskis, K. Gray, A. Bera, and D. Manocha, “Identifying emotions from walking using affective and deep features, ”arXiv preprint arXiv:1906.11884, 2019

    1906 arXiv

  102. [110]

    Motion capture sensor-based emotion recognition using a bi-modular sequential neural network,

    Y. Bhatia, A. H. Bari, G.-S. J. Hsu, and M. Gavrilova, “Motion capture sensor-based emotion recognition using a bi-modular sequential neural network, ”Sensors, vol. 22, no. 1, p. 403, 2022

    2022

  103. [111]

    Hierarchical-attention-based neural network for gait emotion recognition,

    S. Zhang, J. Zhang, W. Song, L. Yang, and X. Zhao, “Hierarchical-attention-based neural network for gait emotion recognition, ”Physica A: Statistical Mechanics and its Applications , vol. 637, p. 129600, 2024. [Online]. Available: https://www.sciencedirect.com/science/article/...

    2024

  104. [112]

    Take an emotion walk: Perceiving emotions from gaits using hierarchical attention pooling and affective mapping,

    U. Bhattacharya, C. Roncal, T. Mittal, R. Chandra, K. Kapsaskis, K. Gray, A. Bera, and D. Manocha, “Take an emotion walk: Perceiving emotions from gaits using hierarchical attention pooling and affective mapping, ” inECCV. Springer, 2020, pp. 145–163

    2020

  105. [113]

    Vfl—a deep learning-based framework for classifying walking gaits into emotions,

    X. Sun, K. Su, and C. Fan, “Vfl—a deep learning-based framework for classifying walking gaits into emotions, ” Neurocomputing, vol. 473, pp. 1–13, 2022. J. ACM, Vol. 37, No. 4, Article 111. Publication date: August 2025. Emotion Recognition from Skeleton Data: A Comprehensive ...

    2022

  106. [114]

    Tntc: two-stream network with transformer-based complementarity for gait-based emotion recognition,

    C. Hu, W. Sheng, B. Dong, and X. Li, “Tntc: two-stream network with transformer-based complementarity for gait-based emotion recognition, ” inIEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . IEEE, 2022, pp. 3229–3233

    2022

  107. [115]

    Temporal group attention network with affective complementary learning for gait emotion recognition,

    Z. Zhu, C. P. Chen, H. Liu, and T. Zhang, “Temporal group attention network with affective complementary learning for gait emotion recognition, ” in2024 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) . IEEE, 2024, pp. 3026–3033

    2024

  108. [116]

    Tt-gcn: Temporal-tightly graph convolutional network for emotion recognition from gaits,

    T. Zhang, Y. Chen, S. Li, X. Hu, and C. L. P. Chen, “Tt-gcn: Temporal-tightly graph convolutional network for emotion recognition from gaits, ”IEEE Transactions on Computational Social Systems , vol. 11, no. 3, pp. 4300–4314, 2024

    2024

  109. [117]

    Looking into gait for perceiving emotions via bilateral posture and movement graph convolutional networks,

    Y. Zhai, G. Jia, Y.-K. Lai, J. Zhang, J. Yang, and D. Tao, “Looking into gait for perceiving emotions via bilateral posture and movement graph convolutional networks, ”IEEE Transactions on Affective Computing, vol. 15, no. 3, pp. 1634–1648, 2024

    2024

  110. [118]

    Proxemo: Gait-based emotion learning and multi-view proxemic fusion for socially-aware robot navigation,

    V. Narayanan, B. M. Manoghar, V. S. Dorbala, D. Manocha, and A. Bera, “Proxemo: Gait-based emotion learning and multi-view proxemic fusion for socially-aware robot navigation, ” inIROS, 2020, pp. 8200–8207

    2020

  111. [119]

    G-gcsn: Global graph convolution shrinkage network for emotion perception from gait,

    Y. Zhuang, L. Lin, R. Tong, J. Liu, Y. Iwamoto, and Y.-W. Chen, “G-gcsn: Global graph convolution shrinkage network for emotion perception from gait, ” inACCV Workshops, 2021, pp. 46–57

    2021

  112. [120]

    Epic: Emotion perception by spatio-temporal interaction context of gait,

    H. Lu, S. Xu, S. Zhao, X. Hu, R. Ma, and B. Hu, “Epic: Emotion perception by spatio-temporal interaction context of gait, ”IEEE Journal of Biomedical and Health Informatics , vol. 28, no. 5, pp. 2592–2601, 2024

    2024

  113. [121]

    Msa-gcn: Multiscale adaptive graph convolution network for gait emotion recognition,

    Y. Yin, L. Jing, F. Huang, G. Yang, and Z. Wang, “Msa-gcn: Multiscale adaptive graph convolution network for gait emotion recognition, ” Pattern Recognition , vol. 147, p. 110117, 2024. [Online]. Available: https://www.sciencedirect.com/science/article/pii/S0031320323008142

    2024

  114. [122]

    Sta-gcn:spatial temporal adaptive graph convolutional network for gait emotion recognition,

    C. Chen and X. Sun, “Sta-gcn:spatial temporal adaptive graph convolutional network for gait emotion recognition, ” in 2023 IEEE International Conference on Multimedia and Expo (ICME) , 2023, pp. 1385–1390

    2023

  115. [123]

    Gaitcycformer: Leveraging gait cycles and transformers for gait emotion recognition

    Q. Zeng and L. Shang, “Gaitcycformer: Leveraging gait cycles and transformers for gait emotion recognition. ” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 39, no. 9, 2025, pp. 9815–9823

    2025

  116. [124]

    See your emotion from gait using unlabeled skeleton data,

    H. Lu, X. Hu, and B. Hu, “See your emotion from gait using unlabeled skeleton data, ” inAAAI, vol. 37, no. 2, jun 2023, pp. 1826–1834. [Online]. Available: https://doi.org/10.1609%2Faaai.v37i2.25272

    2023

  117. [125]

    Self-supervised gait-based emotion representation learning from selective strongly augmented skeleton sequences,

    C. Song, L. Lu, Z. Ke, L. Gao, and S. Ding, “Self-supervised gait-based emotion representation learning from selective strongly augmented skeleton sequences, ”arXiv preprint arXiv:2405.04900, 2024

    2024 arXiv

  118. [126]

    See your mental state from your walk: Recognizing anxiety and depression through kinect-recorded gait data,

    N. Zhao, Z. Zhang, Y. Wang, J. Wang, B. Li, T. Zhu, and Y. Xiang, “See your mental state from your walk: Recognizing anxiety and depression through kinect-recorded gait data, ”PloS one, vol. 14, no. 5, 2019

    2019

  119. [127]

    Depression identification from gait spectrum features based on hilbert-huang transform,

    Y. Yuan, B. Li, N. Wang, Q. Ye, Y. Liu, and T. Zhu, “Depression identification from gait spectrum features based on hilbert-huang transform, ” inHuman Centered Computing: 4th International Conference, HCC 2018, Mexico, December, 5–7, 2018, Revised Selected Papers 4 . Springer,...

    2018

  120. [128]

    Detecting depression through gait data: examining the contribution of gait features in recognizing depression,

    Y. Wang, J. Wang, X. Liu, and T. Zhu, “Detecting depression through gait data: examining the contribution of gait features in recognizing depression, ”Frontiers in psychiatry, vol. 12, p. 661213, 2021

    2021

  121. [129]

    A new skeletal representation based on gait for depression detection,

    H. Lu, W. Shao, E. Ngai, X. Hu, and B. Hu, “A new skeletal representation based on gait for depression detection, ” in 2020 IEEE International Conference on E-health Networking, Application Services (HEALTHCOM) , 2021, pp. 1–6

    2020

  122. [130]

    Postgraduate student depression assessment by multimedia gait analysis,

    H. Lu, S. Xu, X. Hu, E. Ngai, Y. Guo, W. Wang, and B. Hu, “Postgraduate student depression assessment by multimedia gait analysis, ”IEEE MultiMedia, vol. 29, no. 2, pp. 56–65, 2022

    2022

  123. [131]

    Depression prevalence in postgraduate students and its association with gait abnormality,

    J. Fang, T. Wang, C. Li, X. Hu, E. Ngai, B.-C. Seet, J. Cheng, Y. Guo, and X. Jiang, “Depression prevalence in postgraduate students and its association with gait abnormality, ”IEEE Access, vol. 7, pp. 174 425–174 437, 2019

    2019

  124. [132]

    A gait assessment framework for depression detection using kinect sensors,

    T. Wang, C. Li, C. Wu, C. Zhao, J. Sun, H. Peng, X. Hu, and B. Hu, “A gait assessment framework for depression detection using kinect sensors, ”IEEE Sensors Journal, vol. 21, no. 3, pp. 3260–3270, 2021

    2021

  125. [133]

    Data augmentation for depression detection using skeleton-based gait information,

    J. Yang, H. Lu, C. Li, X. Hu, and B. Hu, “Data augmentation for depression detection using skeleton-based gait information, ”Medical & Biological Engineering & Computing , p. 2665–2679, jul 2022

    2022

  126. [134]

    A multi-modal gait analysis-based detection system of the risk of depression,

    W. Shao, Z. You, L. Liang, X. Hu, C. Li, W. Wang, and B. Hu, “A multi-modal gait analysis-based detection system of the risk of depression, ”IEEE Journal of Biomedical and Health Informatics , vol. 26, no. 10, pp. 4859–4868, 2021

    2021

  127. [135]

    Depression risk recognition based on gait: A benchmark,

    X. Liu, Q. Li, S. Hou, M. Ren, X. Hu, and Y. Huang, “Depression risk recognition based on gait: A benchmark, ” Neurocomputing, vol. 596, p. 128045, 2024

    2024

  128. [136]

    Spatio-temporal multi-granularity for skeleton-based depression risk recognition,

    Q. Li, M. Ren, X. Hu, X. Liu, L. Yao, and Y. Huang, “Spatio-temporal multi-granularity for skeleton-based depression risk recognition, ”IEEE Journal of Biomedical and Health Informatics , pp. 1–12, 2025

    2025

  129. [137]

    The role of emotion regulation in autism spectrum disorder,

    C. A. Mazefsky, J. Herrington, M. Siegel, A. Scarpa, B. B. Maddox, L. Scahill, and S. W. White, “The role of emotion regulation in autism spectrum disorder, ”Journal of the American Academy of Child & Adolescent Psychiatry , vol. 52, no. 7, pp. 679–688, 2013

    2013

  130. [138]

    Generating 3d dataset of gait and full body movement of children with autism spectrum disorders collected by kinect v2 camera,

    A. A. Al-Jubouri, I. H. Ali, and Y. Rajihy, “Generating 3d dataset of gait and full body movement of children with autism spectrum disorders collected by kinect v2 camera, ”Compusoft, vol. 9, no. 8, pp. 3791–3797, 2020. J. ACM, Vol. 37, No. 4, Article 111. Publication date: Au...

    2020

  131. [139]

    Application of skeleton data and long short-term memory in action recognition of children with autism spectrum disorder,

    Y. Zhang, Y. Tian, P. Wu, and D. Chen, “Application of skeleton data and long short-term memory in action recognition of children with autism spectrum disorder, ”Sensors, vol. 21, no. 2, p. 411, 2021

    2021

  132. [140]

    Human gesture and gait analysis for autism detection,

    S. Zahan, Z. Gilani, G. M. Hassan, and A. Mian, “Human gesture and gait analysis for autism detection, ” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 3328–3337

    2023

  133. [141]

    Body posture based detection of autism spectrum disorder in children,

    M. Yang, M. Ni, T. Su, W. Zhou, Y. She, W. Zheng, and B. Hu, “Body posture based detection of autism spectrum disorder in children, ”IEEE Sensors Journal, 2025

    2025

  134. [142]

    Skeletal video anomaly detection using deep learning: Survey, challenges, and future directions,

    P. K. Mishra, A. Mihailidis, and S. S. Khan, “Skeletal video anomaly detection using deep learning: Survey, challenges, and future directions, ”IEEE Transactions on Emerging Topics in Computational Intelligence , vol. 8, no. 2, pp. 1073–1085, 2024

    2024

  135. [143]

    Skeleton based abnormal behavior recognition using spatio-temporal convolution and attention-based lstm,

    K. Zhou, T. Wu, C. Wang, J. Wang, and C. Li, “Skeleton based abnormal behavior recognition using spatio-temporal convolution and attention-based lstm, ”Procedia Computer Science, vol. 174, pp. 424–432, 2020

    2020

  136. [144]

    Learning regularity in skeleton trajectories for anomaly detection in videos,

    R. Morais, V. Le, T. Tran, B. Saha, M. Mansour, and S. Venkatesh, “Learning regularity in skeleton trajectories for anomaly detection in videos, ” inProceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2019, pp. 11 996–12 004

    2019

  137. [145]

    Graph embedded pose clustering for anomaly detection,

    A. Markovitz, G. Sharir, I. Friedman, L. Zelnik-Manor, and S. Avidan, “Graph embedded pose clustering for anomaly detection, ” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2020, pp. 10 539– 10 547

    2020

  138. [146]

    A self-attention augmented graph convolutional clustering networks for skeleton-based video anomaly behavior detection,

    C. Liu, R. Fu, Y. Li, Y. Gao, L. Shi, and W. Li, “A self-attention augmented graph convolutional clustering networks for skeleton-based video anomaly behavior detection, ”Applied Sciences, vol. 12, no. 1, p. 4, 2021

    2021

  139. [147]

    Contracting skeletal kinematics for human-related video anomaly detection,

    A. Flaborea, G. M. D. di Melendugno, S. D’Arrigo, M. A. Sterpa, A. Sampieri, and F. Galasso, “Contracting skeletal kinematics for human-related video anomaly detection, ”Pattern Recognition, vol. 156, p. 110817, 2024

    2024

  140. [148]

    Graph-jigsaw conditioned diffusion model for skeleton-based video anomaly detection,

    A. Karami, T. K. K. Ho, and N. Armanfard, “Graph-jigsaw conditioned diffusion model for skeleton-based video anomaly detection, ” in2025 IEEE/CVF Winter Conference on Applications of Computer Vision (W ACV). IEEE, 2025, pp. 4237–4247

    2025

  141. [149]

    Prompt-guided zero-shot anomaly action recognition using pretrained deep skeleton features,

    F. Sato, R. Hachiuma, and T. Sekii, “Prompt-guided zero-shot anomaly action recognition using pretrained deep skeleton features, ” inCVPR, 2023, pp. 6471–6480

    2023

  142. [150]

    Language-skeleton pre-training to collaborate with self-supervised human action recognition,

    Y. Liu, R. Liu, W. Xin, Q. Miao, Y. Hu, and J. Qi, “Language-skeleton pre-training to collaborate with self-supervised human action recognition, ” inChinese Conference on Pattern Recognition and Computer Vision (PRCV) . Springer, 2024, pp. 409–423

    2024

  143. [151]

    A multimodal non-intrusive stress monitoring from the pleasure-arousal emotional dimensions,

    M. Dahmane, J. Alam, P.-L. St-Charles, M. Lalonde, K. Heffner, and S. Foucher, “A multimodal non-intrusive stress monitoring from the pleasure-arousal emotional dimensions, ”IEEE Transactions on Affective Computing , vol. 13, no. 2, pp. 1044–1056, 2020

    2020

  144. [152]

    Development and application of emotion recognition technology—a systematic literature review,

    R. Guo, H. Guo, L. Wang, M. Chen, D. Yang, and B. Li, “Development and application of emotion recognition technology—a systematic literature review, ”BMC psychology, vol. 12, no. 1, p. 95, 2024

    2024

  145. [153]

    Skeleton-based pre-training with discrete labels for emotion recognition in iot environments,

    Z. Zhang, F. Liang, W. Wang, R. Zeng, V. C. Leung, and X. Hu, “Skeleton-based pre-training with discrete labels for emotion recognition in iot environments, ”IEEE Internet of Things Journal , 2025

    2025

  146. [154]

    Arbee: Towards automated recognition of bodily expression of emotion in the wild,

    Y. Luo, J. Ye, R. B. Adams, J. Li, M. G. Newman, and J. Z. Wang, “Arbee: Towards automated recognition of bodily expression of emotion in the wild, ”International Journal of Computer Vision , vol. 128, no. 1, pp. 1–25, 2020

    2020

  147. [155]

    Decoding group emotional dynamics in a web-based collaborative environment: A novel framework utilizing multi-person facial expression recognition,

    Q. Li, Z. Liu, Z. Zhang, Q. Wang, and M. Ma, “Decoding group emotional dynamics in a web-based collaborative environment: A novel framework utilizing multi-person facial expression recognition, ” International Journal of Human–Computer Interaction, vol. 41, no. 5, pp. 3455–3473, 2025

    2025

  148. [156]

    Deep learning-based multimodal emotion recognition from audio, visual, and text modalities: A systematic review of recent advancements and future prospects,

    S. Zhang, Y. Yang, C. Chen, X. Zhang, Q. Leng, and X. Zhao, “Deep learning-based multimodal emotion recognition from audio, visual, and text modalities: A systematic review of recent advancements and future prospects, ”Expert Systems with Applications, vol. 237, p. 121692, 2024

    2024

  149. [157]

    Eeg based emotion recognition: A tutorial and review,

    X. Li, Y. Zhang, P. Tiwari, D. Song, B. Hu, M. Yang, Z. Zhao, N. Kumar, and P. Marttinen, “Eeg based emotion recognition: A tutorial and review, ”ACM Computing Surveys (CSUR), 2022

    2022

  150. [158]

    Multimodal emotion recognition based on facial expressions, speech, and body gestures

    J. Yan, P. Li, C. Du, K. Zhu, X. Zhou, Y. Liu, and J. Wei, “Multimodal emotion recognition based on facial expressions, speech, and body gestures. ”Electronics (2079-9292), vol. 13, no. 18, 2024

    2024

  151. [159]

    Enhancing emotion recognition using multimodal fusion of physiological, environmental, personal data,

    H. Kim and T. Hong, “Enhancing emotion recognition using multimodal fusion of physiological, environmental, personal data, ”Expert Systems with Applications, vol. 249, p. 123723, 2024

    2024

  152. [160]

    Chatgpt: An ai language model,

    OpenAI, “Chatgpt: An ai language model, ” https://chat.openai.com/, 2024

    2024

  153. [161]

    Visual instruction tuning,

    H. Liu, C. Li, Q. Wu, and Y. J. Lee, “Visual instruction tuning, ”NeurIPS, vol. 36, 2024

    2024

  154. [162]

    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context,

    G. Research, “Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context, ” arXiv, vol. abs/2403.05530, 2024, technical report detailing the Gemini 1.5 Pro architecture and performance benchmarks. [Online]. Available: https://ar5iv.labs.arxiv.org/html/...

    2024 arXiv

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.