Pith. sign in

REVIEW 1 major objections 7 minor 118 references

STAR: Skeletal Token Alignment and Rearrangement for Interaction Recognition

T0 review · 1 major / 7 minor · reviewed 2026-08-01 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read The paper claims that a skeleton-only interaction recognizer can learn from RGB video during training—via contrastive alignment of skeleton and visual interaction features—and then outperform previous methods at inference using only skeleto

desk verdict Competent extension of ISTA-Net with multi-modal alignment; the visual-alignment claim is plausible but only weakly evidenced, so the revision needs statistical rigor. read the letter →

arxiv 2607.17342 v1 pith:H4LVPAA2 submitted 2026-07-19 cs.CV cs.AI

Yuhang Wen , Mengyuan Liu , Zixuan Tang , Junsong Yuan , Sirui Li , Beichen Ding This is my paper
classification cs.CVcs.AI
keywords InteractionrecognitionSkeleton-basedactionHuman-robotMulti-modalalignmentContrastivelearningSpatiotemporaltokensEntitypermutationinvarianceVisualdistillation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

STAR tackles two problems in skeleton-based interaction recognition: skeletons of two interacting entities carry less evidence than video, and standard skeleton architectures often fail to model the interaction itself. The proposed solution trains with both modalities but deploys with only skeletons. A skeleton encoder built from Interactive Spatiotemporal Tokens and Entity Rearrangement learns interaction-local features while respecting that the two actors could be swapped. During training, a contrastive loss pulls those skeleton features toward visual features cropped around the interaction in the RGB video; at test time only skeletons are used, with an optional refinement head that learned to mimic the visual branch. If the claim holds, a privacy-preserving, low-light-friendly skeleton system gains the disambiguating power of video—distinguishing, for example, 'punch/slap' from 'hit with object'—without needing video at runtime.

What carries the argument

Two mechanisms carry the argument. Entity Rearrangement randomly permutes the order of the two entities during training; because interaction labels are invariant under entity swap, the symmetric group reduces variance in the estimator and stabilizes optimization. Interactive Spatiotemporal Tokens are 3D windows sliding over time, joints, and entities, so each token bundles a local spatiotemporal patch of the interaction; stacked Token Self-Attention blocks then model interdependencies without relying on adjacency matrices, which matters because human bone structure differs from a quadruped robot's. The third mechanism is the multimodal alignment: a contrastive loss ties the skeleton token fe

What would settle it

Run STAR on a test set where the two interacting entities are frequently partially out of frame or far apart; if accuracy drops to the no-alignment baseline (about 91.5% in the paper's Table III) while the alignment loss stays high, the visual teacher is injecting noise rather than signal, and random-crop controls would confirm whether FoI localization is the source of gains.

Watch

Extended reading notes

Core claim

STAR is claimed to be the first skeleton-based interaction recognition method to use multi-modal alignment with visual interaction features. In training, an object detector finds both entities in each RGB frame; a maximum square box covering all detections at all sampled times crops an interaction Region of Interest, which a pretrained video encoder embeds. The skeleton encoder's intermediate feature vector is aligned to that visual embedding by a contrastive objective in a shared latent space, and a separate refinement head learns to predict the label from the visual embedding, so at test time it can be fed with the skeleton feature instead. On the Chico and HARPER human-robot datasets and

Load-bearing premise

The load-bearing premise is that the Focus on Interactions crops—obtained from a pretrained object detector and a maximum square box—contain the interaction-discriminative visual information that survives temporal sampling, and that the detector does not fail; the paper itself notes (Fig. 8) failures when entities are partially out of frame or too far apart, and the conclusion acknowledges the assumption of known actor types.

Editorial extensions

If this is right

  • If STAR is correct, a skeleton-only model can learn from video during training and match or beat methods that need video at inference, enabling privacy-sensitive and low-light deployments.
  • The Entity Rearrangement perspective implies that two-entity interaction modeling can treat entity order as a symmetry, reducing reliance on subject-specific adjacency priors in graph-based skeleton models.
  • Because the visual target comes from Focus on Interactions cropping, alignment quality depends on detector localization; the paper shows success cases under occlusion and identifies partially out-of-frame or far-apart entities as failure cases.
  • The refinement head adds a 'think-twice' step at test time with negligible overhead (about 0.41M additional parameters reported for the alignment components).
  • On fine-grained categories such as 'hit with object' and 'punch/slap', visual alignment yields large reported category-level accuracy gains, suggesting video cues specifically resolve ambiguities in contact point and manipulated object.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • A natural extension of the training-time-video, inference-time-skeleton recipe is to distill knowledge from larger video foundation models without increasing deployment cost; the paper's encoder benchmark suggests video models transfer more useful cues than image models.
  • The known-actor-type assumption flagged in the conclusion could be tested by clustering roles from spatiotemporal movement patterns; if that works, STAR-style alignment could apply to open-world human-robot interaction instead of pre-specified entity pairs.
  • The FoI failure cases suggest a specific stress test: when the detector misses entities or crops too large a region, the contrastive objective may pull skeleton features toward noise; probing performance under progressively larger entity distances would reveal how much robustness margin remains.
  • Because the visual branch is a training-time teacher only, the same alignment objective could be applied to other privacy-sensitive modalities (e.g., depth or thermal) to enrich skeleton features without changing the skeleton-only inference pipeline.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

1 major / 7 minor

Summary. The paper presents STAR, a framework for skeleton-based human-robot and human-human interaction recognition. STAR consists of a skeleton encoder built on Entity Rearrangement (ER) and Interactive Spatiotemporal Tokens (ISTs), a visual branch that extracts interaction-focused RGB features via Focus on Interactions (FoI), and a contrastive alignment loss that trains skeleton and visual features in a shared latent space. At inference, only the skeleton branch is used, with an auxiliary refinement head that estimates visual-informed logits from skeleton features. The method is evaluated on Chico, HARPER, NTU Mutual 11, and NTU Mutual 26, reporting state-of-the-art accuracy. The paper also provides ablations for each component, robustness tests under noise and masking, and a public code release.

Significance. If the central claim holds, STAR would be a useful contribution: it demonstrates that visual cues can be distilled into a skeleton-only model through training-time alignment, preserving the efficiency and privacy advantages of skeleton-based inference while improving accuracy. The paper's strengths are its comprehensive evaluation across four benchmarks, including two recent HRI datasets, its component-wise ablations, and the release of code. The skeleton encoder design (ISTs and ER) appears well motivated and the authors provide quantitative and qualitative evidence that the learned representations are more discriminative. However, the paper's headline contribution—the multi-modal alignment—is supported by a small accuracy gain (about 0.7 percentage points on NTU Mutual 26) and lacks statistical validation. The alignment loss itself, as written, also raises a technical concern about whether it actually pulls positive pairs together. These issues must be addressed before the central claim can be considered established.

major comments (1)
  1. [§II-B] The claim that STAR is 'the first to leverage multi-modal alignment to learn both human-robot and human-human interactions' is stated in the introduction and related work, but the comparison to prior multi-modal alignment works (e.g., GAP, MMCL, C2VL) is made at the level of task scope. The paper does not discuss whether any of those methods could be adapted to the interaction setting with minimal changes. A more careful positioning, perhaps with an adapted-baseline experiment, would strengthen the novelty claim.
minor comments (7)
  1. [Abstract / Intro] The sentence 'with a refinement head further refines predictions' has a grammatical error ('head further refines'). Please revise.
  2. [§I, Fig. 1] The figure caption for Fig. 1 uses 'Ours can infer the interactions in dark or privacy-sensitive workspaces' but the figure shows only an illustrative example; consider clarifying that this is a schematic and not an actual experimental result.
  3. [§III-A] The use of Chen et al. [107] to argue variance reduction from random permutation is appropriate, but the notation O = d πO and the approximate-invariance case are introduced briefly. A short intuitive explanation of why approximate invariance also yields variance reduction would improve readability.
  4. [§III-C] In Eq. (8), the operator ∩ is defined as 'intersection' with the original video, but the actual operation is a spatial crop using the maximum covering box. The notation is confusing; please use a clearer operator name, e.g., 'crop'.
  5. [§IV-E, Table III(a)] The table title 'PRETRAINED VISION ENCODERS' includes 'No Alignment' as a row, which is not a vision encoder. Consider moving that row to Table III(b) or renaming the table.
  6. [§IV-E, Table III(e)] The parameter counts in Table III(e) are given for different encoder layers, but the 'No Alignment' row reports a different parameter count (6.22M) that is not directly comparable to the 6.63M used for the default model. Please clarify whether the parameter count includes the alignment MLP and refinement head, and note that removing alignment reduces parameters.
  7. [§IV-E, Table III(h)] The robustness experiment applies noise with σ=0.01 and masking with p=0.01, but the choice of these values is not justified. A small sensitivity analysis over noise/mask levels would make the robustness claim more convincing.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity found: STAR's alignment and refinement are empirical training objectives, not derivations that reduce to their inputs.

full rationale

STAR's derivation chain is empirical rather than algebraic. The skeleton encoder (Eqs. 3-7), Focus on Interactions (Eq. 8), contrastive alignment objective (Eqs. 9-10), and refinement head (Eqs. 11-12) define training procedures; the claimed skeleton-only benefit is measured by test-set accuracy and ablations, not derived from the equations. I could not exhibit any step where an output reduces by construction to a fitted value or to a definitional identity. The self-citations to the authors' ISTA-Net [15] and CHASE [85] are used for motivation, baselines, and design references; these are externally published results and the multi-modal alignment contribution does not depend on their correctness. The 'first to introduce multi-modal alignment' statement is a novelty claim, not a circular derivation. Skeptical concerns about the small alignment gain (0.73%), lack of significance testing, and FoI failure cases are evidence-strength and robustness issues, not circularity. Therefore the appropriate score is 0.

Assumptions & free parameters 7 free parameters · 6 assumptions · 0 invented entities

The central claim depends on a small set of tuned hyperparameters and on domain assumptions about entity-order invariance and visual RoI quality. No new physical or ontological entities are introduced; the proposed components (ISTs, ER, FoI, refinement head) are model constructs implemented in code and trained on existing data.

free parameters (7)
  • λ1 (alignment loss weight) = 0.4
    Trade-off coefficient for LAlign in Eq. 13; chosen by ablation reported in Fig. 7(b).
  • λ2 (refinement loss weight) = 0.7
    Trade-off coefficient for LREF in Eq. 13; chosen by ablation in Fig. 7(b).
  • β (refinement fusion coefficient) = 0.8
    Convex combination weight in Eq. 12; not ablated in the paper, set by hand/code.
  • τ (contrastive temperature) = not stated
    Temperature in contrastive critic Eq. 9; value deferred to code repository.
  • Window shape W=(Tw,Jw,Ew) = (20,1,2)
    3D tokenization window; selected by ablation in Table III(g), strongly affects performance.
  • Alignment block index l_hat = 6
    Intermediate TSA block used for skeleton-vision alignment; ablated in Table III(f).
  • Encoder layers L, downsampling layers, heads = L=8, LD={3,5}, H=3
    Architecture sizes selected by ablation in Table III(e).
assumptions (6)
  • domain assumption Interaction labels are exactly permutation-invariant along the entity dimension (O =d πO, Eq. 2).
    Entity Rearrangement assumes swapping subjects never changes the interaction class; plausible for symmetric interactions but not verified for role-asymmetric HRI labels.
  • domain assumption Visual RoI features extracted by FoI contain interaction-discriminative cues absent from skeletons.
    The alignment benefit rests on UniformerV2 features of the cropped region encoding objects and contact; failure cases in Fig. 8 show this can fail.
  • domain assumption The object detector Ω provides correct entity bounding boxes for the max covering box.
    Eq. 8 uses detector outputs; missed or failed detections corrupt the visual alignment target.
  • standard math Chen et al. [107] group-theoretic variance-reduction result applies to ERM for skeleton interaction learning.
    The theoretical motivation for Entity Rearrangement is imported from [107]; not re-derived.
  • domain assumption Actor types are known in advance for training and inference.
    Stated in Sec. IV-B and Conclusion; the model requires specifying entity class names (e.g., person, robot dog).
  • domain assumption Skeleton and RGB sequences are correctly paired and synchronized in all datasets.
    Contrastive alignment uses (X, Xv) pairs; misalignment would make positives invalid.

how reviews work

0 comments
Cite this review

Pith. "Pith review of STAR: Skeletal Token Alignment and Rearrangement for Interaction Recognition." pith.science (2026). https://pith.science/paper/H4LVPAA2

@misc{pith2026260717342,
  author       = {Pith},
  title        = {Pith review of: STAR: Skeletal Token Alignment and Rearrangement for Interaction Recognition},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/H4LVPAA2}},
  note         = {Machine review of arXiv:2607.17342}
}
read the original abstract

Understanding physical human-robot and human-human interactions is a challenging yet emerging topic in 3D vision. While most existing methods rely on skeleton sequences--effective in low-light and privacy-sensitive environment--they face two major challenges: 1) learning and effectively exploiting interaction cues from skeletal data, and 2) compensating for the lack of visual information absent in skeletons alone. To address these challenges, we propose skeletal token alignment and rearrangement (STAR) for human-robot and human-human interaction recognition. It learns interaction-specific skeleton features and enriches them using visual cues by aligning skeleton and RGB video representations in a shared latent space. Specifically, STAR consists of three key components. First, we design a skeleton encoder that captures fine-grained interdependencies using Entity Rearrangement (ER) and Interactive Spatiotemporal Tokens (ISTs). Second, we present Visual Interaction Encoding that introduces a Focus on Interactions (FoI) strategy to attend to spatiotemporal regions relevant to interactions in RGB videos. Finally, these representations are aligned via a contrastive learning objective, with a refinement head further refines predictions. During training, STAR leverages both skeleton and RGB video data to learn robust, discriminative interaction representations. At inference time, it operates on skeletons alone, retaining visual-informed benefits while preserving skeleton-only efficiency. Extensive experiments on Chico, HARPER, NTU Mutual 11 and 26 datasets consistently validate our approach by demonstrating superior performance over state-of-the-art methods. Our code is publicly available at https://github.com/Necolizer/STAR.

Figures

Figures reproduced from arXiv: 2607.17342 by the authors.

Figure 1
Figure 1. Ways to learn interactions. (a) Most existing methods leverage skeleton [PITH_FULL_IMAGE:figures/full_fig_p001_1.png] view at source ↗
Figure 2
Figure 2. The overall framework of the proposed STAR for human-robot and human-human interactions. STAR consists of an encoder to learn skeletal interactions, [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗
Figure 3
Figure 3. Motivation of Entity Rearrangement. We observe that the category of [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (5 more)
Figure 4
Figure 4. Figure 4: The architecture of the skeleton encoder in our proposed STAR. Given [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]
Figure 5
Figure 5. Figure 5: Confusion matrices of the baseline (a) and our proposed STAR (b). Their detailed category results (c) demonstrate that STAR effectively recognizes [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]
Figure 6
Figure 6. Figure 6: Case visualization and analysis of difficult interaction samples. [PITH_FULL_IMAGE:figures/full_fig_p008_6.png]
Figure 7
Figure 7. Figure 7: (a) UMAP [116] visualizations of skeletal representations of interactions on the test set. Compared to the baseline (left), STAR (right) produces more [PITH_FULL_IMAGE:figures/full_fig_p009_7.png]
Figure 8
Figure 8. Figure 8: Success and failure cases in FoI. FoI succeeds in both dynamic and [PITH_FULL_IMAGE:figures/full_fig_p010_8.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

118 extracted references · 3 linked inside Pith

  1. [1]

    Hierarchical aggregated graph neu- ral network for skeleton-based action recognition,

    P. Geng, X. Lu, W. Li, and L. Lyu, “Hierarchical aggregated graph neu- ral network for skeleton-based action recognition,”IEEE Transactions on Multimedia, pp. 1–16, 2024

    2024

  2. [2]

    Joints-centered spatial-temporal features fused skeleton convolution network for action recognition,

    W. Song, T. Chu, S. Li, N. Li, A. Hao, and H. Qin, “Joints-centered spatial-temporal features fused skeleton convolution network for action recognition,”IEEE Transactions on Multimedia, vol. 26, pp. 4602– 4616, 2024

    2024

  3. [3]

    Noise- tolerant learning for audio-visual action recognition,

    H. Han, Q. Zheng, M. Luo, K. Miao, F. Tian, and Y . Chen, “Noise- tolerant learning for audio-visual action recognition,”IEEE Transac- tions on Multimedia, vol. 26, pp. 7761–7774, 2024

    2024

  4. [4]

    Commonsense knowledge prompt- ing for few-shot action recognition in videos,

    Y . Shi, X. Wu, H. Lin, and J. Luo, “Commonsense knowledge prompt- ing for few-shot action recognition in videos,”IEEE Transactions on Multimedia, vol. 26, pp. 8395–8405, 2024

    2024

  5. [5]

    Exploring rich semantics for open-set action recognition,

    Y . Hu, J. Gao, J. Dong, B. Fan, and H. Liu, “Exploring rich semantics for open-set action recognition,”IEEE Transactions on Multimedia, vol. 26, pp. 5410–5421, 2024

    2024

  6. [6]

    Dear-net: Learning diver- sities for skeleton-based early action recognition,

    R. Wang, J. Liu, Q. Ke, D. Peng, and Y . Lei, “Dear-net: Learning diver- sities for skeleton-based early action recognition,”IEEE Transactions on Multimedia, vol. 25, pp. 1175–1189, 2023

    2023

  7. [7]

    Just addπ! pose induced video transformers for understanding activities of daily living,

    D. Reilly and S. Das, “Just addπ! pose induced video transformers for understanding activities of daily living,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2024, pp. 18 340–18 350

    2024

  8. [8]

    Mmnet: A model-based multimodal network for human action recognition in rgb-d videos,

    B. X. Yu, Y . Liu, X. Zhang, S.-h. Zhong, and K. C. Chan, “Mmnet: A model-based multimodal network for human action recognition in rgb-d videos,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 3, pp. 3522–3538, 2023

    2023

Show all 118 references
  1. [9]

    A unified multi- modal de- and re-coupling framework for rgb-d motion recognition,

    B. Zhou, P. Wang, J. Wan, Y . Liang, and F. Wang, “A unified multi- modal de- and re-coupling framework for rgb-d motion recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 10, pp. 11 428–11 442, 2023

    2023

  2. [10]

    Selective, interpretable and motion consistent privacy attribute obfuscation for action recognition,

    F. Ilic, H. Zhao, T. Pock, and R. P. Wildes, “Selective, interpretable and motion consistent privacy attribute obfuscation for action recognition,” inConference on Computer Vision and Pattern Recognition (CVPR), 2024

    2024

  3. [11]

    On the benefits of 3d pose and tracking for human action recognition,

    J. Rajasegaran, G. Pavlakos, A. Kanazawa, C. Feichtenhofer, and J. Malik, “On the benefits of 3d pose and tracking for human action recognition,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023, pp. 640–649

    2023

  4. [12]

    Smam: Self and mutual adaptive matching for skeleton-based few-shot action recognition,

    Z. Li, X. Gong, R. Song, P. Duan, J. Liu, and W. Zhang, “Smam: Self and mutual adaptive matching for skeleton-based few-shot action recognition,”IEEE Transactions on Image Processing, vol. 32, pp. 392– 402, 2023

    2023

  5. [13]

    Integrating image and textual information in human–robot interactions for children with autism spectrum disorder,

    X. Yang, M.-L. Shyu, H.-Q. Yu, S.-M. Sun, N.-S. Yin, and W. Chen, “Integrating image and textual information in human–robot interactions for children with autism spectrum disorder,”IEEE Transactions on Multimedia, vol. 21, no. 3, pp. 746–759, 2019

    2019

  6. [14]

    Jrdb-social: A multifaceted robotic dataset for understanding of context and dynamics of human interactions within social groups,

    S. Jahangard, Z. Cai, S. Wen, and H. Rezatofighi, “Jrdb-social: A multifaceted robotic dataset for understanding of context and dynamics of human interactions within social groups,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024

    2024

  7. [15]

    Interactive spatiotem- poral token attention network for skeleton-based general interactive ac- tion recognition,

    Y . Wen, Z. Tang, Y . Pang, B. Ding, and M. Liu, “Interactive spatiotem- poral token attention network for skeleton-based general interactive ac- tion recognition,” inIEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023, pp. 7886–7892

    2023

  8. [16]

    Pose forecasting in industrial human-robot collaboration,

    A. Sampieri, G. M. D. di Melendugno, A. Avogaro, F. Cunico, F. Setti, G. Skenderi, M. Cristani, and F. Galasso, “Pose forecasting in industrial human-robot collaboration,” inProceedings of the 17th European Conference on Computer Vision (ECCV), 2022, pp. 51–69

    2022

  9. [17]

    Exploring 3d human pose estimation and forecasting from the robot’s perspective: The harper dataset,

    A. Avogaro, A. Toaiari, F. Cunico, X. Xu, H. Dafas, A. Vinciarelli, E. Li, and M. Cristani, “Exploring 3d human pose estimation and forecasting from the robot’s perspective: The harper dataset,” in2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024

    2024

  10. [18]

    Pedestrian trajectory prediction based on social interactions learning with random weights,

    J. Xie, S. Zhang, B. Xia, Z. Xiao, H. Jiang, S. Zhou, Z. Qin, and H. Chen, “Pedestrian trajectory prediction based on social interactions learning with random weights,”IEEE Transactions on Multimedia, vol. 26, pp. 7503–7515, 2024

    2024

  11. [19]

    Inter- action transformer for human reaction generation,

    B. Chopin, H. Tang, N. Otberdout, M. Daoudi, and N. Sebe, “Inter- action transformer for human reaction generation,”IEEE Transactions on Multimedia, vol. 25, pp. 8842–8854, 2023

    2023

  12. [20]

    Spikepoint: An efficient point-based spiking neural network for event cameras action recognition,

    H. Ren, Y . ZHOU, X. LIN, Y . Huang, H. FU, J. Song, and B. Cheng, “Spikepoint: An efficient point-based spiking neural network for event cameras action recognition,” inInternational Conference on Learning Representations, vol. 2024, 2024, pp. 27 827–27 846

    2024

  13. [21]

    Scaling up dynamic human-scene interaction modeling,

    N. Jiang, Z. Zhang, H. Li, X. Ma, Z. Wang, Y . Chen, T. Liu, Y . Zhu, and S. Huang, “Scaling up dynamic human-scene interaction modeling,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 1737–1747

    2024

  14. [22]

    An outlook into the future of egocentric vision,

    C. Plizzari, G. Goletto, A. Furnari, S. Bansal, F. Ragusa, G. M. Farinella, D. Damen, and T. Tommasi, “An outlook into the future of egocentric vision,”International Journal of Computer Vision, May 2024

    2024

  15. [23]

    Locllm: Exploiting generalizable human keypoint localization via large language model,

    D. Wang, S. Xuan, and S. Zhang, “Locllm: Exploiting generalizable human keypoint localization via large language model,” inProceed- ings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2024, pp. 614–623

    2024

  16. [24]

    Intergen: Diffusion- based multi-human motion generation under complex interactions,

    H. Liang, W. Zhang, W. Li, J. Yu, and L. Xu, “Intergen: Diffusion- based multi-human motion generation under complex interactions,” International Journal of Computer Vision, pp. 1–21, 2024

    2024

  17. [25]

    Multi-modal & multi-view & interactive benchmark dataset for human action recognition,

    N. Xu, A. Liu, W. Nie, Y . Wong, F. Li, and Y . Su, “Multi-modal & multi-view & interactive benchmark dataset for human action recognition,” inProceedings of the 23rd ACM International Conference on Multimedia (ACMMM), ser. MM ’15, 2015, p. 1195–1198

    2015

  18. [26]

    Motionbert: A unified perspective on learning human motion representations,

    W. Zhu, X. Ma, Z. Liu, L. Liu, W. Wu, and Y . Wang, “Motionbert: A unified perspective on learning human motion representations,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023, pp. 15 085–15 099

    2023

  19. [27]

    Versatile multi-modal pre-training for human-centric perception,

    F. Hong, L. Pan, Z. Cai, and Z. Liu, “Versatile multi-modal pre-training for human-centric perception,” inProceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition (CVPR), June 2022, pp. 16 156–16 166

    2022

  20. [28]

    Beyond appearance: A semantic controllable self-supervised learning framework for human-centric visual tasks,

    W. Chen, X. Xu, J. Jia, H. Luo, Y . Wang, F. Wang, R. Jin, and X. Sun, “Beyond appearance: A semantic controllable self-supervised learning framework for human-centric visual tasks,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Ju...

    2023

  21. [29]

    Humanbench: Towards general human-centric perception with projector assisted pretraining,

    S. Tang, C. Chen, Q. Xie, M. Chen, Y . Wang, Y . Ci, L. Bai, F. Zhu, H. Yang, L. Yi, R. Zhao, and W. Ouyang, “Humanbench: Towards general human-centric perception with projector assisted pretraining,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Reco...

    2023

  22. [30]

    HAP: Structure-aware masked image modeling for human- centric perception,

    J. Yuan, X. Zhang, H. Zhou, J. Wang, Z. Qiu, Z. Shao, S. Zhang, S. Long, K. Kuang, K. Yao, J. Han, E. Ding, L. Lin, F. Wu, and J. Wang, “HAP: Structure-aware masked image modeling for human- centric perception,” inThirty-seventh Conference on Neural Informa- tion Processing Sy...

    2023

  23. [31]

    Unihcp: A unified model for human-centric JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 12 perceptions,

    Y . Ci, Y . Wang, M. Chen, S. Tang, L. Bai, F. Zhu, R. Zhao, F. Yu, D. Qi, and W. Ouyang, “Unihcp: A unified model for human-centric JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 12 perceptions,” inProceedings of the IEEE/CVF Conference on Com- puter Vision and Pat...

    2021

  24. [32]

    Hulk: A universal knowledge translator for human-centric tasks,

    Y . Wang, Y . Wu, W. He, X. Guo, F. Zhu, L. Bai, R. Zhao, J. Wu, T. He, W. Ouyang, and S. Tang, “Hulk: A universal knowledge translator for human-centric tasks,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 47, no. 7, pp. 5672–5689, 2025

    2025

  25. [33]

    Sapiens: Foundation for human vision models,

    R. Khirodkar, T. Bagautdinov, J. Martinez, S. Zhaoen, A. James, P. Selednik, S. Anderson, and S. Saito, “Sapiens: Foundation for human vision models,” inProceedings of the 18th European Conference on Computer Vision (ECCV), 2024

    2024

  26. [34]

    Learning composite latent structures for 3d human action representation and recognition,

    P. Wei, H. Sun, and N. Zheng, “Learning composite latent structures for 3d human action representation and recognition,”IEEE Transactions on Multimedia, vol. 21, no. 9, pp. 2195–2208, 2019

    2019

  27. [35]

    Navigating open set scenarios for skeleton-based action recognition,

    K. Peng, C. Yin, J. Zheng, R. Liu, D. Schneider, J. Zhang, K. Yang, M. S. Sarfraz, R. Stiefelhagen, and A. Roitberg, “Navigating open set scenarios for skeleton-based action recognition,”Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 5, pp. 4487– 4...

    2024

  28. [36]

    One-shot action recognition via multi-scale spatial-temporal skeleton matching,

    S. Yang, J. Liu, S. Lu, E. M. Hwa, and A. C. Kot, “One-shot action recognition via multi-scale spatial-temporal skeleton matching,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 46, no. 7, pp. 5149–5156, 2024

    2024

  29. [37]

    Self- supervised 3d action representation learning with skeleton cloud colorization,

    S. Yang, J. Liu, S. Lu, E. M. Hwa, Y . Hu, and A. C. Kot, “Self- supervised 3d action representation learning with skeleton cloud colorization,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 46, no. 1, pp. 509–524, 2024

    2024

  30. [38]

    Meet jeanie: A similarity measure for 3d skeleton sequences via temporal-viewpoint alignment,

    L. Wang, J. Liu, L. Zheng, T. Gedeon, and P. Koniusz, “Meet jeanie: A similarity measure for 3d skeleton sequences via temporal-viewpoint alignment,”Int. J. Comput. Vision, vol. 132, no. 9, p. 4091–4122, may 2024

    2024

  31. [39]

    Neural koopman pooling: Control- inspired temporal dynamics encoding for skeleton-based action recog- nition,

    X. Wang, X. Xu, and Y . Mu, “Neural koopman pooling: Control- inspired temporal dynamics encoding for skeleton-based action recog- nition,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023, pp. 10 597–10 607

    2023

  32. [40]

    Learning discriminative representations for skeleton based action recognition,

    H. Zhou, Q. Liu, and Y . Wang, “Learning discriminative representations for skeleton based action recognition,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023, pp. 10 608–10 617

    2023

  33. [41]

    You2me: Inferring body pose in egocentric video via first and second person interactions,

    E. Ng, D. Xiang, H. Joo, and K. Grauman, “You2me: Inferring body pose in egocentric video via first and second person interactions,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2020

    2020

  34. [42]

    Skeleton- based online action prediction using scale selection network,

    J. Liu, A. Shahroudy, G. Wang, L.-Y . Duan, and A. C. Kot, “Skeleton- based online action prediction using scale selection network,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 6, pp. 1453–1467, 2020

    2020

  35. [43]

    Interaction relational network for mutual action recognition,

    M. Perez, J. Liu, and A. C. Kot, “Interaction relational network for mutual action recognition,”IEEE Transactions on Multimedia, vol. 24, pp. 366–376, 2022

    2022

  36. [44]

    Igformer: Interaction graph transformer for skeleton-based human interaction recognition,

    Y . Pang, Q. Ke, H. Rahmani, J. Bailey, and J. Liu, “Igformer: Interaction graph transformer for skeleton-based human interaction recognition,” inProceedings of the 17th European Conference on Computer Vision (ECCV), 2022, pp. 605–622

    2022

  37. [45]

    Graph diffusion convolutional network for skeleton based semantic recognition of two- person actions,

    S. Li, X. He, W. Song, A. Hao, and H. Qin, “Graph diffusion convolutional network for skeleton based semantic recognition of two- person actions,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 7, pp. 8477–8493, 2023

    2023

  38. [46]

    Learning mutual exci- tation for hand-to-hand and human-to-human interaction recognition,

    M. Liu, C. Chen, S. Wu, F. Meng, and H. Liu, “Learning mutual exci- tation for hand-to-hand and human-to-human interaction recognition,” IEEE Transactions on Human-Machine Systems, pp. 1–10, 2025

    2025

  39. [47]

    Multi-modal enhancement transformer network for skeleton-based human interaction recognition,

    Q. Hu and H. Liu, “Multi-modal enhancement transformer network for skeleton-based human interaction recognition,”Biomimetics, vol. 9, no. 3, 2024

    2024

  40. [48]

    Ntu rgb+d: A large scale dataset for 3d human activity analysis,

    A. Shahroudy, J. Liu, T.-T. Ng, and G. Wang, “Ntu rgb+d: A large scale dataset for 3d human activity analysis,” in2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 1010– 1019

    2016

  41. [49]

    Ntu rgb+d 120: A large-scale benchmark for 3d human activity understanding,

    J. Liu, A. Shahroudy, M. Perez, G. Wang, L.-Y . Duan, and A. C. Kot, “Ntu rgb+d 120: A large-scale benchmark for 3d human activity understanding,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 42, no. 10, pp. 2684–2701, 2020

    2020

  42. [50]

    Cross-view action modeling, learning, and recognition,

    J. Wang, X. Nie, Y . Xia, Y . Wu, and S.-C. Zhu, “Cross-view action modeling, learning, and recognition,” inConference on Computer Vision and Pattern Recognition (CVPR), 2014, p. 2649–2656

    2014

  43. [51]

    Pku-mmd: A large scale benchmark for skeleton-based human action understanding,

    C. Liu, Y . Hu, Y . Li, S. Song, and J. Liu, “Pku-mmd: A large scale benchmark for skeleton-based human action understanding,” inPro- ceedings of the Workshop on Visual Analysis in Smart and Connected Communities, ser. VSCC ’17. New York, NY , USA: Association for Computing Ma...

    2017

  44. [52]

    Toyota smarthome: Real-world activities of daily living,

    S. Das, R. Dai, M. Koperski, L. Minciullo, L. Garattoni, F. Bremond, and G. Francesca, “Toyota smarthome: Real-world activities of daily living,” inProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2019

    2019

  45. [53]

    Assemblyhands: Towards egocentric activity understanding via 3d hand pose estimation,

    T. Ohkawa, K. He, F. Sener, T. Hodan, L. Tran, and C. Keskin, “Assemblyhands: Towards egocentric activity understanding via 3d hand pose estimation,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023, pp. 12 999–13 008

    2023

  46. [54]

    Hi4d: 4d instance segmentation of close human interaction,

    Y . Yin, C. Guo, M. Kaufmann, J. J. Zarate, J. Song, and O. Hilliges, “Hi4d: 4d instance segmentation of close human interaction,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023, pp. 17 016–17 027

    2023

  47. [55]

    Inter-x: Towards versatile human-human interaction analysis,

    L. Xu, X. Lv, Y . Yan, X. Jin, S. Wu, C. Xu, Y . Liu, Y . Zhou, F. Rao, X. Sheng, Y . Liu, W. Zeng, and X. Yang, “Inter-x: Towards versatile human-human interaction analysis,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024

    2024

  48. [56]

    Intergen: Diffusion- based multi-human motion generation under complex interactions,

    H. Liang, W. Zhang, W. Li, J. Yu, and L. Xu, “Intergen: Diffusion- based multi-human motion generation under complex interactions,” International Journal of Computer Vision, Mar 2024

    2024

  49. [57]

    Co- occurrence feature learning for skeleton based action recognition using regularized deep lstm networks,

    W. Zhu, C. Lan, J. Xing, W. Zeng, Y . Li, L. Shen, and X. Xie, “Co- occurrence feature learning for skeleton based action recognition using regularized deep lstm networks,” inProceedings of the Thirtieth AAAI Conference on Artificial Intelligence, ser. AAAI’16. AAAI Press, 201...

    2016

  50. [58]

    Spatio-temporal lstm with trust gates for 3d human action recognition,

    J. Liu, A. Shahroudy, D. Xu, and G. Wang, “Spatio-temporal lstm with trust gates for 3d human action recognition,” inProceedings of the 17th European Conference on Computer Vision (ECCV), 2016, pp. 816–833

    2016

  51. [59]

    Global context- aware attention lstm networks for 3d action recognition,

    J. Liu, G. Wang, P. Hu, L.-Y . Duan, and A. C. Kot, “Global context- aware attention lstm networks for 3d action recognition,” in2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 3671–3680

    2017

  52. [60]

    View adaptive recurrent neural networks for high performance human action recognition from skeleton data,

    P. Zhang, C. Lan, J. Xing, W. Zeng, J. Xue, and N. Zheng, “View adaptive recurrent neural networks for high performance human action recognition from skeleton data,” in2017 IEEE International Confer- ence on Computer Vision (ICCV), 2017, pp. 2136–2145

    2017

  53. [61]

    Skeleton- based human action recognition with global context-aware attention lstm networks,

    J. Liu, G. Wang, L.-Y . Duan, K. Abdiyeva, and A. C. Kot, “Skeleton- based human action recognition with global context-aware attention lstm networks,”IEEE Transactions on Image Processing, vol. 27, no. 4, pp. 1586–1599, 2018

    2018

  54. [62]

    View adaptive neural networks for high performance skeleton-based human action recognition,

    P. Zhang, C. Lan, J. Xing, W. Zeng, J. Xue, and N. Zheng, “View adaptive neural networks for high performance skeleton-based human action recognition,”IEEE Transactions on Pattern Analysis and Ma- chine Intelligence, vol. 41, no. 8, pp. 1963–1978, 2019

    1963

  55. [63]

    Spatial temporal graph convolutional networks for skeleton-based action recognition,

    S. Yan, Y . Xiong, and D. Lin, “Spatial temporal graph convolutional networks for skeleton-based action recognition,” inProceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, ser. AAAI’18, vol. 32, no. 1, 2018, pp. 7444–7452

    2018

  56. [64]

    Actional- structural graph convolutional networks for skeleton-based action recognition,

    M. Li, S. Chen, X. Chen, Y . Zhang, Y . Wang, and Q. Tian, “Actional- structural graph convolutional networks for skeleton-based action recognition,” in2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 3590–3598

    2019

  57. [65]

    Two-stream adaptive graph convolutional networks for skeleton-based action recognition,

    L. Shi, Y . Zhang, J. Cheng, and H. Lu, “Two-stream adaptive graph convolutional networks for skeleton-based action recognition,” in2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 12 018–12 027

    2019

  58. [66]

    Disentangling and unifying graph convolutions for skeleton-based action recognition,

    Z. Liu, H. Zhang, Z. Chen, Z. Wang, and W. Ouyang, “Disentangling and unifying graph convolutions for skeleton-based action recognition,” in2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020, pp. 140–149

    2020

  59. [67]

    Channel- wise topology refinement graph convolution for skeleton-based action recognition,

    Y . Chen, Z. Zhang, C. Yuan, B. Li, Y . Deng, and W. Hu, “Channel- wise topology refinement graph convolution for skeleton-based action recognition,” inIEEE International Conference on Computer Vision (ICCV), 2021, pp. 13 359–13 368

    2021

  60. [68]

    Infogcn: Representation learning for human skeleton-based action recognition,

    H.-G. Chi, M. H. Ha, S. Chi, S. W. Lee, Q. Huang, and K. Ramani, “Infogcn: Representation learning for human skeleton-based action recognition,” inIEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 20 154–20 164

    2022

  61. [69]

    Hierarchically decomposed graph convolutional networks for skeleton-based action recognition,

    J. Lee, M. Lee, D. Lee, and S. Lee, “Hierarchically decomposed graph convolutional networks for skeleton-based action recognition,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023, pp. 10 444–10 453. JOURNAL OF LATEX CLASS FILES,...

    2023

  62. [70]

    Hypergraph neural network for skeleton-based action recognition,

    X. Hao, J. Li, Y . Guo, T. Jiang, and M. Yu, “Hypergraph neural network for skeleton-based action recognition,”IEEE Transactions on Image Processing, vol. 30, pp. 2263–2275, 2021

    2021

  63. [71]

    Pyskl: Towards good practices for skeleton action recognition,

    H. Duan, J. Wang, K. Chen, and D. Lin, “Pyskl: Towards good practices for skeleton action recognition,” inProceedings of the 30th ACM International Conference on Multimedia (ACMMM), 2022, pp. 7351– 7354

    2022

  64. [72]

    Tsgcnext: Dynamic-static multi- graph convolution for efficient skeleton-based action recognition,

    D. Liu, X. Li, Z. Cai, and P. Chen, “Tsgcnext: Dynamic-static multi- graph convolution for efficient skeleton-based action recognition,” Expert Systems with Applications, vol. 276, p. 127081, 2025

    2025

  65. [73]

    Degcn: Deformable graph convolutional networks for skeleton-based action recognition,

    W. Myung, N. Su, J.-H. Xue, and G. Wang, “Degcn: Deformable graph convolutional networks for skeleton-based action recognition,”IEEE Transactions on Image Processing, vol. 33, pp. 2477–2490, 2024

    2024

  66. [74]

    Blockgcn: Redefine topology awareness for skeleton-based action recognition,

    Y . Zhou, X. Yan, Z.-Q. Cheng, Y . Yan, Q. Dai, and X.-S. Hua, “Blockgcn: Redefine topology awareness for skeleton-based action recognition,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2024, pp. 2049–2058

    2024

  67. [75]

    Decoupled spatial-temporal attention network for skeleton-based action-gesture recognition,

    L. Shi, Y . Zhang, J. Cheng, and H. Lu, “Decoupled spatial-temporal attention network for skeleton-based action-gesture recognition,” in 15th Asian Conference on Computer Vision (ACCV), 2020, p. 38–53

    2020

  68. [76]

    Spatio-temporal segments attention for skeleton-based action recognition,

    H. Qiu, B. Hou, B. Ren, and X. Zhang, “Spatio-temporal segments attention for skeleton-based action recognition,”Neurocomputing, vol. 518, pp. 30–38, 2023

    2023

  69. [77]

    Hypergraph transformer for skeleton-based action recognition,

    Y . Zhou, Z.-Q. Cheng, C. Li, Y . Geng, X. Xie, and M. Keu- per, “Hypergraph transformer for skeleton-based action recognition,” arXiv:2211.09590, 2022

    2022 arXiv

  70. [78]

    A cuboid cnn model with an attention mechanism for skeleton-based action recognition,

    K. Zhu, R. Wang, Q. Zhao, J. Cheng, and D. Tao, “A cuboid cnn model with an attention mechanism for skeleton-based action recognition,” IEEE Transactions on Multimedia, vol. 22, no. 11, pp. 2977–2989, 2020

    2020

  71. [79]

    Step catformer: Spatial-temporal effective body- part cross attention transformer for skeleton-based action recognition,

    N. H. B. Long, “Step catformer: Spatial-temporal effective body- part cross attention transformer for skeleton-based action recognition,” arXiv:2312.03288, 2023

    2023 arXiv

  72. [80]

    Masked motion predictors are strong 3d action representation learners,

    Y . Mao, J. Deng, W. Zhou, Y . Fang, W. Ouyang, and H. Li, “Masked motion predictors are strong 3d action representation learners,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023, pp. 10 181–10 191

    2023

  73. [81]

    Psumnet: Unified modality part streams are all you need for efficient pose-based action recognition,

    N. Trivedi and R. K. Sarvadevabhatla, “Psumnet: Unified modality part streams are all you need for efficient pose-based action recognition,” inProceedings of the 17th European Conference on Computer Vision (ECCV), 2022, p. 211–227

    2022

  74. [82]

    Skateformer: Skeletal-temporal transformer for human action recognition,

    J. Do and M. Kim, “Skateformer: Skeletal-temporal transformer for human action recognition,” inProceedings of the 18th European Conference on Computer Vision (ECCV), 2024

    2024

  75. [83]

    Multiview skeletal interaction recognition using active joint interaction graph,

    M. Li and H. Leung, “Multiview skeletal interaction recognition using active joint interaction graph,”IEEE Transactions on Multimedia, vol. 18, no. 11, pp. 2293–2302, 2016

    2016

  76. [84]

    Interactive body part contrast mining for human interaction recognition,

    Y . Ji, G. Ye, and H. Cheng, “Interactive body part contrast mining for human interaction recognition,” in2014 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), 2014, pp. 1–6

    2014

  77. [85]

    Chase: Learning convex hull adaptive shift for skeleton-based multi-entity action recognition,

    Y . Wen, M. Liu, S. Wu, and B. Ding, “Chase: Learning convex hull adaptive shift for skeleton-based multi-entity action recognition,” in Thirty-eighth Conference on Neural Information Processing Systems (NeurIPS), 2024

    2024

  78. [86]

    Skeletr: Towards skeleton-based action recognition in the wild,

    H. Duan, M. Xu, B. Shuai, D. Modolo, Z. Tu, J. Tighe, and A. Bergamo, “Skeletr: Towards skeleton-based action recognition in the wild,” inProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023, pp. 13 634–13 644

    2023

  79. [87]

    Assembly101: A large-scale multi-view video dataset for understanding procedural activities,

    F. Sener, D. Chatterjee, D. Shelepov, K. He, D. Singhania, R. Wang, and A. Yao, “Assembly101: A large-scale multi-view video dataset for understanding procedural activities,” in2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022, pp. 21 064– 21 074

    2022

  80. [88]

    Hi- erarchical temporal transformer for 3d hand pose estimation and action recognition from egocentric rgb videos,

    Y . Wen, H. Pan, L. Yang, J. Pan, T. Komura, and W. Wang, “Hi- erarchical temporal transformer for 3d hand pose estimation and action recognition from egocentric rgb videos,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023,...

    2023

  81. [89]

    H2o: Two hands manipulating objects for first person interaction recognition,

    T. Kwon, B. Tekin, J. St ¨uhmer, F. Bogo, and M. Pollefeys, “H2o: Two hands manipulating objects for first person interaction recognition,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2021, pp. 10 138–10 148

    2021

  82. [90]

    H+o: Unified egocentric recog- nition of 3d hand-object poses and interactions,

    B. Tekin, F. Bogo, and M. Pollefeys, “H+o: Unified egocentric recog- nition of 3d hand-object poses and interactions,” in2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 4506–4515

    2019

  83. [91]

    On the utility of 3d hand poses for action recognition,

    M. S. Shamil, D. Chatterjee, F. Sener, S. Ma, and A. Yao, “On the utility of 3d hand poses for action recognition,” inProceedings of the 18th European Conference on Computer Vision (ECCV), 2024

    2024

  84. [92]

    Transformer-based unified recognition of two hands manipulating objects,

    H. Cho, C. Kim, J. Kim, S. Lee, E. Ismayilzada, and S. Baek, “Transformer-based unified recognition of two hands manipulating objects,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023, pp. 4769–4778

    2023

  85. [93]

    In my perspective, in my hands: Accurate egocentric 2d hand pose and action recognition,

    W. Mucha and M. Kampel, “In my perspective, in my hands: Accurate egocentric 2d hand pose and action recognition,” in2024 IEEE 18th International Conference on Automatic Face and Gesture Recognition (FG). IEEE, 2024, pp. 1–9

    2024

  86. [94]

    B2c-afm: Bi-directional co-temporal and cross-spatial attention fusion model for human action recognition,

    F. Guo, T. Jin, S. Zhu, X. Xi, W. Wang, Q. Meng, W. Song, and J. Zhu, “B2c-afm: Bi-directional co-temporal and cross-spatial attention fusion model for human action recognition,”IEEE Transactions on Image Processing, vol. 32, pp. 4989–5003, 2023

    2023

  87. [95]

    Cross-modal learning with 3d deformable attention for action recognition,

    S. Kim, D. Ahn, and B. C. Ko, “Cross-modal learning with 3d deformable attention for action recognition,” inProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023, pp. 10 265–10 275

    2023

  88. [96]

    Vpn++: Rethinking video- pose embeddings for understanding activities of daily living,

    S. Das, R. Dai, D. Yang, and F. Bremond, “Vpn++: Rethinking video- pose embeddings for understanding activities of daily living,”IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 12, pp. 9703–9717, 2022

    2022

  89. [97]

    Revisiting skeleton- based action recognition,

    H. Duan, Y . Zhao, K. Chen, D. Lin, and B. Dai, “Revisiting skeleton- based action recognition,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2022, pp. 2969–2978

    2022

  90. [98]

    Star-transformer: A spatio- temporal cross attention transformer for human action recognition,

    D. Ahn, S. Kim, H. Hong, and B. Chul Ko, “Star-transformer: A spatio- temporal cross attention transformer for human action recognition,” inIEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023, pp. 3319–3328

    2023

  91. [99]

    Multi- view action recognition using contrastive learning,

    K. Shah, A. Shah, C. P. Lau, C. M. de Melo, and R. Chellappa, “Multi- view action recognition using contrastive learning,” inProceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), January 2023, pp. 3381–3391

    2023

  92. [100]

    Explore human parsing modality for action recognition,

    J. Liu, R. Ding, Y . Wen, N. Dai, F. Meng, F.-L. Zhang, S. Zhao, and M. Liu, “Explore human parsing modality for action recognition,”CAAI Transactions on Intelligence Technology, 2024

    2024

  93. [101]

    A dense-sparse complementary network for human action recognition based on rgb and skeleton modalities,

    Q. Cheng, J. Cheng, Z. Liu, Z. Ren, and J. Liu, “A dense-sparse complementary network for human action recognition based on rgb and skeleton modalities,”Expert Systems with Applications, vol. 244, p. 123061, 2024

    2024

  94. [102]

    Language knowledge- assisted representation learning for skeleton-based action recognition,

    H. Xu, Y . Gao, Z. Hui, J. Li, and X. Gao, “Language knowledge- assisted representation learning for skeleton-based action recognition,” IEEE Transactions on Multimedia, vol. 27, pp. 5784–5799, 2025

    2025

  95. [103]

    Generative action description prompts for skeleton-based action recognition,

    W. Xiang, C. Li, Y . Zhou, B. Wang, and L. Zhang, “Generative action description prompts for skeleton-based action recognition,” in Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023, pp. 10 276–10 285

    2023

  96. [104]

    Multi-modality co-learning for efficient skeleton-based action recognition,

    J. Liu, C. Chen, and M. Liu, “Multi-modality co-learning for efficient skeleton-based action recognition,” inProceedings of the ACM Multi- media (ACM MM), 2024

    2024

  97. [105]

    Interactive prototype learning for egocentric action recognition,

    X. Wang, L. Zhu, H. Wang, and Y . Yang, “Interactive prototype learning for egocentric action recognition,” inProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2021, pp. 8168–8177

    2021

  98. [106]

    Vision-language meets the skeleton: Progressively distillation with cross-modal knowledge for 3d action representation learning,

    Y . Chen, T. He, J. Fu, L. Wang, J. Guo, T. Hu, and H. Cheng, “Vision-language meets the skeleton: Progressively distillation with cross-modal knowledge for 3d action representation learning,”IEEE Transactions on Multimedia, vol. 27, pp. 2293–2303, 2025

    2025

  99. [107]

    A group-theoretic framework for data augmentation,

    S. Chen, E. Dobriban, and J. H. Lee, “A group-theoretic framework for data augmentation,”Journal of Machine Learning Research, vol. 21, no. 245, pp. 1–71, 2020

    2020

  100. [108]

    Theory, analysis, and best practices for sigmoid self-attention,

    J. Ramapuram, F. Danieli, E. G. Dhekane, F. Weers, D. Busbridge, P. Ablin, T. Likhomanenko, J. Digani, Z. Gu, A. Shidani, and R. Webb, “Theory, analysis, and best practices for sigmoid self-attention,” in International Conference on Learning Representations, vol. 2025, 2025, p...

    2025

  101. [109]

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection,

    S. Liu, Z. Zeng, T. Ren, F. Li, H. Zhang, J. Yang, Q. Jiang, C. Li, J. Yang, H. Su, J. Zhu, and L. Zhang, “Grounding dino: Marrying dino with grounded pre-training for open-set object detection,” in Proceedings of the 18th European Conference on Computer Vision (ECCV), 2024

    2024

  102. [110]

    Deep graph contrastive representation learning,

    Y . Zhu, Y . Xu, F. Yu, Q. Liu, S. Wu, and L. Wang, “Deep graph contrastive representation learning,”arXiv preprint arXiv:2006.04131, 2020. JOURNAL OF LATEX CLASS FILES, VOL. 14, NO. 8, AUGUST 2021 14

    2006 arXiv

  103. [111]

    Augmented skeleton sequences with hypergraph network for self- supervised group activity recognition,

    G. Wang, M. Liu, H. Liu, P. Guo, T. Wang, J. Guo, and R. Fan, “Augmented skeleton sequences with hypergraph network for self- supervised group activity recognition,”Pattern Recognition, vol. 152, p. 110478, 2024

    2024

  104. [112]

    Ultralytics yolov5,

    G. Jocher, “Ultralytics yolov5,” 2020. [Online]. Available: https: //github.com/ultralytics/yolov5

    2020

  105. [113]

    Uniformerv2: Unlocking the potential of image vits for video under- standing,

    K. Li, Y . Wang, Y . He, Y . Li, Y . Wang, L. Wang, and Y . Qiao, “Uniformerv2: Unlocking the potential of image vits for video under- standing,” inProceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), October 2023, pp. 1632–1643

    2023

  106. [114]

    mixup: Beyond empirical risk minimization,

    H. Zhang, M. Cisse, Y . N. Dauphin, and D. Lopez-Paz, “mixup: Beyond empirical risk minimization,” inProceedings of the 35th International Conference on Learning Representations (ICLR), 2018, pp. 2866–2878

    2018

  107. [115]

    Manifold mixup: Better representations by interpolating hidden states,

    V . Verma, A. Lamb, C. Beckham, A. Najafi, I. Mitliagkas, D. Lopez- Paz, and Y . Bengio, “Manifold mixup: Better representations by interpolating hidden states,” inProceedings of the 36th International Conference on Machine Learning, ser. Proceedings of Machine Learn- ing Rese...

    2019

  108. [116]

    Umap: Uniform manifold approximation and projection,

    L. McInnes, J. Healy, N. Saul, and L. Grossberger, “Umap: Uniform manifold approximation and projection,”The Journal of Open Source Software, vol. 3, no. 29, p. 861, 2018

    2018

  109. [117]

    Dinov2: Learning robust visual features without supervision,

    M. Oquab, T. Darcet, T. Moutakanni, H. V o, M. Szafraniec, V . Khali- dov, P. Fernandez, D. Haziza, F. Massa, A. El-Noubyet al., “Dinov2: Learning robust visual features without supervision,”Transactions on Machine Learning Research Journal, pp. 1–31, 2024

    2024

  110. [118]

    Videomae v2: Scaling video masked autoencoders with dual masking,

    L. Wang, B. Huang, Z. Zhao, Z. Tong, Y . He, Y . Wang, Y . Wang, and Y . Qiao, “Videomae v2: Scaling video masked autoencoders with dual masking,” inProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2023, pp. 14 549–14 560

    2023

Pith tools

Reviewed August 1, 2026 · model on record in the stance chip above.