Pith. sign in

REVIEW 4 major objections 6 minor 1 cited by

GigaHands: A Massive Annotated Dataset of Bimanual Hand Activities

T0 review · 4 major / 6 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read GigaHands is the largest bimanual hand activity dataset, with 183 million annotated frames and 0.37 billion hand poses.

desk verdict GigaHands is genuinely massive and the pipeline is clever, but the lack of ground-truth validation of the automatic 3D poses is a load-bearing soft spot that a revision must fix. read the letter →

arxiv 2412.04244 v3 pith:WM4X2QJN submitted 2024-12-05 cs.CV

Rao Fu , Dingxi Zhang , Alex Jiang , Wanjia Fu , Austin Funk , Daniel Ritchie , Srinath Sridhar This is my paper · ORCID
classification cs.CV
keywords bimanualhandactivitieshand-objectinteractiontext-to-motionsynthesismotioncaptioning3Dposeestimationmulti-viewcaptureMANOmodellarge-scaledataset
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper claims that existing datasets are too small, too narrow, and too sparsely annotated to support large models of bimanual hand activity, and introduces GigaHands to fill that gap. GigaHands contains 34 hours of activity from 56 subjects and 417 objects, organized into 14k motion clips paired with 84k text descriptions, with 3.7 million 3D bimanual hand poses and 51 camera views per clip. The paper argues that this scale and diversity improve text-driven hand motion synthesis and hand motion captioning, and it demonstrates both with quantitative comparisons against TACO and OakInk2. A sympathetic reader would care because the dataset is positioned as the missing resource for training models that can understand and generate natural two-handed manipulation.

What carries the argument

The load-bearing mechanism is the Instruct-to-Annotate acquisition pipeline. It starts from a pooled set of verbs mined from existing action datasets, uses an LLM to group verbs and objects into scenes and write temporally ordered instruction scripts, films subjects following those scripts with 51 synchronized RGB cameras, then has annotators split sequences into clips and uses an LLM to rephrase each clip into five text variations. The 3D annotations come from an automatic hybrid pipeline: hand bounding boxes and initial meshes from detection and keypoint models, multi-view triangulation with filtering, then MANO fitting; objects are segmented with foundation models and tracked by differentiable rendering against multi-view masks. This pipeline converts raw RGB video into paired motion and text data without markers, which is what allows the dataset to reach its scale.

What would settle it

Run marker-based motion capture on a few activities inside the same capture rig, then compare GigaHands' MANO hand poses and object 6D poses against that reference; large per-joint or per-frame errors on fast or occluded segments would undercut the claim that scale alone drives the reported improvements.

Watch

Extended reading notes

Core claim

GigaHands is presented as the largest and most diverse bimanual hand activity dataset to date, with over 183 million unique frames each showing two hands, amounting to 0.37 billion unique hand poses. All frames come with 3D hand shape and pose in MANO form, 3D object shape and pose, segmentation masks, 2D/3D keypoints, camera poses, and dense text annotations. The authors claim that their markerless multi-camera setup plus a procedural instruct-to-annotate protocol produces this annotation at scale with minimal manual effort, and that models trained on GigaHands outperform models trained on existing datasets on most metrics for text-to-motion generation and motion captioning. On the dataset's own test set, a T2M-GPT model trained on GigaHands reaches higher R-Precision, lower FID, and better diversity than models trained on TACO or OakInk2, and the captioning model produces more diverse captions while matching retrieval accuracy.

Load-bearing premise

The claim rests on the automated 3D hand and object estimation pipeline producing accurate annotations despite having no quantitative validation against ground-truth motion capture, so systematic errors in fast or occluded frames would be baked into every model trained on the dataset.

Editorial extensions

If this is right

  • Training on progressively larger subsets of GigaHands (10%, 20%, 50%, 80%, 100%) consistently improves FID, multimodal distance, and retrieval accuracy, so the paper's reported gains are driven by scale rather than by a single model choice.
  • A motion captioning model trained only on GigaHands can generate captions for unseen motions from TACO and OakInk2, suggesting that the dataset transfers to other 3D hand motion distributions.
  • The 51-view capture makes dynamic radiance field reconstruction possible, with synthesized test views reaching 29.50 PSNR on sampled clips.
  • The abundance of text annotations (84k for 14k clips) improves synthesis quality, and the paper's ablation shows that more annotations consistently boost generation metrics.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • If the automatic estimation pipeline carries systematic bias in fast or heavily occluded frames, then enlarging the dataset further may not fully replace ground-truth validation; a marker-based validation subset could test that directly.
  • The verb pool of 1,467 verbs, 580 of them unique to GigaHands, suggests that procedural instruction elicitation could be reused to expand the dataset into new scenarios such as larger-space activities or tool use without redesigning the pipeline.
  • The object meshes, 6D poses, and contact regions in GigaHands may support robotic manipulation learning, although the paper only sketches hand-object experiments and does not claim robot results.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper introduces GigaHands, a large multi-view RGB dataset of bimanual hand activities captured from 56 subjects and 417 objects, with 34 hours of footage, 14k motion clips, 183M frames, and 84k text annotations. The authors describe a markerless capture pipeline with procedural instruction elicitation, automatic 3D hand and object pose estimation, and text augmentation, and they report experiments on text-driven motion synthesis, motion captioning, and dynamic radiance field reconstruction. The central claims are that GigaHands is the largest bimanual hand dataset, that its automatic annotation pipeline produces accurate 3D hand/object poses, and that its scale and diversity improve downstream tasks.

Significance. If validated, GigaHands would be a substantial community resource: the scale in hours, clips, and camera views is larger than existing bimanual hand datasets, and the pairing of dense 3D annotations with rich text is a useful combination. The paper also ships a fully automatic annotation pipeline and reproducible experiments across three backbones, which are strengths. The main significance hinges on two facts that are currently not established: that the automatically estimated 3D hand and object poses are accurate enough to serve as training targets, and that the reported cross-dataset improvements are meaningful despite per-dataset evaluation embeddings. Because these points are load-bearing for the paper's claims, the significance is conditional on additional validation.

major comments (4)
  1. [Section 4.4, Supp. Section 7, Supp. Table 10] The hand motion estimation pipeline is validated only by a self-consistency 'valid rate' (97.9% for the chosen YOLOv9+HaMeR configuration), defined by missing keypoints, kinematic plausibility, and temporal consistency. This does not measure accuracy: a system can be kinematically plausible and temporally smooth while systematically biased in depth, especially since the paper itself states that HaMeR 'lacks accurate depth' (Section 4.4). The central claim that GigaHands provides accurate 3D hand poses requires a quantitative comparison against ground truth, for example a small marker-based MoCap subset or manually annotated keypoint frames, reported as 3D PCK or MPJPE. Without such validation, models trained on the annotations may inherit depth and pose biases, and the downstream improvements reported in Section 5.1 cannot be attributed to accurate supervision.
  2. [Section 4.5, Supp. Section 8, Supp. Table 11] Object pose accuracy is evaluated only by mask coverage, which averages 78.5% over sequences and is only 45.2% after coarse estimation. Mask coverage conflates segmentation errors, mesh shape errors, and pose errors, and it does not quantify translation or rotation accuracy. Given that the experimental sections include text-driven synthesis and motion forecasting that use object poses (e.g., Supp. Section 6), the claim that object motion estimates are 'precise' (Section 4.5) is not supported. The authors should report a direct object pose error (e.g., ADD or rotation/translation error) on a subset with known object poses, such as objects with fiducial markers or a small manually annotated test set.
  3. [Section 5.1, Table 2, Supp. Section 3] The evaluation of text-to-motion synthesis uses feature extractors trained independently for each dataset (Supp. Section 3), so the FID, R-Precision, and Multimodality scores are computed in different embedding spaces. While the 'upper bound' rows partially control for the difficulty of each test set, they do not make the scores directly comparable across datasets; for example, the GigaHands upper-bound FID is 0.002 while the TACO upper-bound FID is 0.045. The conclusion that 'models trained on GigaHands outperform others on all metrics except MM Dist.' (Section 5.1) is therefore not a valid cross-dataset comparison. The authors should either evaluate all models on a shared feature space, normalize metrics by their per-dataset upper bounds, or report cross-dataset evaluation on a common test set as the primary evidence.
  4. [Section 4.3, Section 1, Supp. Section 9.5] The verb count comparison in Figure 2 and the claim that GigaHands has more verbs than any other hand dataset are based on the 84k augmented text annotations, which are produced by LLM rephrasing of the original 14k descriptions. Because the augmentation prompt explicitly asks for varied verbs and descriptions, the 1,467-verb count partly reflects LLM paraphrasing rather than the diversity of the captured activities. The paper should report the verb count computed from the original 14k human/instructional annotations separately, and clarify whether the comparison in Figure 2 uses original or augmented text. This matters because verb diversity is presented as evidence of dataset diversity.
minor comments (6)
  1. [Section 2.2] There is a typo: 'We demonstrate that multi-view RGB us sufficient' should read 'multi-view RGB is sufficient'.
  2. [Figure 2 caption] The phrase 'the right figure compares the verb sets' should be 'the right figure compares the verb counts' for accuracy, since the UpSet plot shows counts and overlaps, not sets themselves.
  3. [Abstract] The abstract states 'totaling 14k motion clips derived from 183 million frames', but Section 1 and Table 1 report 13.9k motion clips; please unify the rounding consistently.
  4. [Section 5.1] The sentence 'Feature extractors are trained independently for each dataset and subset' is important and should be stated in the main text before Table 2, not only in the supplement, because it affects the interpretation of all reported numbers.
  5. [Section 4.3] The phrase 'This expanded our 14k motion clips into 84k motion-text pairs' should clarify that this includes the original annotation plus five rephrasings; the current wording implies a six-fold expansion without explicitly stating the inclusion of the original description.
  6. [Supp. Section 7, Table 10] Table 10 compares detection and keypoint methods on 'valid rate' but does not report whether the 60 motion clips used for this comparison are representative across the 25 scenes; a sentence describing the selection of these clips would improve reproducibility.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the dataset-scale claims are arithmetic or descriptive, and the downstream evaluations are empirical comparisons against external baselines.

full rationale

GigaHands is a dataset paper: its central deliverable is the capture, annotation, and pose-estimation pipeline plus the dataset itself. The headline scale numbers are arithmetic identities (34 hours at 30 fps from 51 views gives 183M frames; 34 hours at 30 fps gives 3.7M timestep poses), not outputs fitted to the claims. The 3D hand and object pipelines (HaMeR, multi-view triangulation, MANO fitting; DINOv2/Grounding DINO/SAM2 masks, differentiable rendering) are cascades of external tools, and no step defines its output in terms of the downstream evaluation metrics. The application experiments train T2M-GPT and TM2T on GigaHands and compare against models trained on TACO and OakInk2, with per-dataset upper bounds reported; relative performance is therefore an empirical observation and not forced by construction. The scale ablations hold the test set fixed while varying training fractions, so the observed improvement with more data is a genuine empirical finding. The verb-count claim is inflated by LLM paraphrase augmentation (14k clips × 6 texts = 84k pairs), and the automatic pose estimates are validated only by self-consistency metrics in the supplement; both are overclaim or correctness risks, not circularity. Self-citations (e.g., Manus, GenHeld, Sridhar et al.) are used as prior tooling or related work and are not load-bearing for the central claims. No equation equates a target result with its own input, and no fitted parameter is renamed as a prediction. Hence, no significant circularity is present.

Assumptions & free parameters 2 free parameters · 4 assumptions · 0 invented entities

The central claims rest on the quality of the automatic annotation pipeline, which is not quantitatively validated. Standard ML hyperparameters for downstream models are not counted as free parameters. The five-fold LLM augmentation is a hand-chosen design that inflates verb diversity.

free parameters (2)
  • Number of LLM rephrasings per annotation = 5
    Section 4.3: each of the 14k clips is expanded to 6 text descriptions via LLM paraphrasing. This ad hoc choice directly inflates the reported verb count and text-diversity metrics.
  • Contrastive margin m in evaluation feature learning = 10
    Supplementary Section 3: the margin in the contrastive loss used to train motion-text feature extractors is set to 10 across all datasets; it affects R-Precision and Multimodal Distance.
assumptions (4)
  • domain assumption HaMeR produces reliable 2D keypoints and hand meshes on this capture setup
    Section 4.4 relies on HaMeR for per-view 2D keypoints and MANO fitting; no accuracy validation on the specific GigaHands rig is reported.
  • domain assumption COLMAP-based camera calibration with fiducial markers is accurate enough for triangulation
    Section 4.2 describes COLMAP calibration; residual calibration errors propagate directly into the 3D hand keypoint triangulation.
  • domain assumption LLM-generated instruction scripts match the performed activities after manual sanity checks
    Sections 4.1 and 4.3 depend on GPT-4 for instructions and annotations; hallucinations are acknowledged and manually corrected, but no quality metric for the final text-motion alignment is reported.
  • domain assumption Silhouette-based differentiable rendering converges to the correct object pose
    Section 4.5 uses multi-view mask supervision only; the paper reports mask coverage (up to 91.1%) but no direct 6D pose error against ground truth.

how reviews work

0 comments
Cite this review

Pith. "Pith review of GigaHands: A Massive Annotated Dataset of Bimanual Hand Activities." pith.science (2026). https://pith.science/paper/WM4X2QJN

@misc{pith2026241204244,
  author       = {Pith},
  title        = {Pith review of: GigaHands: A Massive Annotated Dataset of Bimanual Hand Activities},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/WM4X2QJN}},
  note         = {Machine review of arXiv:2412.04244}
}
read the original abstract

Understanding bimanual human hand activities is a critical problem in AI and robotics. We cannot build large models of bimanual activities because existing datasets lack the scale, coverage of diverse hand activities, and detailed annotations. We introduce GigaHands, a massive annotated dataset capturing 34 hours of bimanual hand activities from 56 subjects and 417 objects, totaling 14k motion clips derived from 183 million frames paired with 84k text annotations. Our markerless capture setup and data acquisition protocol enable fully automatic 3D hand and object estimation while minimizing the effort required for text annotation. The scale and diversity of GigaHands enable broad applications, including text-driven action synthesis, hand motion captioning, and dynamic radiance field reconstruction. Our website are avaliable at https://ivl.cs.brown.edu/research/gigahands.html .

Figures

Figures reproduced from arXiv: 2412.04244 by the authors.

Figure 1
Figure 1. GigaHands is a massive dataset of human bimanual activities with paired text annotations. Each column above shows an activity sequence from the dataset. The dataset covers diverse 3D hand activities, including hand-object interactions (blue) across object scales, gestures (orange), and self-interactions (red). Each clip is paired with descriptive text and 51 camera views, enabling radiance field reconstruction. The … view at source ↗
Figure 2
Figure 2. Dataset Diversity. The left and middle figures illustrate the diversity of pose and motion variations in GigaHands, visualized using t-SNE embeddings. Some points along the convex hull are highlighted with their corresponding text instructions, showcasing unique motions captured in our dataset. The right figure compares the verb sets among different datasets using an UpSet visualization [50]. Each column represents … view at source ↗
Figure 3
Figure 3. Diverse Objects and Frequent Hand Contact Re￾gions. GigaHands provide objects (left) spanning diverse sce￾narios, including cooking, office working, crafting, entertainment, and housework. The diverse activities result in contact regions (right) spanning both the front and back of both hands. Diverse Contacts. Since we have 3D meshes both hands and objects, we can use them to estimate contact maps on both hands, fol… view at source ↗
Figures from the paper (13 more)
Figure 4
Figure 4. Figure 4: Instruct-to-Annotate Pipeline. The instruction elicitation process (left yellow block) creates atomic action-level instruction scripts in a temporally smooth order, structured within scenes. This is achieved by parsing action datasets, grouping verbs into a pool, struc…
Figure 5
Figure 5. Figure 5: Generated motions from models trained on different datasets. Texts highlighted in [PITH_FULL_IMAGE:figures/full_fig_p007_5.png]
Figure 6
Figure 6. Figure 6: Effect of dataset size on motion reconstruction and text [PITH_FULL_IMAGE:figures/full_fig_p007_6.png]
Figure 7
Figure 7. Figure 7: Motion captioning results with different datasets. Each column shows a motion sequence, its ground truth text description, and two generated texts. Hand motions highlighted in green, orange, and blue come from OakInk2, TACO, and GigaHands, respectively. Texts highlight…
Figure 8
Figure 8. Figure 8: Synthesized test views using 2DGS for the motion ‘zip [PITH_FULL_IMAGE:figures/full_fig_p008_8.png]
Figure 1
Figure 1. Figure 1: More qualitative results for text-driven motion synthesis on GigaHands. Darker color indicates later frame in the sequence. [PITH_FULL_IMAGE:figures/full_fig_p020_1.png]
Figure 2
Figure 2. Figure 2: Effect of dataset size on motion reconstruction and motion-to-text generation performance. The x-axis shows the percentage of [PITH_FULL_IMAGE:figures/full_fig_p021_2.png]
Figure 3
Figure 3. Figure 3: More qualitative results for motion caption. Each column shows a motion sequence, its ground truth text description, and two [PITH_FULL_IMAGE:figures/full_fig_p022_3.png]
Figure 4
Figure 4. Figure 4: Qualitative Results on Novel View Synthesis. 6. Experiments on Hand-Object Interaction To assess the effectiveness of our dataset in modeling hand-object interactions, we evaluate its applicability across two object￾related tasks inspired by prior benchmarks in Oakink …
Figure 5
Figure 5. Figure 5: Hand Motion Tracking Pipeline. we fit the MANO [32] parameters under these constraints. To validate our choices for hand detection, handedness classifi￾cation, and 2D keypoint estimation, we calculate the number of valid 3D triangulated frames. We consider a 3D frame v…
Figure 6
Figure 6. Figure 6: Hand Motion Tracking Pipeline. stage mask coverage coarse estimation 45.2% pose refinement (first frame) 91.1% pose refinement (sequence) 78.5% [PITH_FULL_IMAGE:figures/full_fig_p026_6.png]
Figure 7
Figure 7. Figure 7: Annotation Interface. Instructions: - Begin the output with: "Rewritten Sentences:" - Each sentence should be separated by the symbol "$" - Use different verbs or phrasing to achieve natural, varied expressions without changing the action or intent of the original sent…
Figure 8
Figure 8. Figure 8: Randomly Sampled Objects. 10.2. Verb Pool. GigaHands contains a total of 1467 verbs [PITH_FULL_IMAGE:figures/full_fig_p031_8.png]

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. BG-HOP: A Bimanual Generative Hand-Object Prior

    cs.CV 2025-06 conditional novelty 4.0 of 10

    BG-HOP is a transfer-learned diffusion prior for bimanual hand-object interaction, but its left-hand results are often implausible.

Reference graph

Works this paper leans on

42 extracted references · 29 canonical work pages · cited by 1 Pith paper

  1. [1]

    Github, 2021

    Easymocap - make human motion capture easier. Github, 2021. 11

    work page 2021

  2. [2]

    Gpt-4 technical report

    Josh Achiam, Steven Adler, Sandhini Agarwal, Lama Ahmad, Ilge Akkaya, Florencia Leoni Aleman, Diogo Almeida, Janko Al- tenschmidt, Sam Altman, Shyamal Anadkat, et al. Gpt-4 technical report. arXiv preprint arXiv:2303.08774, 2023. 6

    arXiv 2023

  3. [3]

    Least Frequent 320 Verbs

    Prithviraj Banerjee, Sindi Shkodrani, Pierre Moulon, Shreyas Hampali, Fan Zhang, Jade Fountain, Edward Miller, Selen Basol, hydrate nourish gain closed travel document interchange submit disorganize investigate convert decorate opener imperfect realign be disarrange toggle tab purify enfold seek tension container crisscross come systematize chuck tangle s...

    arXiv 2024

  4. [4]

    Text2hoi: Text-guided 3d motion generation for hand-object interac- tion

    Junuk Cha, Jihyeon Kim, Jae Shin Yoon, and Seungryul Baek. Text2hoi: Text-guided 3d motion generation for hand-object interac- tion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 1577–1585, 2024. 8

    work page 2024

  5. [5]

    Arctic: A dataset for dexterous bimanual hand-object manipulation

    Zicong Fan, Omid Taheri, Dimitrios Tzionas, Muhammed Kocabas, Manuel Kaufmann, Michael J Black, and Otmar Hilliges. Arctic: A dataset for dexterous bimanual hand-object manipulation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12943–12954, 2023. 3, 8

    work page 2023

  6. [6]

    Ego4d: Around the world in 3,000 hours of egocentric video

    Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, et al. Ego4d: Around the world in 3,000 hours of egocentric video. In Proceedings of the IEEE/CVF scenarios scenes Cooking, Cleaning, Eating. Making and Drinking Tea Making, Eating and Cleaning Instant Noodle...

    work page 2022

  7. [7]

    Ego-exo4d: Understanding skilled human activity from first-and third-person per- spectives

    Kristen Grauman, Andrew Westbury, Lorenzo Torresani, Kris Kitani, Jitendra Malik, Triantafyllos Afouras, Kumar Ashutosh, Vijay Baiyya, Siddhant Bansal, Bikram Boote, et al. Ego-exo4d: Understanding skilled human activity from first-and third-person per- spectives. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages...

    work page 2024

  8. [8]

    Generating diverse and natural 3d human motions from text

    Chuan Guo, Shihao Zou, Xinxin Zuo, Sen Wang, Wei Ji, Xingyu Li, and Li Cheng. Generating diverse and natural 3d human motions from text. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , pages 5152–5161,

    work page

Show all 42 references
  1. [9]

    Tm2t: Stochastic and tokenized modeling for the reciprocal generation of 3d human motions and texts

    Chuan Guo, Xinxin Zuo, Sen Wang, and Li Cheng. Tm2t: Stochastic and tokenized modeling for the reciprocal generation of 3d human motions and texts. In ECCV, 2022. 4, 5, 6

    2022

  2. [10]

    Deep residual learning for image recognition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 770–778, 2016. 3

    2016

  3. [11]

    spaCy 2: Natural language understanding with Bloom embeddings, convolutional neural networks and incremental parsing

    Matthew Honnibal and Ines Montani. spaCy 2: Natural language understanding with Bloom embeddings, convolutional neural networks and incremental parsing. To appear, 2017. 3

    2017

  4. [12]

    2d gaussian splatting for geometrically accurate radiance fields

    Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, and Shenghua Gao. 2d gaussian splatting for geometrically accurate radiance fields. In ACM SIGGRAPH 2024 Conference Papers, pages 1–11, 2024. 8

    2024

  5. [13]

    Affordpose: A large-scale dataset of hand-object interactions with affordance-driven hand pose

    Juntao Jian, Xiuping Liu, Manyi Li, Ruizhen Hu, and Jian Liu. Affordpose: A large-scale dataset of hand-object interactions with affordance-driven hand pose. In Proceedings of the IEEE/CVF International Conference on Computer Vision , pages 14713–14724,

  6. [14]

    A diversity-promoting objective function for neural conversa- tion models

    Jiwei Li, Michel Galley, Chris Brockett, Jianfeng Gao, and Bill Dolan. A diversity-promoting objective function for neural conversa- tion models. arXiv preprint arXiv:1510.03055, 2015. 7

    2015 arXiv

  7. [15]

    Rouge: A package for automatic evaluation of summaries

    Chin-Yew Lin. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out, pages 74–81, 2004. 7

    2004

  8. [16]

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection

    Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Chunyuan Li, Jianwei Yang, Hang Su, Jun Zhu, et al. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. arXiv preprint arXiv:2303.05499 , 2023. 12

    2023 arXiv

  9. [17]

    Hoi4d: A 4d egocentric dataset for category-level human-object interaction

    Yunze Liu, Yun Liu, Che Jiang, Kangbo Lyu, Weikang Wan, Hao Shen, Boqiang Liang, Zhoujie Fu, He Wang, and Li Yi. Hoi4d: A 4d egocentric dataset for category-level human-object interaction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pa...

    2022

  10. [18]

    Taco: Benchmarking generalizable bimanual tool-action-object understanding

    Yun Liu, Haolin Yang, Xu Si, Ling Liu, Zipeng Li, Yuxiang Zhang, Yebin Liu, and Li Yi. Taco: Benchmarking generalizable bimanual tool-action-object understanding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 21740–21751, 2024. 3, 6, 10

    2024

  11. [19]

    Decoupled weight decay regularization

    I Loshchilov. Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101, 2017. 3

    2017 arXiv

  12. [20]

    Wordnet: a lexical database for english

    George A Miller. Wordnet: a lexical database for english. Communications of the ACM, 38(11):39–41, 1995. 3

    1995

  13. [21]

    Instant neural graphics primitives with a multiresolution hash encoding

    Thomas M ¨uller, Alex Evans, Christoph Schied, and Alexander Keller. Instant neural graphics primitives with a multiresolution hash encoding. ACM transactions on graphics (TOG), 41(4):1–15, 2022. 12

    2022

  14. [22]

    Assemblyhands: Towards egocentric activity understanding via 3d hand pose estimation

    Takehiko Ohkawa, Kun He, Fadime Sener, Tomas Hodan, Luan Tran, and Cem Keskin. Assemblyhands: Towards egocentric activity understanding via 3d hand pose estimation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 12999–13008, 2023. 3

    2023

  15. [23]

    Open x-embodiment: Robotic learning datasets and rt-x models

    Abby O’Neill, Abdul Rehman, Abhinav Gupta, Abhiram Maddukuri, Abhishek Gupta, Abhishek Padalkar, Abraham Lee, Acorn Pooley, Agrim Gupta, Ajay Mandlekar, et al. Open x-embodiment: Robotic learning datasets and rt-x models. arXiv preprint arXiv:2310.08864, 2023. 12

    arXiv

  16. [24]

    Dinov2: Learning robust visual features without supervision

    Maxime Oquab, Timoth ´ee Darcet, Th ´eo Moutakanni, Huy V o, Marc Szafraniec, Vasil Khalidov, Pierre Fernandez, Daniel Haz- iza, Francisco Massa, Alaaeldin El-Nouby, et al. Dinov2: Learning robust visual features without supervision. arXiv preprint arXiv:2304.07193, 2023. 12

    2023 arXiv

  17. [25]

    Foundpose: Unseen object pose estimation with foundation features

    Evin Pınar ¨Ornek, Yann Labb´e, Bugra Tekin, Lingni Ma, Cem Keskin, Christian Forster, and Tomas Hodan. Foundpose: Unseen object pose estimation with foundation features. arXiv preprint arXiv:2311.18809, 2023. 13

    2023 arXiv

  18. [26]

    Bleu: a method for automatic evaluation of machine translation

    Kishore Papineni, Salim Roukos, Todd Ward, and Wei-Jing Zhu. Bleu: a method for automatic evaluation of machine translation. In Proceedings of the 40th annual meeting of the Association for Computational Linguistics , pages 311–318, 2002. 7

    2002

  19. [27]

    Reconstructing hands in 3d with transformers

    Georgios Pavlakos, Dandan Shan, Ilija Radosavovic, Angjoo Kanazawa, David Fouhey, and Jitendra Malik. Reconstructing hands in 3d with transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 9826–9836,

  20. [28]

    Glove: Global vectors for word representation

    Jeffrey Pennington, Richard Socher, and Christopher D Manning. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP) , pages 1532–1543, 2014. 3

    2014

  21. [29]

    Sam 2: Segment anything in images and videos

    Nikhila Ravi, Valentin Gabeur, Yuan-Ting Hu, Ronghang Hu, Chaitanya Ryali, Tengyu Ma, Haitham Khedr, Roman R ¨adle, Chloe Rolland, Laura Gustafson, et al. Sam 2: Segment anything in images and videos. arXiv preprint arXiv:2408.00714, 2024. 12

    2024 arXiv

  22. [30]

    Real-time flying object detection with yolov8

    Dillon Reis, Jordan Kupec, Jacqueline Hong, and Ahmad Daoudi. Real-time flying object detection with yolov8. arXiv preprint arXiv:2305.09972, 2023. 11

    2023 arXiv

  23. [31]

    Javier Romero, Dimitrios Tzionas, and Michael J. Black. Embodied hands: Modeling and capturing hands and bodies together. ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), 2017. 3

    2017

  24. [32]

    Embodied hands: Modeling and capturing hands and bodies together

    Javier Romero, Dimitrios Tzionas, and Michael J Black. Embodied hands: Modeling and capturing hands and bodies together. arXiv preprint arXiv:2201.02610, 2022. 11

    2022 arXiv

  25. [33]

    Image quality assessment through fsim, ssim, mse and psnr—a compar- ative study

    Umme Sara, Morium Akter, and Mohammad Shorif Uddin. Image quality assessment through fsim, ssim, mse and psnr—a compar- ative study. Journal of Computer and Communications , 7(3):8–18, 2019. 8

    2019

  26. [34]

    Mixture models for diverse machine translation: Tricks of the trade

    Tianxiao Shen, Myle Ott, Michael Auli, and Marc’Aurelio Ranzato. Mixture models for diverse machine translation: Tricks of the trade. In International conference on machine learning , pages 5719–5728. PMLR, 2019. 7

    2019

  27. [35]

    Human motion diffusion model

    Guy Tevet, Sigal Raab, Brian Gordon, Yoni Shafir, Daniel Cohen-or, and Amit Haim Bermano. Human motion diffusion model. In The Eleventh International Conference on Learning Representations , 2023. 4, 5, 10

    2023

  28. [36]

    Attention is all you need

    A Vaswani. Attention is all you need. Advances in Neural Information Processing Systems , 2017. 3

    2017

  29. [37]

    Detectron2

    Yuxin Wu, Alexander Kirillov, Francisco Massa, Wan-Yen Lo, and Ross Girshick. Detectron2. https://github.com/ facebookresearch/detectron2, 2019. 11

    2019

  30. [38]

    InterDiff: Generating 3d human-object interactions with physics- informed diffusion

    Sirui Xu, Zhengyuan Li, Yu-Xiong Wang, and Liang-Yan Gui. InterDiff: Generating 3d human-object interactions with physics- informed diffusion. In ICCV, 2023. 10

    2023

  31. [39]

    Oakink2: A dataset of bimanual hands-object manipulation in complex task completion

    Xinyu Zhan, Lixin Yang, Yifei Zhao, Kangrui Mao, Hanlin Xu, Zenan Lin, Kailin Li, and Cewu Lu. Oakink2: A dataset of bimanual hands-object manipulation in complex task completion. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 445–45...

    2024

  32. [40]

    Generating human motion from textual descriptions with discrete representations

    Jianrong Zhang, Yangsong Zhang, Xiaodong Cun, Yong Zhang, Hongwei Zhao, Hongtao Lu, Xi Shen, and Ying Shan. Generating human motion from textual descriptions with discrete representations. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pa...

    2023

  33. [41]

    The unreasonable effectiveness of deep features as a perceptual metric

    Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. The unreasonable effectiveness of deep features as a perceptual metric. In Proceedings of the IEEE conference on computer vision and pattern recognition , pages 586–595, 2018. 8

    2018

  34. [42]

    On the continuity of rotation representations in neural networks

    Yi Zhou, Connelly Barnes, Jingwan Lu, Jimei Yang, and Hao Li. On the continuity of rotation representations in neural networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages 5745–5753, 2019. 5

    2019

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.