Pith. sign in

REVIEW 3 major objections 5 minor 55 references

OpenHuman4D: Open-Vocabulary 4D Human Parsing

T0 review · 3 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read The paper introduces the first open-vocabulary 4D human parsing method, using video-object tracking and mask fusion to segment arbitrary text-queried parts on dynamic 3D humans up to 93.3% faster than fixed-class 4D-DRESS.

desk verdict OpenHuman4D is a useful and plausibly fast open-vocabulary 4D human parsing system, but its accuracy claims rest on a small, unreleased, author-made benchmark, so the numbers should be treated as provisional. read the letter →

arxiv 2507.09880 v2 pith:X246MM5Q submitted 2025-07-14 cs.CV

Keito Suzuki , Bang Du , Runfa Blark Li , Kunyao Chen , Lei Wang , Peng Liu , Ning Bi , Truong Nguyen This is my paper · ORCID
classification cs.CV
keywords open-vocabularysegmentation4DhumanparsingvideoobjecttrackingmaskpropagationSAM2dynamic3DhumansGaussiansequenceshuman-centricdatasets
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

Existing human part segmentation methods handle only static 3D models or a fixed set of classes, and the leading 4D method, 4D-DRESS, takes hours because it regenerates segmentation masks for every frame and view. This paper claims to make 4D human parsing open-vocabulary and practical by instead propagating the first frame's masks through the whole sequence with a video object tracker, validating and repairing those masks, and fusing their embeddings across space and time. On the CTD Dynamic dataset the method reports higher accuracy than state-of-the-art 3D and 4D baselines, and on a 300-frame MPEG-PCC sequence it cuts inference time by up to 93.3%. If the claim holds, users of VR, XR, and animation pipelines could type arbitrary labels for clothing, body parts, or interacting objects and receive temporally coherent segments in seconds rather than hours.

What carries the argument

The machinery has three parts. First, SAM proposes class-agnostic 2D masks on the first rendered view, and SAM 2 propagates each mask to every frame and view, so mask proposal generation happens once instead of per frame. Second, a Mask Validation module takes each rendered image's foreground silhouette, subtracts the union of tracked masks, and decomposes the uncovered region into connected components that become new masks; this adds targets that first appear later in the sequence and repairs tracking failures. Third, the 4D MaskFusion module stores embeddings for each tracked mask from all frames and views in a memory bank, updates them with self-attention $Q'_i = \operatorname{softmax}(Q_i Q_i^T) Q_i$, and equalizes per-class logits by min-max normalization inside each class, suppressing low-confidence masks before the weighted fusion that produces the final labels.

What would settle it

Have independent annotators re-label the ten CTD Dynamic sequences from the raw scans using the same four classes, then re-run all methods with identical prompts and settings; if OpenHuman4D's mean IoU margin over 4D-DRESS and OpenHuman3D disappears or flips, the central accuracy claim is falsified.

Watch

Extended reading notes

Core claim

The paper's central claim is that open-vocabulary parsing of dynamic 3D humans can be both accurate and fast: instead of generating masks for every frame, propagate the first frame's masks through the sequence with a video object tracker, validate them, and fuse their embeddings across views and time. On the CTD Dynamic dataset this pipeline reports overall accuracy 96.88, mean accuracy 96.17, and mean IoU 92.78, ahead of OpenHuman3D, 4D-DRESS, CloSe-Net, and Find3D; on a 300-frame MPEG-PCC sequence it reduces one-time inference from over four hours to about seventeen minutes and average per-query inference to 11.75 seconds, a 93.3% acceleration relative to 4D-DRESS. The authors also release manually annotated four-class ground truth for ten CTD Dynamic sequences, and they demonstrate the same pipeline on dynamic 3D Gaussians with multiple people.

Load-bearing premise

The accuracy claims rest on the manually annotated ground truth for ten CTD Dynamic sequences being correct and neutral; if those labels are noisy, or were influenced by the proposed method's behavior, the reported margins over 4D-DRESS and OpenHuman3D are not established.

Editorial extensions

If this is right

  • Users can query a dynamic human sequence with arbitrary natural-language labels, including objects and ground, rather than a fixed six-class taxonomy.
  • A 300-frame sequence that took 4D-DRESS over four hours for a single inference can be re-queried in about twelve seconds per text prompt after a one-time setup.
  • The method extends to alternative point-based dynamic representations such as 3D Gaussian sequences and to scenes with multiple people.
  • Decoupling mask proposals from text prompts means the same 4D asset can be labeled with many different vocabularies without re-running mask generation.
  • The released CTD Dynamic annotations provide a comparison set whose ground truth was not produced by any of the evaluated methods.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Editorial inference: the tracking-plus-validation design is not tied to humans; the same SAM-2 propagation with silhouette-based validation could be applied to other dynamic 3D object categories whenever a foreground silhouette is available.
  • Editorial inference: the quantitative accuracy evaluation uses only four coarse classes, so the finer-grained open-vocabulary results shown on MPEG-PCC are qualitative; a benchmark with many fine labels would be needed to verify performance at that granularity.
  • Editorial inference: the 93.3% speedup is relative to 4D-DRESS; compared with applying OpenHuman3D per frame the gain is smaller, so the practical claim is speed plus arbitrary queries rather than speed alone.
  • Editorial inference: the logits equalization step is a generic correction that could improve other mask-classification fusion pipelines whenever low-confidence masks are misclassified.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. The paper proposes OpenHuman4D, an open-vocabulary 4D human parsing pipeline that extends the authors' static OpenHuman3D framework. The method uses SAM 2 to propagate an initial set of SAM masks across frames and views, a Mask Validation module to recover regions unseen at the first frame, and a 4D MaskFusion module that fuses mask embeddings across frames and views via memory attention and logits equalization. Experiments compare against Find3D, CloSe-Net, OpenHuman3D, and 4D-DRESS on the CTD Dynamic dataset using author-annotated ground truth for 10 sequences, with additional qualitative results on MPEG-PCC and Dynamic 3D Gaussians, and report up to 93.3% inference-time acceleration over 4D-DRESS.

Significance. If the accuracy and efficiency results hold, this is a useful contribution: it brings open-vocabulary text queries to dynamic 3D humans while avoiding per-frame SAM inference, and the efficiency claim is concrete and internally consistent. The design is coherent, and the qualitative results suggest genuine flexibility beyond fixed taxonomies. However, the quantitative evidence for the central accuracy claim is currently weak: the benchmark is author-annotated, unreleased, and covers only four coarse classes, so the claimed superiority over prior methods is not yet independently established, and the open-vocabulary claim is not tested quantitatively with novel queries.

major comments (3)
  1. [§4.2, Table 1] The load-bearing accuracy comparison in Table 1 rests entirely on 10 CTD Dynamic sequences annotated by the authors into four coarse classes ('upper clothing', 'lower clothing', 'shoes', 'other'), with no annotation protocol, no inter-annotator agreement, and no released labels. Because the proposed pipeline is built on the authors' own OpenHuman3D/HumanCLIP, the labels can be inadvertently aligned with the method, which is the same concern the authors raise against 4D-DRESS labels. Please provide external labels, release the annotations, report per-sequence and per-class metrics with error bars, and include an annotation protocol before the accuracy margins in Table 1 can be taken as established.
  2. [§4.2, Table 1; Fig. 4] The central claim of open-vocabulary parsing is only tested quantitatively on the four fixed classes in Table 1; no experiment measures accuracy for text queries outside that taxonomy or outside the HumanCLIP training distribution. The qualitative MPEG-PCC and Gaussian examples show flexibility, but they are not scored. Please add a quantitative evaluation with held-out prompts or novel object classes (or at least per-query results for a varied prompt set); otherwise the 'arbitrary human-centric data' claim is not supported.
  3. [§3.3, Eq. (4)] Equation (4) defines the missing area as the intersection of the silhouette and the union of propagated masks, which is actually the covered area, not the missing area. The textual description and Figure 3 require the set difference S_{t,v} \ M_{t,v}. As written, the Mask Validation module would operate on the wrong region, so this needs correction, and the subsequent connected-component step should be re-stated accordingly.
minor comments (5)
  1. [§3.4, Eq. (6)] The notation is inconsistent: embeddings q_{i,j} are introduced as the j-th mask from the i-th view, but the memory bank Q_i concatenates embeddings from all frames and views for the i-th initial mask; please align the notation.
  2. [§4.2] The text says 'more details on the generation is provided in the supplementary,' but the supplementary is not included with the submission; either include it or describe the annotation protocol in the paper.
  3. [§3.1, Eq. (7)] The 'no label' threshold tau is not specified, and the logits-equalization formula in Eq. (7) has a division by (max - min) that is undefined if all intra-class logits are equal; please report the threshold value and a stability handling for the equalization.
  4. [Table 2] The inference-time comparison should state explicitly what is included in 'one-time inference' and 'average inference' for each method, including rendering, mask proposal, and embedding computation, and should report the number of views V and SAM prompt settings used.
  5. [Fig. 4] The visual comparison modifies 4D-DRESS by relaxing its class merging to include face, arms, and legs; this nonstandard modification should be described precisely so the comparison is reproducible.

Circularity Check

0 steps flagged · score 2.0 of 10

No derivation-level circularity: predicted segmentations come from frozen pretrained modules with no parameter fitting, and the reported improvements are empirical measurements; the main caveats are author-annotated ground truth and reuse of the authors' own OpenHuman3D/HumanCLIP, which are validity concerns rather than circular reductions.

full rationale

The paper's pipeline is a composition of frozen components: SAM (Sec. 3.2), SAM 2 (Sec. 3.2), HumanCLIP (Sec. 3.4), and text-embedding cosine similarity (Sec. 3.1). No trainable parameter is fitted to the evaluation labels. The mask validation and 4D MaskFusion modules are fixed algorithmic operations (Eqs. 5-7), and the final segmentation is a weighted sum of masks with text-similarity logits. Thus no predicted quantity is, by construction, equal to a fitted input. The 93.3% acceleration figure is an arithmetic ratio of measured inference times (Table 2) and is not derived from the method's own outputs. The use of [39], a same-author prior work, as the source of HumanCLIP is component reuse, not a uniqueness argument or ansatz smuggled by citation; the prior model is externally testable. The author-annotated CTD Dynamic ground truth is unreleased and described only briefly in Sec. 4.2, which weakens independent verification, but the labels are not computed by the proposed method and no model parameter is fitted to them, so this is not circularity. Eq. (4) appears to state the missing area as an intersection rather than a set difference, which is a likely typo or implementation bug affecting mask validation, but it is not a circularity. Overall, the central derivation is self-contained; the score reflects only minor self-reliance in evaluation, not a circular derivation chain.

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

The pipeline introduces no new learned parameters and no new physical entities. It relies on pretrained components such as SAM, SAM2, and HumanCLIP, plus a manually annotated benchmark. The main axioms are that tracking is reliable enough, that silhouette-connected components make sensible mask proposals, and that HumanCLIP text-image alignment transfers to arbitrary prompts. The only hand-set quantities are prompt density, view count V, and an inherited no-label threshold.

free parameters (3)
  • SAM prompt grid density = 64 points per side at 512x512
    Hand-selected in Section 4.1; it controls mask granularity and can affect parsing quality, but it is not fitted to the evaluation metric.
  • Number of render views V
    V is used in Eq. 1 but its value is never stated in the main text; it is a manual configuration choice that affects both runtime and multi-view fusion.
  • No-label logits threshold tau
    Inherited from OpenHuman3D in Section 3.1; the value is not given and can change accuracy by including or excluding low-confidence points.
assumptions (4)
  • domain assumption SAM2 propagates a given mask correctly across frames and views often enough to build consistent memories
    Invoked in Section 3.2 Eq. 3; the whole efficiency argument depends on replacing per-frame SAM with SAM2 tracking, and mask validation only patches partial failures.
  • domain assumption Connected components of the uncovered foreground silhouette correspond to useful semantic masks
    Section 3.3 Eqs. 4 and 5; component splitting is a geometric heuristic with no semantic guarantee, yet these components are treated as new proposals.
  • domain assumption HumanCLIP embeddings align with user text for human-centric concepts
    Section 3.4 and implementation details; HumanCLIP is a self-cited pretrained model and no calibration is performed in this paper.
  • standard math Rendering and unprojection with camera parameters preserves correct point-to-part correspondences
    Sections 3.1, 3.2, and 3.4; the pipeline assumes calibrated rendering and correct inverse projection, which is standard but unstated in detail.

how reviews work

0 comments
Cite this review

Pith. "Pith review of OpenHuman4D: Open-Vocabulary 4D Human Parsing." pith.science (2026). https://pith.science/paper/X246MM5Q

@misc{pith2026250709880,
  author       = {Pith},
  title        = {Pith review of: OpenHuman4D: Open-Vocabulary 4D Human Parsing},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/X246MM5Q}},
  note         = {Machine review of arXiv:2507.09880}
}
read the original abstract

Understanding dynamic 3D human representation has become increasingly critical in virtual and extended reality applications. However, existing human part segmentation methods are constrained by reliance on closed-set datasets and prolonged inference times, which significantly restrict their applicability. In this paper, we introduce the first 4D human parsing framework that simultaneously addresses these challenges by reducing the inference time and introducing open-vocabulary capabilities. Building upon state-of-the-art open-vocabulary 3D human parsing techniques, our approach extends the support to 4D human-centric video with three key innovations: 1) We adopt mask-based video object tracking to efficiently establish spatial and temporal correspondences, avoiding the necessity of segmenting all frames. 2) A novel Mask Validation module is designed to manage new target identification and mitigate tracking failures. 3) We propose a 4D Mask Fusion module, integrating memory-conditioned attention and logits equalization for robust embedding fusion. Extensive experiments demonstrate the effectiveness and flexibility of the proposed method on 4D human-centric parsing tasks, achieving up to 93.3% acceleration compared to the previous state-of-the-art method, which was limited to parsing fixed classes.

Figures

Figures reproduced from arXiv: 2507.09880 by the authors.

Figure 1
Figure 1. We propose the first open-vocabulary parsing method for 4D human-centric data. [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Overview of the proposed framework. 3D Mask Fusion. The 3D mask proposal m 3D i, j is formed by unprojecting its corresponding 2D mask proposal m 2D i, j using the camera parameters. The final proposals M ∈ {0,1} P×N and their embeddings Q ∈ R N×D are obtained by concatenating the 3D masks and embed￾dings from all views. The classification logits P ∈ R N×K are computed by taking the cosine similarity between each ma… view at source ↗
Figure 3
Figure 3. Failure cases of Visual Object Tracking. (a), (b) Initial and current frame with the union of the generated masks over￾laid on the image in green. The boxes show areas with no masks. (c) Newly generated masks to compensate for uncovered areas. St,v during the rendering process indicating the foreground region. Furthermore, to dis￾cover the areas covered by the current masks at frame t, view v, the union of all of th… view at source ↗
Figures from the paper (3 more)
Figure 4
Figure 4. Figure 4: Qualitative comparison on the ‘football’ sequence from the MPEG-PCC dataset [PITH_FULL_IMAGE:figures/full_fig_p008_4.png]
Figure 5
Figure 5. Figure 5: Segmentation result on Dynamic 3D Gaussians [24]. Our design inherits the benefit of Open￾Human3D [39] by decoupling user-defined text prompts from mask proposal generation. During the inference stage, only the text en￾coder and 4D Mask Fusion module remain active, res…
Figure 6
Figure 6. Figure 6: Comparison of segmentation re￾sults from different mask embedding compu￾tations. hair face vest shirt hands pants legs shoes torso (c)Without Mask Validation (d) With Mask Validation (b) Current Frame (a) Initial Frame [PITH_FULL_IMAGE:figures/full_fig_p010_6.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

55 extracted references · 42 canonical work pages

  1. [1]

    Satr: Zero-shot semantic segmentation of 3d shapes

    Ahmed Abdelreheem, Ivan Skorokhodov, Maks Ovsjanikov, and Peter Wonka. Satr: Zero-shot semantic segmentation of 3d shapes. In Proceedings of the IEEE/CVF Inter- national Conference on Computer Vision, pages 15166–15179, 2023

    work page 2023

  2. [2]

    CloSe: A 3D clothing segmentation dataset and model

    Dimitrije Anti ´c, Garvita Tiwari, Batuhan Ozcomlekci, Riccardo Marin, and Gerard Pons-Moll. CloSe: A 3D clothing segmentation dataset and model. In International Conference on 3D Vision (3DV), March 2024

    work page 2024

  3. [3]

    Cloth3d: clothed 3d humans

    Hugo Bertiche, Meysam Madadi, and Sergio Escalera. Cloth3d: clothed 3d humans. In European Conference on Computer Vision, pages 344–359. Springer, 2020

    work page 2020

  4. [4]

    Bedlam: A syn- thetic dataset of bodies exhibiting detailed lifelike animated motion

    Michael J Black, Priyanka Patel, Joachim Tesch, and Jinlong Yang. Bedlam: A syn- thetic dataset of bodies exhibiting detailed lifelike animated motion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 8726– 8737, 2023

    work page 2023

  5. [5]

    Humman: Multi-modal 4d human dataset for versatile sensing and modeling

    Zhongang Cai, Daxuan Ren, Ailing Zeng, Zhengyu Lin, Tao Yu, Wenjia Wang, Xi- angyu Fan, Yang Gao, Yifan Yu, Liang Pan, et al. Humman: Multi-modal 4d human dataset for versatile sensing and modeling. In European Conference on Computer Vi- sion, pages 557–577. Springer, 2022

    work page 2022

  6. [6]

    Tightcap: 3d human shape capture with clothing tightness field

    Xin Chen, Anqi Pang, Wei Yang, Peihao Wang, Lan Xu, and Jingyi Yu. Tightcap: 3d human shape capture with clothing tightness field. ACM Transactions on Graphics (TOG), 41(1):1–17, 2021

    work page 2021

  7. [7]

    Decoupling zero-shot semantic segmentation

    Jian Ding, Nan Xue, Gui-Song Xia, and Dengxin Dai. Decoupling zero-shot semantic segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 11583–11592, 2022

    work page 2022

  8. [8]

    Scaling open-vocabulary image segmentation with image-level labels

    Golnaz Ghiasi, Xiuye Gu, Yin Cui, and Tsung-Yi Lin. Scaling open-vocabulary image segmentation with image-level labels. In European Conference on Computer Vision , pages 540–557. Springer, 2022

    work page 2022

Show all 55 references
  1. [9]

    Graphonomy: Universal human parsing via graph transfer learning

    Ke Gong, Yiming Gao, Xiaodan Liang, Xiaohui Shen, Meng Wang, and Liang Lin. Graphonomy: Universal human parsing via graph transfer learning. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 7450– 7459, 2019

    2019

  2. [10]

    Drape: Dressing any person

    Peng Guan, Loretta Reiss, David A Hirshberg, Alexander Weiss, and Michael J Black. Drape: Dressing any person. ACM Transactions on Graphics (ToG), 31(4):1–10, 2012

    2012

  3. [11]

    On using pointnet architecture for human body segmentation

    Andrej Jertec, David Bojani ´c, Kristijan Bartol, Tomislav Pribani´c, Tomislav Petkovi´c, and Slavenka Petrak. On using pointnet architecture for human body segmentation. In 2019 11th International Symposium on Image and Signal Processing and Analysis (ISPA), pages 253–257. IEEE, 2019

    2019

  4. [12]

    Scaling up visual and vision-language representation learning with noisy text supervision

    Chao Jia, Yinfei Yang, Ye Xia, Yi-Ting Chen, Zarana Parekh, Hieu Pham, Quoc Le, Yun-Hsuan Sung, Zhen Li, and Tom Duerig. Scaling up visual and vision-language representation learning with noisy text supervision. In International conference on machine learning, pages 4904–4916....

    2021

  5. [13]

    Collaborative vision-text representation optimizing for open-vocabulary segmen- tation

    Siyu Jiao, Hongguang Zhu, Jiannan Huang, Yao Zhao, Yunchao Wei, and Humphrey Shi. Collaborative vision-text representation optimizing for open-vocabulary segmen- tation. In European Conference on Computer Vision, pages 399–416. Springer, 2024

    2024

  6. [14]

    Sharp: Shape-aware reconstruction of people in loose clothing

    Sai Sagar Jinka, Astitva Srivastava, Chandradeep Pokhariya, Avinash Sharma, and PJ Narayanan. Sharp: Shape-aware reconstruction of people in loose clothing. In- ternational Journal of Computer Vision, 131(4):918–937, 2023

    2023

  7. [15]

    Panoptic studio: A massively multiview system for social motion capture

    Hanbyul Joo, Hao Liu, Lei Tan, Lin Gui, Bart Nabbe, Iain Matthews, Takeo Kanade, Shohei Nobuhara, and Yaser Sheikh. Panoptic studio: A massively multiview system for social motion capture. In Proceedings of the IEEE international conference on computer vision, pages 3334–3342, 2015

    2015

  8. [16]

    3d gaussian splatting for real-time radiance field rendering

    Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, and George Drettakis. 3d gaussian splatting for real-time radiance field rendering. ACM Trans. Graph., 42(4): 139–1, 2023

    2023

  9. [17]

    Seg- ment anything

    Alexander Kirillov, Eric Mintun, Nikhila Ravi, Hanzi Mao, Chloe Rolland, Laura Gustafson, Tete Xiao, Spencer Whitehead, Alexander C Berg, Wan-Yen Lo, et al. Seg- ment anything. In Proceedings of the IEEE/CVF international conference on computer vision, pages 4015–4026, 2023

    2023

  10. [18]

    Language-driven semantic segmentation

    Boyi Li, Kilian Q Weinberger, Serge Belongie, Vladlen Koltun, and Rene Ran- ftl. Language-driven semantic segmentation. In International Conference on Learn- ing Representations , 2022. URL https://openreview.net/forum?id= RriDjddCLN

    2022

  11. [19]

    Grounded language-image pre-training

    Liunian Harold Li, Pengchuan Zhang, Haotian Zhang, Jianwei Yang, Chunyuan Li, Yiwu Zhong, Lijuan Wang, Lu Yuan, Lei Zhang, Jenq-Neng Hwang, et al. Grounded language-image pre-training. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages ...

    2022

  12. [20]

    Open-vocabulary semantic seg- mentation with mask-adapted clip

    Feng Liang, Bichen Wu, Xiaoliang Dai, Kunpeng Li, Yinan Zhao, Hang Zhang, Peizhao Zhang, Peter Vajda, and Diana Marculescu. Open-vocabulary semantic seg- mentation with mask-adapted clip. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pag...

    2023

  13. [21]

    Partslip: Low-shot part segmentation for 3d point clouds via pretrained image- language models

    Minghua Liu, Yinhao Zhu, Hong Cai, Shizhong Han, Zhan Ling, Fatih Porikli, and Hao Su. Partslip: Low-shot part segmentation for 3d point clouds via pretrained image- language models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 21...

    2023

  14. [22]

    Grounding dino: Marrying dino with grounded pre-training for open-set object detection

    Shilong Liu, Zhaoyang Zeng, Tianhe Ren, Feng Li, Hao Zhang, Jie Yang, Qing Jiang, Chunyuan Li, Jianwei Yang, Hang Su, et al. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. In European Conference on Com- puter Vision, pages 38–55. Springer, 2024

    2024

  15. [23]

    Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. SMPL: A skinned multi-person linear model. ACM Trans. Graphics (Proc. SIGGRAPH Asia), 34(6):248:1–248:16, October 2015. STUDENT, PROF, COLLABORA TOR: BMVC AUTHOR GUIDELINES 13

    2015

  16. [24]

    Dynamic 3d gaussians: Tracking by persistent dynamic view synthesis

    Jonathon Luiten, Georgios Kopanas, Bastian Leibe, and Deva Ramanan. Dynamic 3d gaussians: Tracking by persistent dynamic view synthesis. In 2024 International Conference on 3D Vision (3DV), pages 800–809. IEEE, 2024

    2024

  17. [25]

    Find any part in 3d

    Ziqi Ma, Yisong Yue, and Georgia Gkioxari. Find any part in 3d. arXiv preprint arXiv:2411.13550, 2024

    2024 arXiv

  18. [26]

    Gim3d: A 3d dataset for garment segmentation

    Pietro Musoni, Simone Melzi, Umberto Castellani, et al. Gim3d: A 3d dataset for garment segmentation. InSmart Tools and Applications in Graphics, STAG 2022, pages 21–28. 2022

    2022

  19. [27]

    Gim3d plus: A labeled 3d dataset to design data-driven solutions for dressed humans

    Pietro Musoni, Simone Melzi, and Umberto Castellani. Gim3d plus: A labeled 3d dataset to design data-driven solutions for dressed humans. Graphical Models, 129: 101187, 2023

    2023

  20. [28]

    Open3dis: Open-vocabulary 3d instance segmentation with 2d mask guidance

    Phuc Nguyen, Tuan Duc Ngo, Evangelos Kalogerakis, Chuang Gan, Anh Tran, Cuong Pham, and Khoi Nguyen. Open3dis: Open-vocabulary 3d instance segmentation with 2d mask guidance. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4018–4028, 2024

    2024

  21. [29]

    Clothcap: Seam- less 4d clothing capture and retargeting

    Gerard Pons-Moll, Sergi Pujades, Sonny Hu, and Michael Black. Clothcap: Seam- less 4d clothing capture and retargeting. ACM Transactions on Graphics, (Proc. SIGGRAPH), 36(4), 2017. URL http://dx.doi.org/10.1145/3072959. 3073711. Two first authors contributed equally

    2017 doi

  22. [30]

    3dpeople: Modeling the geometry of dressed humans

    Albert Pumarola, Jordi Sanchez-Riera, Gary Choi, Alberto Sanfeliu, and Francesc Moreno-Noguer. 3dpeople: Modeling the geometry of dressed humans. In Proceed- ings of the IEEE/CVF international conference on computer vision, pages 2242–2251, 2019

    2019

  23. [31]

    Pointnet: Deep learn- ing on point sets for 3d classification and segmentation

    Charles R Qi, Hao Su, Kaichun Mo, and Leonidas J Guibas. Pointnet: Deep learn- ing on point sets for 3d classification and segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 652–660, 2017

    2017

  24. [32]

    Pointnet++: Deep hier- archical feature learning on point sets in a metric space.Advances in neural information processing systems, 30, 2017

    Charles Ruizhongtai Qi, Li Yi, Hao Su, and Leonidas J Guibas. Pointnet++: Deep hier- archical feature learning on point sets in a metric space.Advances in neural information processing systems, 30, 2017

    2017

  25. [33]

    Learning transferable visual models from natural language supervision

    Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, et al. Learning transferable visual models from natural language supervision. In International confer- ence on machine learning, ...

    2021

  26. [34]

    Sam 2: Segment anything in images and videos

    Nikhila Ravi, Valentin Gabeur, Yuan-Ting Hu, Ronghang Hu, Chaitanya Ryali, Tengyu Ma, Haitham Khedr, Roman Rädle, Chloe Rolland, Laura Gustafson, et al. Sam 2: Segment anything in images and videos. arXiv preprint arXiv:2408.00714, 2024

    2024 arXiv

  27. [35]

    Diffusionnet: Discretization agnostic learning on surfaces

    Nicholas Sharp, Souhaib Attaiki, Keenan Crane, and Maks Ovsjanikov. Diffusionnet: Discretization agnostic learning on surfaces. ACM Transactions on Graphics (TOG), 41(3):1–16, 2022. 14 STUDENT, PROF, COLLABORA TOR: BMVC AUTHOR GUIDELINES

    2022

  28. [36]

    X-avatar: Expressive human avatars

    Kaiyue Shen, Chen Guo, Manuel Kaufmann, Juan Jose Zarate, Julien Valentin, Jie Song, and Otmar Hilliges. X-avatar: Expressive human avatars. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 16911– 16921, 2023

    2023

  29. [37]

    Language embed- ded 3d gaussians for open-vocabulary scene understanding

    Jin-Chuan Shi, Miao Wang, Hao-Bin Duan, and Shao-Hua Guan. Language embed- ded 3d gaussians for open-vocabulary scene understanding. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 5333– 5343, 2024

    2024

  30. [38]

    Alpha-clip: A clip model focusing on wherever you want

    Zeyi Sun, Ye Fang, Tong Wu, Pan Zhang, Yuhang Zang, Shu Kong, Yuanjun Xiong, Dahua Lin, and Jiaqi Wang. Alpha-clip: A clip model focusing on wherever you want. In Proceedings of the IEEE/CVF conference on computer vision and pattern recogni- tion, pages 13019–13029, 2024

    2024

  31. [39]

    Open-vocabulary semantic part segmentation of 3d human

    Keito Suzuki, Bang Du, Girish Krishnan, Runfa Blark Li, Kunyao Chen, and Truong Nguyen. Open-vocabulary semantic part segmentation of 3d human. arXiv preprint arXiv:2502.19782, 2025

    2025 arXiv

  32. [40]

    Openmask3d: Open-vocabulary 3d instance segmentation

    Ayça Takmaz, Elisabetta Fedele, Robert W Sumner, Marc Pollefeys, Federico Tombari, and Francis Engelmann. Openmask3d: Open-vocabulary 3d instance segmentation. arXiv preprint arXiv:2306.13631, 2023

    2023 arXiv

  33. [41]

    Raft: Recurrent all-pairs field transforms for optical flow

    Zachary Teed and Jia Deng. Raft: Recurrent all-pairs field transforms for optical flow. In Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part II 16, pages 402–419. Springer, 2020

    2020

  34. [42]

    Training pointnet for human point cloud segmentation with 3d meshes

    Takuma Ueshima, Katsuya Hotta, Shogo Tokai, and Chao Zhang. Training pointnet for human point cloud segmentation with 3d meshes. InFifteenth International Conference on Quality Control by Artificial Vision, volume 11794, pages 72–77. SPIE, 2021

    2021

  35. [43]

    4d-dress: A 4d dataset of real-world human clothing with semantic annotations

    Wenbo Wang, Hsuan-I Ho, Chen Guo, Boxiang Rong, Artur Grigorev, Jie Song, Juan Jose Zarate, and Otmar Hilliges. 4d-dress: A 4d dataset of real-world human clothing with semantic annotations. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, ...

    2024

  36. [44]

    Point transformer v3: Simpler faster stronger

    Xiaoyang Wu, Li Jiang, Peng-Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, and Hengshuang Zhao. Point transformer v3: Simpler faster stronger. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 4840–4851, 2024

    2024

  37. [45]

    Owlii dynamic human mesh sequence dataset

    Yi Xu, Yao Lu, and Ziyu Wen. Owlii dynamic human mesh sequence dataset. ISO/IEC JTC1/SC29/WG11 m41658, 120th MPEG Meeting, Macau, October 2017

    2017

  38. [46]

    Maskclustering: View consensus based mask graph clustering for open-vocabulary 3d instance segmentation

    Mi Yan, Jiazhao Zhang, Yan Zhu, and He Wang. Maskclustering: View consensus based mask graph clustering for open-vocabulary 3d instance segmentation. In Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 28274–28284, 2024

    2024

  39. [47]

    Function4d: Real-time human volumetric capture from very sparse consumer rgbd sensors

    Tao Yu, Zerong Zheng, Kaiwen Guo, Pengpeng Liu, Qionghai Dai, and Yebin Liu. Function4d: Real-time human volumetric capture from very sparse consumer rgbd sensors. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 5746–5756, 2021. STUD...

    2021

  40. [48]

    Sigmoid loss for language image pre-training

    Xiaohua Zhai, Basil Mustafa, Alexander Kolesnikov, and Lucas Beyer. Sigmoid loss for language image pre-training. In Proceedings of the IEEE/CVF international con- ference on computer vision, pages 11975–11986, 2023

    2023

  41. [49]

    Black, and Gerard Pons-Moll

    Chao Zhang, Sergi Pujades, Michael J. Black, and Gerard Pons-Moll. Detailed, accu- rate, human shape estimation from clothed 3d scan sequences. InThe IEEE Conference on Computer Vision and Pattern Recognition (CVPR), July 2017

    2017

  42. [50]

    Dreamlip: Language-image pre-training with long captions

    Kecheng Zheng, Yifei Zhang, Wei Wu, Fan Lu, Shuailei Ma, Xin Jin, Wei Chen, and Yujun Shen. Dreamlip: Language-image pre-training with long captions. In European Conference on Computer Vision, pages 73–90. Springer, 2024

    2024

  43. [51]

    Structured local radiance fields for human avatar modeling

    Zerong Zheng, Han Huang, Tao Yu, Hongwen Zhang, Yandong Guo, and Yebin Liu. Structured local radiance fields for human avatar modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 15893– 15903, 2022

    2022

  44. [52]

    Meshsegmenter: Zero-shot mesh semantic segmentation via texture synthesis

    Ziming Zhong, Yanyu Xu, Jing Li, Jiale Xu, Zhengxin Li, Chaohui Yu, and Shenghua Gao. Meshsegmenter: Zero-shot mesh semantic segmentation via texture synthesis. In European Conference on Computer Vision, pages 182–199. Springer, 2024

    2024

  45. [53]

    Part- slip++: Enhancing low-shot 3d part segmentation via multi-view instance segmentation and maximum likelihood estimation

    Yuchen Zhou, Jiayuan Gu, Xuanlin Li, Minghua Liu, Yunhao Fang, and Hao Su. Part- slip++: Enhancing low-shot 3d part segmentation via multi-view instance segmentation and maximum likelihood estimation. arXiv preprint arXiv:2312.03015, 2023

    2023 arXiv

  46. [54]

    Open-vocabulary 3d semantic segmenta- tion with text-to-image diffusion models

    Xiaoyu Zhu, Hao Zhou, Pengfei Xing, Long Zhao, Hao Xu, Junwei Liang, Alexander Hauptmann, Ting Liu, and Andrew Gallagher. Open-vocabulary 3d semantic segmenta- tion with text-to-image diffusion models. InEuropean Conference on Computer Vision, pages 357–375. Springer, 2024

    2024

  47. [55]

    Cloth4d: A dataset for clothed hu- man reconstruction

    Xingxing Zou, Xintong Han, and Waikeung Wong. Cloth4d: A dataset for clothed hu- man reconstruction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 12847–12857, 2023

    2023

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.