ContextHOI: Spatial Context Learning for Human-Object Interaction Detection

Ge Li; Liming Zhao; Mingda Jia; Yun Zheng

REVIEW 3 major objections 7 minor 40 references

ContextHOI: Spatial Context Learning for Human-Object Interaction Detection

T0 review · 3 major / 7 minor · reviewed 2026-08-11 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read ContextHOI claims that adding a context-learning branch to a DETR-style HOI detector yields state-of-the-art results, especially on occluded and blurred scenes.

desk verdict Credible HOI context-learning method with solid HICO-DET gains, but the occlusion-robustness claim rests on an unvalidated benchmark and the v-coco SOTA claim is contradicted by its own table. read the letter →

arxiv 2412.09050 v1 pith:7ONVAKVT submitted 2024-12-12 cs.CV

Mingda Jia , Liming Zhao , Ge Li , Yun Zheng This is my paper · ORCID

classification cs.CV

keywords Human-ObjectInteractiondetectionspatialcontextlearningocclusionrobustnessDETRvision-languagemodelsHICO-DETcontrastiveknowledgedistillation

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that transformer-based HOI detectors fail on occluded or blurred scenes because they treat backgrounds as irrelevant. ContextHOI adds a dual-branch architecture: an instance branch and a context branch that explicitly learns spatial context, supervised by contrastive spatial losses and semantic knowledge from a vision-language model. On HICO-DET and v-coco it reports state-of-the-art mAP, and on a new 659-image subset of HICO-DET curated for ambiguous appearances it reports gains of +5.17 full and +16.66 rare mAP over its own full-test performance. The claim is that this demonstrates genuine robustness to degraded foreground cues.

What carries the argument

The load-bearing mechanism is the dual-branch architecture with a context extractor that shares the decoder structure of the instance branch but is pushed away from it by three spatially contrastive constraints: feature-level, region-level, and instance-level with a dynamic distance weight. A semantic-guided context explorer, initialized with CLIP text embeddings and refined with Gumbel softmax and top-k selection, selects category-relevant regions. The context aggregator then fuses instance and context features via shared cross-attention, producing the interaction prediction.

What would settle it

Run ContextHOI on a random 659-image subset of the HICO-DET test set with the same label distribution: if the random-subset mAP matches the 46.99 full mAP observed on HICO-ambiguous, the robustness gain is an artifact of subset selection rather than occlusion handling.

Watch

Extended reading notes

Core claim

The central discovery is that explicit spatial context learning, supervised to diverge from instance-centric regions, substantially improves HOI prediction under occlusion and blur. The context branch, guided by three spatially contrastive constraints and semantic guidance distilled from CLIP, extracts informative backgrounds that complement detection features. This yields state-of-the-art full and rare mAP on HICO-DET (41.82/43.91 with ResNet50) and competitive v-coco scores, while raising mAP on the new HICO-ambiguous subset from 41.82 to 46.99 full and from 43.91 to 60.57 rare.

Load-bearing premise

The claim that ContextHOI is robust to occlusion rests on the HICO-ambiguous subset being a fair, representative sample of hard cases, but the subset was selected by human volunteers and no baseline ensures the mAP difference is not due to a shift in label distribution.

Editorial extensions

If this is right

If the claim holds, adding explicit context supervision becomes a standard recipe for making DETR-based HOI detectors robust to occlusion and blur.
The HICO-ambiguous benchmark could serve as a new evaluation protocol for robustness in HOI detection beyond average mAP.
The dynamic distance weight mechanism suggests a general way to keep learned context regions away from image margins, transferable to other context-learning tasks.
The large rare-category gain implies that spatial context is especially valuable for long-tail interactions where foreground cues are scarce, potentially guiding data augmentation or sampling strategies.
Two-stage HOI detectors, which rely on pre-trained backbones, may need comparable context branches to close the robustness gap shown on ambiguous scenes.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

If context is as informative as claimed, a detector using only the context branch (with the instance branch ablated) might still recognize many interactions; this could be tested to quantify how much action-recognition signal lives in background regions.
The HICO-ambiguous subset may be skewed toward scenes with strong contextual affordances (parking lots, roads), so the mAP gain could partly reflect label-context correlation; a balanced subset with occluded instances in context-free scenes would disentangle this.
The semantic teacher choice (CLIP over EVA-01) suggests that scaling to stronger vision-language models may push robustness further, but the paper does not test teachers with higher-capacity visual encoders.
The context-learning paradigm may generalize to other object-centric tasks such as affordance detection or group activity recognition, where background priors are similarly decisive.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Colleague,

ContextHOI is a credible HOI detector with a dual-branch design that learns spatial context explicitly. The context branch is supervised by three spatially contrastive losses plus a CLIP-based semantic explorer, and on standard HICO-DET it sets a new high (41.82 mAP with R50). The ablations are decent and each proposed component gives a bump. That part is worth reading.

The problem is the headline robustness claim. The paper says ContextHOI is much better on occluded and blurred scenes, but the only evidence is a new benchmark, HICO-ambiguous, that they constructed. It is a 659-image subset of HICO-DET test picked by unnamed human volunteers using vague criteria. There is no inter-annotator agreement, no release of the image list, no selection code, and no random-subset baseline. On this supposedly harder subset, ContextHOI scores 46.99 full / 60.57 rare, which is higher than its own 41.82/43.91 on the full test, while the three baselines they evaluate (UPT, ADA-CM, QPIC) drop 15-20 points. That pattern is exactly what you would expect if the subset is biased toward easier cases or if the evaluation protocol differs, perhaps by excluding HOI categories that have no ground truth in those 659 images. As reported, the robustness claim is not verifiable.

Second issue: the abstract claims state-of-the-art on v-coco, but Table 1 shows SCTC at 67.1 with R50 versus ContextHOI's 66.1. Only the R101 variant (67.3) beats it. That overclaim should be fixed.

The paper also mentions zero-shot ability in the introduction but never evaluates it, and it does not compare against BCOM, the most relevant occlusion-robust prior, on the new benchmark. These are not fatal to the method, but they weaken the paper's main selling point.

The math and data side look sound: the losses are auxiliary training objectives, there are no fitted constants passed off as predictions, and the citation pattern covers the field adequately. The typos are minor.

Take it to a serious referee, but expect heavy revision. The benchmark needs to be released with selection code and a random-subset control, the v-coco claim needs qualification, and the baseline set on HICO-ambiguous needs to include BCOM and others. For now, read it for the architecture and the standard-benchmark results. I would not cite it until the benchmark is sorted.

Referee Report

3 major / 7 minor

Summary. The paper introduces ContextHOI, a DETR-style HOI detector with an additional context-learning branch that produces instance-independent spatial context features, supervised by spatially contrastive losses and semantic guidance distilled from CLIP text embeddings. A context aggregator fuses instance, context, and VLM visual features for interaction prediction. The authors report strong HICO-DET results, claim state-of-the-art performance on v-coco, and introduce a manually selected HICO-DET(ambiguous) subset of 659 images to demonstrate robustness to occluded, blurred, or tiny instances.

Significance. The core idea is well-motivated and the technical development is nontrivial: explicit spatial supervision to separate context from instance attention, a dynamic distance weight, and VLM-initialized explorers are coherent design choices. Table 3 ablations support the contribution of each component, and the HICO-DET default numbers are competitive with or better than prior work under similar backbones. The evaluation is not circular: the training losses are auxiliary objectives and standard test protocols are used for the main benchmark. However, the two headline claims—v-coco state-of-the-art and occlusion robustness—are not currently established. The v-coco claim is contradicted by Table 1, and the occlusion-robustness claim rests entirely on an unvalidated, unreleased subset whose evaluation protocol is not described. With those points fixed, the paper would make a solid contribution.

major comments (3)

[Abstract; §4.3, Table 1] The abstract and Section 4.3 state that ContextHOI achieves state-of-the-art performance on the v-coco benchmark, but Table 1 lists SCTC with ResNet50 at 67.1 mAP and ContextHOI with ResNet50 at 66.1 mAP; the R101 result (67.3) is not a same-backbone comparison. The sentence 'Both performances outperforms existing HOI detectors under the same backbones' is therefore inaccurate for v-coco, and the state-of-the-art claim should be revised or the comparison clarified.
[§4.1, Table 2] The HICO-DET(ambiguous) benchmark is the sole evidence for the occlusion-robustness claim, but its construction is not validated: the 659 images were selected by unnamed human volunteers using criteria 'unseen subjects, occluded subjects, blurred subjects, and instances too small to distinguish,' with no image list, subset release, inter-annotator agreement statistics, or random-subset baseline. Without these, the interpretation that ContextHOI's higher mAP on this subset (46.99 vs 41.82 on the full test) indicates robustness is fragile, because the subset's label distribution and difficulty may differ systematically from the full test set.
[§4.3, Table 2] The paper does not state how UPT, ADA-CM, and QPIC were evaluated on the ambiguous subset, e.g., whether their released checkpoints were run under the same evaluation code and with the same set of HOI categories. If the evaluation protocol excludes categories with no ground truth in the 659 images, or if baselines are re-implemented, the comparisons in Table 2 may not be apples-to-apples. This should be documented, and ideally the benchmark and evaluation code should be released for verification.

minor comments (7)

[Eq. (1)] The sets \Phi and \bar{\Phi} are used before being defined, and the phrase 'mean cosine similarity along the query dimension' is inconsistent with the explicit sum over k; please align the text with the equation.
[Eq. (6)] Equation (6) uses \prod where a concatenation operator is intended ('Q refers to concatenation'); the notation should be corrected.
[Section 5] The section heading contains the typo 'Conlusion' instead of 'Conclusion'.
[Figure 5] The caption contains 'dirve a car'; it should be 'drive a car'.
[§4.2] The sentence 'a 10 times weight decay at 40 epochs' presumably means a learning-rate decay by a factor of 10; please clarify the wording.
[Table 1] The ContextHOI entries '41.8243.91' and '42.0942.41' lack spacing; the table formatting should be fixed.
[References] The reference list contains inconsistent key formats, such as 'Gao et al. (2018)' and 'Tamura et al.(2021)'; unify the citation style.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: ContextHOI's losses are training objectives and its evaluation uses held-out public benchmarks, with no equation reducing to a fitted value or to self-citation.

full rationale

The paper's derivation chain is self-contained. The proposed spatially contrastive constraints (Eqs. 1, 2, 4) are auxiliary training losses that shape the context branch; L = L_HOI + L_SC (Eq. 9) is a standard end-to-end training objective, not a definition of the reported mAP. The semantic-guided context explorer initializes weights from CLIP text embeddings, which is external prior knowledge, not a circular input. The context aggregator is a transformer decoder module whose behavior is evaluated by ablation, not by construction. No parameter is fitted to the HICO-DET test set and then reported as a prediction; the HICO-ambiguous subset is an evaluation-only benchmark constructed from test images and original annotations, and it is not used to train or select the model. The comparisons in Table 2 compare the same checkpoint on the full test set and on the ambiguous subset, so the +5.17 full and +16.66 rare mAP gains are empirical measurements rather than consequences of the loss equations. There are no load-bearing self-citations: the cited base methods (DETR, QPIC, HOICLIP, CDN) come from disjoint author groups, and no uniqueness theorem or prior same-author result is invoked to force the design. Concerns about the HICO-ambiguous benchmark's validation (unreleased image list, no inter-annotator agreement, no random-subset baseline) are legitimate correctness and reproducibility risks, but they are not circularity: the subset does not enter the derivation of ContextHOI's predictions or losses. Accordingly, the paper warrants a score of 0 for circularity.

Assumptions & free parameters 3 free parameters · 4 assumptions · 0 invented entities

The ledger shows no invented physical entities. The central claim rests on hand-chosen loss weights, a learned temperature, and three domain assumptions about context value, CLIP semantic alignment, and the validity of the author-created ambiguous benchmark.

free parameters (3)

spatial constraint loss weights lambda_fc, lambda_rc, lambda_ic = 4, 1, 4
Hand-chosen coefficients in Eq. (8) that balance the three contrastive losses; the ablation fixes them and reports no sensitivity analysis, so the reported gains depend on these values.
dynamic distance weight temperature tau = initialized 0.5, learned
Learnable scalar in Eq. (3) controlling how quickly context boxes are penalized as they move to image edges; only an initialization is reported.
query count Nq = 64
Number of instance and context queries; set to 64 for both benchmarks and not ablated.

assumptions (4)

domain assumption Spatial context, such as backgrounds and surroundings, is critical for HOI recognition, especially when the foreground is blurred or occluded.
Motivates the entire context branch; not demonstrated independently but supported by prior work and the paper's ablations.
domain assumption CLIP text embeddings of object and verb categories are an appropriate semantic prior for HOI context exploration.
Used to initialize and supervise semantic-guided explorers in Section 3.3; if CLIP semantics are misaligned, the context branch may be misdirected.
ad hoc to paper The hand-selected HICO-ambiguous subset is a representative, unbiased sample of occluded and blurred HOI scenes.
Selection by human volunteers is described in Section 4.1 without inter-annotator agreement or comparison to a random subset; the reported mAP differences are interpreted as robustness.
domain assumption Spatially contrastive losses (Eqs. 1-8) encourage the context branch to capture complementary information rather than duplicate instance features.
The optimization objective assumes that pushing context away from instance regions and image margins yields informative context; this is not proven but is supported by ablations.

how reviews work

0 comments

Cite this review

Pith. "Pith review of ContextHOI: Spatial Context Learning for Human-Object Interaction Detection." pith.science (2026). https://pith.science/paper/7ONVAKVT

@misc{pith2026241209050,
  author       = {Pith},
  title        = {Pith review of: ContextHOI: Spatial Context Learning for Human-Object Interaction Detection},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/7ONVAKVT}},
  note         = {Machine review of arXiv:2412.09050}
}

read the original abstract

Spatial contexts, such as the backgrounds and surroundings, are considered critical in Human-Object Interaction (HOI) recognition, especially when the instance-centric foreground is blurred or occluded. Recent advancements in HOI detectors are usually built upon detection transformer pipelines. While such an object-detection-oriented paradigm shows promise in localizing objects, its exploration of spatial context is often insufficient for accurately recognizing human actions. To enhance the capabilities of object detectors for HOI detection, we present a dual-branch framework named ContextHOI, which efficiently captures both object detection features and spatial contexts. In the context branch, we train the model to extract informative spatial context without requiring additional hand-craft background labels. Furthermore, we introduce context-aware spatial and semantic supervision to the context branch to filter out irrelevant noise and capture informative contexts. ContextHOI achieves state-of-the-art performance on the HICO-DET and v-coco benchmarks. For further validation, we construct a novel benchmark, HICO-ambiguous, which is a subset of HICO-DET that contains images with occluded or impaired instance cues. Extensive experiments across all benchmarks, complemented by visualizations, underscore the enhancements provided by ContextHOI, especially in recognizing interactions involving occluded or blurred instances.

Figures

Figures reproduced from arXiv: 2412.09050 by the authors.

**Figure 1.** The role of context learning in HOI Detection. Spatial context, like a parkinglot or a cityroad helps little with identify the salient car. However, context is critical in distinguishing human interactions. Both parking and driving are highly related to the context information. methods rely more heavily on the confidence of their pretrained object detection backbones (Zhang et al. 2022). Despite significant advan… view at source ↗

**Figure 2.** The overall architecture of ContextHOI. ContextHOI has a dual-branch and fusion structure, with instance detection and context learning branches. The instance detection branch captures instance-centric attributes, while the context learning branch focuses on instance-independent context features. We introduce a semantic-guided instance/context exploration module to distil prior knowledge from VLM to help ground inf… view at source ↗

**Figure 3.** Inner design of semantic-guided context exploration module. pooling refers to mean pooling on the spatial dimension of Zˆ, concat refers to concatenation. Region-level constraint. At the region level, we constrain the learned positional guided embeddings P ins ∈ R Nq×C and P c ∈ R Nq×C predicted together with instance and context features by corresponding decoders. As the guided embeddings take the role of direct… view at source ↗

Figures from the paper (2 more)

**Figure 4.** Figure 4: Visualization analysis on spatial context learning. (a) The feature map of the last layer of instance decoder, context aggregator and context extractor, indexed by the highest logits. Our instance decoder focuses on the appearance of the car, and the context extract…

**Figure 5.** Figure 5: Visualizations of the visual feature captured by ContextHOI on images in HICO-DET (ambiguous). We mask the predicted instance boxes and let GPT-4V (OpenAI 2023) describe the left images; the words describing contexts in GPT captions are selected and shown as the yello…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

40 extracted references · 32 canonical work pages

[1]

K.; and Huang, F

An, B.; Zhu, S.; Panaitescu-Liess, M.-A.; Mummadi, C. K.; and Huang, F. 2023. More Context, Less Distraction: Visual Classification by Inferring and Conditioning on Contextual Attributes. arXiv:2308.01313

arXiv 2023
[2]

Cao, S.; Yin, Y.; Huang, L.; Liu, Y.; Zhao, X.; Zhao, D.; and Huang, K. 2023 a . Efficient-VQGAN: Towards High-Resolution Image Generation with Efficient Vision Transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 7368--7377

work page 2023
[3]

Cao, Y.; Tang, Q.; Su, X.; Chen, S.; You, S.; Lu, X.; and Xu, C. 2023 b . Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Models. In Advances in Neural Information Processing Systems, volume 36, 739--751

work page 2023
[4]

Carion, N.; Massa, F.; Synnaeve, G.; Usunier, N.; Kirillov, A.; and Zagoruyko, S. 2020. End-to-End Object Detection with Transformers. In Computer Vision -- ECCV 2020, 213--229

work page 2020
[5]

Chao, Y.-W.; Liu, Y.; Liu, X.; Zeng, H.; and Deng, J. 2018. Learning to Detect Human-Object Interactions. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), 381--389

work page 2018
[6]

Chen, M.; Liao, Y.; Liu, S.; Chen, Z.; Wang, F.; and Qian, C. 2021. Reformulating HOI Detection As Adaptive Set Prediction. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021 , 9004--9013

work page 2021
[7]

Chen, Z.; Huang, S.; and Tao, D. 2018. Context Refinement for Object Detection. In Proceedings of the European Conference on Computer Vision (ECCV)

work page 2018
[8]

Fang, Y.; Wang, W.; Xie, B.; Sun, Q.; Wu, L.; Wang, X.; Huang, T.; Wang, X.; and Cao, Y. 2022. EVA: Exploring the Limits of Masked Visual Representation Learning at Scale. arXiv preprint arXiv:2211.07636

arXiv 2022

Show all 40 references

[9]

Zhang, D

Frederic Z. Zhang, D. C.; and Gould, S. 2021. Spatially Conditioned Graphs for Detecting Human–Object Interactions. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 13319--13327

2021
[10]

Gao, C.; Xu, J.; Zou, Y.; and Huang, J.-B. 2020. DRG: Dual Relation Graph for Human-Object Interaction Detection. In European Conference on Computer Vision

2020
[11]

(2018) Chen, G.; Yuliang, Z.; and Huang, J

Gao et al. (2018) Chen, G.; Yuliang, Z.; and Huang, J. 2018. iCAN: Instance-Centric Attention Network for Human-Object Interaction Detection. In BMVC2018

2018
[12]

Gupta, S.; and Malik, J. 2015. Visual Semantic Role Labeling. arXiv:1505.04474

2015 arXiv
[13]

Jang, E.; Gu, S.; and Poole, B. 2017. Categorical Reparameterization with Gumbel-Softmax. arXiv:1611.01144

2017 arXiv
[14]

Jiang, W.; Ren, W.; Tian, J.; Qu, L.; Wang, Z.; and Liu, H. 2024. Exploring Self- and Cross-Triplet Correlations for Human-Object Interaction Detection. arXiv:2401.05676

2024 arXiv
[15]

Kim, B.; Lee, J.; Kang, J.; Kim, E.; and Kim, H. J. 2021. HOTR: End-to-End Human-Object Interaction Detection With Transformers. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021 , 74--83

2021
[16]

Kim, S.; Jung, D.; and Cho, M. 2023. Relational Context Learning for Human-Object Interaction Detection. arXiv:2304.04997

2023 arXiv
[17]

Lei, T.; Caba, F.; Chen, Q.; Jin, H.; Peng, Y.; and Liu, Y. 2023. Efficient Adaptive Human-Object Interaction Detection with Concept-guided Memory. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 6480--6490

2023
[18]

Li, L.; Wei, J.; Wang, W.; and Yang, Y. 2023. Neural-Logic Human-Object Interaction Detection. In Advances in Neural Information Processing Systems, volume 36, 21158--21171

2023
[19]

Liao, Y.; Zhang, A.; Lu, M.; Wang, Y.; Li, X.; and Liu, S. 2022. GEN-VLKT: Simplify Association and Enhance Interaction Understanding for HOI Detection. In IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022, New Orleans, LA, USA, June 18-24, 2022 , 20091--20100

2022
[20]

Ma, S.; Wang, Y.; Wang, S.; and Wei, Y. 2023. FGAHOI: Fine-Grained Anchors for Human-Object Interaction Detection. arXiv:2301.04019

2023 arXiv
[21]

Ning, S.; Qiu, L.; Liu, Y.; and He, X. 2023. HOICLIP: Efficient Knowledge Transfer for HOI Detection with Vision-Language Models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,bCVPR 2023, 23507--23517

2023
[22]

OpenAI . 2023. GPT-4: Enhancements and Capabilities. https://openai.com/blog/gpt-4. Accessed: yyyy-mm-dd

2023
[23]

K.; and Kim, H

Park, J.; Lee, S.; Heo, H.; Choi, H. K.; and Kim, H. J. 2022. Consistency Learning via Decoding Path Augmentation for Transformers in Human Object Interaction Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR 2022

2022
[24]

(2023) Park, J.; Park, J.-W.; and Lee, J.-S

Part et al. (2023) Park, J.; Park, J.-W.; and Lee, J.-S. 2023. ViPLO: Vision Transformer Based Pose-Conditioned Self-Loop Graph for Human-Object Interaction Detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 17152--17162

2023
[25]

W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; Krueger, G.; and Sutskever, I

Radford, A.; Kim, J. W.; Hallacy, C.; Ramesh, A.; Goh, G.; Agarwal, S.; Sastry, G.; Askell, A.; Mishkin, P.; Clark, J.; Krueger, G.; and Sutskever, I. 2021. Learning Transferable Visual Models From Natural Language Supervision. In Proceedings of the 38th International Conferen...

2021
[26]

D.; and Savarese, S

Rezatofighi, H.; Tsoi, N.; Gwak, J.; Sadeghian, A.; Reid, I. D.; and Savarese, S. 2019. Generalized Intersection Over Union: A Metric and a Loss for Bounding Box Regression. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, June 16-...

2019
[27]

Sun, Q.; Fang, Y.; Wu, L.; Wang, X.; and Cao, Y. 2023. EVA-CLIP: Improved Training Techniques for CLIP at Scale. arXiv preprint arXiv:2303.15389

2023 arXiv
[28]

Tamura et al.(2021) Masato, T.; Hiroki, O.; and Tomoaki, Y. 2021. QPIC: Query-Based Pairwise Human-Object Interaction Detection With Image-Wide Contextual Information. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021 , 10410--10419

2021
[29]

Wang, G.; Guo, Y.; Xu, Z.; and Kankanhalli, M. 2024. Bilateral Adaptation for Human-Object Interaction Detection with Occlusion-Robustness. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 27970--27980

2024
[30]

M.; Khan, M

Wang, T.; Anwer, R. M.; Khan, M. H.; Khan, F. S.; Pang, Y.; Shao, L.; and Laaksonen, J. 2019. Deep Contextual Attention for Human-Object Interaction Detection . In ICCV

2019
[31]

Yang, J.; Lu, J.; Lee, S.; Batra, D.; and Parikh, D. 2018. Graph r-cnn for scene graph generation. In Proceedings of the European Conference on Computer Vision (ECCV), 670--685

2018
[32]

Yuan, H.; Jiang, J.; Albanie, S.; Feng, T.; Huang, Z.; Ni, D.; and Tang, M. 2022. RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detection. In Advances in Neural Information Processing Systems, volume 35, 37416--37431

2022
[33]

Yuan, H.; and Ni, D. 2021. Learning Visual Context for Group Activity Recognition. AAAI, 35

2021
[34]

Yuan, H.; Zhang, S.; Wang, X.; Albanie, S.; Pan, Y.; Feng, T.; Jiang, J.; Ni, D.; Zhang, Y.; and Zhao, D. 2023. RLIPv2: Fast Scaling of Relational Language-Image Pre-Training. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 21649--21661

2023
[35]

Zhai, Y.; Liu, Z.; Wu, Z.; Wu, Y.; Zhou, C.; Doermann, D.; Yuan, J.; and Hua, G. 2023. SOAR: Scene-debiasing Open-set Action Recognition. arXiv:2309.01265

2023 arXiv
[36]

Zhang, A.; Liao, Y.; Liu, S.; Lu, M.; Wang, Y.; Gao, C.; and Li, X. 2021. Mining the Benefits of Two-stage and One-stage HOI Detection. In Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, Decem...

2021
[37]

Z.; Yuan, Y.; Campbell, D.; Zhong, Z.; and Gould, S

Zhang, F. Z.; Yuan, Y.; Campbell, D.; Zhong, Z.; and Gould, S. 2023. Exploring Predicate Visual Context in Detecting of Human-Object Interactions. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 10411--10421

2023
[38]

(2022) Zhang, F

Zhang et al. (2022) Zhang, F. Z.; Campbell, D.; and Gould, S. 2022. Efficient Two-Stage Detection of Human-Object Interactions with a Novel Unary-Pairwise Transformer. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 20104--20112

2022
[39]

, " * write output.state after.block = add.period write newline

ENTRY address archivePrefix author booktitle chapter edition editor eid eprint howpublished institution isbn journal key month note number organization pages publisher school series title type volume year label extra.label sort.label short.list INTEGERS output.state before.all...
[40]

write newline

" write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.

[1] [1]

K.; and Huang, F

An, B.; Zhu, S.; Panaitescu-Liess, M.-A.; Mummadi, C. K.; and Huang, F. 2023. More Context, Less Distraction: Visual Classification by Inferring and Conditioning on Contextual Attributes. arXiv:2308.01313

arXiv 2023

[2] [2]

Cao, S.; Yin, Y.; Huang, L.; Liu, Y.; Zhao, X.; Zhao, D.; and Huang, K. 2023 a . Efficient-VQGAN: Towards High-Resolution Image Generation with Efficient Vision Transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 7368--7377

work page 2023

[3] [3]

Cao, Y.; Tang, Q.; Su, X.; Chen, S.; You, S.; Lu, X.; and Xu, C. 2023 b . Detecting Any Human-Object Interaction Relationship: Universal HOI Detector with Spatial Prompt Learning on Foundation Models. In Advances in Neural Information Processing Systems, volume 36, 739--751

work page 2023

[4] [4]

Carion, N.; Massa, F.; Synnaeve, G.; Usunier, N.; Kirillov, A.; and Zagoruyko, S. 2020. End-to-End Object Detection with Transformers. In Computer Vision -- ECCV 2020, 213--229

work page 2020

[5] [5]

Chao, Y.-W.; Liu, Y.; Liu, X.; Zeng, H.; and Deng, J. 2018. Learning to Detect Human-Object Interactions. In 2018 IEEE Winter Conference on Applications of Computer Vision (WACV), 381--389

work page 2018

[6] [6]

Chen, M.; Liao, Y.; Liu, S.; Chen, Z.; Wang, F.; and Qian, C. 2021. Reformulating HOI Detection As Adaptive Set Prediction. In IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2021, virtual, June 19-25, 2021 , 9004--9013

work page 2021

[7] [7]

Chen, Z.; Huang, S.; and Tao, D. 2018. Context Refinement for Object Detection. In Proceedings of the European Conference on Computer Vision (ECCV)

work page 2018

[8] [8]

Fang, Y.; Wang, W.; Xie, B.; Sun, Q.; Wu, L.; Wang, X.; Huang, T.; Wang, X.; and Cao, Y. 2022. EVA: Exploring the Limits of Masked Visual Representation Learning at Scale. arXiv preprint arXiv:2211.07636

arXiv 2022