Pith. sign in

REVIEW 3 major objections 5 minor 189 references

Data-Efficient Challenges in Visual Inductive Priors: A Retrospective

T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash

Pith's one-line read Across four editions of data-deficient vision challenges, winners succeeded with large ensembles mixing CNNs and Transformers plus heavy data augmentation, not with novel prior-knowledge methods alone.

desk verdict Useful retrospective with honest limitations, but the headline claim about ensembling and augmentation is a pooled correlation that does not survive within-year inspection. read the letter →

arxiv 2506.08612 v1 pith:LUHQYQFJ submitted 2025-06-10 cs.CV

classification cs.CV
keywords data-efficientlearningvisualinductivepriorsmodelensemblesdataaugmentationTransformersCNNscomputervisionchallengesfrom-scratchtraining
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper reports on four editions of the VIPriors workshops, which challenged teams to train vision models from scratch on small datasets with transfer learning banned. Analyzing the submitted methods, it argues that the winning recipe in data-deficient settings is not novel prior-knowledge engineering but large ensembles that mix CNN and Transformer backbones plus heavy data augmentation. Novel prior-based methods did appear among winners, but only in combination with those standard techniques. The paper also finds that even the best entries lag comparable large-scale benchmarks by roughly fifteen percentage points, which it reads as evidence that data-efficient deep learning still needs work.

What carries the argument

The load-bearing instrument is the challenge protocol itself: models trained from scratch on a fixed small dataset, with transfer learning and outside data forbidden, evaluated on withheld test labels through CodaLab with limited submissions. Against that protocol, the paper's statistical analysis plots each entry's task score against the number of distinct backbone types in its ensemble and the number of data-augmentation methods used, fitting regression lines to show a rising correlation. The named pattern it uses to explain success is the 'CNN + Transformer' ensemble, described as covering a wider range of inductive priors than a single model.

What would settle it

Run one VIPriors task again with identical compute budgets and shared code libraries for all teams; if the top entries no longer use the largest ensembles, the claim that ensembling drives success is contradicted.

Watch

Extended reading notes

Core claim

The paper's central claim is that, in a setting where models must be trained from scratch on a few thousand samples, successful competition entries are characterized by large model ensembles mixing CNN and Transformer backbones and by heavy use of data augmentation. Across image classification, object detection, segmentation, action recognition, and re-identification, the correlations plotted against ensemble size and augmentation count rise with task score, and the winners in each task combine several backbone families with policy-based augmentations. The paper further claims that novel prior-knowledge methods contributed to only some winning entries and were effective only alongside ensembling and augmentation, and that data-deficient performance remains about fifteen points below large-scale benchmarks.

Load-bearing premise

The correlational claims assume each challenge entry is an independent, representative sample of method quality, so that the regression fits reflect a genuine relationship between ensemble size or augmentation count and performance rather than shared tooling, team skill, or compute budget.

Editorial extensions

If this is right

  • Winning entries across four editions improved year over year, showing progress in data-deficient training.
  • Ensemble diversity across architecture families is a reliable predictor of success in these challenges.
  • Heavy data augmentation is consistently used by successful entries across all five tasks.
  • Novel prior-based methods, while showcased by a jury prize, rarely succeed on their own; they combine with standard methods.
  • The roughly fifteen-point gap to large-scale benchmarks implies data-efficient learning remains an open problem.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The challenge rules may partly cause the result: banning transfer learning pushes competitors toward ensembling and augmentation, so the recipe's dominance may not generalize to settings where pretraining is allowed.
  • Ensembling and augmentation are themselves a form of prior knowledge: architectural diversity and data symmetries encode assumptions that the target task shares with generic vision; the paper notes augmentation as prior knowledge but stops short of this formulation.
  • A controlled comparison with equal compute per entrant would clarify whether the correlations reflect method quality or team resources; if compute were held fixed, the ensemble advantage might shrink.
  • A future challenge that scores entries by data efficiency, such as accuracy versus samples or compute, would likely reward prior-based methods more heavily.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This retrospective paper reports on the VIPriors workshop series, which organized four editions of data-deficient computer-vision challenges (image classification, object detection, segmentation, action recognition, re-identification) with the rule that models must be trained from scratch without transfer learning. The authors document the challenge designs, datasets, evaluation protocols, and full final rankings in the appendix, and they analyze the methods used by competitors. The central claim, stated in the abstract and conclusion, is that successful challenge entries make heavy use of model ensembles that mix Transformers and CNNs, together with large amounts of data augmentation, while novel prior-knowledge-based methods contributed to success in only a few entries. The paper also compares the challenge winners to large-scale benchmark leaders and reports a gap of roughly fifteen percentage points, which it interprets as evidence that data-efficient deep-learning research is still needed. The manuscript is honest about several limitations, including the small number of competitors, the use of deprecated datasets in 2020, and evidence that some competitors evaded evaluation limits.

Significance. If taken as a descriptive record of what winning teams actually did, this is a useful and reasonably complete retrospective: it provides the community with full rankings, method summaries, and openly stated limitations, and it does not involve any circularity or fitted parameters. The appendix tables are a valuable reference for future challenge organizers. The paper's main significance, however, rests on the general conclusion that ensembling and augmentation were the main contributors to success, and that claim currently goes beyond what the observational regressions in Section 5 can support. The authors deserve credit for making the raw entries available in the appendix and for acknowledging the small competitor pool and the deprecated 2020 data, but the causal phrasing of the central claim needs to be either supported by within-year analyses or softened to correlational language.

major comments (3)
  1. [Section 5.1 and Table 2] The regressions in Figures 4 and 5 are the main evidence for the abstract and conclusion that ensembling and data augmentation "contributed most to success" and that mixing Transformers and CNNs is "a recipe for success." These regressions pool entries across different years and, for object detection and segmentation, across non-comparable datasets and metrics (the 2020 COCO subset and MiniCity versus DelftBikes and SynergySports basketball, as described in Sections 3.2 and 3.3). Within individual years, the relationship is not stable: in Table 2, the 2022 image-classification winner used 5 model types and 3 augmentation types (78.7), the runner-up used 2 model types and 1 augmentation type (77.9), and the fourth-place entry used 10 model types (76.8); in 2021, the winner used a single architecture (ResNeSt) and scored 75.5, higher than the 2020 winner, which used 6 model types and scored 73.1. These examples show that the pooled positive slopes can be driven by year-to-year progress in architectures, libraries, and team experience rather than by a genuine within-year relationship. No significance tests, confidence intervals, or year controls are reported. I request that the authors either add within-year or year-stratified analyses, or reword the causal claims ("contributed most to success," "recipe for success") to descriptive statements about what successful entries tended to use, and explicitly note in Section 5 that compute budget, team resources, and recency are likely confounders.
  2. [Section 5.1 and Table 2] The claim that successful entries mix Transformers and CNNs is weakened by a factual inconsistency in the flagship example. Section 5.1 states that the winning image-classification entry (Ma et al., 2022) ensembled "both CNNs and Transformers," but Table 2 lists only SE+PyramidNet, ResNeSt200e, ReXNet, EfficientNet-B8, and ConvNeXt-XL, all of which are convolutional architectures; no Transformer is listed. If the entry included a Transformer, the table and the sentence should be aligned; if not, the sentence should be corrected. More generally, the abstract's phrasing "large model ensembles that mix Transformers and CNNs" is not true of every winning entry: the 2020 and 2021 image-classification winners used only CNNs, and the re-identification winner used only ResNet variants (Tables 2 and 6). The claim should be qualified to characterize many successful entries rather than the winning entries as a class.
  3. [Section 6 and Figure 1] The comparison in Figure 1 and the statement that "gaps of around fifteen percentage points" appear "in all challenges" is used to justify the need for further data-efficient learning research. The comparison is between the challenge winners and large-scale benchmark leaders, but the two settings differ not only in data volume but also in the no-transfer-learning rule and in the substantially larger compute and engineering resources available to leaderboard teams. The paper does acknowledge that fewer competitors may explain part of the gap, but it should also state that the gap is not a clean measure of data deficiency alone. This is not a fatal issue, but the wording "due to the difficulty of deep learning in a data-deficient setting" should be tempered to reflect the multiple confounds.
minor comments (5)
  1. [Section 5.4] The sentence "On KineticsVIPriors, only ensembles are used" appears to conflate the KineticsVIPriors editions (2021-2022) with the single-model entry in the 2020 UCF101 edition; please clarify that the statement refers to the Kinetics-based editions and that the 2020 edition is a separate setting.
  2. [Section 5.5] In the sentence "which could indicate that the our sample of competitors is biased in some way," remove the extra "the."
  3. [Section 3.2] The abbreviation "COC" is used for COCO without being defined; it should be expanded or replaced with "COCO" throughout for consistency.
  4. [Table 4] In the 2022 and 2023 segmentation rows, "Moasic" is a typo for "Mosaic." Please scan the appendix for similar spelling inconsistencies.
  5. [References] Several references appear in duplicate or near-duplicate form (e.g., Buslaev et al. 2020a/2020b, Cubuk et al. 2020a/2020b, He et al. 2015/2016, Izmailov et al. 2018a/2018b). A pass to merge or disambiguate these entries would improve readability.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the conclusions are empirical summaries of independently-run challenge outcomes, not derivations from fitted inputs.

full rationale

The paper makes no derivation that reduces to its own inputs. The central claims—that successful entries use large model ensembles, heavy data augmentation, and mixes of Transformers and CNNs—are read off from final rankings produced by independent competitors on the CodaLab platform and from the teams' technical reports. The evaluation scores are generated by an external platform with withheld test labels, and the method counts (number of model types, number of augmentation types) are coded from the entries themselves, so the outcome and the explanatory variable are not the same measurement. The regression fits in Figures 4 and 5 are descriptive summaries of the plotted entries, not predictions of held-out data; no parameter fitted from a subset is renamed as a prediction. The self-citations that appear, such as Bruintjes et al. (2021) for a backbone variant and Kayhan et al. (2021) for the DelftBikes dataset, are references to prior tools or datasets and are not load-bearing derivations for the paper's conclusions. The paper explicitly acknowledges limitations that weaken the observational conclusions—small numbers of competitors, possible evasion of evaluation limits via multiple accounts, and the use of deprecated 2020 datasets—but these are robustness concerns, not circularity. No equation, fitted parameter, or cited uniqueness result forces the paper's conclusions by construction.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

The paper introduces no free parameters or invented entities. Its conclusions depend on the comparability of entries across years and tasks and on the reliability of the challenge rankings, which are acknowledged as imperfect.

assumptions (2)
  • domain assumption Each challenge entry is an independent, representative sample of method performance.
    The correlational analyses in Section 5 and Figures 4-5 pool entries from different years, tasks, and datasets, with varying team resources and shared codebases, treating them as exchangeable data points.
  • domain assumption The challenge ranking scores are reliable despite possible evaluation-limit evasion.
    The paper notes in Section 4 that some competitors may have registered multiple CodaLab accounts to exceed evaluation limits; if widespread, rankings could be distorted.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Data-Efficient Challenges in Visual Inductive Priors: A Retrospective." pith.science (2026). https://pith.science/paper/LUHQYQFJ

@misc{pith2026250608612,
  author       = {Pith},
  title        = {Pith review of: Data-Efficient Challenges in Visual Inductive Priors: A Retrospective},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LUHQYQFJ}},
  note         = {Machine review of arXiv:2506.08612}
}
read the original abstract

Deep Learning requires large amounts of data to train models that work well. In data-deficient settings, performance can be degraded. We investigate which Deep Learning methods benefit training models in a data-deficient setting, by organizing the "VIPriors: Visual Inductive Priors for Data-Efficient Deep Learning" workshop series, featuring four editions of data-impaired challenges. These challenges address the problem of training deep learning models for computer vision tasks with limited data. Participants are limited to training models from scratch using a low number of training samples and are not allowed to use any form of transfer learning. We aim to stimulate the development of novel approaches that incorporate prior knowledge to improve the data efficiency of deep learning models. Successful challenge entries make use of large model ensembles that mix Transformers and CNNs, as well as heavy data augmentation. Novel prior knowledge-based methods contribute to success in some entries.

Figures

Figures reproduced from arXiv: 2506.08612 by the authors.

Figure 1
Figure 1. Comparing the winning entries in our challenges against those in corresponding large-scale bench [PITH_FULL_IMAGE:figures/full_fig_p002_1.png] view at source ↗
Figure 2
Figure 2. Example images from the a) DelftBikes and b) SynergySports Basketball dataset. [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 3
Figure 3. Results of all challenges. Most challenges show improvement in the best submissions year by year. [PITH_FULL_IMAGE:figures/full_fig_p006_3.png] view at source ↗
Figures from the paper (2 more)
Figure 4
Figure 4. Figure 4: Results of selected challenges plotted against the number of distinct backbone types used in each [PITH_FULL_IMAGE:figures/full_fig_p007_4.png]
Figure 5
Figure 5. Figure 5: Results of selected challenges plotted against the number of data augmentations used in each [PITH_FULL_IMAGE:figures/full_fig_p008_5.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

189 extracted references · 38 canonical work pages

  1. [1]

    https://cocodataset.org/

    Coco 2017 object detection task. https://cocodataset.org/. Accessed: 2024-07-10

  2. [2]

    Accessed: 2024-07-02

    Progressive sprinkles: A new data augmentation for cnn’s (and helps achieve new 98+ https://lessw.medium.com/progressive-sprinkles-a-new-data-augmentation-for-cnns-and-helps-achieve-new-98-nih-malaria-6056965f671a. Accessed: 2024-07-02

  3. [3]

    https://github.com/ultralytics/ultralytics

    G it H ub - ultralytics/ultralytics. https://github.com/ultralytics/ultralytics. [Accessed 13-06-2024]

  4. [4]

    Kaggle.com: Tiny imagenet

    Mohammed Ali. Kaggle.com: Tiny imagenet. https://kaggle.com/competitions/tiny-imagenet. Accessed: 2024-07-09

  5. [5]

    Deep learning on small datasets without pre-training using cosine loss

    Bjorn Barz and Joachim Denzler. Deep learning on small datasets without pre-training using cosine loss. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp.\ 1371--1380, 2020

  6. [6]

    Revisiting resnets: Improved training and scaling strategies

    Irwan Bello, William Fedus, Xianzhi Du, Ekin Dogus Cubuk, Aravind Srinivas, Tsung-Yi Lin, Jonathon Shlens, and Barret Zoph. Revisiting resnets: Improved training and scaling strategies. Advances in Neural Information Processing Systems, 34: 0 22614--22627, 2021

  7. [7]

    Is space-time attention all you need for video understanding? arXiv preprint arXiv:2102.05095, 2021

    Gedas Bertasius, Heng Wang, and Lorenzo Torresani. Is space-time attention all you need for video understanding? arXiv preprint arXiv:2102.05095, 2021

  8. [8]

    Yolov4: Optimal speed and accuracy of object detection, 2020

    Alexey Bochkovskiy, Chien-Yao Wang, and Hong-Yuan Mark Liao. Yolov4: Optimal speed and accuracy of object detection, 2020

Show all 189 references
  1. [9]

    Soft-nms--improving object detection with one line of code

    Navaneeth Bodla, Bharat Singh, Rama Chellappa, and Larry S Davis. Soft-nms--improving object detection with one line of code. In Proceedings of the IEEE international conference on computer vision, pp.\ 5561--5569, 2017

  2. [10]

    Tune it or don't use it: Benchmarking data-efficient image classification

    Lorenzo Brigato, Bj \"o rn Barz, Luca Iocchi, and Joachim Denzler. Tune it or don't use it: Benchmarking data-efficient image classification. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 1071--1080, 2021

  3. [11]

    Vipriors 1: Visual inductive priors for data-efficient deep learning challenges

    Robert-Jan Bruintjes, Attila Lengyel, Marcos Baptista Rios, Osman Semih Kayhan, and Jan van Gemert. Vipriors 1: Visual inductive priors for data-efficient deep learning challenges. arXiv preprint arXiv:2103.03768, 2021

  4. [13]

    Iglovikov, Eugene Khvedchenya, Alex Parinov, Mikhail Druzhinin, and Alexandr A

    Alexander Buslaev, Vladimir I. Iglovikov, Eugene Khvedchenya, Alex Parinov, Mikhail Druzhinin, and Alexandr A. Kalinin. Albumentations: Fast and flexible image augmentations. Information, 11 0 (2), 2020 b . ISSN 2078-2489. doi:10.3390/info11020125. URL https://www.mdpi.com/207...

  5. [14]

    Cascade r-cnn: Delving into high quality object detection

    Zhaowei Cai and Nuno Vasconcelos. Cascade r-cnn: Delving into high quality object detection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2018 a

  6. [15]

    Cascade r-cnn: Delving into high quality object detection

    Zhaowei Cai and Nuno Vasconcelos. Cascade r-cnn: Delving into high quality object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 6154--6162, 2018 b

  7. [16]

    Gcnet: Non-local networks meet squeeze-excitation networks and beyond

    Yue Cao, Jiarui Xu, Stephen Lin, Fangyun Wei, and Han Hu. Gcnet: Non-local networks meet squeeze-excitation networks and beyond. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshops, pp.\ 0--0, 2019

  8. [17]

    End-to-end object detection with transformers

    Nicolas Carion, Francisco Massa, Gabriel Synnaeve, Nicolas Usunier, Alexander Kirillov, and Sergey Zagoruyko. End-to-end object detection with transformers. In European conference on computer vision, pp.\ 213--229. Springer, 2020

  9. [18]

    Carreira and A

    J. Carreira and A. Zisserman . Quo vadis, action recognition? a new model and the kinetics dataset. In 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp.\ 4724--4733, 2017. doi:10.1109/CVPR.2017.502

  10. [19]

    2nd place scheme on action recognition track of eccv 2020 vipriors challenges: An efficient optical flow stream guided framework

    Haoyu Chen, Zitong Yu, Xin Liu, Wei Peng, Yoon Lee, and Guoying Zhao. 2nd place scheme on action recognition track of eccv 2020 vipriors challenges: An efficient optical flow stream guided framework. Jul 2020 a . URL https://openreview.net/forum?id=R6YWiPVOQBo

  11. [20]

    Hybrid task cascade for instance segmentation

    Kai Chen, Jiangmiao Pang, Jiaqi Wang, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jianping Shi, Wanli Ouyang, Chen Change Loy, and Dahua Lin. Hybrid task cascade for instance segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern...

  12. [21]

    Hybrid task cascade for instance segmentation

    Kai Chen, Jiangmiao Pang, Jiaqi Wang, Yu Xiong, Xiaoxiao Li, Shuyang Sun, Wansen Feng, Ziwei Liu, Jianping Shi, Wanli Ouyang, et al. Hybrid task cascade for instance segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 4974--...

  13. [22]

    Gridmask data augmentation, 2020 b

    Pengguang Chen, Shu Liu, Hengshuang Zhao, and Jiaya Jia. Gridmask data augmentation, 2020 b

  14. [23]

    Exploring simple siamese representation learning

    Xinlei Chen and Kaiming He. Exploring simple siamese representation learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 15750--15758, 2021

  15. [24]

    Improved baselines with momentum contrastive learning

    Xinlei Chen, Haoqi Fan, Ross Girshick, and Kaiming He. Improved baselines with momentum contrastive learning. arXiv preprint arXiv:2003.04297, 2020 c

  16. [25]

    An empirical study of training self-supervised vision transformers

    Xinlei Chen, Saining Xie, and Kaiming He. An empirical study of training self-supervised vision transformers. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 9640--9649, 2021

  17. [26]

    Stitcher: Feedback-driven data provider for object detection, 2020 d

    Yukang Chen, Peizhen Zhang, Zeming Li, Yanwei Li, Xiangyu Zhang, Gaofeng Meng, Shiming Xiang, Jian Sun, and Jiaya Jia. Stitcher: Feedback-driven data provider for object detection, 2020 d

  18. [27]

    Dual path networks

    Yunpeng Chen, Jianan Li, Huaxin Xiao, Xiaojie Jin, Shuicheng Yan, and Jiashi Feng. Dual path networks. Advances in neural information processing systems, 30, 2017

  19. [28]

    Vision transformer adapter for dense predictions

    Zhe Chen, Yuchen Duan, Wenhai Wang, Junjun He, Tong Lu, Jifeng Dai, and Yu Qiao. Vision transformer adapter for dense predictions. arXiv preprint arXiv:2205.08534, 2022

  20. [29]

    Masked-attention mask transformer for universal image segmentation

    Bowen Cheng, Ishan Misra, Alexander G Schwing, Alexander Kirillov, and Rohit Girdhar. Masked-attention mask transformer for universal image segmentation. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 1290--1299, 2022 a

  21. [30]

    Sparse instance activation for real-time instance segmentation

    Tianheng Cheng, Xinggang Wang, Shaoyu Chen, Wenqiang Zhang, Qian Zhang, Chang Huang, Zhaoxiang Zhang, and Wenyu Liu. Sparse instance activation for real-time instance segmentation. In Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), 2022 b

  22. [31]

    Kim, and Jaegul Choo

    Sungha Choi, Joanne T. Kim, and Jaegul Choo. Cars can't fly up in the sky: Improving urban-scene segmentation via height-driven attention networks, 2020

  23. [32]

    Total recall: Automatic query expansion with a generative feature model for object retrieval

    Ondrej Chum, James Philbin, Josef Sivic, Michael Isard, and Andrew Zisserman. Total recall: Automatic query expansion with a generative feature model for object retrieval. In 2007 IEEE 11th International Conference on Computer Vision, pp.\ 1--8. IEEE, 2007

  24. [33]

    The cityscapes dataset for semantic urban scene understanding

    Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler, Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele. The cityscapes dataset for semantic urban scene understanding. In Proceedings of the IEEE Conference on Computer Vision and Pattern Reco...

  25. [34]

    Autoaugment: Learning augmentation policies from data

    Ekin D Cubuk, Barret Zoph, Dandelion Mane, Vijay Vasudevan, and Quoc V Le. Autoaugment: Learning augmentation policies from data. arXiv preprint arXiv:1805.09501, 2018

  26. [35]

    Randaugment: Practical automated data augmentation with a reduced search space

    Ekin D Cubuk, Barret Zoph, Jonathon Shlens, and Quoc V Le. Randaugment: Practical automated data augmentation with a reduced search space. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp.\ 702--703, 2020 a

  27. [36]

    Randaugment: Practical automated data augmentation with a reduced search space

    Ekin Dogus Cubuk, Barret Zoph, Jon Shlens, and Quoc Le. Randaugment: Practical automated data augmentation with a reduced search space. In H. Larochelle, M. Ranzato, R. Hadsell, M. F. Balcan, and H. Lin (eds.), Advances in Neural Information Processing Systems, volume 33, pp.\...

  28. [37]

    Deformable convolutional networks

    Jifeng Dai, Haozhi Qi, Yuwen Xiong, Yi Li, Guodong Zhang, Han Hu, and Yichen Wei. Deformable convolutional networks. In Proceedings of the IEEE international conference on computer vision, pp.\ 764--773, 2017

  29. [38]

    Dave, Rohit Gupta, Mamshad Nayeem Rizve, and Mubarak Shah

    Ishan R. Dave, Rohit Gupta, Mamshad Nayeem Rizve, and Mubarak Shah. TCLR: temporal contrastive learning for video representation. arXiv preprint arXiv:2101.07974, 2021

  30. [39]

    Imagenet: A large-scale hierarchical image database

    Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. Imagenet: A large-scale hierarchical image database. In 2009 IEEE conference on computer vision and pattern recognition, pp.\ 248--255. Ieee, 2009

  31. [40]

    Arcface: Additive angular margin loss for deep face recognition

    Jiankang Deng, Jia Guo, Niannan Xue, and Stefanos Zafeiriou. Arcface: Additive angular margin loss for deep face recognition. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 4690--4699, 2019

  32. [41]

    Improved regularization of convolutional neural networks with cutout

    Terrance DeVries and Graham W Taylor. Improved regularization of convolutional neural networks with cutout. arXiv preprint arXiv:1708.04552, 2017

  33. [42]

    Multiscale vision transformers

    Haoqi Fan, Bo Xiong, Karttikeya Mangalam, Yanghao Li, Zhicheng Yan, Jitendra Malik, and Christoph Feichtenhofer. Multiscale vision transformers. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 2021

  34. [43]

    Instaboost: Boosting instance segmentation via probability map guided copy-pasting

    Hao-Shu Fang, Jianhua Sun, Runzhong Wang, Minghao Gou, Yong-Lu Li, and Cewu Lu. Instaboost: Boosting instance segmentation via probability map guided copy-pasting. In Proceedings of the IEEE International Conference on Computer Vision, pp.\ 682--691, 2019

  35. [44]

    Feichtenhofer , H

    C. Feichtenhofer , H. Fan , J. Malik , and K. He . Slowfast networks for video recognition. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp.\ 6201--6210, 2019. doi:10.1109/ICCV.2019.00630

  36. [46]

    Fernando , E

    B. Fernando , E. Gavves , J. Oramas M. , A. Ghodrati , and T. Tuytelaars . Rank pooling for action recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 39 0 (4): 0 773--787, 2017. doi:10.1109/TPAMI.2016.2558148

  37. [47]

    Res2net: A new multi-scale backbone architecture

    Shang-Hua Gao, Ming-Ming Cheng, Kai Zhao, Xin-Yu Zhang, Ming-Hsuan Yang, and Philip Torr. Res2net: A new multi-scale backbone architecture. IEEE transactions on pattern analysis and machine intelligence, 43 0 (2): 0 652--662, 2019

  38. [48]

    Yolox: Exceeding yolo series in 2021

    Zheng Ge, Songtao Liu, Feng Wang, Zeming Li, and Jian Sun. Yolox: Exceeding yolo series in 2021. arXiv preprint arXiv:2107.08430, 2021

  39. [49]

    Cubuk, Quoc V

    Golnaz Ghiasi, Yin Cui, Aravind Srinivas, Rui Qian, Tsung-Yi Lin, Ekin D. Cubuk, Quoc V. Le, and Barret Zoph. Simple copy-paste is a strong data augmentation method for instance segmentation. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.\ 2...

  40. [50]

    Rich feature hierarchies for accurate object detection and semantic segmentation

    Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. Rich feature hierarchies for accurate object detection and semantic segmentation. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 580--587, 2014

  41. [51]

    2nd place solution to eccv 2020 vipriors object detection challenge, 2020

    Yinzheng Gu, Yihan Pan, and Shizhe Chen. 2nd place solution to eccv 2020 vipriors object detection challenge, 2020

  42. [52]

    Rethinking channel dimensions for efficient model design

    Dongyoon Han, Sangdoo Yun, Byeongho Heo, and YoungJoon Yoo. Rethinking channel dimensions for efficient model design. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 732--741, 2021

  43. [53]

    Towards good practice for action recognition with spatiotemporal 3d convolutions

    Kensho Hara, Hirokatsu Kataoka, and Yutaka Satoh. Towards good practice for action recognition with spatiotemporal 3d convolutions. In 2018 24th International Conference on Pattern Recognition (ICPR), pp.\ 2516--2521, 2018. doi:10.1109/ICPR.2018.8546325

  44. [54]

    Deep residual learning for image recognition, 2015

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition, 2015

  45. [55]

    Deep residual learning for image recognition

    Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 770--778, 2016

  46. [56]

    Mask r-cnn

    Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. Mask r-cnn. In 2017 IEEE International Conference on Computer Vision (ICCV), pp.\ 2980--2988, 2017. doi:10.1109/ICCV.2017.322

  47. [57]

    Rethinking imagenet pre-training

    Kaiming He, Ross Girshick, and Piotr Doll \'a r. Rethinking imagenet pre-training. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 4918--4927, 2019

  48. [58]

    Momentum contrast for unsupervised visual representation learning

    Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick. Momentum contrast for unsupervised visual representation learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2020 a

  49. [59]

    Momentum contrast for unsupervised visual representation learning

    Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, and Ross Girshick. Momentum contrast for unsupervised visual representation learning. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.\ 9726--9735, 2020 b . doi:10.1109/CVPR42600.2020.00975

  50. [60]

    Bag of tricks for image classification with convolutional neural networks, 2018

    Tong He, Zhi Zhang, Hang Zhang, Zhongyue Zhang, Junyuan Xie, and Mu Li. Bag of tricks for image classification with convolutional neural networks, 2018

  51. [61]

    Cubuk, Barret Zoph, Justin Gilmer, and Balaji Lakshminarayanan

    Dan Hendrycks, Norman Mu, Ekin D. Cubuk, Barret Zoph, Justin Gilmer, and Balaji Lakshminarayanan. AugMix : A simple data processing method to improve robustness and uncertainty. Proceedings of the International Conference on Learning Representations (ICLR), 2020

  52. [62]

    In defense of the triplet loss for person re-identification

    Alexander Hermans, Lucas Beyer, and Bastian Leibe. In defense of the triplet loss for person re-identification. arXiv preprint arXiv:1703.07737, 2017

  53. [63]

    Learning curves for analysis of deep networks

    Derek Hoiem, Tanmay Gupta, Zhizhong Li, and Michal Shlapentokh-Rothman. Learning curves for analysis of deep networks. In International conference on machine learning, pp.\ 4287--4296. PMLR, 2021

  54. [64]

    Sspnet: Scale selection pyramid network for tiny person detection from uav images

    Mingbo Hong, Shuiwang Li, Yuchao Yang, Feiyu Zhu, Qijun Zhao, and Li Lu. Sspnet: Scale selection pyramid network for tiny person detection from uav images. IEEE Geoscience and Remote Sensing Letters, 19: 0 1--5, 2021

  55. [65]

    Searching for mobilenetv3

    Andrew Howard, Mark Sandler, Grace Chu, Liang-Chieh Chen, Bo Chen, Mingxing Tan, Weijun Wang, Yukun Zhu, Ruoming Pang, Vijay Vasudevan, et al. Searching for mobilenetv3. In Proceedings of the IEEE/CVF international conference on computer vision, pp.\ 1314--1324, 2019

  56. [66]

    Edge-preserving guided semantic segmentation for vipriors challenge

    Chih-Chung Hsu and Hsin-Ti Ma. Edge-preserving guided semantic segmentation for vipriors challenge. arXiv:2007.08919 [cs], Jul 2020. URL http://arxiv.org/abs/2007.08919. arXiv: 2007.08919

  57. [67]

    Squeeze-and-excitation networks

    Jie Hu, Li Shen, and Gang Sun. Squeeze-and-excitation networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 7132--7141, 2018

  58. [68]

    Deep networks with stochastic depth

    Gao Huang, Yu Sun, Zhuang Liu, Daniel Sedra, and Kilian Q Weinberger. Deep networks with stochastic depth. In European conference on computer vision, pp.\ 646--661. Springer, 2016

  59. [69]

    Mask scoring r-cnn

    Zhaojin Huang, Lichao Huang, Yongchao Gong, Chang Huang, and Xinggang Wang. Mask scoring r-cnn. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp.\ 6402--6411, 2019. doi:10.1109/CVPR.2019.00657

  60. [70]

    What makes imagenet good for transfer learning? arXiv preprint arXiv:1608.08614, 2016

    Minyoung Huh, Pulkit Agrawal, and Alexei A Efros. What makes imagenet good for transfer learning? arXiv preprint arXiv:1608.08614, 2016

  61. [71]

    “kallis” crcv vipriors challenge submission

    Kali Carter Ishan Dave and Mubarak Shah. “kallis” crcv vipriors challenge submission. Jul 2020

  62. [73]

    Vetrov, and Andrew Gordon Wilson

    Pavel Izmailov, Dmitrii Podoprikhin, Timur Garipov, Dmitry P. Vetrov, and Andrew Gordon Wilson. Averaging weights leads to wider optima and better generalization. CoRR, abs/1803.05407, 2018 b . URL http://arxiv.org/abs/1803.05407

  63. [74]

    Semask: Semantically masked transformers for semantic segmentation

    Jitesh Jain, Anukriti Singh, Nikita Orlov, Zilong Huang, Jiachen Li, Steven Walton, and Humphrey Shi. Semask: Semantically masked transformers for semantic segmentation. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 752--761, 2023

  64. [75]

    Glenn Jocher and et. al. Yolo v5. 2021. URL https://github.com/ ultralytics/yolov5

  65. [76]

    Alexander B. Jung. imgaug . https://github.com/aleju/imgaug, 2018. [Online; accessed 30-Oct-2018]

  66. [77]

    The kinetics human action video dataset

    Will Kay, Joao Carreira, Karen Simonyan, Brian Zhang, Chloe Hillier, Sudheendra Vijayanarasimhan, Fabio Viola, Tim Green, Trevor Back, Paul Natsev, Mustafa Suleyman, and Andrew Zisserman. The kinetics human action video dataset. arXiv preprint arXiv:1705.06950, 2017

  67. [78]

    Hallucination in object detection--a study in visual part verification

    Osman Semih Kayhan, Bart Vredebregt, and Jan C van Gemert. Hallucination in object detection--a study in visual part verification. arXiv preprint arXiv:2106.02523, 2021

  68. [79]

    Mask transfiner for high-quality instance segmentation

    Lei Ke, Martin Danelljan, Xia Li, Yu-Wing Tai, Chi-Keung Tang, and Fisher Yu. Mask transfiner for high-quality instance segmentation. In CVPR, 2022

  69. [80]

    Data-efficient deep learning method for image classification using data augmentation, focal cosine loss, and ensemble, 2020 a

    Byeongjo Kim, Chanran Kim, Jaehoon Lee, Jein Song, and Gyoungsoo Park. Data-efficient deep learning method for image classification using data augmentation, focal cosine loss, and ensemble, 2020 a

  70. [81]

    Learning temporally invariant and localizable features via data augmentation for video recognition

    Taeoh Kim, Hyeongmin Lee, MyeongAh Cho, Hoseong Lee, Dong heon Cho, and Sangyoun Lee. Learning temporally invariant and localizable features via data augmentation for video recognition. Jul 2020 b . URL https://openreview.net/forum?id=tqz0rQvz_58

  71. [82]

    Augmentation for small object detection

    Mate Kisantal, Zbigniew Wojna, Jakub Murawski, Jacek Naruniec, and Kyunghyun Cho. Augmentation for small object detection. arXiv preprint arXiv:1902.07296, 2019

  72. [83]

    Everything you need to know about few-shot learning

    Rohit Kundu. Everything you need to know about few-shot learning. https://blog.paperspace.com/few-shot-learning/. Accessed: 2024-07-09

  73. [84]

    Selective kernel networks

    Xiang Li, Wenhai Wang, Xiaolin Hu, and Jian Yang. Selective kernel networks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 510--519, 2019

  74. [86]

    Cbnetv2: A composite backbone network architecture for object detection

    Tingting Liang, Xiaojie Chu, Yudong Liu, Yongtao Wang, Zhi Tang, Wei Chu, Jingdong Chen, and Haibing Ling. Cbnetv2: A composite backbone network architecture for object detection. arXiv preprint arXiv:2107.00420, 2021 b

  75. [87]

    J. Lin , C. Gan , and S. Han . Tsm: Temporal shift module for efficient video understanding. In 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp.\ 7082--7092, 2019. doi:10.1109/ICCV.2019.00718

  76. [88]

    Feature pyramid networks for object detection, 2017 a

    Tsung-Yi Lin, Piotr Dollár, Ross Girshick, Kaiming He, Bharath Hariharan, and Serge Belongie. Feature pyramid networks for object detection, 2017 a

  77. [89]

    Focal loss for dense object detection

    Tsung-Yi Lin, Priya Goyal, Ross Girshick, Kaiming He, and Piotr Doll \'a r. Focal loss for dense object detection. In Proceedings of the IEEE international conference on computer vision, pp.\ 2980--2988, 2017 b

  78. [90]

    Diversification is all you need: Towards data efficient image understanding

    Qingfeng Liu, Behnam Babagholami Mohamadabadi, Mostafa El-Khamy, and Jungwon Lee. Diversification is all you need: Towards data efficient image understanding. Jul 2020 a . URL https://openreview.net/forum?id=UPbbSsBzfEW

  79. [91]

    Multi-scale methods

    Wing Kam Liu, Su Hao, Ted Belytschko, Shaofan Li, and Chin Tang Chang. Multi-scale methods. International Journal for Numerical Methods in Engineering, 47 0 (7): 0 1343--1361, 2000

  80. [92]

    Cbnet: A novel composite backbone network architecture for object detection

    Yudong Liu, Yongtao Wang, Siwei Wang, TingTing Liang, Qijie Zhao, Zhi Tang, and Haibin Ling. Cbnet: A novel composite backbone network architecture for object detection. In Proceedings of the AAAI conference on artificial intelligence, volume 34, pp.\ 11653--11660, 2020 b

  81. [93]

    Swin transformer: Hierarchical vision transformer using shifted windows

    Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. Swin transformer: Hierarchical vision transformer using shifted windows. International Conference on Computer Vision (ICCV), 2021 a

  82. [94]

    Video swin transformer

    Ze Liu, Jia Ning, Yue Cao, Yixuan Wei, Zheng Zhang, Stephen Lin, and Han Hu. Video swin transformer. arXiv preprint arXiv:2106.13230, 2021 b

  83. [95]

    Tanet: Robust 3d object detection from point clouds with triple attention

    Zhe Liu, Xin Zhao, Tengteng Huang, Ruolan Hu, Yu Zhou, and Xiang Bai. Tanet: Robust 3d object detection from point clouds with triple attention. AAAI, 2020 c . URL https://arxiv.org/pdf/1912.05163.pdf

  84. [96]

    A convnet for the 2020s

    Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, and Saining Xie. A convnet for the 2020s. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022

  85. [97]

    Unveiling the power of mixup for stronger classifiers

    Zicheng Liu, Siyuan Li, Di Wu, Zhiyuan Chen, Lirong Wu, Jianzhu Guo, and Stan Z Li. Unveiling the power of mixup for stronger classifiers. arXiv preprint arXiv:2103.13027, 2021 c

  86. [98]

    Vipriors object detection challenge, 2020

    Zhipeng Luo and Lixuan Che. Vipriors object detection challenge, 2020

  87. [99]

    A technical report for vipriors image classification challenge, 2020

    Zhipeng Luo, Ge Li, and Zhiguang Zhang. A technical report for vipriors image classification challenge, 2020

  88. [100]

    Curvature-balanced feature manifold learning for long-tailed classification

    Yanbiao Ma, Licheng Jiao, Fang Liu, Shuyuan Yang, Xu Liu, and Lingling Li. Curvature-balanced feature manifold learning for long-tailed classification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 15824--15835, 2023

  89. [101]

    Test-time augmentation for deep learning-based cell segmentation on microscopy images

    Nikita Moshkov, Botond Mathe, Attila Kertesz-Farkas, Reka Hollandi, and Peter Horvath. Test-time augmentation for deep learning-based cell segmentation on microscopy images. Scientific reports, 10 0 (1): 0 5068, 2020

  90. [102]

    When does label smoothing help? arXiv preprint arXiv:1906.02629, 2019

    Rafael M \"u ller, Simon Kornblith, and Geoffrey Hinton. When does label smoothing help? arXiv preprint arXiv:1906.02629, 2019

  91. [103]

    Semi-supervised transformer with fpn for bikes parts detection

    Junhao Niu, Yu Gu, Luyao Nie, and Chao You. Semi-supervised transformer with fpn for bikes parts detection. 2021

  92. [104]

    Libra r-cnn: Towards balanced learning for object detection, 2019

    Jiangmiao Pang, Kai Chen, Jianping Shi, Huajun Feng, Wanli Ouyang, and Dahua Lin. Libra r-cnn: Towards balanced learning for object detection, 2019

  93. [105]

    u diger G \

    Magdalini Paschali, Walter Simson, Abhijit Guha Roy, R \"u diger G \"o bl, Christian Wachinger, and Nassir Navab. Manifold exploring data augmentation with geometric transformations for increased performance and robustness. In Information Processing in Medical Imaging: 26th In...

  94. [106]

    Codalab competitions: An open source platform to organize scientific challenges

    Adrien Pavao, Isabelle Guyon, Anne-Catherine Letournel, Dinh-Tuan Tran, Xavier Baro, Hugo Jair Escalante, Sergio Escalera, Tyler Thomas, and Zhen Xu. Codalab competitions: An open source platform to organize scientific challenges. Journal of Machine Learning Research, 24 0 (19...

  95. [107]

    A unified view of masked image modeling

    Zhiliang Peng, Li Dong, Hangbo Bao, Qixiang Ye, and Furu Wei. A unified view of masked image modeling. arXiv preprint arXiv:2210.10615, 2022

  96. [108]

    Data-efficient semantic segmentation via extremely perturbed data augmentation

    Rafal Pytel and Tomasz Motyka. Data-efficient semantic segmentation via extremely perturbed data augmentation. Jul 2020. URL https://vipriors.github.io/assets/downloads/Data-efficient\_semantic\_segmentation\_via\_extremely\_perturbed\_data\_augmentation.pdf

  97. [109]

    Detectors: Detecting objects with recursive feature pyramid and switchable atrous convolution, 2020

    Siyuan Qiao, Liang-Chieh Chen, and Alan Yuille. Detectors: Detecting objects with recursive feature pyramid and switchable atrous convolution, 2020

  98. [110]

    Diversification is all you need : Towards data efficient image understanding

    Mostafa El-Khamy Qingfeng Liu, Behnam Babagholami Mohamadabadi and Jungwon Lee. Diversification is all you need : Towards data efficient image understanding. 2020. URL https://openreview.net/forum?id=UPbbSsBzfEW

  99. [111]

    Designing network design spaces

    Ilija Radosavovic, Raj Prateek Kosaraju, Ross Girshick, Kaiming He, and Piotr Doll \'a r. Designing network design spaces. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 10428--10436, 2020

  100. [112]

    You only look once: Unified, real-time object detection

    Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 779--788, 2016

  101. [113]

    Faster r-cnn: Towards real-time object detection with region proposal networks, 2016

    Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. Faster r-cnn: Towards real-time object detection with region proposal networks, 2016

  102. [114]

    Generalized intersection over union: A metric and a loss for bounding box regression

    Hamid Rezatofighi, Nathan Tsoi, JunYoung Gwak, Amir Sadeghian, Ian Reid, and Silvio Savarese. Generalized intersection over union: A metric and a loss for bounding box regression. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 658--666, 2019

  103. [115]

    Tresnet: High performance gpu-dedicated architecture

    Tal Ridnik, Hussam Lawen, Asaf Noy, Emanuel Ben Baruch, Gilad Sharir, and Itamar Friedman. Tresnet: High performance gpu-dedicated architecture. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pp.\ 1400--1409, 2021

  104. [116]

    Weighted boxes fusion: Ensembling boxes from different object detection models

    Weimin Wang Roman Solovyev and Tatiana Gabruseva. Weighted boxes fusion: Ensembling boxes from different object detection models. Image and Vision Computing, 107: 0 104117, 2021

  105. [117]

    U-net: Convolutional networks for biomedical image segmentation

    Olaf Ronneberger, Philipp Fischer, and Thomas Brox. U-net: Convolutional networks for biomedical image segmentation. In Nassir Navab, Joachim Hornegger, William M. Wells, and Alejandro F. Frangi (eds.), Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2015,...

  106. [118]

    Berg, and Li Fei-Fei

    Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. ImageNet Large Scale Visual Recognition Challenge . International Journal of Computer Vision (IJ...

  107. [119]

    Green ai

    Roy Schwartz, Jesse Dodge, Noah A Smith, and Oren Etzioni. Green ai. Communications of the ACM, 63 0 (12): 0 54--63, 2020

  108. [120]

    Temporal interlacing network

    Hao Shao, Shengju Qian, and Yu Liu. Temporal interlacing network. AAAI, 2020

  109. [121]

    A competitive method to vipriors object detection challenge

    Fei Shen, Xin He, Mengwan Wei, and Yi Xie. A competitive method to vipriors object detection challenge. Technical report, Huaqiao University, Wuhan University Of Technology, 2020

  110. [122]

    Training region-based object detectors with online hard example mining

    Abhinav Shrivastava, Abhinav Gupta, and Ross Girshick. Training region-based object detectors with online hard example mining. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 2016

  111. [123]

    Weighted boxes fusion: Ensembling boxes from different object detection models

    Roman Solovyev, Weimin Wang, and Tatiana Gabruseva. Weighted boxes fusion: Ensembling boxes from different object detection models. Image and Vision Computing, pp.\ 104117, Feb 2021. ISSN 0262-8856. doi:10.1016/j.imavis.2021.104117. URL http://dx.doi.org/10.1016/j.imavis.2021.104117

  112. [124]

    Revisiting the sibling head in object detector, 2020

    Guanglu Song, Yu Liu, and Xiaogang Wang. Revisiting the sibling head in object detector, 2020

  113. [125]

    Ucf101: A dataset of 101 human actions classes from videos in the wild

    Khurram Soomro, Amir Roshan Zamir, and Mubarak Shah. Ucf101: A dataset of 101 human actions classes from videos in the wild. arXiv preprint arXiv:1212.0402, 2012

  114. [126]

    Dropout: A simple way to prevent neural networks from overfitting

    Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 15 0 (56): 0 1929--1958, 2014. URL http://jmlr.org/papers/v15/srivastava14a.html

  115. [127]

    Energy and policy considerations for modern deep learning research

    Emma Strubell, Ananya Ganesh, and Andrew McCallum. Energy and policy considerations for modern deep learning research. In Proceedings of the AAAI conference on artificial intelligence, volume 34, pp.\ 13693--13696, 2020

  116. [128]

    A visual inductive priors framework for data-efficient image classification

    Pengfei Sun, Xuan Jin, Wei Su, Yuan He, Hui Xue, and Quan Lu. A visual inductive priors framework for data-efficient image classification. In European Conference on Computer Vision Workshops, pp.\ 511--520. Springer, 2020 a

  117. [129]

    Circle loss: A unified perspective of pair similarity optimization

    Yifan Sun, Changmao Cheng, Yuhan Zhang, Chi Zhang, Liang Zheng, Zhongdao Wang, and Yichen Wei. Circle loss: A unified perspective of pair similarity optimization. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 6398--6407, 2020 b

  118. [130]

    Rethinking the inception architecture for computer vision

    Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jon Shlens, and Zbigniew Wojna. Rethinking the inception architecture for computer vision. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 2818--2826, 2016

  119. [131]

    Inception-v4, inception-resnet and the impact of residual connections on learning

    Christian Szegedy, Sergey Ioffe, Vincent Vanhoucke, and Alexander A Alemi. Inception-v4, inception-resnet and the impact of residual connections on learning. In Thirty-first AAAI conference on artificial intelligence, 2017

  120. [132]

    Efficientnet: Rethinking model scaling for convolutional neural networks

    Mingxing Tan and Quoc Le. Efficientnet: Rethinking model scaling for convolutional neural networks. In International Conference on Machine Learning, pp.\ 6105--6114. PMLR, 2019

  121. [133]

    Efficientnetv2: Smaller models and faster training

    Mingxing Tan and Quoc Le. Efficientnetv2: Smaller models and faster training. In International conference on machine learning, pp.\ 10096--10106. PMLR, 2021

  122. [134]

    Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results

    Antti Tarvainen and Harri Valpola. Mean teachers are better role models: Weight-averaged consistency targets improve semi-supervised deep learning results. arXiv preprint arXiv:1703.01780, 2017

  123. [135]

    Designing bert for convolutional networks: Sparse and hierarchical masked modeling

    Keyu Tian, Yi Jiang, Qishuai Diao, Chen Lin, Liwei Wang, and Zehuan Yuan. Designing bert for convolutional networks: Sparse and hierarchical masked modeling. arXiv preprint arXiv:2301.03580, 2023

  124. [136]

    Video MAE : Masked autoencoders are data-efficient learners for self-supervised video pre-training

    Zhan Tong, Yibing Song, Jue Wang, and Limin Wang. Video MAE : Masked autoencoders are data-efficient learners for self-supervised video pre-training. In Advances in Neural Information Processing Systems, 2022

  125. [137]

    Tran , L

    D. Tran , L. Bourdev , R. Fergus , L. Torresani , and M. Paluri . Learning spatiotemporal features with 3d convolutional networks. In 2015 IEEE International Conference on Computer Vision (ICCV), pp.\ 4489--4497, 2015. doi:10.1109/ICCV.2015.510

  126. [138]

    Tran , H

    D. Tran , H. Wang , L. Torresani , J. Ray , Y. LeCun , and M. Paluri . A closer look at spatiotemporal convolutions for action recognition. In 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 6450--6459, 2018. doi:10.1109/CVPR.2018.00675

  127. [139]

    Video classification with channel-separated convolutional networks

    Du Tran, Heng Wang, Lorenzo Torresani, and Matt Feiszli. Video classification with channel-separated convolutional networks. CoRR, abs/1904.02811, 2019. URL http://arxiv.org/abs/1904.02811

  128. [140]

    Direcformer: A directed attention in transformer approach to robust action recognition

    Thanh-Dat Truong, Quoc-Huy Bui, Chi Nhan Duong, Han-Seok Seo, Son Lam Phung, Xin Li, and Khoa Luu. Direcformer: A directed attention in transformer approach to robust action recognition. In Computer Vision and Pattern Recognition, 2022

  129. [141]

    A metric and a loss for bounding box regression

    Generalized Intersection Over Union. A metric and a loss for bounding box regression. In Rezatofighi, N. Tsoi, J. Gwak, A. Sadeghian, I. Reid, S. Savarese//IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, pp.\ 658--666, 2019

  130. [142]

    Matching networks for one shot learning

    Oriol Vinyals, Charles Blundell, Timothy Lillicrap, Daan Wierstra, et al. Matching networks for one shot learning. Advances in neural information processing systems, 29, 2016

  131. [143]

    Scnet: Training inference sample consistency for instance segmentation

    Thang Vu, Kang Haeyong, and Chang D Yoo. Scnet: Training inference sample consistency for instance segmentation. In AAAI, 2021

  132. [144]

    Nbdt: neural-backed decision trees

    Alvin Wan, Lisa Dunlap, Daniel Ho, Jihan Yin, Scott Lee, Henry Jin, Suzanne Petryk, Sarah Adel Bargal, and Joseph E Gonzalez. Nbdt: neural-backed decision trees. arXiv preprint arXiv:2004.00221, 2020

  133. [145]

    Scaled-yolov4: Scaling cross stage partial network

    Chien-Yao Wang, Alexey Bochkovskiy, and Hong-Yuan Mark Liao. Scaled-yolov4: Scaling cross stage partial network. In Proceedings of the IEEE/cvf conference on computer vision and pattern recognition, pp.\ 13029--13038, 2021 a

  134. [147]

    You only learn one representation: Unified network for multiple tasks

    Chien-Yao Wang, I-Hau Yeh, and Hong-Yuan Mark Liao. You only learn one representation: Unified network for multiple tasks. arXiv preprint arXiv:2105.04206, 2021 c

  135. [148]

    Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors

    Chien-Yao Wang, Alexey Bochkovskiy, and Hong-Yuan Mark Liao. Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv preprint arXiv:2207.02696, 2022

  136. [149]

    Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors

    Chien-Yao Wang, Alexey Bochkovskiy, and Hong-Yuan Mark Liao. Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 7464--7475, 2023 a

  137. [150]

    Region proposal by guided anchoring, 2019 a

    Jiaqi Wang, Kai Chen, Shuo Yang, Chen Change Loy, and Dahua Lin. Region proposal by guided anchoring, 2019 a

  138. [151]

    Seesaw loss for long-tailed instance segmentation

    Jiaqi Wang, Wenwei Zhang, Yuhang Zang, Yuhang Cao, Jiangmiao Pang, Tao Gong, Kai Chen, Ziwei Liu, Chen Change Loy, and Dahua Lin. Seesaw loss for long-tailed instance segmentation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp....

  139. [152]

    Deep high-resolution representation learning for visual recognition

    Jingdong Wang, Ke Sun, Tianheng Cheng, Borui Jiang, Chaorui Deng, Yang Zhao, Dong Liu, Yadong Mu, Mingkui Tan, Xinggang Wang, Wenyu Liu, and Bin Xiao. Deep high-resolution representation learning for visual recognition. CoRR, abs/1908.07919, 2019 b . URL http://arxiv.org/abs/1...

  140. [153]

    Temporal segment networks: Towards good practices for deep action recognition

    Limin Wang, Yuanjun Xiong, Zhe Wang, Yu Qiao, Dahua Lin, Xiaoou Tang, and Luc Van Gool. Temporal segment networks: Towards good practices for deep action recognition. volume 9912, 10 2016

  141. [154]

    Pyramid vision transformer: A versatile backbone for dense prediction without convolutions

    Wenhai Wang, Enze Xie, Xiang Li, Deng-Ping Fan, Kaitao Song, Ding Liang, Tong Lu, Ping Luo, and Ling Shao. Pyramid vision transformer: A versatile backbone for dense prediction without convolutions. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp...

  142. [155]

    Internimage: Exploring large-scale vision foundation models with deformable convolutions

    Wenhai Wang, Jifeng Dai, Zhe Chen, Zhenhang Huang, Zhiqi Li, Xizhou Zhu, Xiaowei Hu, Tong Lu, Lewei Lu, Hongsheng Li, et al. Internimage: Exploring large-scale vision foundation models with deformable convolutions. In Proceedings of the IEEE/CVF Conference on Computer Vision a...

  143. [156]

    Generalizing from a few examples: A survey on few-shot learning

    Yaqing Wang, Quanming Yao, James T Kwok, and Lionel M Ni. Generalizing from a few examples: A survey on few-shot learning. ACM computing surveys (csur), 53 0 (3): 0 1--34, 2020

  144. [157]

    Symmetric cross entropy for robust learning with noisy labels

    Yisen Wang, Xingjun Ma, Zaiyi Chen, Yuan Luo, Jinfeng Yi, and James Bailey. Symmetric cross entropy for robust learning with noisy labels. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 322--330, 2019 c

  145. [158]

    Michael L. Waskom. seaborn: statistical data visualization. Journal of Open Source Software, 6 0 (60): 0 3021, 2021. doi:10.21105/joss.03021. URL https://doi.org/10.21105/joss.03021

  146. [159]

    Distance metric learning for large margin nearest neighbor classification

    Kilian Q Weinberger and Lawrence K Saul. Distance metric learning for large margin nearest neighbor classification. Journal of machine learning research, 10 0 (2), 2009

  147. [160]

    Multi-level tail pixel cutmix and scale attention for long-tailed scene parsing

    Chen Weitao and Wang Zhibing. Multi-level tail pixel cutmix and scale attention for long-tailed scene parsing. Jul 2020. URL https://openreview.net/forum?id=GHaQlkoNM-p

  148. [161]

    A discriminative feature learning approach for deep face recognition

    Yandong Wen, Kaipeng Zhang, Zhifeng Li, and Yu Qiao. A discriminative feature learning approach for deep face recognition. In European conference on computer vision, pp.\ 499--515. Springer, 2016

  149. [162]

    Convnext v2: Co-designing and scaling convnets with masked autoencoders

    Sanghyun Woo, Shoubhik Debnath, Ronghang Hu, Xinlei Chen, Zhuang Liu, In So Kweon, and Saining Xie. Convnext v2: Co-designing and scaling convnets with masked autoencoders. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 16133--16142, 2023

  150. [163]

    Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time

    Mitchell Wortsman, Gabriel Ilharco, Samir Ya Gadre, Rebecca Roelofs, Raphael Gontijo-Lopes, Ari S Morcos, Hongseok Namkoong, Ali Farhadi, Yair Carmon, Simon Kornblith, et al. Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing infe...

  151. [164]

    Group normalization

    Yuxin Wu and Kaiming He. Group normalization. In ECCV, 2018

  152. [165]

    Segformer: Simple and efficient design for semantic segmentation with transformers

    Enze Xie, Wenhai Wang, Zhiding Yu, Anima Anandkumar, Jose M Alvarez, and Ping Luo. Segformer: Simple and efficient design for semantic segmentation with transformers. Advances in neural information processing systems, 34: 0 12077--12090, 2021 a

  153. [166]

    Aggregated residual transformations for deep neural networks

    Saining Xie, Ross Girshick, Piotr Doll \'a r, Zhuowen Tu, and Kaiming He. Aggregated residual transformations for deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 1492--1500, 2017

  154. [167]

    Self-supervised learning with swin transformers

    Zhenda Xie, Yutong Lin, Zhuliang Yao, Zheng Zhang, Qi Dai, Yue Cao, and Han Hu. Self-supervised learning with swin transformers. arXiv preprint arXiv:2105.04553, 2021 b

  155. [168]

    Simmim: A simple framework for masked image modeling

    Zhenda Xie, Zheng Zhang, Yue Cao, Yutong Lin, Jianmin Bao, Zhuliang Yao, Qi Dai, and Han Hu. Simmim: A simple framework for masked image modeling. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 9653--9663, 2022

  156. [169]

    The second place solution for iccv2021 vipriors instance segmentation challenge, 2021

    Bo Yan, Fengliang Qi, Leilei Cao, and Hongbin Wang. The second place solution for iccv2021 vipriors instance segmentation challenge, 2021

  157. [170]

    Task-specific data augmentation and inference processing for vipriors instance segmentation challenge

    Bo Yan, Xingran Zhao, Yadong Li, and Hongbin Wang. Task-specific data augmentation and inference processing for vipriors instance segmentation challenge. 2022. URL https://arxiv.org/abs/2211.11282

  158. [171]

    Temporal pyramid network for action recognition

    Ceyuan Yang, Yinghao Xu, Jianping Shi, Bo Dai, and Bolei Zhou. Temporal pyramid network for action recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020

  159. [172]

    Swalp: Stochastic weight averaging in low precision training

    Guandao Yang, Tianyi Zhang, Polina Kirichenko, Junwen Bai, Andrew Gordon Wilson, and Chris De Sa. Swalp: Stochastic weight averaging in low precision training. In International Conference on Machine Learning, pp.\ 7015--7024. PMLR, 2019

  160. [173]

    Sahin, and Gozde Unal

    Vahit Bugra Yesilkaynak, Yusuf H. Sahin, and Gozde Unal. Efficientseg: An efficient semantic segmentation network. arXiv:2009.06469 [cs], Oct 2020. URL http://arxiv.org/abs/2009.06469. arXiv: 2009.06469

  161. [174]

    Object-contextual representations for semantic segmentation

    Yuhui Yuan, Xilin Chen, and Jingdong Wang. Object-contextual representations for semantic segmentation. CoRR, abs/1909.11065, 2019. URL http://arxiv.org/abs/1909.11065

  162. [175]

    Cutmix: Regularization strategy to train strong classifiers with localizable features

    Sangdoo Yun, Dongyoon Han, Seong Joon Oh, Sanghyuk Chun, Junsuk Choe, and Youngjoon Yoo. Cutmix: Regularization strategy to train strong classifiers with localizable features. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pp.\ 6023--6032, 2019

  163. [176]

    Instance segmentation challenge track technical report, vipriors workshop at iccv 2021: Task-specific copy-paste data augmentation method for instance segmentation, 2021

    Jahongir Yunusov, Shohruh Rakhmatov, Abdulaziz Namozov, Abdulaziz Gaybulayev, and Tae-Hyong Kim. Instance segmentation challenge track technical report, vipriors workshop at iccv 2021: Task-specific copy-paste data augmentation method for instance segmentation, 2021

  164. [177]

    o rr, and Bernd J \

    C. Zach, T. Pock, and H. Bischof. A duality based approach for realtime tv-l1 optical flow. In Fred A. Hamprecht, Christoph Schn \"o rr, and Bernd J \"a hne (eds.), Pattern Recognition, pp.\ 214--223, Berlin, Heidelberg, 2007. Springer Berlin Heidelberg. ISBN 978-3-540-74936-3

  165. [178]

    Manmatha, Mu Li, and Alexander Smola

    Hang Zhang, Chongruo Wu, Zhongyue Zhang, Yi Zhu, Haibin Lin, Zhi Zhang, Yue Sun, Tong He, Jonas Mueller, R. Manmatha, Mu Li, and Alexander Smola. Resnest: Split-attention networks, 2020 a

  166. [179]

    Swa object detection

    Haoyang Zhang, Ying Wang, Feras Dayoub, and Niko S \"u nderhauf. Swa object detection. arXiv preprint arXiv:2012.12645, 2020 b

  167. [180]

    Dauphin, and David Lopez-Paz

    Hongyi Zhang, Moustapha Cisse, Yann N. Dauphin, and David Lopez-Paz. mixup: Beyond empirical risk minimization. In International Conference on Learning Representations, 2018. URL https://openreview.net/forum?id=r1Ddp1-Rb

  168. [181]

    Making convolutional networks shift-invariant again

    Richard Zhang. Making convolutional networks shift-invariant again. In ICML, 2019

  169. [182]

    Distilling visual priors from self-supervised learning

    Bingchen Zhao and Xin Wen. Distilling visual priors from self-supervised learning. In European Conference on Computer Vision Workshops, pp.\ 422--429. Springer, 2020

  170. [183]

    Decoupled knowledge distillation

    Borui Zhao, Quan Cui, Renjie Song, Yiyu Qiu, and Jiajun Liang. Decoupled knowledge distillation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 11953--11962, 2022

  171. [184]

    Re-ranking person re-identification with k-reciprocal encoding

    Zhun Zhong, Liang Zheng, Donglin Cao, and Shaozi Li. Re-ranking person re-identification with k-reciprocal encoding. In Proceedings of the IEEE conference on computer vision and pattern recognition, pp.\ 1318--1327, 2017

  172. [185]

    Random erasing data augmentation

    Zhun Zhong, Liang Zheng, Guoliang Kang, Shaozi Li, and Yi Yang. Random erasing data augmentation. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 34, pp.\ 13001--13008, 2020

  173. [186]

    Cad: Scale invariant framework for real-time object detection

    Huajun Zhou, Zechao Li, Chengcheng Ning, and Jinhui Tang. Cad: Scale invariant framework for real-time object detection. In Proceedings of the IEEE international conference on computer vision workshops, pp.\ 760--768, 2017

  174. [187]

    Yolov5-ge vehicle detection algorithm integrating global attention mechanism

    Song Zhou, Yueling Zhao, and Dong Guo. Yolov5-ge vehicle detection algorithm integrating global attention mechanism. 2022 3rd International Conference on Information Science, Parallel and Distributed Systems (ISPDS), pp.\ 439--444, 2022. URL https://api.semanticscholar.org/Cor...

  175. [188]

    Scratchdet: Training single-shot object detectors from scratch

    Rui Zhu, Shifeng Zhang, Xiaobo Wang, Longyin Wen, Hailin Shi, Liefeng Bo, and Tao Mei. Scratchdet: Training single-shot object detectors from scratch. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp.\ 2268--2277, 2019 a

  176. [189]

    An empirical study of spatial attention mechanisms in deep networks, 2019 b

    Xizhou Zhu, Dazhi Cheng, Zheng Zhang, Stephen Lin, and Jifeng Dai. An empirical study of spatial attention mechanisms in deep networks, 2019 b

  177. [190]

    Deformable convnets v2: More deformable, better results

    Xizhou Zhu, Han Hu, Stephen Lin, and Jifeng Dai. Deformable convnets v2: More deformable, better results. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp.\ 9308--9316, 2019 c

  178. [191]

    Cubuk, Golnaz Ghiasi, Tsung-Yi Lin, Jonathon Shlens, and Quoc V

    Barret Zoph, Ekin D. Cubuk, Golnaz Ghiasi, Tsung-Yi Lin, Jonathon Shlens, and Quoc V. Le. Learning data augmentation strategies for object detection, 2019

  179. [192]

    , " * write output.state after.block = add.period write

    ENTRY address author booktitle chapter doi edition editor eid howpublished institution journal key month note number organization pages publisher school series title type url volume year label INTEGERS output.state before.all mid.sentence after.sentence after.block FUNCTION in...

  180. [193]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...

  181. [194]

    write newline

    " write newline "" before.all 'output.state := FUNCTION n.dashify 't := "" t empty not t #1 #1 substring "-" = t #1 #2 substring "--" = not "--" * t #2 global.max substring 't := t #1 #1 substring "-" = "-" * t #2 global.max substring 't := while if t #1 #1 substring * t #2 gl...

Pith tools

Reviewed August 7, 2026 · model on record in the stance chip above.