Generalizing vision-language models to novel domains: A comprehensive survey

Fengling Li; Heng Tao Shen; Jingjing Li; Lei Zhu; Xinyao Li; Yang Yang

REVIEW 4 major objections 5 minor 1 cited by

Generalizing vision-language models to novel domains: A comprehensive survey

T0 review · 4 major / 5 minor · reviewed 2026-08-06 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗

Pith's one-line read This survey claims to be the first comprehensive review of knowledge transfer in vision-language models, organizing the field's methods into prompt-based, parameter-based, and feature-based families, and comparing them on standard…

desk verdict A useful survey with a solid taxonomy, but the benchmark tables contain at least one phantom row that undermines its 'fair comparison' claim. read the letter →

arxiv 2506.18504 v2 pith:RANUAOBL submitted 2025-06-23 cs.CV cs.AI

Xinyao Li , Jingjing Li , Fengling Li , Lei Zhu , Yang Yang , Heng Tao Shen This is my paper

classification cs.CVcs.AI

keywords vision-languagemodelstransferlearningprompttuningrobustfine-tuningdomaingeneralizationtest-timeadaptationunsupervisedmultimodallargelanguagemodel

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This survey tries to establish the first comprehensive map of how pretrained vision-language models (VLMs) such as CLIP are transferred to novel domains, and its organizing claim is that nearly every adaptation method touches one of three modules: the textual prompts, the encoder parameters, or the extracted features. Working from the standard two-tower VLM, it sorts the surging literature into prompt-based, parameter-based, and feature-based families, then re-reads the classical transfer-learning settings — few-shot learning, domain generalization, unsupervised domain adaptation, and test-time adaptation — through this lens. It also compiles the standard benchmarks and tables of accuracy comparisons across all three families, and extends the picture to multimodal large language models built on VLM components. A sympathetic reader would take the survey's value to be conditional: if the taxonomy and the tables hold, the community gains a shared grid for choosing methods and benchmarks; if they do not, the comparative conclusions need repair.

What carries the argument

The load-bearing object is the frozen two-tower contrastive VLM (CLIP and its relatives) split into three transferable components, and the paper's argument rides on this decomposition. Prompts are the text embeddings handed to the language encoder, made learnable as [U] tokens around the class name. Parameters are the encoder weights, either updated under constraints or distilled into a student by Eq. (6). Features are the extracted vectors, refined by an adapter residual $v^* = v + \alpha\Phi(v)$ or stored in a cache model whose logits combine with the zero-shot head as $\hat{y} = \alpha\psi(vF)L^\top + vW$. The cache equation is the mechanical heart of the feature-based family, and the taxonomy itself is the survey's main instrument: it turns a scattered literature into a grid, and the benchmark tables fill that grid with numbers by setting, backbone, and method type.

What would settle it

Spot-check the tables against the cited papers. One concrete check: the row for 'Xiao et al. [104]' in Table 8 is classified as unsupervised domain adaptation yet reports numbers nearly identical to CLIP's zero-shot accuracy for the same backbones on OfficeHome, VisDA, and DomainNet; comparing every row of Tables 6-8 to the original publications would show whether the survey's comparisons are faithful, and a single systemic mismatch would falsify the benchmarking claim.

Watch

Extended reading notes

Core claim

The central claim of the paper is that the VLM generalization literature becomes coherent once methods are classified by the transferred module. Prompt-based methods learn the text inputs of the language encoder, from CoOp's class-agnostic context vectors to test-time prompts optimized per sample. Parameter-based methods either update pretrained weights — robustly, by ensembling or regularizing toward the zero-shot model, or selectively, by adapting only statistics or task-relevant blocks — or distill the VLM's knowledge into smaller student models. Feature-based methods leave the encoders frozen and either refine their outputs through lightweight adapters or store few-shot features in a train-free key-value cache whose retrieval logits are added to the zero-shot prediction. The paper further claims that revisiting transfer learning in this era changes the setting itself: VLM zero-shot predictions make unsupervised domain adaptation partly a pseudo-labeling problem, test-time adaptation favors cheap prompt and cache methods, and large domain gaps still demand robust fine-tuning. Its comparison tables support a headline empirical claim that CLIP-based transfer methods exceed single-modality baselines by wide margins, with the vision backbone rather than the method family dominating accuracy.

Load-bearing premise

The survey's value rests on the completeness of its three-way taxonomy and the fidelity of its benchmark tables, so if methods are assigned to the wrong transfer setting or accuracies are mis-transcribed, its comparative conclusions lose support.

Editorial extensions

If this is right

A practitioner facing a new domain shift can find their setting in the grid and pick the method family that fits: prompts for label-efficient few-shot use, caches for fast test-time adaptation, robust fine-tuning for large distribution gaps, and distillation for deployment on small models.
CLIP-based methods beat single-modality transfer baselines on UDA and DG benchmarks, largely because zero-shot predictions supply high-quality pseudo labels rather than because source knowledge is better aligned.
Vision backbone is the dominant accuracy factor, with ViT-B/16 roughly 15 points above ResNet50 across settings, so benchmark comparisons that mix backbones mask method quality.
Under matched backbones, test-time adaptation methods lead on hard out-of-distribution sets like ImageNet-A and EuroSAT, while domain-generalization methods lead on more in-distribution tasks, and cache models outperform prompt tuning when adaptation must be fast.
The same transfer logic extends to multimodal large language models, whose vision encoders and vision-language adapters are themselves VLM components being adapted to wider task sets.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

The taxonomy's three-way split is already being stretched by multimodal large language models, whose vision-LLM connectors form a de facto fourth transferred component; a natural extension is a connector-based family tracking how adapters, Q-Formers, and projection layers are tuned.
Because the tables show UDA results clustering by target domain almost regardless of method, a testable extension is to report 'gain over zero-shot' per method, isolating which approaches actually use source knowledge rather than merely re-labeling with CLIP.
The comparison tables carry a verifiability risk: the row for 'Xiao et al. [104]' is listed as a UDA method while reporting values nearly identical to the CLIP zero-shot baselines on the same backbones, which points to a misattribution or transcription error that a mechanical audit of Tables 6-8 against the original papers could settle.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

The paper does something genuinely useful: it organizes the VLM generalization literature into prompt-, parameter-, and feature-based methods, and it does so with enough care that the prose descriptions of individual methods are accurate and the taxonomy is coherent. The claim to be the first survey focused specifically on generalization seems plausible, and the coverage is broad, including test-time adaptation, domain generalization, UDA, few-shot, and even MLLMs. If you want a structured map of this area, this is a reasonable place to start.

The soft spot is real and it is in the numbers. The stress-test note is right: the Xiao et al. row in Table 8 is target-invariant across all source-target pairs (CA/PA/RA all 71.9, AC/PC/RC all 51.6, etc.), and its VisDA and DomainNet entries are exactly the CLIP zero-shot values. That is not a transcribed UDA result; it is a zero-shot baseline. The same paper appears as a DG method in Table 6, which makes the misattribution in Table 8 look like a copy-and-paste error rather than a deliberate choice. This matters because the paper's third contribution is a "fair and comprehensive evaluation" of methods, and a phantom row in the central UDA table directly contradicts that claim.

There is also a smaller labeling issue that I noticed: in Table 7, reference [106] is listed as "CLIPood" with type FT-R, but in Table 1 the same reference is "CoOpood" (a prompt tuning method). Probably a typo, but it is the sort of thing that makes you want to double-check every entry.

The taxonomy and the written summaries hold up; the quantitative comparisons do not. The correct fix is to verify each row of Tables 6-8 against the original papers, or at minimum remove rows that cannot be sourced. That is a mechanical fix, not a conceptual one.

Who is this for? Anyone looking for an entry point into VLM transfer methods would get value from the body of the survey, provided they ignore the tables until they are corrected. I would not cite it in its current form because a survey with suspect benchmark tables is not a reliable reference. A serious editor should send it to peer review rather than desk reject it, but the reviewers should demand a full audit of the comparison tables before acceptance.

Referee Report

4 major / 5 minor

Summary. This manuscript is a survey of methods for adapting and generalizing pretrained vision-language models, mainly CLIP-style dual-branch encoders, to novel domains and tasks. It organizes the literature into prompt-based, parameter-based, and feature-based method families, revisits standard transfer-learning settings (UDA, DG, TTA, FSL, SFDA), introduces benchmark datasets, and provides three comparison tables for domain-level DG, dataset-level generalization, and domain-wise transfer. A final section reviews multimodal large language models and discusses future research directions. The paper claims to be the first survey focused specifically on VLM knowledge transfer and generalization, with a detailed, fair, and comprehensive quantitative comparison as one of its main contributions.

Significance. The proposed module-based taxonomy is coherent and the prose summaries of individual methods are generally accurate, so the paper has the potential to serve as a useful roadmap for researchers entering this area. The MLLM section usefully expands the scope beyond CLIP-style adaptation. The paper's principal added value beyond organization is its quantitative comparison tables, and it is honest about not conducting new experiments. Because the tables are load-bearing for the stated 'fair and comprehensive evaluation' contribution, their fidelity must be established; at present at least one row appears to be a copied zero-shot baseline, which substantially undermines confidence in the comparative conclusions. No new experiments or code are included, which is appropriate for a survey, but the manuscript should be judged primarily on the accuracy and completeness of its organization and benchmarks.

major comments (4)

[Section 6.2.3, Table 8] The row labeled 'Xiao et al. [104]' in the UDA block reports OfficeHome values that are target-invariant (AC=PC=RC=51.6, AP=CP=RP=81.9, AR=CR=PR=82.6, CA=PA=RA=71.9), which exactly mirrors the target-invariance structure of the CLIP zero-shot row, and it reproduces the zero-shot VisDA (84.4) and DomainNet (56.2) values to one decimal place. Since a UDA method trained on labeled source data should not be exactly independent of the source domain, this row is almost certainly a transcription or copying error. This is a load-bearing issue: the comparative analysis in Section 6.2.3, the discussion of source knowledge under-exploitation, and Contribution 3 all depend on this table. Please re-verify every row of Tables 6-8 against the original papers and, ideally, add an automated check for duplicate rows or target-invariance patterns that would catch this class of error.
[Section 6.2.2, Table 7] The row labeled 'CLIPood [106] FT-R' is misattributed. Reference [106] in the bibliography is Zhang et al., 'Amend to alignment: decoupled prompt tuning...', which corresponds to CoOPood in Table 1, whereas CLIPood is reference [47] (Shu et al., ICML 2023). Using an incorrect reference key for a benchmark row makes the reported numbers unverifiable and constitutes a second concrete table-fidelity error. Please correct the citation and, more broadly, audit all reference keys in the result tables for consistency with the cited papers.
[Section 3.1.2 / Table 1 vs Table 8] The same reference [104] (Xiao et al., CVPR 2024) is classified as a domain-generalization method (type V,T) in Table 1, appears in the UDA block of Table 8 without any explanation, and receives substantially different reported numbers in Table 6 (e.g., OfficeHome 86.0 under DG vs. the near-zero-shot 72.0 average in Table 8). This internal inconsistency shows that the survey's claim to assign methods correctly to their transfer settings is not yet reliable. Please either remove the erroneous UDA row or provide the original UDA results from the cited paper and reconcile the taxonomy.
[Section 6.2.3, discussion paragraph] The observation that 'current CLIP-based UDA methods overly rely on pseudo labels... leading to similar accuracies among tasks with the same target domain' is partly an artifact of the erroneous first row. Once that row is excluded, methods such as DAPrompt (AC=54.1, PC=54.6, RC=54.7) and Lai et al. (CA=77.4, PA=76.5, RA=75.9) show clear source-dependent variation within the same target domain. The qualitative conclusion about source knowledge being under-explored should be rewritten on the basis of corrected tables, not a duplicated zero-shot baseline.

minor comments (5)

[Abstract and Section 1] 'generalization prospective' should be 'generalization perspective', and in Contribution 1 'knowledge transfer and generalize of VLMs' should be 'knowledge transfer and generalization of VLMs'.
[Section 5.3] The sentence 'can are suitable for agile adaptation' contains a grammatical error and should read 'can be suitable for agile adaptation'.
[Section 7.2.1 and Table 9] There are several typos in the MLLM section: 'two-towel structure' should be 'two-tower structure', 'ration' should be 'ratio', 'high-solution' should be 'high-resolution', and 'mutlimodal' should be 'multimodal'.
[Table 7] The table mixes ViT-B/32, ResNet50, and ViT-B/16 rows in the same blocks; since the paper itself identifies the backbone as the dominant performance factor, consider separating or visibly shading rows by backbone to avoid misleading visual comparisons.
[Introduction] The claim of being the first survey on VLM generalization should be supported by a more explicit comparison with existing surveys such as [43] and [44], rather than a single sentence in the introduction.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: survey taxonomy and comparisons are descriptive and externally sourced; no derivation reduces to its inputs.

full rationale

This is a survey paper, not a derivation. Its central claims are organizational: methods are grouped into prompt-, parameter-, and feature-based categories according to which VLM module is transferred. That categorization is a descriptive taxonomy, not a result derived from the surveyed methods' equations. The performance comparisons in Tables 6-8 are transcribed from independent cited papers; the survey itself fits no parameters, runs no experiments, and predicts nothing from its own inputs. The authors do cite several of their own prior works (e.g., UniMoS [35], DAMP [36], and earlier domain adaptation papers), but these are reviewed methods with externally reported benchmark numbers, not load-bearing justifications for the survey's structure or conclusions. The claim of being the first survey on VLM generalization is a novelty assertion, not a circular derivation. The skeptical observation about the 'Xiao et al. [104]' row in Table 8, even if confirmed as a copy of the CLIP zero-shot baseline, would be a table-fidelity or transcription error, not a circularity: it does not make the survey's conclusions equivalent to its inputs by construction. No self-definitional, fitted-input, self-citation-load-bearing, uniqueness-imported, ansatz-smuggled, or renaming circular steps are present. The survey is self-contained as a literature review and the score is therefore 0.

Assumptions & free parameters 0 free parameters · 2 assumptions · 0 invented entities

A survey introduces no free parameters or invented entities. Its claims rest on the completeness of the taxonomy and the fidelity of transcribed benchmark numbers.

assumptions (2)

domain assumption The three-way categorization by transferred modules (prompt, parameter, feature) is a complete and non-overlapping taxonomy of VLM generalization methods.
The survey's organizing principle, introduced in Section 2.1 and used throughout Sections 3-5, assumes every method fits one of these buckets; hybrid methods are classified by primary type.
domain assumption The accuracy numbers compiled in Tables 6-8 faithfully reproduce the results of the cited papers.
The survey's performance comparisons rest on transcribed numbers; a misattributed row (e.g., Xiao et al. in Table 8) would otherwise corrupt the comparison.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Generalizing vision-language models to novel domains: A comprehensive survey." pith.science (2026). https://pith.science/paper/RANUAOBL

@misc{pith2026250618504,
  author       = {Pith},
  title        = {Pith review of: Generalizing vision-language models to novel domains: A comprehensive survey},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/RANUAOBL}},
  note         = {Machine review of arXiv:2506.18504}
}

read the original abstract

Recently, vision-language pretraining has emerged as a transformative technique that integrates the strengths of both visual and textual modalities, resulting in powerful vision-language models (VLMs). Leveraging web-scale pretraining data, these models exhibit strong zero-shot capabilities. However, their performance often deteriorates when confronted with domain-specific or specialized generalization tasks. To address this, a growing body of research focuses on transferring or generalizing the rich knowledge embedded in VLMs to various downstream applications. This survey aims to comprehensively summarize the generalization settings, methodologies, benchmarking and results in VLM literatures. Delving into the typical VLM structures, current literatures are categorized into prompt-based, parameter-based and feature-based methods according to the transferred modules. The differences and characteristics in each category are furthered summarized and discussed by revisiting the typical transfer learning (TL) settings, providing novel interpretations for TL in the era of VLMs. Popular benchmarks for VLM generalization are further introduced with thorough performance comparisons among the reviewed methods. Following the advances in large-scale generalizable pretraining, this survey also discusses the relations and differences between VLMs and up-to-date multimodal large language models (MLLM), e.g., DeepSeek-VL. By systematically reviewing the surging literatures in vision-language research from a novel and practical generalization prospective, this survey contributes to a clear landscape of current and future multimodal researches.

Figures

Figures reproduced from arXiv: 2506.18504 by the authors.

**Figure 2.** This survey is organized based on the typical and most investigated dual-branch VLM structure, where generalization methods are [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗

**Figure 3.** An overview of recent advances in vision-language systems, including adapting VLMs (lower part) and building general MLLMs (upper part). [PITH_FULL_IMAGE:figures/full_fig_p003_3.png] view at source ↗

Figures from the paper (5 more)

**Figure 4.** Figure 4: Illustration of the language-image contrastive learning procedure. [PITH_FULL_IMAGE:figures/full_fig_p004_4.png]

**Figure 5.** Figure 5: Illustrations of text, visual and context prompts. [PITH_FULL_IMAGE:figures/full_fig_p005_5.png]

**Figure 6.** Figure 6: Illustrations of parameter-based methods. For clarity, only the [PITH_FULL_IMAGE:figures/full_fig_p007_6.png]

**Figure 7.** Figure 7: Illustrations of feature-based methods, where [PITH_FULL_IMAGE:figures/full_fig_p009_7.png]

**Figure 8.** Figure 8: General structure of MLLMs, composing of a pretrained vision en [PITH_FULL_IMAGE:figures/full_fig_p014_8.png]

Discussion (0). Sign in to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

Adapting Vision-Language Models Without Labels: A Comprehensive Survey
cs.LG 2025-08 conditional novelty 5.0 of 10

A survey that organizes unsupervised vision-language model adaptation by unlabeled-data availability into four paradigms: data-free transfer, domain transfer, episodic test-time, and online test-time adaptation.

Reference graph

Works this paper leans on

297 extracted references · 9 canonical work pages · cited by 1 Pith paper

[106]

Amend to alignment: decoupled prompt tuning for mitigating spurious correlation in vision-language models,

J. Zhang, X. Ma, S. Guo, P . Li, W. Xu, X. Tang, and Z. Hong, “Amend to alignment: decoupled prompt tuning for mitigating spurious correlation in vision-language models,” in Forty-first International Conference on Machine Learning, 2024

2024
[104]

Any-shift prompting for generalization over distributions,

Z. Xiao, J. Shen, M. M. Derakhshani, S. Liao, and C. G. Snoek, “Any-shift prompting for generalization over distributions,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 13 849–13 860

2024
[47]

Clipood: Generalizing clip to out-of-distributions,

Y. Shu, X. Guo, J. Wu, X. Wang, J. Wang, and M. Long, “Clipood: Generalizing clip to out-of-distributions,” in International Confer- ence on Machine Learning. PMLR, 2023, pp. 31 716–31 731

2023
[1]

Imagenet classi- fication with deep convolutional neural networks,

A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classi- fication with deep convolutional neural networks,” Advances in neural information processing systems, vol. 25, 2012

2012
[2]

Deep residual learning for image recognition,

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778

2016
[3]

An image is worth 16x16 words: Transformers for image recognition at scale,

A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2020

arXiv 2010
[4]

A comprehensive survey on transfer learning,

F. Zhuang, Z. Qi, K. Duan, D. Xi, Y. Zhu, H. Zhu, H. Xiong, and Q. He, “A comprehensive survey on transfer learning,” Proceedings of the IEEE, vol. 109, no. 1, pp. 43–76, 2020

2020
[5]

Imagenet: A large-scale hierarchical image database,

J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition . Ieee, 2009, pp. 248–255

2009

Show all 297 references

[6]

Object detection in 20 years: A survey,

Z. Zou, K. Chen, Z. Shi, Y. Guo, and J. Ye, “Object detection in 20 years: A survey,” Proceedings of the IEEE , vol. 111, no. 3, pp. 257–276, 2023

2023
[7]

Attention is all you need,

A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin, “Attention is all you need,” Advances in neural information processing systems , vol. 30, 2017

2017
[8]

Bert: Pre- training of deep bidirectional transformers for language under- standing,

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “Bert: Pre- training of deep bidirectional transformers for language under- standing,” in Proceedings of the 2019 conference of the North Amer- ican chapter of the association for computational linguistics: human language techn...

2019
[9]

Language models are unsupervised multitask learners,

A. Radford, J. Wu, R. Child, D. Luan, D. Amodei, I. Sutskever et al. , “Language models are unsupervised multitask learners,” OpenAI blog, vol. 1, no. 8, p. 9, 2019

2019
[10]

Language models are few-shot learners,

T. Brown, B. Mann, N. Ryder, M. Subbiah, J. D. Kaplan, P . Dhari- wal, A. Neelakantan, P . Shyam, G. Sastry, A. Askell et al. , “Language models are few-shot learners,” Advances in neural information processing systems, vol. 33, pp. 1877–1901, 2020

1901
[11]

Learning transferable visual models from natural language supervision,

A. Radford, J. W. Kim, C. Hallacy, A. Ramesh, G. Goh, S. Agar- wal, G. Sastry, A. Askell, P . Mishkin, J. Clark et al. , “Learning transferable visual models from natural language supervision,” in International conference on machine learning . PmLR, 2021, pp. 8748–8763

2021
[12]

Regionclip: Region-based language- image pretraining,

Y. Zhong, J. Yang, P . Zhang, C. Li, N. Codella, L. H. Li, L. Zhou, X. Dai, L. Yuan, Y. Li et al., “Regionclip: Region-based language- image pretraining,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 16 793–16 803

2022
[13]

Clip4clip: An empirical study of clip for end to end video clip retrieval and captioning,

H. Luo, L. Ji, M. Zhong, Y. Chen, W. Lei, N. Duan, and T. Li, “Clip4clip: An empirical study of clip for end to end video clip retrieval and captioning,” Neurocomputing, vol. 508, pp. 293–304, 2022

2022
[14]

Scaling up visual and vision- language representation learning with noisy text supervision,

C. Jia, Y. Yang, Y. Xia, Y.-T. Chen, Z. Parekh, H. Pham, Q. Le, Y.-H. Sung, Z. Li, and T. Duerig, “Scaling up visual and vision- language representation learning with noisy text supervision,” in International conference on machine learning . PMLR, 2021, pp. 4904–4916

2021
[15]

Coca: Contrastive captioners are image-text foundation models,

J. Yu, Z. Wang, V . Vasudevan, L. Yeung, M. Seyedhosseini, and Y. Wu, “Coca: Contrastive captioners are image-text foundation models,” arXiv preprint arXiv:2205.01917, 2022

2022 arXiv
[16]

Blip: Bootstrapping language- image pre-training for unified vision-language understanding and generation,

J. Li, D. Li, C. Xiong, and S. Hoi, “Blip: Bootstrapping language- image pre-training for unified vision-language understanding and generation,” in International conference on machine learning . PMLR, 2022, pp. 12 888–12 900

2022
[17]

Instructblip: Towards general-purpose vision-language models with instruction tuning,

W. Dai, J. Li, D. Li, A. M. H. Tiong, J. Zhao, W. Wang, B. Li, P . Fung, and S. Hoi, “Instructblip: Towards general-purpose vision-language models with instruction tuning,” arXiv preprint arXiv:2305.06500, 2023

2023 arXiv
[18]

Visual instruction tuning,

H. Liu, C. Li, Q. Wu, and Y. J. Lee, “Visual instruction tuning,” Advances in neural information processing systems , vol. 36, pp. 34 892–34 916, 2023

2023
[19]

Pali: A jointly-scaled multilingual language-image model,

X. Chen, X. Wang, S. Changpinyo, A. Piergiovanni, P . Padlewski, D. Salz, S. Goodman, A. Grycner, B. Mustafa, L. Beyer et al. , “Pali: A jointly-scaled multilingual language-image model,” arXiv preprint arXiv:2209.06794, 2022

2022 arXiv
[20]

Pali-x: On scaling up a multilingual vision and language model,

X. Chen, J. Djolonga, P . Padlewski, B. Mustafa, S. Changpinyo, J. Wu, C. R. Ruiz, S. Goodman, X. Wang, Y. Tay et al. , “Pali-x: On scaling up a multilingual vision and language model,” arXiv preprint arXiv:2305.18565, 2023

2023 arXiv
[21]

Multilingual diversity improves vision-language representations,

T. Nguyen, M. Wallingford, S. Santy, W.-C. Ma, S. Oh, L. Schmidt, P . W. W. Koh, and R. Krishna, “Multilingual diversity improves vision-language representations,” Advances in Neural Information Processing Systems, vol. 37, pp. 91 430–91 459, 2024

2024
[25]

Fine- tuning can distort pretrained features and underperform out-of- distribution,

A. Kumar, A. Raghunathan, R. Jones, T. Ma, and P . Liang, “Fine- tuning can distort pretrained features and underperform out-of- distribution,” arXiv preprint arXiv:2202.10054, 2022

2022 arXiv
[26]

Clip-adapter: Better vision-language models with feature adapters,

P . Gao, S. Geng, R. Zhang, T. Ma, R. Fang, Y. Zhang, H. Li, and Y. Qiao, “Clip-adapter: Better vision-language models with feature adapters,” International Journal of Computer Vision, vol. 132, no. 2, pp. 581–595, 2024

2024
[27]

Tip-adapter: Training-free adaption of clip for few-shot classification,

R. Zhang, W. Zhang, R. Fang, P . Gao, K. Li, J. Dai, Y. Qiao, and H. Li, “Tip-adapter: Training-free adaption of clip for few-shot classification,” in European conference on computer vision. Springer, 2022, pp. 493–510

2022
[28]

The power of scale for parameter-efficient prompt tuning,

B. Lester, R. Al-Rfou, and N. Constant, “The power of scale for parameter-efficient prompt tuning,” arXiv preprint arXiv:2104.08691, 2021

2021 arXiv
[29]

Parameter- efficient transfer learning for nlp,

N. Houlsby, A. Giurgiu, S. Jastrzebski, B. Morrone, Q. De Larous- silhe, A. Gesmundo, M. Attariyan, and S. Gelly, “Parameter- efficient transfer learning for nlp,” in International conference on machine learning. PMLR, 2019, pp. 2790–2799

2019
[30]

Knowledge distillation: A survey,

J. Gou, B. Yu, S. J. Maybank, and D. Tao, “Knowledge distillation: A survey,” International Journal of Computer Vision, vol. 129, no. 6, pp. 1789–1819, 2021

2021
[31]

Learning to prompt for vision-language models,

K. Zhou, J. Yang, C. C. Loy, and Z. Liu, “Learning to prompt for vision-language models,” International Journal of Computer Vision, vol. 130, no. 9, pp. 2337–2348, 2022

2022
[32]

Conditional prompt learning for vision-language models,

——, “Conditional prompt learning for vision-language models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 16 816–16 825

2022
[33]

Distilling large vision-language model with out-of-distribution generalizability,

X. Li, Y. Fang, M. Liu, Z. Ling, Z. Tu, and H. Su, “Distilling large vision-language model with out-of-distribution generalizability,” JOURNAL OF LATEX CLASS FILES, VOL. 13, NO. 9, SEPTEMBER 2014 19 in Proceedings of the IEEE/CVF International Conference on Computer Vision, 20...

2014
[34]

Domain adaptation via prompt learning,

C. Ge, R. Huang, M. Xie, Z. Lai, S. Song, S. Li, and G. Huang, “Domain adaptation via prompt learning,” IEEE Transactions on Neural Networks and Learning Systems, 2023

2023
[35]

Split to merge: Unifying separated modalities for unsupervised domain adaptation,

X. Li, Y. Li, Z. Du, F. Li, K. Lu, and J. Li, “Split to merge: Unifying separated modalities for unsupervised domain adaptation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 23 364–23 374

2024
[36]

Domain-agnostic mutual prompting for unsupervised domain adaptation,

Z. Du, X. Li, F. Li, K. Lu, L. Zhu, and J. Li, “Domain-agnostic mutual prompting for unsupervised domain adaptation,” in Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 23 375–23 384

2024
[37]

Soft prompt generation for domain generalization,

S. Bai, Y. Zhang, W. Zhou, Z. Luan, and B. Chen, “Soft prompt generation for domain generalization,” in European Conference on Computer Vision. Springer, 2024, pp. 434–450

2024
[38]

Leverag- ing vision-language models for improving domain generalization in image classification,

S. Addepalli, A. R. Asokan, L. Sharma, and R. V . Babu, “Leverag- ing vision-language models for improving domain generalization in image classification,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 23 922– 23 932

2024
[39]

Practicaldg: Perturbation distillation on vision-language models for hybrid domain generalization,

Z. Chen, W. Wang, Z. Zhao, F. Su, A. Men, and H. Meng, “Practicaldg: Perturbation distillation on vision-language models for hybrid domain generalization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 23 501–23 511

2024
[40]

Test-time prompt tuning for zero-shot generalization in vision-language models,

M. Shu, W. Nie, D.-A. Huang, Z. Yu, T. Goldstein, A. Anand- kumar, and C. Xiao, “Test-time prompt tuning for zero-shot generalization in vision-language models,” Advances in Neural Information Processing Systems, vol. 35, pp. 14 274–14 289, 2022

2022
[41]

Efficient test-time adaptation of vision-language models,

A. Karmanov, D. Guan, S. Lu, A. El Saddik, and E. Xing, “Efficient test-time adaptation of vision-language models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recogni- tion, 2024, pp. 14 162–14 171

2024
[42]

Diverse data augmentation with diffusions for effective test-time prompt tun- ing,

C.-M. Feng, K. Yu, Y. Liu, S. Khan, and W. Zuo, “Diverse data augmentation with diffusions for effective test-time prompt tun- ing,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 2704–2714

2023
[43]

Vision-language models for vision tasks: A survey,

J. Zhang, J. Huang, S. Jin, and S. Lu, “Vision-language models for vision tasks: A survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

2024
[44]

A survey of vision-language pre-trained models,

Y. Du, Z. Liu, J. Li, and W. X. Zhao, “A survey of vision-language pre-trained models,” arXiv preprint arXiv:2202.10936, 2022

2022 arXiv
[45]

Ex- ploring the frontier of vision-language models: A survey of current methodologies and future directions,

A. Ghosh, A. Acharya, S. Saha, V . Jain, and A. Chadha, “Ex- ploring the frontier of vision-language models: A survey of current methodologies and future directions,” arXiv preprint arXiv:2404.07214, 2024

2024
[46]

Domain generalization by mutual-information regularization with pre-trained models,

J. Cha, K. Lee, S. Park, and S. Chun, “Domain generalization by mutual-information regularization with pre-trained models,” in European conference on computer vision . Springer, 2022, pp. 440– 457

2022
[48]

Towards calibrated robust fine-tuning of vision-language models,

C. Oh, H. Lim, M. Kim, D. Han, S. Yun, J. Choo, A. Hauptmann, Z.-Q. Cheng, and K. Song, “Towards calibrated robust fine-tuning of vision-language models,” Advances in Neural Information Pro- cessing Systems, vol. 37, pp. 12 677–12 707, 2024

2024
[49]

Dual memory networks: A versatile adaptation approach for vision- language models,

Y. Zhang, W. Zhu, H. Tang, Z. Ma, K. Zhou, and L. Zhang, “Dual memory networks: A versatile adaptation approach for vision- language models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2024, pp. 28 718–28 728

2024
[50]

A survey of transfer learning,

K. Weiss, T. M. Khoshgoftaar, and D. Wang, “A survey of transfer learning,” Journal of Big data, vol. 3, pp. 1–40, 2016

2016
[51]

A survey on deep transfer learning,

C. Tan, F. Sun, T. Kong, W. Zhang, C. Yang, and C. Liu, “A survey on deep transfer learning,” in Artificial Neural Networks and Machine Learning–ICANN 2018: 27th International Conference on Artificial Neural Networks, Rhodes, Greece, October 4-7, 2018, Proceedings, Part III 27...

2018
[52]

Deepseek llm: Scaling open- source language models with longtermism,

X. Bi, D. Chen, G. Chen, S. Chen, D. Dai, C. Deng, H. Ding, K. Dong, Q. Du, Z. Fu et al. , “Deepseek llm: Scaling open- source language models with longtermism,” arXiv preprint arXiv:2401.02954, 2024

2024 arXiv
[53]

Qwen2 technical report,

Q. Team, “Qwen2 technical report,” arXiv preprint arXiv:2407.10671, 2024

2024 arXiv
[54]

Introducing qwen-7b: Open foundation and human- aligned models (of the state-of-the-arts),

Qwen, “Introducing qwen-7b: Open foundation and human- aligned models (of the state-of-the-arts),” https://github.com/ zsc19/Qwen-7B/tree/main?tab=readme-ov-file, 2023

2023
[55]

Gpt-4 technical report,

J. Achiam, S. Adler, S. Agarwal, L. Ahmad, I. Akkaya, F. L. Aleman, D. Almeida, J. Altenschmidt, S. Altman, S. Anadkat et al. , “Gpt-4 technical report,” arXiv preprint arXiv:2303.08774 , 2023

2023 arXiv
[56]

Deepseek-vl: towards real-world vision- language understanding,

H. Lu, W. Liu, B. Zhang, B. Wang, K. Dong, B. Liu, J. Sun, T. Ren, Z. Li, H. Yang et al. , “Deepseek-vl: towards real-world vision- language understanding,” arXiv preprint arXiv:2403.05525, 2024

2024 arXiv
[57]

Qwen-vl: A versatile vision-language model for understanding, localization, text reading, and beyond,

J. Bai, S. Bai, S. Yang, S. Wang, S. Tan, P . Wang, J. Lin, C. Zhou, and J. Zhou, “Qwen-vl: A versatile vision-language model for understanding, localization, text reading, and beyond,” 2023. [Online]. Available: https://arxiv.org/abs/2308.12966

2023 arXiv
[58]

Minigpt-4: Enhancing vision-language understanding with advanced large language models,

D. Zhu, J. Chen, X. Shen, X. Li, and M. Elhoseiny, “Minigpt-4: Enhancing vision-language understanding with advanced large language models,” arXiv preprint arXiv:2304.10592, 2023

2023 arXiv
[59]

Contrastive learning of medical visual representations from paired images and text,

Y. Zhang, H. Jiang, Y. Miura, C. D. Manning, and C. P . Lan- glotz, “Contrastive learning of medical visual representations from paired images and text,” in Machine learning for healthcare conference. PMLR, 2022, pp. 2–25

2022
[60]

Transfer learning,

L. Torrey and J. Shavlik, “Transfer learning,” in Handbook of research on machine learning applications and trends: algorithms, methods, and techniques. IGI global, 2010, pp. 242–264

2010
[61]

Conditional adversarial domain adaptation,

M. Long, Z. Cao, J. Wang, and M. I. Jordan, “Conditional adversarial domain adaptation,” Advances in neural information processing systems, vol. 31, 2018

2018
[62]

Transfer independently together: A generalized framework for domain adaptation,

J. Li, K. Lu, Z. Huang, L. Zhu, and H. T. Shen, “Transfer independently together: A generalized framework for domain adaptation,” IEEE transactions on cybernetics , vol. 49, no. 6, pp. 2144–2155, 2018

2018
[63]

Maximum density divergence for domain adaptation,

J. Li, E. Chen, Z. Ding, L. Zhu, K. Lu, and H. T. Shen, “Maximum density divergence for domain adaptation,” IEEE transactions on pattern analysis and machine intelligence , vol. 43, no. 11, pp. 3918– 3930, 2020

2020
[64]

Divergence- agnostic unsupervised domain adaptation by adversarial at- tacks,

J. Li, Z. Du, L. Zhu, Z. Ding, K. Lu, and H. T. Shen, “Divergence- agnostic unsupervised domain adaptation by adversarial at- tacks,” IEEE Transactions on Pattern Analysis and Machine Intelli- gence, vol. 44, no. 11, pp. 8196–8211, 2021

2021
[65]

Deep transfer metric learning,

J. Hu, J. Lu, and Y.-P . Tan, “Deep transfer metric learning,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 325–333

2015
[66]

Mind the class weight bias: Weighted maximum mean discrepancy for unsupervised domain adaptation,

H. Yan, Y. Ding, P . Li, Q. Wang, Y. Xu, and W. Zuo, “Mind the class weight bias: Weighted maximum mean discrepancy for unsupervised domain adaptation,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2017, pp. 2272–2281

2017
[67]

Unsupervised domain adaptation by backpropagation,

Y. Ganin and V . Lempitsky, “Unsupervised domain adaptation by backpropagation,” in International conference on machine learning . PMLR, 2015, pp. 1180–1189

2015
[68]

Domain generalization: A survey,

K. Zhou, Z. Liu, Y. Qiao, T. Xiang, and C. C. Loy, “Domain generalization: A survey,”IEEE transactions on pattern analysis and machine intelligence, vol. 45, no. 4, pp. 4396–4415, 2022

2022
[69]

Learning transferrable and interpretable representations for domain generalization,

Z. Du, J. Li, K. Lu, L. Zhu, and Z. Huang, “Learning transferrable and interpretable representations for domain generalization,” in Proceedings of the 29th ACM International Conference on Multimedia, 2021, pp. 3340–3349

2021
[70]

Domain gener- alization via invariant feature representation,

K. Muandet, D. Balduzzi, and B. Sch ¨olkopf, “Domain gener- alization via invariant feature representation,” in International conference on machine learning. PMLR, 2013, pp. 10–18

2013
[71]

Energy-based domain generalization for face anti-spoofing,

Z. Du, J. Li, L. Zuo, L. Zhu, and K. Lu, “Energy-based domain generalization for face anti-spoofing,” in Proceedings of the 30th ACM international conference on multimedia, 2022, pp. 1749–1757

2022
[72]

Deep domain generalization via conditional invariant adversar- ial networks,

Y. Li, X. Tian, M. Gong, Y. Liu, T. Liu, K. Zhang, and D. Tao, “Deep domain generalization via conditional invariant adversar- ial networks,” in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 624–639

2018
[73]

Domain general- ization via entropy regularization,

S. Zhao, M. Gong, T. Liu, H. Fu, and D. Tao, “Domain general- ization via entropy regularization,” Advances in neural information processing systems, vol. 33, pp. 16 096–16 107, 2020

2020
[74]

Learning to gen- eralize: Meta-learning for domain generalization,

D. Li, Y. Yang, Y.-Z. Song, and T. Hospedales, “Learning to gen- eralize: Meta-learning for domain generalization,” in Proceedings of the AAAI conference on artificial intelligence , vol. 32, no. 1, 2018

2018
[75]

Metareg: Towards domain generalization using meta-regularization,

Y. Balaji, S. Sankaranarayanan, and R. Chellappa, “Metareg: Towards domain generalization using meta-regularization,” Ad- vances in neural information processing systems , vol. 31, 2018. JOURNAL OF LATEX CLASS FILES, VOL. 13, NO. 9, SEPTEMBER 2014 20

2018
[76]

A comprehensive survey on test- time adaptation under distribution shifts,

J. Liang, R. He, and T. Tan, “A comprehensive survey on test- time adaptation under distribution shifts,” International Journal of Computer Vision, vol. 133, no. 1, pp. 31–64, 2025

2025
[77]

Tent: Fully test-time adaptation by entropy minimization,

D. Wang, E. Shelhamer, S. Liu, B. Olshausen, and T. Darrell, “Tent: Fully test-time adaptation by entropy minimization,”arXiv preprint arXiv:2006.10726, 2020

2006 arXiv
[78]

A comprehensive survey on source-free domain adaptation,

J. Li, Z. Yu, Z. Du, L. Zhu, and H. T. Shen, “A comprehensive survey on source-free domain adaptation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024

2024
[79]

Source-free active domain adaptation via energy-based locality preserving transfer,

X. Li, Z. Du, J. Li, L. Zhu, and K. Lu, “Source-free active domain adaptation via energy-based locality preserving transfer,” in Pro- ceedings of the 30th ACM international conference on multimedia , 2022, pp. 5802–5810

2022
[80]

Generalizing from a few examples: A survey on few-shot learning,

Y. Wang, Q. Yao, J. T. Kwok, and L. M. Ni, “Generalizing from a few examples: A survey on few-shot learning,” ACM computing surveys (csur), vol. 53, no. 3, pp. 1–34, 2020

2020
[81]

Leveraging the invariant side of generative zero-shot learning,

J. Li, M. Jing, K. Lu, Z. Ding, L. Zhu, and Z. Huang, “Leveraging the invariant side of generative zero-shot learning,” inProceedings of the IEEE/CVF conference on computer vision and pattern recogni- tion, 2019, pp. 7402–7411

2019
[82]

Visual prompt tuning,

M. Jia, L. Tang, B.-C. Chen, C. Cardie, S. Belongie, B. Hariharan, and S.-N. Lim, “Visual prompt tuning,” in European conference on computer vision. Springer, 2022, pp. 709–727

2022
[83]

Maple: Multi-modal prompt learning,

M. U. Khattak, H. Rasheed, M. Maaz, S. Khan, and F. S. Khan, “Maple: Multi-modal prompt learning,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2023, pp. 19 113–19 122

2023
[84]

Unified vision and language prompt learning,

Y. Zang, W. Li, K. Zhou, C. Huang, and C. C. Loy, “Unified vision and language prompt learning,” arXiv preprint arXiv:2210.07225 , 2022

2022 arXiv
[85]

Dual modality prompt tuning for vision-language pre-trained model,

Y. Xing, Q. Wu, D. Cheng, S. Zhang, G. Liang, P . Wang, and Y. Zhang, “Dual modality prompt tuning for vision-language pre-trained model,” IEEE Transactions on Multimedia, vol. 26, pp. 2056–2068, 2023

2023
[86]

Distribution-aware prompt tun- ing for vision-language models,

E. Cho, J. Kim, and H. J. Kim, “Distribution-aware prompt tun- ing for vision-language models,” in Proceedings of the IEEE/CVF international conference on computer vision, 2023, pp. 22 004–22 013

2023
[87]

Ex- ploring visual prompts for adapting large-scale models,

H. Bahng, A. Jahanian, S. Sankaranarayanan, and P . Isola, “Ex- ploring visual prompts for adapting large-scale models,” arXiv preprint arXiv:2203.17274, 2022

2022 arXiv
[88]

Unadversarial examples: Designing objects for ro- bust vision,

H. Salman, A. Ilyas, L. Engstrom, S. Vemprala, A. Madry, and A. Kapoor, “Unadversarial examples: Designing objects for ro- bust vision,” Advances in Neural Information Processing Systems , vol. 34, pp. 15 270–15 284, 2021

2021
[89]

Dept: Decoupled prompt tuning,

J. Zhang, S. Wu, L. Gao, H. T. Shen, and J. Song, “Dept: Decoupled prompt tuning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 12 924–12 933

2024
[90]

Dpc: Dual-prompt collaboration for tuning vision-language models,

H. Li, L. Wang, C. Wang, J. Jiang, Y. Peng, and G. Long, “Dpc: Dual-prompt collaboration for tuning vision-language models,” arXiv preprint arXiv:2503.13443, 2025

2025 arXiv
[91]

Decoop: robust prompt tuning with out-of-distribution detection,

Z. Zhou, M. Yang, J.-X. Shi, L.-Z. Guo, and Y.-F. Li, “Decoop: robust prompt tuning with out-of-distribution detection,” arXiv preprint arXiv:2406.00345, 2024

2024 arXiv
[92]

Robust fine-tuning of zero-shot models,

M. Wortsman, G. Ilharco, J. W. Kim, M. Li, S. Kornblith, R. Roelofs, R. G. Lopes, H. Hajishirzi, A. Farhadi, H. Namkoong et al., “Robust fine-tuning of zero-shot models,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2022, pp. 7959–7971

2022
[93]

Visual-language prompt tuning with knowledge-guided context optimization,

H. Yao, R. Zhang, and C. Xu, “Visual-language prompt tuning with knowledge-guided context optimization,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2023, pp. 6757–6767

2023
[94]

Prompt-aligned gradient for prompt tuning,

B. Zhu, Y. Niu, Y. Han, Y. Wu, and H. Zhang, “Prompt-aligned gradient for prompt tuning,” in Proceedings of the IEEE/CVF international conference on computer vision, 2023, pp. 15 659–15 669

2023
[95]

Self-regulating prompts: Foundational model adaptation without forgetting,

M. U. Khattak, S. T. Wasim, M. Naseer, S. Khan, M.-H. Yang, and F. S. Khan, “Self-regulating prompts: Foundational model adaptation without forgetting,” in Proceedings of the IEEE/CVF international conference on computer vision, 2023, pp. 15 190–15 200

2023
[96]

What does a platypus look like? generating customized prompts for zero-shot image classification,

S. Pratt, I. Covert, R. Liu, and A. Farhadi, “What does a platypus look like? generating customized prompts for zero-shot image classification,” in Proceedings of the IEEE/CVF International Confer- ence on Computer Vision, 2023, pp. 15 691–15 701

2023
[97]

Learning to prompt with text only supervision for vision-language models,

M. U. Khattak, M. F. Naeem, M. Naseer, L. Van Gool, and F. Tombari, “Learning to prompt with text only supervision for vision-language models,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 39, no. 4, 2025, pp. 4230–4238

2025
[98]

Ad-clip: Adapting do- mains in prompt space using clip,

M. Singha, H. Pal, A. Jha, and B. Banerjee, “Ad-clip: Adapting do- mains in prompt space using clip,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 4355–4364

2023
[99]

Stylip: Multi-scale style-conditioned prompt learning for clip- based domain generalization,

S. Bose, A. Jha, E. Fini, M. Singha, E. Ricci, and B. Banerjee, “Stylip: Multi-scale style-conditioned prompt learning for clip- based domain generalization,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , 2024, pp. 5542–5552

2024
[100]

Enhancing domain adaptation through prompt gradient alignment,

V . H. Phan, T. L. Tran, Q. Tran, and T. Le, “Enhancing domain adaptation through prompt gradient alignment,” Advances in Neural Information Processing Systems , vol. 37, pp. 45 518–45 551, 2024

2024
[101]

Enhancing vision-language models generalization via diversity-driven novel feature synthe- sis,

S. Yan, C. Luo, Z. Yu, and Z. Ge, “Enhancing vision-language models generalization via diversity-driven novel feature synthe- sis,” arXiv preprint arXiv:2405.02586, 2024

2024 arXiv
[102]

Dis- entangled prompt representation for domain generalization,

D. Cheng, Z. Xu, X. Jiang, N. Wang, D. Li, and X. Gao, “Dis- entangled prompt representation for domain generalization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 23 595–23 604

2024
[103]

Unknown prompt the only lacuna: Unveiling clip’s potential for open domain generalization,

M. Singha, A. Jha, S. Bose, A. Nair, M. Abdar, and B. Banerjee, “Unknown prompt the only lacuna: Unveiling clip’s potential for open domain generalization,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 13 309–13 319

2024
[105]

Quan- tized prompt for efficient generalization of vision-language mod- els,

T. Hao, X. Ding, J. Feng, Y. Yang, H. Chen, and G. Ding, “Quan- tized prompt for efficient generalization of vision-language mod- els,” in European Conference on Computer Vision . Springer, 2024, pp. 54–73

2024
[107]

Overcoming the pitfalls of vision-language model finetuning for ood generaliza- tion,

Y. Zang, H. Goh, J. Susskind, and C. Huang, “Overcoming the pitfalls of vision-language model finetuning for ood generaliza- tion,” arXiv preprint arXiv:2401.15914, 2024

2024 arXiv
[108]

Meta-learning to teach semantic prompts for open domain gen- eralization in vision-language models,

S. Bose, M. Singha, A. Jha, S. Mukhopadhyay, and B. Banerjee, “Meta-learning to teach semantic prompts for open domain gen- eralization in vision-language models,” Transactions on Machine Learning Research, 2025

2025
[109]

Prompt-based distribution alignment for unsupervised domain adaptation,

S. Bai, M. Zhang, W. Zhou, S. Huang, Z. Luan, D. Wang, and B. Chen, “Prompt-based distribution alignment for unsupervised domain adaptation,” in Proceedings of the AAAI conference on artificial intelligence, vol. 38, no. 2, 2024, pp. 729–737

2024
[110]

Clip-enhanced unsuper- vised domain adaptation with consistency regularization,

K. Shi, J. Lu, Z. Fang, and G. Zhang, “Clip-enhanced unsuper- vised domain adaptation with consistency regularization,” in 2024 International Joint Conference on Neural Networks (IJCNN) . IEEE, 2024, pp. 1–8

2024
[111]

Unsupervised domain adaptation enhanced by fuzzy prompt learning,

——, “Unsupervised domain adaptation enhanced by fuzzy prompt learning,” IEEE Transactions on Fuzzy Systems, 2024

2024
[112]

Multi-prompt align- ment for multi-source unsupervised domain adaptation,

H. Chen, X. Han, Z. Wu, and Y.-G. Jiang, “Multi-prompt align- ment for multi-source unsupervised domain adaptation,” Ad- vances in Neural Information Processing Systems, vol. 36, pp. 74 127– 74 139, 2023

2023
[113]

Prompt distribution learning,

Y. Lu, J. Liu, Y. Zhang, Y. Liu, and X. Tian, “Prompt distribution learning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 5206–5215

2022
[114]

Zip: An efficient zeroth-order prompt tuning for black-box vision-language mod- els,

S. Park, J. Jeong, Y. Kim, J. Lee, and N. Lee, “Zip: An efficient zeroth-order prompt tuning for black-box vision-language mod- els,” arXiv preprint arXiv:2504.06838, 2025

2025 arXiv
[115]

Generalizing to unseen domains: A survey on domain generalization,

J. Wang, C. Lan, C. Liu, Y. Ouyang, T. Qin, W. Lu, Y. Chen, W. Zeng, and P . S. Yu, “Generalizing to unseen domains: A survey on domain generalization,” IEEE transactions on knowledge and data engineering, vol. 35, no. 8, pp. 8052–8072, 2022

2022
[116]

Learning to learn single domain generalization,

F. Qiao, L. Zhao, and X. Peng, “Learning to learn single domain generalization,” in Proceedings of the IEEE/CVF conference on com- puter vision and pattern recognition, 2020, pp. 12 556–12 565

2020
[117]

Learning to generate novel domains for domain generalization,

K. Zhou, Y. Yang, T. Hospedales, and T. Xiang, “Learning to generate novel domains for domain generalization,” in Computer vision–ECCV 2020: 16th European conference, glasgow, UK, August 23–28, 2020, proceedings, part XVI 16. Springer, 2020, pp. 561–578

2020
[118]

A simple feature augmentation for domain generalization,

P . Li, D. Li, W. Li, S. Gong, Y. Fu, and T. M. Hospedales, “A simple feature augmentation for domain generalization,” in Proceedings JOURNAL OF LATEX CLASS FILES, VOL. 13, NO. 9, SEPTEMBER 2014 21 of the IEEE/CVF international conference on computer vision , 2021, pp. 8886–8895

2014
[119]

Moment matching for multi-source domain adaptation,

X. Peng, Q. Bai, X. Xia, Z. Huang, K. Saenko, and B. Wang, “Moment matching for multi-source domain adaptation,” in Pro- ceedings of the IEEE/CVF international conference on computer vision, 2019, pp. 1406–1415

2019
[120]

Agile multi-source-free domain adaptation,

X. Li, J. Li, F. Li, L. Zhu, and K. Lu, “Agile multi-source-free domain adaptation,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 12, 2024, pp. 13 673–13 681

2024
[121]

A mathematical theory of communication,

C. E. Shannon, “A mathematical theory of communication,” The Bell system technical journal, vol. 27, no. 3, pp. 379–423, 1948

1948
[122]

Align your prompts: Test-time prompting with distribution alignment for zero-shot generalization,

J. Abdul Samadh, M. H. Gani, N. Hussein, M. U. Khattak, M. M. Naseer, F. Shahbaz Khan, and S. H. Khan, “Align your prompts: Test-time prompting with distribution alignment for zero-shot generalization,” Advances in Neural Information Processing Systems, vol. 36, pp. 80 396–80 ...

2023
[123]

Swapprompt: Test-time prompt adaptation for vision-language models,

X. Ma, J. Zhang, S. Guo, and W. Xu, “Swapprompt: Test-time prompt adaptation for vision-language models,” Advances in Neural Information Processing Systems , vol. 36, pp. 65 252–65 264, 2023

2023
[124]

C-tpt: Calibrated test-time prompt tuning for vision- language models via text feature dispersion,

H. S. Yoon, E. Yoon, J. T. J. Tee, M. Hasegawa-Johnson, Y. Li, and C. D. Yoo, “C-tpt: Calibrated test-time prompt tuning for vision- language models via text feature dispersion,” arXiv preprint arXiv:2403.14119, 2024

2024 arXiv
[125]

Dynaprompt: Dynamic test-time prompt tun- ing,

Z. Xiao, S. Yan, J. Hong, J. Cai, X. Jiang, Y. Hu, J. Shen, Q. Wang, and C. G. Snoek, “Dynaprompt: Dynamic test-time prompt tun- ing,” arXiv preprint arXiv:2501.16404, 2025

2025 arXiv
[126]

R-tpt: Improving adversarial robustness of vision-language models through test- time prompt tuning,

L. Sheng, J. Liang, Z. Wang, and R. He, “R-tpt: Improving adversarial robustness of vision-language models through test- time prompt tuning,” in Proceedings of the Computer Vision and Pattern Recognition Conference, 2025, pp. 29 958–29 967

2025
[127]

O-tpt: Orthogonality constraints for calibrating test- time prompt tuning in vision-language models,

A. Sharifdeen, M. A. Munir, S. Baliah, S. Khan, and M. H. Khan, “O-tpt: Orthogonality constraints for calibrating test- time prompt tuning in vision-language models,” arXiv preprint arXiv:2503.12096, 2025

2025 arXiv
[128]

Image segmentation using text and image prompts,

T. L ¨uddecke and A. Ecker, “Image segmentation using text and image prompts,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 7086–7096

2022
[129]

Clip the gap: A single domain generalization approach for object detection,

V . Vidit, M. Engilberge, and M. Salzmann, “Clip the gap: A single domain generalization approach for object detection,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2023, pp. 3219–3229

2023
[130]

Clip-count: Towards text-guided zero-shot object counting,

R. Jiang, L. Liu, and C. Chen, “Clip-count: Towards text-guided zero-shot object counting,” in Proceedings of the 31st ACM Interna- tional Conference on Multimedia, 2023, pp. 4535–4545

2023
[131]

Padclip: Pseudo-labeling with adaptive debi- asing in clip for unsupervised domain adaptation,

Z. Lai, N. Vesdapunt, N. Zhou, J. Wu, C. P . Huynh, X. Li, K. K. Fu, and C.-N. Chuah, “Padclip: Pseudo-labeling with adaptive debi- asing in clip for unsupervised domain adaptation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 16 155–16 165

2023
[132]

Distilling the knowledge in a neural network,

G. Hinton, O. Vinyals, and J. Dean, “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531, 2015

2015 arXiv
[133]

On large-batch training for deep learning: Generalization gap and sharp minima,

N. S. Keskar, D. Mudigere, J. Nocedal, M. Smelyanskiy, and P . T. P . Tang, “On large-batch training for deep learning: Generalization gap and sharp minima,” arXiv preprint arXiv:1609.04836, 2016

2016 arXiv
[134]

Averaging weights leads to wider optima and better generalization,

P . Izmailov, D. Podoprikhin, T. Garipov, D. Vetrov, and A. G. Wilson, “Averaging weights leads to wider optima and better generalization,” in 34th Conference on Uncertainty in Artificial Intelligence 2018, UAI 2018 . Association For Uncertainty in Artificial Intelligence (AUA...

2018
[135]

Swad: Domain generalization by seeking flat minima,

J. Cha, S. Chun, K. Lee, H.-C. Cho, S. Park, Y. Lee, and S. Park, “Swad: Domain generalization by seeking flat minima,” Advances in Neural Information Processing Systems, vol. 34, pp. 22 405–22 418, 2021

2021
[136]

Context- aware robust fine-tuning,

X. Mao, Y. Chen, X. Jia, R. Zhang, H. Xue, and Z. Li, “Context- aware robust fine-tuning,” International Journal of Computer Vision, vol. 132, no. 5, pp. 1685–1700, 2024

2024
[137]

Dart: Diversify-aggregate-repeat training improves generalization of neural networks,

S. Jain, S. Addepalli, P . K. Sahu, P . Dey, and R. V . Babu, “Dart: Diversify-aggregate-repeat training improves generalization of neural networks,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 16 048–16 059

2023
[138]

Watt: Weight average test-time adaptation of clip,

D. Osowiechi, M. Noori, G. A. V . Hakim, M. Yazdanpanah, A. Bahri, M. Cheraghalikhani, S. Dastani, F. Beizaee, I. B. Ayed, and C. Desrosiers, “Watt: Weight average test-time adaptation of clip,” arXiv preprint arXiv:2406.13875, 2024

2024 arXiv
[139]

Finetune like you pretrain: Improved finetuning of zero-shot vision models,

S. Goyal, A. Kumar, S. Garg, Z. Kolter, and A. Raghunathan, “Finetune like you pretrain: Improved finetuning of zero-shot vision models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 19 338–19 347

2023
[140]

Lipsum-ft: Robust fine-tuning of zero-shot models using random text guidance,

G. Nam, B. Heo, and J. Lee, “Lipsum-ft: Robust fine-tuning of zero-shot models using random text guidance,” arXiv preprint arXiv:2404.00860, 2024

2024 arXiv
[141]

Realistic unsuper- vised clip fine-tuning with universal entropy optimization,

J. Liang, L. Sheng, Z. Wang, R. He, and T. Tan, “Realistic unsuper- vised clip fine-tuning with universal entropy optimization,” in Proceedings of the 41st International Conference on Machine Learning, 2024, pp. 29 667–29 681

2024
[142]

Do we really need to access the source data? source hypothesis transfer for unsupervised do- main adaptation,

J. Liang, D. Hu, and J. Feng, “Do we really need to access the source data? source hypothesis transfer for unsupervised do- main adaptation,” in International conference on machine learning . PMLR, 2020, pp. 6028–6039

2020
[143]

Saft: Towards out-of-distribution generalization in fine-tuning,

B. Nguyen, S. Uhlich, F. Cardinaux, L. Mauch, M. Edraki, and A. Courville, “Saft: Towards out-of-distribution generalization in fine-tuning,” in European Conference on Computer Vision. Springer, 2024, pp. 138–154

2024
[144]

Clip-td: Clip targeted distil- lation for vision-language tasks,

Z. Wang, N. Codella, Y.-C. Chen, L. Zhou, J. Yang, X. Dai, B. Xiao, H. You, S.-F. Chang, and L. Yuan, “Clip-td: Clip targeted distil- lation for vision-language tasks,” arXiv preprint arXiv:2201.05729, 2022

2022 arXiv
[145]

Ad- versarial prompt distillation for vision-language models,

L. Luo, X. Wang, B. Zi, S. Zhao, X. Ma, and Y.-G. Jiang, “Ad- versarial prompt distillation for vision-language models,” arXiv preprint arXiv:2411.15244, 2024

2024
[146]

Distilling vision-language foundation models: A data-free ap- proach via prompt diversification,

Y. Xuan, W. Chen, S. Yang, D. Xie, L. Lin, and Y. Zhuang, “Distilling vision-language foundation models: A data-free ap- proach via prompt diversification,” in Proceedings of the 31st ACM International Conference on Multimedia, 2023, pp. 4928–4938

2023
[147]

A sentence speaks a thousand images: Domain generalization through distilling clip with language guidance,

Z. Huang, A. Zhou, Z. Ling, M. Cai, H. Wang, and Y. J. Lee, “A sentence speaks a thousand images: Domain generalization through distilling clip with language guidance,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 11 685–11 695

2023
[148]

Distilling out-of- distribution robustness from vision-language foundation mod- els,

A. Zhou, J. Wang, Y.-X. Wang, and H. Wang, “Distilling out-of- distribution robustness from vision-language foundation mod- els,” Advances in Neural Information Processing Systems , vol. 36, pp. 32 938–32 957, 2023

2023
[149]

Promptkd: Unsupervised prompt distillation for vision- language models,

Z. Li, X. Li, X. Fu, X. Zhang, W. Wang, S. Chen, and J. Yang, “Promptkd: Unsupervised prompt distillation for vision- language models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 26 617–26 626

2024
[150]

Im- proving zero-shot generalization of learned prompts via un- supervised knowledge distillation,

M. Mistretta, A. Baldrati, M. Bertini, and A. D. Bagdanov, “Im- proving zero-shot generalization of learned prompts via un- supervised knowledge distillation,” in European Conference on Computer Vision. Springer, 2024, pp. 459–477

2024
[151]

Clip the divergence: Language- guided unsupervised domain adaptation,

J. Zhu, Y. Chen, and L. Wang, “Clip the divergence: Language- guided unsupervised domain adaptation,” arXiv preprint arXiv:2407.01842, 2024

2024 arXiv
[152]

Unsupervised domain adaption harness- ing vision-language pre-training,

W. Zhou and Z. Zhou, “Unsupervised domain adaption harness- ing vision-language pre-training,” IEEE Transactions on Circuits and Systems for Video Technology, 2024

2024
[153]

Customkd: Customizing large vision foundation for edge model improvement via knowledge distillation,

J. Lee, D. Das, M. Hayat, S. Choi, K. Hwang, and F. Porikli, “Customkd: Customizing large vision foundation for edge model improvement via knowledge distillation,” arXiv preprint arXiv:2503.18244, 2025

2025 arXiv
[154]

Test-time adaptation with clip reward for zero-shot generalization in vision-language mod- els,

S. Zhao, X. Wang, L. Zhu, and Y. Yang, “Test-time adaptation with clip reward for zero-shot generalization in vision-language mod- els,” in 12th International Conference on Learning Representations, ICLR 2024, 2024

2024
[155]

Words matter: Leveraging individual text embeddings for code generation in clip test-time adaptation,

S. Mishra, J. Silva-Rodrıguez, I. B. Ayed, M. Pedersoli, and J. Dolz, “Words matter: Leveraging individual text embeddings for code generation in clip test-time adaptation,” arXiv preprint arXiv:2411.17002, 2024

2024
[156]

Towards stable test-time adaptation in dynamic wild world,

S. Niu, J. Wu, Y. Zhang, Z. Wen, Y. Chen, P . Zhao, and M. Tan, “Towards stable test-time adaptation in dynamic wild world,” arXiv preprint arXiv:2302.12400, 2023

2023 arXiv
[157]

Domain- specific block selection and paired-view pseudo-labeling for on- line test-time adaptation,

Y. Yu, S. Shin, S. Back, M. Ko, S. Noh, and K. Lee, “Domain- specific block selection and paired-view pseudo-labeling for on- line test-time adaptation,” in Proceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition , 2024, pp. 22 723– 22 732

2024
[158]

Cli- partt: Adaptation of clip to new domains at test time,

G. A. V . Hakim, D. Osowiechi, M. Noori, M. Cheraghalikhani, A. Bahri, M. Yazdanpanah, I. B. Ayed, and C. Desrosiers, “Cli- partt: Adaptation of clip to new domains at test time,” in 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). IEEE, 2025, pp. 709...

2025
[159]

Test-time low rank adaptation via confidence maximization for zero-shot generalization of vision-language models,

R. Imam, H. Gani, M. Huzaifa, and K. Nandakumar, “Test-time low rank adaptation via confidence maximization for zero-shot generalization of vision-language models,” in 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) . IEEE, 2025, pp. 5449–5459

2025
[160]

Pouf: Prompt-oriented unsupervised fine-tuning for large pre-trained models,

K. Tanwisuth, S. Zhang, H. Zheng, P . He, and M. Zhou, “Pouf: Prompt-oriented unsupervised fine-tuning for large pre-trained models,” in International Conference on Machine Learning. PMLR, 2023, pp. 33 816–33 832

2023
[161]

Empowering source-free domain adaptation with mllm-driven curriculum learning,

D. Chen, K. Patwari, Z. Lai, S.-c. Cheung, and C.-N. Chuah, “Empowering source-free domain adaptation with mllm-driven curriculum learning,” arXiv preprint arXiv:2405.18376, 2024

2024
[162]

Vilaad: Enhancing

S. Tarashima, X. Shu, and N. Tagawa, “Vilaad: Enhancing” attracting and dispersing”source-free domain adaptation with vision-and-language model,” arXiv preprint arXiv:2503.23529 , 2025

2025 arXiv
[163]

The unreasonable effectiveness of large language-vision models for source-free video domain adaptation,

G. Zara, A. Conti, S. Roy, S. Lathuili `ere, P . Rota, and E. Ricci, “The unreasonable effectiveness of large language-vision models for source-free video domain adaptation,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 10 307–10 317

2023
[164]

Source-free domain adapta- tion with frozen multimodal foundation model,

S. Tang, W. Su, M. Ye, and X. Zhu, “Source-free domain adapta- tion with frozen multimodal foundation model,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recogni- tion, 2024, pp. 23 711–23 720

2024
[165]

To- wards dynamic-prompting collaboration for source-free domain adaptation,

M. Zhan, Z. Wu, R. Hu, P . Hu, H. T. Shen, and X. Zhu, “To- wards dynamic-prompting collaboration for source-free domain adaptation,” in Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, 2024, pp. 1643–1651

2024
[166]

Source-free domain adapta- tion guided by vision and vision-language pre-training,

W. Zhang, L. Shen, and C.-S. Foo, “Source-free domain adapta- tion guided by vision and vision-language pre-training,” Inter- national Journal of Computer Vision , vol. 133, no. 2, pp. 844–866, 2025

2025
[167]

Proxy denoising for source-free domain adaptation,

S. Tang, W. Su, Y. Gan, M. Ye, J. Zhang, and X. Zhu, “Proxy denoising for source-free domain adaptation,” arXiv preprint arXiv:2406.01658, 2024

2024 arXiv
[168]

Batch normalization: Accelerating deep network training by reducing internal covariate shift,

S. Ioffe and C. Szegedy, “Batch normalization: Accelerating deep network training by reducing internal covariate shift,” in Interna- tional conference on machine learning. pmlr, 2015, pp. 448–456

2015
[169]

Revisiting batch normalization for practical domain adaptation,

Y. Li, N. Wang, J. Shi, J. Liu, and X. Hou, “Revisiting batch normalization for practical domain adaptation,” arXiv preprint arXiv:1603.04779, 2016

2016 arXiv
[170]

Improving robustness against common corruptions by covariate shift adaptation,

S. Schneider, E. Rusak, L. Eck, O. Bringmann, W. Brendel, and M. Bethge, “Improving robustness against common corruptions by covariate shift adaptation,” Advances in neural information processing systems, vol. 33, pp. 11 539–11 551, 2020

2020
[171]

Test-time batch statistics calibration for covariate shift,

F. You, J. Li, and Z. Zhao, “Test-time batch statistics calibration for covariate shift,” arXiv preprint arXiv:2110.04065, 2021

2021 arXiv
[172]

Lora: Low-rank adaptation of large language models

E. J. Hu, Y. Shen, P . Wallis, Z. Allen-Zhu, Y. Li, S. Wang, L. Wang, W. Chen et al. , “Lora: Low-rank adaptation of large language models.” ICLR, vol. 1, no. 2, p. 3, 2022

2022
[173]

Parameter-efficient fine-tuning of large- scale pre-trained language models,

N. Ding, Y. Qin, G. Yang, F. Wei, Z. Yang, Y. Su, S. Hu, Y. Chen, C.- M. Chan, W. Chen et al., “Parameter-efficient fine-tuning of large- scale pre-trained language models,” Nature Machine Intelligence , vol. 5, no. 3, pp. 220–235, 2023

2023
[174]

Deep model reassembly,

X. Yang, D. Zhou, S. Liu, J. Ye, and X. Wang, “Deep model reassembly,” Advances in neural information processing systems , vol. 35, pp. 25 739–25 753, 2022

2022
[175]

Intrinsic di- mensionality explains the effectiveness of language model fine- tuning,

A. Aghajanyan, L. Zettlemoyer, and S. Gupta, “Intrinsic di- mensionality explains the effectiveness of language model fine- tuning,” arXiv preprint arXiv:2012.13255, 2020

2012 arXiv
[176]

Stronger gener- alization bounds for deep nets via a compression approach,

S. Arora, R. Ge, B. Neyshabur, and Y. Zhang, “Stronger gener- alization bounds for deep nets via a compression approach,” in International conference on machine learning. PMLR, 2018, pp. 254– 263

2018
[177]

Black box few-shot adaptation for vision-language models,

Y. Ouali, A. Bulat, B. Matinez, and G. Tzimiropoulos, “Black box few-shot adaptation for vision-language models,” in Proceedings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 15 534–15 546

2023
[178]

Dine: Domain adaptation from single and multiple black-box predictors,

J. Liang, D. Hu, J. Feng, and R. He, “Dine: Domain adaptation from single and multiple black-box predictors,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2022, pp. 8003–8013

2022
[179]

Confident anchor- induced multi-source free domain adaptation,

J. Dong, Z. Fang, A. Liu, G. Sun, and T. Liu, “Confident anchor- induced multi-source free domain adaptation,”Advances in neural information processing systems, vol. 34, pp. 2848–2860, 2021

2021
[180]

Select and distill: Selective dual-teacher knowledge transfer for continual learning on vision-language models,

Y.-C. Yu, C.-P . Huang, J.-J. Chen, K.-P . Chang, Y.-H. Lai, F.-E. Yang, and Y.-C. F. Wang, “Select and distill: Selective dual-teacher knowledge transfer for continual learning on vision-language models,” in European Conference on Computer Vision . Springer, 2024, pp. 219–236

2024
[181]

Learning a unified classifier incrementally via rebalancing,

S. Hou, X. Pan, C. C. Loy, Z. Wang, and D. Lin, “Learning a unified classifier incrementally via rebalancing,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2019, pp. 831–839

2019
[182]

Learning to learn without forgetting by maximizing transfer and minimizing interference,

M. Riemer, I. Cases, R. Ajemian, M. Liu, I. Rish, Y. Tu, and G. Tesauro, “Learning to learn without forgetting by maximizing transfer and minimizing interference,” in International Conference on Learning Representations, 2019

2019
[183]

A review of semantic segmentation using deep neural networks,

Y. Guo, Y. Liu, T. Georgiou, and M. S. Lew, “A review of semantic segmentation using deep neural networks,” International journal of multimedia information retrieval, vol. 7, pp. 87–93, 2018

2018
[184]

Open-vocabulary object detection via vision and language knowledge distillation,

X. Gu, T.-Y. Lin, W. Kuo, and Y. Cui, “Open-vocabulary object detection via vision and language knowledge distillation,” arXiv preprint arXiv:2104.13921, 2021

2021 arXiv
[185]

Open-vocabulary one-stage detection with hierarchical visual-language knowledge distillation,

Z. Ma, G. Luo, J. Gao, L. Li, Y. Chen, S. Wang, C. Zhang, and W. Hu, “Open-vocabulary one-stage detection with hierarchical visual-language knowledge distillation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2022, pp. 14 074–14 083

2022
[186]

Bridging the gap between object and image-level rep- resentations for open-vocabulary detection,

H. Bangalath, M. Maaz, M. U. Khattak, S. H. Khan, and F. Shah- baz Khan, “Bridging the gap between object and image-level rep- resentations for open-vocabulary detection,” Advances in Neural Information Processing Systems, vol. 35, pp. 33 781–33 794, 2022

2022
[187]

A simple baseline for open-vocabulary semantic segmentation with pre-trained vision-language model,

M. Xu, Z. Zhang, F. Wei, Y. Lin, Y. Cao, H. Hu, and X. Bai, “A simple baseline for open-vocabulary semantic segmentation with pre-trained vision-language model,” in European Conference on Computer Vision. Springer, 2022, pp. 736–753

2022
[188]

Scaling open-vocabulary image segmentation with image-level labels,

G. Ghiasi, X. Gu, Y. Cui, and T.-Y. Lin, “Scaling open-vocabulary image segmentation with image-level labels,” in European confer- ence on computer vision. Springer, 2022, pp. 540–557

2022
[189]

Extract free dense labels from clip,

C. Zhou, C. C. Loy, and B. Dai, “Extract free dense labels from clip,” in European Conference on Computer Vision. Springer, 2022, pp. 696–712

2022
[190]

Calip: Zero-shot enhancement of clip with parameter-free atten- tion,

Z. Guo, R. Zhang, L. Qiu, X. Ma, X. Miao, X. He, and B. Cui, “Calip: Zero-shot enhancement of clip with parameter-free atten- tion,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 37, no. 1, 2023, pp. 746–754

2023
[191]

On the test-time zero-shot gener- alization of vision-language models: Do we really need prompt learning?

M. Zanella and I. Ben Ayed, “On the test-time zero-shot gener- alization of vision-language models: Do we really need prompt learning?” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 23 783–23 793

2024
[192]

Adapting to distribution shift by visual domain prompt generation,

Z. Chi, L. Gu, T. Zhong, H. Liu, Y. Yu, K. N. Plataniotis, and Y. Wang, “Adapting to distribution shift by visual domain prompt generation,” arXiv preprint arXiv:2405.02797, 2024

2024 arXiv
[193]

Learning to adapt frozen clip for few-shot test-time domain adaptation,

Z. Chi, L. Gu, H. Liu, Z. Wang, Y. Wu, Y. Wang, and K. N. Plataniotis, “Learning to adapt frozen clip for few-shot test-time domain adaptation,” in The Thirteenth International Conference on Learning Representations, 2025

2025
[194]

Promptstyler: Prompt-driven style generation for source-free domain general- ization,

J. Cho, G. Nam, S. Kim, H. Yang, and S. Kwak, “Promptstyler: Prompt-driven style generation for source-free domain general- ization,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 15 702–15 712

2023
[195]

Gradient estimation for unseen domain risk minimization with pre-trained models,

B. Lew, D. Son, and B. Chang, “Gradient estimation for unseen domain risk minimization with pre-trained models,” in Proceed- ings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 4436–4446

2023
[196]

Clipceil: Domain generalization through clip via channel refinement and image-text alignment,

X. Yu, S. Yoo, and Y. Lin, “Clipceil: Domain generalization through clip via channel refinement and image-text alignment,” Advances in Neural Information Processing Systems , vol. 37, pp. 4267–4294, 2024

2024
[197]

Prompt-driven dynamic object-centric learning for single domain generalization,

D. Li, A. Wu, Y. Wang, and Y. Han, “Prompt-driven dynamic object-centric learning for single domain generalization,” in Pro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 17 606–17 615

2024
[198]

Promptta: Prompt- driven text adapter for source-free domain generalization,

H. Zhang, S. Bai, W. Zhou, J. Fu, and B. Chen, “Promptta: Prompt- driven text adapter for source-free domain generalization,” in ICASSP 2025-2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 2025, pp. 1–5

2025
[199]

Task residual for tuning vision-language models,

T. Yu, Z. Lu, X. Jin, Z. Chen, and X. Wang, “Task residual for tuning vision-language models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2023, pp. 10 899–10 909. JOURNAL OF LATEX CLASS FILES, VOL. 13, NO. 9, SEPTEMBER 2014 23

2023
[200]

Improv- ing zero-shot generalization for clip with synthesized prompts,

Z. Wang, J. Liang, R. He, N. Xu, Z. Wang, and T. Tan, “Improv- ing zero-shot generalization for clip with synthesized prompts,” arXiv preprint arXiv:2307.07397, 2023

2023 arXiv
[201]

A closer look at the few-shot adaptation of large vision-language models,

J. Silva-Rodriguez, S. Hajimiri, I. Ben Ayed, and J. Dolz, “A closer look at the few-shot adaptation of large vision-language models,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 23 681–23 690

2024
[202]

Efficient and long- tailed generalization for pre-trained vision-language model,

J.-X. Shi, C. Zhang, T. Wei, and Y.-F. Li, “Efficient and long- tailed generalization for pre-trained vision-language model,” in Proceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 2024, pp. 2663–2673

2024
[203]

Empowering unsupervised domain adaptation with large-scale pre-trained vision-language models,

Z. Lai, H. Bai, H. Zhang, X. Du, J. Shan, Y. Yang, C.-N. Chuah, and M. Cao, “Empowering unsupervised domain adaptation with large-scale pre-trained vision-language models,” in Proceedings of the ieee/cvf winter conference on applications of computer vision , 2024, pp. 2691–2701

2024
[204]

Poda: Prompt-driven zero-shot domain adaptation,

M. Fahes, T.-H. Vu, A. Bursuc, P . P ´erez, and R. De Charette, “Poda: Prompt-driven zero-shot domain adaptation,” in Proceed- ings of the IEEE/CVF International Conference on Computer Vision , 2023, pp. 18 623–18 633

2023
[205]

Unified language-driven zero-shot domain adaptation,

S. Yang, Z. Tian, L. Jiang, and J. Jia, “Unified language-driven zero-shot domain adaptation,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 23 407–23 415

2024
[206]

Landa: Language-guided multi-source domain adaptation,

Z. Wang, L. Zhang, L. Wang, and M. Zhu, “Landa: Language-guided multi-source domain adaptation,” arXiv preprint arXiv:2401.14148, 2024

2024 arXiv
[207]

Reclip: Refine contrastive language image pre-training with source free domain adaptation,

X. Hu, K. Zhang, L. Xia, A. Chen, J. Luo, Y. Sun, K. Wang, N. Qiao, X. Zeng, M. Sun et al., “Reclip: Refine contrastive language image pre-training with source free domain adaptation,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2024, p...

2024
[208]

Domain aligned clip for few-shot clas- sification,

M. W. Gondal, J. Gast, I. A. Ruiz, R. Droste, T. Macri, S. Ku- mar, and L. Staudigl, “Domain aligned clip for few-shot clas- sification,” in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, 2024, pp. 5721–5730

2024
[209]

Concept-guided prompt learning for generalization in vision-language models,

Y. Zhang, C. Zhang, K. Yu, Y. Tang, and Z. He, “Concept-guided prompt learning for generalization in vision-language models,” in Proceedings of the AAAI Conference on Artificial Intelligence , vol. 38, no. 7, 2024, pp. 7377–7386

2024
[210]

Dual prototype evolving for test-time generalization of vision-language models,

C. Zhang, S. Stepputtis, K. Sycara, and Y. Xie, “Dual prototype evolving for test-time generalization of vision-language models,” Advances in Neural Information Processing Systems , vol. 37, pp. 32 111–32 136, 2024

2024
[211]

Bayesian test-time adaptation for vision-language mod- els,

L. Zhou, M. Ye, S. Li, N. Li, X. Zhu, L. Deng, H. Liu, and Z. Lei, “Bayesian test-time adaptation for vision-language mod- els,” arXiv preprint arXiv:2503.09248, 2025

2025 arXiv
[212]

Sus-x: Training-free name-only transfer of vision-language models,

V . Udandarao, A. Gupta, and S. Albanie, “Sus-x: Training-free name-only transfer of vision-language models,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 2725–2736

2023
[213]

Not all features matter: Enhancing few-shot clip with adaptive prior refinement,

X. Zhu, R. Zhang, B. He, A. Zhou, D. Wang, B. Zhao, and P . Gao, “Not all features matter: Enhancing few-shot clip with adaptive prior refinement,” in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 2605–2615

2023
[214]

A hard- to-beat baseline for training-free clip-based adaptation,

Z. Wang, J. Liang, L. Sheng, R. He, Z. Wang, and T. Tan, “A hard- to-beat baseline for training-free clip-based adaptation,” arXiv preprint arXiv:2402.04087, 2024

2024 arXiv
[215]

Frus- tratingly easy test-time adaptation of vision-language models,

M. Farina, G. Franchi, G. Iacca, M. Mancini, and E. Ricci, “Frus- tratingly easy test-time adaptation of vision-language models,” Advances in Neural Information Processing Systems , 2024

2024
[216]

Bendvlm: Test-time debiasing of vision-language embeddings,

W. Gerych, H. Zhang, K. Hamidieh, E. Pan, M. K. Sharma, T. Hartvigsen, and M. Ghassemi, “Bendvlm: Test-time debiasing of vision-language embeddings,” Advances in Neural Information Processing Systems, vol. 37, pp. 62 480–62 502, 2024

2024
[217]

Generalization through memorization: Nearest neigh- bor language models,

U. Khandelwal, O. Levy, D. Jurafsky, L. Zettlemoyer, and M. Lewis, “Generalization through memorization: Nearest neigh- bor language models,” arXiv preprint arXiv:1911.00172, 2019

1911 arXiv
[218]

Natural adversarial examples,

D. Hendrycks, K. Zhao, S. Basart, J. Steinhardt, and D. Song, “Natural adversarial examples,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2021, pp. 15 262–15 271

2021
[219]

The many faces of robustness: A critical analysis of out-of-distribution gen- eralization,

D. Hendrycks, S. Basart, N. Mu, S. Kadavath, F. Wang, E. Dorundo, R. Desai, T. Zhu, S. Parajuli, M. Guoet al., “The many faces of robustness: A critical analysis of out-of-distribution gen- eralization,” in Proceedings of the IEEE/CVF international conference on computer visio...

2021
[220]

Learning robust global representations by penalizing local predictive power,

H. Wang, S. Ge, Z. Lipton, and E. P . Xing, “Learning robust global representations by penalizing local predictive power,” Advances in neural information processing systems, vol. 32, 2019

2019
[221]

Do imagenet classifiers generalize to imagenet?

B. Recht, R. Roelofs, L. Schmidt, and V . Shankar, “Do imagenet classifiers generalize to imagenet?” in International conference on machine learning. PMLR, 2019, pp. 5389–5400

2019
[222]

Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories,

L. Fei-Fei, R. Fergus, and P . Perona, “Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories,” in 2004 conference on computer vision and pattern recognition workshop . IEEE, 2004, pp. 178–178

2004
[223]

Cats and dogs,

O. M. Parkhi, A. Vedaldi, A. Zisserman, and C. Jawahar, “Cats and dogs,” in 2012 IEEE conference on computer vision and pattern recognition. IEEE, 2012, pp. 3498–3505

2012
[224]

3d object represen- tations for fine-grained categorization,

J. Krause, M. Stark, J. Deng, and L. Fei-Fei, “3d object represen- tations for fine-grained categorization,” in Proceedings of the IEEE international conference on computer vision workshops, 2013, pp. 554– 561

2013
[225]

Automated flower classi- fication over a large number of classes,

M.-E. Nilsback and A. Zisserman, “Automated flower classi- fication over a large number of classes,” in 2008 Sixth Indian conference on computer vision, graphics & image processing . IEEE, 2008, pp. 722–729

2008
[226]

Food-101–mining discriminative components with random forests,

L. Bossard, M. Guillaumin, and L. Van Gool, “Food-101–mining discriminative components with random forests,” in Computer vision–ECCV 2014: 13th European conference, zurich, Switzerland, September 6-12, 2014, proceedings, part VI 13 . Springer, 2014, pp. 446–461

2014
[227]

Fine-grained visual classification of aircraft,

S. Maji, E. Rahtu, J. Kannala, M. Blaschko, and A. Vedaldi, “Fine-grained visual classification of aircraft,” arXiv preprint arXiv:1306.5151, 2013

2013 arXiv
[228]

Sun database: Large-scale scene recognition from abbey to zoo,

J. Xiao, J. Hays, K. A. Ehinger, A. Oliva, and A. Torralba, “Sun database: Large-scale scene recognition from abbey to zoo,” in 2010 IEEE computer society conference on computer vision and pattern recognition. IEEE, 2010, pp. 3485–3492

2010
[229]

Describing textures in the wild,

M. Cimpoi, S. Maji, I. Kokkinos, S. Mohamed, and A. Vedaldi, “Describing textures in the wild,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2014, pp. 3606–3613

2014
[230]

Eurosat: A novel dataset and deep learning benchmark for land use and land cover classification,

P . Helber, B. Bischke, A. Dengel, and D. Borth, “Eurosat: A novel dataset and deep learning benchmark for land use and land cover classification,” IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing , vol. 12, no. 7, pp. 2217–2226, 2019

2019
[231]

Ucf101: A dataset of 101 human actions classes from videos in the wild,

K. Soomro, A. R. Zamir, and M. Shah, “Ucf101: A dataset of 101 human actions classes from videos in the wild,” arXiv preprint arXiv:1212.0402, 2012

2012 arXiv
[232]

Deeper, broader and artier domain generalization,

D. Li, Y. Yang, Y.-Z. Song, and T. M. Hospedales, “Deeper, broader and artier domain generalization,” in Proceedings of the IEEE international conference on computer vision, 2017, pp. 5542–5550

2017
[233]

Unbiased look at dataset bias,

A. Torralba and A. A. Efros, “Unbiased look at dataset bias,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. IEEE, 2011, pp. 1521–1528

2011
[234]

Recognition in terra incognita,

S. Beery, G. Van Horn, and P . Perona, “Recognition in terra incognita,” in Proceedings of the European conference on computer vision (ECCV), 2018, pp. 456–473

2018
[235]

Deep hashing network for unsupervised domain adaptation,

H. Venkateswara, J. Eusebio, S. Chakraborty, and S. Pan- chanathan, “Deep hashing network for unsupervised domain adaptation,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 5018–5027

2017
[236]

Visda: The visual domain adaptation challenge,

X. Peng, B. Usman, N. Kaushik, J. Hoffman, D. Wang, and K. Saenko, “Visda: The visual domain adaptation challenge,” arXiv preprint arXiv:1710.06924, 2017

2017 arXiv
[237]

Making the v in vqa matter: Elevating the role of image un- derstanding in visual question answering,

Y. Goyal, T. Khot, D. Summers-Stay, D. Batra, and D. Parikh, “Making the v in vqa matter: Elevating the role of image un- derstanding in visual question answering,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 6904–6913

2017
[238]

Microsoft coco captions: Data collection and evaluation server,

X. Chen, H. Fang, T.-Y. Lin, R. Vedantam, S. Gupta, P . Doll ´ar, and C. L. Zitnick, “Microsoft coco captions: Data collection and evaluation server,” arXiv preprint arXiv:1504.00325, 2015

2015 arXiv
[239]

From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions,

P . Young, A. Lai, M. Hodosh, and J. Hockenmaier, “From image descriptions to visual denotations: New similarity metrics for semantic inference over event descriptions,” Transactions of the association for computational linguistics, vol. 2, pp. 67–78, 2014

2014
[240]

Tvqa: Localized, composi- tional video question answering,

J. Lei, L. Yu, M. Bansal, and T. L. Berg, “Tvqa: Localized, composi- tional video question answering,”arXiv preprint arXiv:1809.01696, 2018. JOURNAL OF LATEX CLASS FILES, VOL. 13, NO. 9, SEPTEMBER 2014 24

2018 arXiv
[241]

Hero: Hierarchical encoder for video+ language omni-representation pre-training,

L. Li, Y.-C. Chen, Y. Cheng, Z. Gan, L. Yu, and J. Liu, “Hero: Hierarchical encoder for video+ language omni-representation pre-training,” arXiv preprint arXiv:2005.00200, 2020

2005 arXiv
[242]

Tvr: A large-scale dataset for video-subtitle moment retrieval,

J. Lei, L. Yu, T. L. Berg, and M. Bansal, “Tvr: A large-scale dataset for video-subtitle moment retrieval,” in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXI 16. Springer, 2020, pp. 447–463

2020
[243]

Vision-and-language navigation: Interpreting visually- grounded navigation instructions in real environments,

P . Anderson, Q. Wu, D. Teney, J. Bruce, M. Johnson, N. S ¨underhauf, I. Reid, S. Gould, and A. Van Den Hen- gel, “Vision-and-language navigation: Interpreting visually- grounded navigation instructions in real environments,” in Pro- ceedings of the IEEE conference on computer...

2018
[244]

Reverie: Remote embodied visual referring expression in real indoor environments,

Y. Qi, Q. Wu, P . Anderson, X. Wang, W. Y. Wang, C. Shen, and A. v. d. Hengel, “Reverie: Remote embodied visual referring expression in real indoor environments,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2020, pp. 9982–9991

2020
[245]

Microsoft coco: Common objects in context,

T.-Y. Lin, M. Maire, S. Belongie, J. Hays, P . Perona, D. Ramanan, P . Doll´ar, and C. L. Zitnick, “Microsoft coco: Common objects in context,” in Computer vision–ECCV 2014: 13th European conference, zurich, Switzerland, September 6-12, 2014, proceedings, part v 13 . Springer,...

2014
[246]

The cityscapes dataset for semantic urban scene understanding,

M. Cordts, M. Omran, S. Ramos, T. Rehfeld, M. Enzweiler, R. Benenson, U. Franke, S. Roth, and B. Schiele, “The cityscapes dataset for semantic urban scene understanding,” in Proceedings of the IEEE conference on computer vision and pattern recognition , 2016, pp. 3213–3223

2016
[247]

Playing for data: Ground truth from computer games,

S. R. Richter, V . Vineet, S. Roth, and V . Koltun, “Playing for data: Ground truth from computer games,” in Computer Vision– ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11-14, 2016, Proceedings, Part II 14 . Springer, 2016, pp. 102–118

2016
[248]

Domain prompt learning for efficiently adapting clip to unseen domains,

X. Zhang, S. S. Gu, Y. Matsuo, and Y. Iwasawa, “Domain prompt learning for efficiently adapting clip to unseen domains,” Trans- actions of the Japanese Society for Artificial Intelligence, vol. 38, no. 6, pp. B–MC2 1, 2023

2023
[249]

Historical test- time prompt tuning for vision foundation models,

J. Zhang, J. Huang, X. Zhang, L. Shao, and S. Lu, “Historical test- time prompt tuning for vision foundation models,” arXiv preprint arXiv:2410.20346, 2024

2024 arXiv
[250]

Zero-shot learning-the good, the bad and the ugly,

Y. Xian, B. Schiele, and Z. Akata, “Zero-shot learning-the good, the bad and the ugly,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 4582–4591

2017
[251]

In search of lost domain general- ization,

I. Gulrajani and D. Lopez-Paz, “In search of lost domain general- ization,” arXiv preprint arXiv:2007.01434, 2020

2007 arXiv
[252]

Sigmoid loss for language image pre-training,

X. Zhai, B. Mustafa, A. Kolesnikov, and L. Beyer, “Sigmoid loss for language image pre-training,” in Proceedings of the IEEE/CVF international conference on computer vision, 2023, pp. 11 975–11 986

2023
[253]

Segment anything,

A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A. C. Berg, W.-Y. Lo et al. , “Segment anything,” in Proceedings of the IEEE/CVF international conference on computer vision, 2023, pp. 4015–4026

2023
[254]

Exploring plain vision transformer backbones for object detection,

Y. Li, H. Mao, R. Girshick, and K. He, “Exploring plain vision transformer backbones for object detection,” in European confer- ence on computer vision. Springer, 2022, pp. 280–296

2022
[255]

Deepseek-vl2: Mixture-of-experts vision-language models for advanced multimodal understand- ing,

Z. Wu, X. Chen, Z. Pan, X. Liu, W. Liu, D. Dai, H. Gao, Y. Ma, C. Wu, B. Wang et al., “Deepseek-vl2: Mixture-of-experts vision-language models for advanced multimodal understand- ing,” arXiv preprint arXiv:2412.10302, 2024

2024 arXiv
[256]

Deepseekmoe: Towards ultimate expert spe- cialization in mixture-of-experts language models,

D. Dai, C. Deng, C. Zhao, R. Xu, H. Gao, D. Chen, J. Li, W. Zeng, X. Yu, Y. Wu et al., “Deepseekmoe: Towards ultimate expert spe- cialization in mixture-of-experts language models,”arXiv preprint arXiv:2401.06066, 2024

2024 arXiv
[257]

Janus: Decoupling visual encoding for unified multimodal understanding and generation,

C. Wu, X. Chen, Z. Wu, Y. Ma, X. Liu, Z. Pan, W. Liu, Z. Xie, X. Yu, C. Ruan et al. , “Janus: Decoupling visual encoding for unified multimodal understanding and generation,” in Proceedings of the Computer Vision and Pattern Recognition Conference , 2025, pp. 12 966–12 977

2025
[258]

Sharegpt4v: Improving large multi-modal models with better captions,

L. Chen, J. Li, X. Dong, P . Zhang, C. He, J. Wang, F. Zhao, and D. Lin, “Sharegpt4v: Improving large multi-modal models with better captions,” in European Conference on Computer Vision . Springer, 2024, pp. 370–387

2024
[259]

Janus-pro: Unified multimodal understanding and generation with data and model scaling,

X. Chen, Z. Wu, X. Liu, Z. Pan, W. Liu, Z. Xie, X. Yu, and C. Ruan, “Janus-pro: Unified multimodal understanding and generation with data and model scaling,” arXiv preprint arXiv:2501.17811 , 2025

2025 arXiv
[260]

Laion-5b: An open large-scale dataset for training next genera- tion image-text models,

C. Schuhmann, R. Beaumont, R. Vencu, C. Gordon, R. Wightman, M. Cherti, T. Coombes, A. Katta, C. Mullis, M. Wortsman et al., “Laion-5b: An open large-scale dataset for training next genera- tion image-text models,” Advances in neural information processing systems, vol. 35, pp...

2022
[261]

Laion coco: 600m synthetic captions from laion2b-en,

C. Schuhmann, A. K ¨opf, R. Vencu, T. Coombes, and R. Beaumont, “Laion coco: 600m synthetic captions from laion2b-en,” URL https://laion. ai/blog/laion-coco, vol. 5, 2022

2022
[262]

Datacomp: In search of the next generation of multimodal datasets,

S. Y. Gadre, G. Ilharco, A. Fang, J. Hayase, G. Smyrnis, T. Nguyen, R. Marten, M. Wortsman, D. Ghosh, J. Zhanget al., “Datacomp: In search of the next generation of multimodal datasets,” Advances in Neural Information Processing Systems, vol. 36, pp. 27 092–27 112, 2023

2023
[263]

Coyo-700m: Image-text pair dataset,

M. Byeon, B. Park, H. Kim, S. Lee, W. Baek, and S. Kim, “Coyo-700m: Image-text pair dataset,” https://github.com/ kakaobrain/coyo-dataset, 2022

2022
[264]

Conceptual 12m: Pushing web-scale image-text pre-training to recognize long-tail visual concepts,

S. Changpinyo, P . Sharma, N. Ding, and R. Soricut, “Conceptual 12m: Pushing web-scale image-text pre-training to recognize long-tail visual concepts,” in Proceedings of the IEEE/CVF confer- ence on computer vision and pattern recognition, 2021, pp. 3558–3568

2021
[265]

Conceptual captions: A cleaned, hypernymed, image alt-text dataset for automatic image captioning,

P . Sharma, N. Ding, S. Goodman, and R. Soricut, “Conceptual captions: A cleaned, hypernymed, image alt-text dataset for automatic image captioning,” in Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), 2018, pp. 2556–2565

2018
[266]

Im2text: Describing im- ages using 1 million captioned photographs,

V . Ordonez, G. Kulkarni, and T. Berg, “Im2text: Describing im- ages using 1 million captioned photographs,” Advances in neural information processing systems, vol. 24, 2011

2011
[267]

Openclip,

G. Ilharco, M. Wortsman, N. Carlini, R. Taori, A. Dave, V . Shankar, H. Namkoong, J. Miller, H. Hajishirzi, A. Farhadi, and L. Schmidt, “Openclip,” Jul. 2021. [Online]. Available: https://doi.org/10.5281/zenodo.5143773

2021 doi
[268]

Qwen2-vl: Enhancing vision-language model’s perception of the world at any resolution,

P . Wang, S. Bai, S. Tan, S. Wang, Z. Fan, J. Bai, K. Chen, X. Liu, J. Wang, W. Ge et al. , “Qwen2-vl: Enhancing vision-language model’s perception of the world at any resolution,” arXiv preprint arXiv:2409.12191, 2024

2024 arXiv
[269]

Data filtering networks,

A. Fang, A. M. Jose, A. Jain, L. Schmidt, A. Toshev, and V . Shankar, “Data filtering networks,” arXiv preprint arXiv:2309.17425, 2023

2023 arXiv
[270]

Qwen2.5-vl technical report,

S. Bai, K. Chen, X. Liu, J. Wang, W. Ge, S. Song, K. Dang, P . Wang, S. Wang, J. Tang et al. , “Qwen2.5-vl technical report,” arXiv preprint arXiv:2502.13923, 2025

2025 arXiv
[271]

Qwen2.5 technical report,

Qwen, :, A. Yang, B. Yang, B. Zhang, B. Hui, B. Zheng, B. Yu, C. Li, D. Liu, F. Huang, H. Wei, H. Lin, J. Yang, J. Tu, J. Zhang, J. Yang, J. Yang, J. Zhou, J. Lin, K. Dang, K. Lu, K. Bao, K. Yang, L. Yu, M. Li, M. Xue, P . Zhang, Q. Zhu, R. Men, R. Lin, T. Li, T. Tang, T. Xia,...
[272]

Visual genome: Connecting language and vision using crowdsourced dense image annotations,

R. Krishna, Y. Zhu, O. Groth, J. Johnson, K. Hata, J. Kravitz, S. Chen, Y. Kalantidis, L.-J. Li, D. A. Shamma et al. , “Visual genome: Connecting language and vision using crowdsourced dense image annotations,” International journal of computer vision , vol. 123, pp. 32–73, 2017

2017
[273]

Laion-400m: Open dataset of clip-filtered 400 million image-text pairs,

C. Schuhmann, R. Vencu, R. Beaumont, R. Kaczmarczyk, C. Mullis, A. Katta, T. Coombes, J. Jitsev, and A. Komatsuzaki, “Laion-400m: Open dataset of clip-filtered 400 million image-text pairs,” arXiv preprint arXiv:2111.02114, 2021

2021 arXiv
[274]

Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models,

J. Li, D. Li, S. Savarese, and S. Hoi, “Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models,” in International conference on machine learning. PMLR, 2023, pp. 19 730–19 742

2023
[275]

Eva: Exploring the limits of masked visual representation learning at scale,

Y. Fang, W. Wang, B. Xie, Q. Sun, L. Wu, X. Wang, T. Huang, X. Wang, and Y. Cao, “Eva: Exploring the limits of masked visual representation learning at scale,” in Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , 2023, pp. 19 358–19 369

2023
[276]

Opt: Open pre-trained transformer language models,

S. Zhang, S. Roller, N. Goyal, M. Artetxe, M. Chen, S. Chen, C. Dewan, M. Diab, X. Li, X. V . Lin et al., “Opt: Open pre-trained transformer language models,” arXiv preprint arXiv:2205.01068 , 2022

2022 arXiv
[277]

Scaling instruction- finetuned language models,

H. W. Chung, L. Hou, S. Longpre, B. Zoph, Y. Tay, W. Fedus, Y. Li, X. Wang, M. Dehghani, S. Brahma et al. , “Scaling instruction- finetuned language models,” Journal of Machine Learning Research, vol. 25, no. 70, pp. 1–53, 2024

2024
[278]

Vicuna: An open- JOURNAL OF LATEX CLASS FILES, VOL. 13, NO. 9, SEPTEMBER 2014 25 source chatbot impressing gpt-4 with 90%* chatgpt quality,

W.-L. Chiang, Z. Li, Z. Lin, Y. Sheng, Z. Wu, H. Zhang, L. Zheng, S. Zhuang, Y. Zhuang, J. E. Gonzalez et al. , “Vicuna: An open- JOURNAL OF LATEX CLASS FILES, VOL. 13, NO. 9, SEPTEMBER 2014 25 source chatbot impressing gpt-4 with 90%* chatgpt quality,” See https://vicuna. lms...

2014
[279]

xgen-mm (blip- 3): A family of open large multimodal models,

L. Xue, M. Shu, A. Awadalla, J. Wang, A. Yan, S. Purushwalkam, H. Zhou, V . Prabhu, Y. Dai, M. S. Ryoo et al. , “xgen-mm (blip- 3): A family of open large multimodal models,” arXiv preprint arXiv:2408.08872, 2024

2024
[280]

Mint-1t: Scaling open- source multimodal data by 10x: A multimodal dataset with one trillion tokens,

A. Awadalla, L. Xue, O. Lo, M. Shu, H. Lee, E. Guha, S. Shen, M. Awadalla, S. Savarese, C. Xiong et al., “Mint-1t: Scaling open- source multimodal data by 10x: A multimodal dataset with one trillion tokens,” Advances in Neural Information Processing Systems, vol. 37, pp. 36 80...

2024
[281]

What mat- ters when building vision-language models?

H. Laurenc ¸on, L. Tronchon, M. Cord, and V . Sanh, “What mat- ters when building vision-language models?” Advances in Neural Information Processing Systems, vol. 37, pp. 87 874–87 907, 2024

2024
[282]

Flamingo: a visual language model for few-shot learning,

J.-B. Alayrac, J. Donahue, P . Luc, A. Miech, I. Barr, Y. Hasson, K. Lenc, A. Mensch, K. Millican, M. Reynolds et al., “Flamingo: a visual language model for few-shot learning,” Advances in neural information processing systems, vol. 35, pp. 23 716–23 736, 2022

2022
[283]

Phi- 3 technical report: A highly capable language model locally on your phone,

M. Abdin, J. Aneja, H. Awadalla, A. Awadallah, A. A. Awan, N. Bach, A. Bahree, A. Bakhtiari, J. Bao, H. Behl et al. , “Phi- 3 technical report: A highly capable language model locally on your phone,” arXiv preprint arXiv:2404.14219, 2024

2024 arXiv
[284]

Improved baselines with visual instruction tuning,

H. Liu, C. Li, Y. Li, and Y. J. Lee, “Improved baselines with visual instruction tuning,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 26 296–26 306

2024
[285]

Llava-plus: Learning to use tools for creating multimodal agents,

S. Liu, H. Cheng, H. Liu, H. Zhang, F. Li, T. Ren, X. Zou, J. Yang, H. Su, J. Zhu et al., “Llava-plus: Learning to use tools for creating multimodal agents,” in European Conference on Computer Vision . Springer, 2024, pp. 126–142

2024
[286]

Llava-onevision: Easy visual task transfer,

B. Li, Y. Zhang, D. Guo, R. Zhang, F. Li, H. Zhang, K. Zhang, P . Zhang, Y. Li, Z. Liu et al. , “Llava-onevision: Easy visual task transfer,” arXiv preprint arXiv:2408.03326, 2024

2024 arXiv
[287]

Dynamic-llava: Efficient multimodal large language models via dynamic vision-language context sparsifi- cation,

W. Huang, Z. Zhai, Y. Shen, S. Cao, F. Zhao, X. Xu, Z. Ye, Y. Hu, and S. Lin, “Dynamic-llava: Efficient multimodal large language models via dynamic vision-language context sparsifi- cation,” arXiv preprint arXiv:2412.00876, 2024

2024 arXiv
[288]

Paligemma: A versatile 3b vlm for transfer,

L. Beyer, A. Steiner, A. S. Pinto, A. Kolesnikov, X. Wang, D. Salz, M. Neumann, I. Alabdulmohsin, M. Tschannen, E. Bugliarello et al., “Paligemma: A versatile 3b vlm for transfer,” arXiv preprint arXiv:2407.07726, 2024

2024 arXiv
[289]

Gemma: Open models based on gemini research and technology,

G. Team, T. Mesnard, C. Hardin, R. Dadashi, S. Bhupatiraju, S. Pathak, L. Sifre, M. Rivi `ere, M. S. Kale, J. Love et al., “Gemma: Open models based on gemini research and technology,” arXiv preprint arXiv:2403.08295, 2024

2024 arXiv
[290]

Pali-3 vision language models: Smaller, faster, stronger,

X. Chen, X. Wang, L. Beyer, A. Kolesnikov, J. Wu, P . Voigtlaender, B. Mustafa, S. Goodman, I. Alabdulmohsin, P . Padlewski et al. , “Pali-3 vision language models: Smaller, faster, stronger,” arXiv preprint arXiv:2310.09199, 2023

arXiv
[291]

Paligemma 2: A family of versatile vlms for transfer,

A. Steiner, A. S. Pinto, M. Tschannen, D. Keysers, X. Wang, Y. Bitton, A. Gritsenko, M. Minderer, A. Sherbondy, S. Longet al., “Paligemma 2: A family of versatile vlms for transfer,” arXiv preprint arXiv:2412.03555, 2024

2024 arXiv
[292]

Mm1: methods, analysis and insights from multimodal llm pre-training,

B. McKinzie, Z. Gan, J.-P . Fauconnier, S. Dodge, B. Zhang, P . Dufter, D. Shah, X. Du, F. Peng, A. Belyiet al., “Mm1: methods, analysis and insights from multimodal llm pre-training,” in Euro- pean Conference on Computer Vision. Springer, 2024, pp. 304–323

2024
[293]

Honeybee: Locality- enhanced projector for multimodal llm,

J. Cha, W. Kang, J. Mun, and B. Roh, “Honeybee: Locality- enhanced projector for multimodal llm,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , 2024, pp. 13 817–13 827

2024
[294]

Mm1.5: Methods, anal- ysis & insights from multimodal llm fine-tuning,

H. Zhang, M. Gao, Z. Gan, P . Dufter, N. Wenzel, F. Huang, D. Shah, X. Du, B. Zhang, Y. Li et al. , “Mm1.5: Methods, anal- ysis & insights from multimodal llm fine-tuning,” arXiv preprint arXiv:2409.20566, 2024

2024 arXiv
[295]

Minigpt-v2: large language model as a unified interface for vision-language multi- task learning,

J. Chen, D. Zhu, X. Shen, X. Li, Z. Liu, P . Zhang, R. Krishnamoor- thi, V . Chandra, Y. Xiong, and M. Elhoseiny, “Minigpt-v2: large language model as a unified interface for vision-language multi- task learning,” arXiv preprint arXiv:2310.09478, 2023

arXiv
[296]

Flickr30k entities: Collecting region- to-phrase correspondences for richer image-to-sentence models,

B. A. Plummer, L. Wang, C. M. Cervantes, J. C. Caicedo, J. Hock- enmaier, and S. Lazebnik, “Flickr30k entities: Collecting region- to-phrase correspondences for richer image-to-sentence models,” in Proceedings of the IEEE international conference on computer vision, 2015, pp. ...

2015
[297]

Kosmos-2: Grounding multimodal large language models to the world,

Z. Peng, W. Wang, L. Dong, Y. Hao, S. Huang, S. Ma, and F. Wei, “Kosmos-2: Grounding multimodal large language models to the world,” arXiv preprint arXiv:2306.14824, 2023

2023 arXiv
[298]

Llama 2: Open foundation and fine-tuned chat models,

H. Touvron, L. Martin, K. Stone, P . Albert, A. Almahairi, Y. Babaei, N. Bashlykov, S. Batra, P . Bhargava, S. Bhosale et al. , “Llama 2: Open foundation and fine-tuned chat models,” arXiv preprint arXiv:2307.09288, 2023

2023 arXiv
[299]

Seed1.5-vl technical report,

D. Guo, F. Wu, F. Zhu, F. Leng, G. Shi, H. Chen, H. Fan, J. Wang, J. Jiang, J. Wang et al., “Seed1.5-vl technical report,” arXiv preprint arXiv:2505.07062, 2025

2025 arXiv
[2025]

Available: https://arxiv.org/abs/2412.15115

[Online]. Available: https://arxiv.org/abs/2412.15115

arXiv

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.

[1] [106]

Amend to alignment: decoupled prompt tuning for mitigating spurious correlation in vision-language models,

J. Zhang, X. Ma, S. Guo, P . Li, W. Xu, X. Tang, and Z. Hong, “Amend to alignment: decoupled prompt tuning for mitigating spurious correlation in vision-language models,” in Forty-first International Conference on Machine Learning, 2024

2024

[2] [104]

Any-shift prompting for generalization over distributions,

Z. Xiao, J. Shen, M. M. Derakhshani, S. Liao, and C. G. Snoek, “Any-shift prompting for generalization over distributions,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp. 13 849–13 860

2024

[3] [47]

Clipood: Generalizing clip to out-of-distributions,

Y. Shu, X. Guo, J. Wu, X. Wang, J. Wang, and M. Long, “Clipood: Generalizing clip to out-of-distributions,” in International Confer- ence on Machine Learning. PMLR, 2023, pp. 31 716–31 731

2023

[4] [1]

Imagenet classi- fication with deep convolutional neural networks,

A. Krizhevsky, I. Sutskever, and G. E. Hinton, “Imagenet classi- fication with deep convolutional neural networks,” Advances in neural information processing systems, vol. 25, 2012

2012

[5] [2]

Deep residual learning for image recognition,

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778

2016

[6] [3]

An image is worth 16x16 words: Transformers for image recognition at scale,

A. Dosovitskiy, L. Beyer, A. Kolesnikov, D. Weissenborn, X. Zhai, T. Unterthiner, M. Dehghani, M. Minderer, G. Heigold, S. Gelly et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2020

arXiv 2010

[7] [4]

A comprehensive survey on transfer learning,

F. Zhuang, Z. Qi, K. Duan, D. Xi, Y. Zhu, H. Zhu, H. Xiong, and Q. He, “A comprehensive survey on transfer learning,” Proceedings of the IEEE, vol. 109, no. 1, pp. 43–76, 2020

2020

[8] [5]

Imagenet: A large-scale hierarchical image database,

J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, and L. Fei-Fei, “Imagenet: A large-scale hierarchical image database,” in 2009 IEEE conference on computer vision and pattern recognition . Ieee, 2009, pp. 248–255

2009