Scaling Representation Diversity: Modulated Attention and Reconstructive Regularization for Visual Grounding

Fengyi Wu; Junli Lin; Junyi Hu; Tian Bai; Wei Wen; Xingchen Li; Yian Huang; Yi Zhang; Zaoli Li; Zhenming Peng

REVIEW 5 major objections 4 minor 287 references

Scaling Representation Diversity: Modulated Attention and Reconstructive Regularization for Visual Grounding

T0 review · 5 major / 4 minor · reviewed 2026-08-16 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A compact 75M visual grounding model can match 13B multimodal LLMs by preserving representation diversity through a dual-stream training objective.

desk verdict A useful empirical recipe and dataset for edge visual grounding, but the theoretical centerpiece is an assumption in disguise and the benchmark comparisons have a protocol wrinkle. read the letter →

arxiv 2608.12748 v1 pith:33O6OSZL submitted 2026-08-13 cs.CV

Junyi Hu , Tian Bai , Fengyi Wu , Yian Huang , Wei Wen , Zaoli Li , Junli Lin , Xingchen Li

show 2 more authors

Zhenming Peng Yi Zhang

This is my paper · ORCID

classification cs.CV

keywords referringexpressioncomprehensionopen-vocabularygroundingrepresentationdiversitycollapseJEPAcross-modalattentionvisualObjects365-Caption

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper argues that the main obstacle to scaling a single open-vocabulary visual grounding model is representation degeneration: contrastive-style training compresses the shared visual features into a low-rank subspace, leaving many feature directions with no alignment signal. To counter this, the authors jointly train the same visual features with two complementary objectives: a token-level modulated attention-contrastive head for grounding, plus a reconstruction-based JEPA auxiliary stream that is removed at inference. On the data side, they convert Objects365 category tags into dense, context-aware referring expressions (O365-Caption). The central claim is that only the dual-stream objective keeps gradient support in all feature directions, so a single 75M checkpoint can match or beat much larger systems on standard referring-expression benchmarks without dataset-specific adaptation.

What carries the argument

The argument runs on three coupled objects. First, the broadcast cross-attention head mACH reformulates standard cross-attention so one visual forward pass scores many text queries at once, expanding supervision from pooled text vectors to token-level centered subspaces. Second, a text-conditioned JEPA auxiliary stream reconstructs masked visual features under language guidance using an EMA teacher; the fluctuation of its gradient under mask resampling is what supplies the full-support spectral floor $\Gamma_J \succeq c_J I$. Third, O365-Caption replaces discrete detection tags with context-aware referring expressions. The theoretical load-bearing identity is directional alignment capacity $\mathrm{cap}(k) = \mathrm{Var}_m(x_m^\top k) = k^\top \Xi_X k$, with Lemma 2 showing that directions without gradient support decay exponentially under weight decay.

What would settle it

For a fixed image and fixed text, sample many JEPA masks and compute the gradient of $\mathcal{L}_{JEPA}$ with respect to the shared visual features; estimate the minimum eigenvalue of the covariance of these centered gradients across masks. If that minimum sits at the numerical floor rather than at $c_J > 0$, Assumption 6 fails and the claimed dimension-$C$ support collapses. A simpler proxy is the empirical effective rank of $\Xi_X$: if the mACH+JEPA spectral tail above the float32 floor does not persist across all 768 dimensions, the predicted spectral floor is contradicted.

Watch

Extended reading notes

Core claim

The core claim, formalized as Theorem 8, is that training objectives differ in which feature directions they supervise. A pooled contrastive loss spans only the pooled text-vector directions (dimension at most $N_c$), the mACH head spans centered token-key subspaces (dimension at most $N-N_c$), and the dual-stream objective with the text-conditioned JEPA stream spans the full feature space $\mathbb{R}^C$ almost surely. Under weight decay, only the dual-stream objective avoids alignment-blind directions, so representation diversity, counted as the number of alignment-active directions, scales along the ladder $N_c < N-N_c < C$. The empirical counterpart is a 75M static checkpoint reaching 85.3/89.0/82.5 on RefCOCO zero-shot and 91.7/93.0/90.2 after fine-tuning, matching or beating 13B multimodal LLMs on several splits.

Load-bearing premise

The theorem's full-support claim collapses if the JEPA mask-noise fluctuation is confined to a lower-dimensional plane; the paper assumes this does not happen (Assumption 6, $\Gamma_J \succeq c_J I$ with $c_J > 0$), and its own Appendix F warns that the theory addresses representation capacity rather than final accuracy or calibration.

Editorial extensions

If this is right

A single 75M checkpoint can do zero-shot referring-expression comprehension across RefCOCO, RefCOCO+, and RefCOCOg, and fine-tuning the same weights yields competitive state-of-the-art numbers on all three benchmarks.
The JEPA branch adds training-time gradient diversity at no inference cost because it is removed after training; the reported latency stays close to the mACH-only head.
Feature covariance rank should climb from at most $N_c$ under contrastive training to at most $N-N_c$ under mACH and to $C=768$ under mACH+JEPA; the paper reports effective ranks 36, 44, and 83, consistent with that ladder.
Novel out-of-distribution expressions whose key directions lie outside the training subspace stay alignment-blind for discriminative-only heads but retain positive capacity under the dual-stream objective.
Scaling the head feature dimension $C$ from 768 to 1024 removes representation bottlenecks and yields further gains, as shown by the ConvNeXt-Base results.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

Because the proof only requires the auxiliary objective's gradient fluctuation to have full support, any reconstructive or self-supervised auxiliary loss with that property could plausibly substitute for JEPA; the specific architecture may matter less than the full-support property.
The O365-Caption pipeline is described by the authors as dataset-agnostic, applicable to other detection corpora and to repairing noisy phrase-grounding corpora, so the data-side contribution extends beyond Objects365.
Even if the full-support proof holds, the paper's own limitation appendix warns that representational capacity is not the same as end-task accuracy under shift; using effective rank as a training-time monitor for transfer readiness would be a natural testable extension.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

This paper is worth a serious look, but the headline theoretical claim does not survive contact with its own assumption. The real contributions are empirical: O365-Caption, a large-scale upgrade of Objects365 labels into referring expressions, and the mACH+JEPA co-design that appears to improve zero-shot grounding at 75M parameters. The ablations are internally consistent, the dataset statistics are carefully documented, and the code and data links make the work re-examinable. Credit where due: the data pipeline is a genuine asset, and the broadcast cross-attention head is a sensible engineering choice for multi-query edge inference.

The soft spots are real and need airing. Theorem 8, the claim that only the dual-stream objective preserves alignment capacity in every direction, rests entirely on Assumption 6: that the JEPA gradient fluctuation is not almost surely confined to any hyperplane. That is the conclusion restated as a premise. Lemma 7 just converts it into the theorem. No constructive argument shows that mask resampling plus the text-conditioned predictor actually spans all 768 feature directions. The empirical spectral evidence is suggestive but not conclusive: effective rank 83 out of 768, with a tail around 1e-5, sits close to the float32 accumulation floor the paper itself cites. A strictly positive but tiny lower bound on the spectral floor would be numerically meaningless.

Also worth flagging: the method is evaluated on the cleaned RefCOCO benchmark while many baseline numbers appear to be cited from the original papers, which were not cleaned. That asymmetry can inflate apparent gains. The lack of error bars or seeds makes it hard to judge how much of the margin is stable. The 9.6M vs 10.0M annotation count discrepancy is minor but should be corrected.

The paper is honest about the theory's scope in Appendix F, which helps, but the main text oversells it. If the theory is reframed as a conditional statement ('if the JEPA fluctuation is full-rank, then...') and the overclaim about being the only paradigm is softened, the paper is in decent shape. As is, the empirical system and dataset deserve a serious referee; the theory does not.

My recommendation: send it to peer review. The data asset and the reproducible experiments justify the time. A good referee can push the authors to demote the theory to a motivating framework and to run a fairer baseline comparison on the same cleaned benchmark.

Referee Report

5 major / 4 minor

Summary. The manuscript proposes a framework for unified open-vocabulary visual grounding based on three components: a Modulated Attention-Contrastive Head (mACH) for token-level vision-language alignment, a text-conditioned JEPA auxiliary stream intended to provide complementary gradient support without inference overhead, and a newly constructed dataset O365-Caption that converts Objects365 category labels into dense referring expressions. The paper also presents a theoretical analysis, culminating in Theorem 8, which claims that only the dual-stream objective (mACH plus JEPA) is almost surely free of alignment-blind directions and preserves alignment capacity in every feature direction. Experiments on RefCOCO/+/g under zero-shot and fine-tuning protocols report strong results, including 85.3/89.0/82.5 zero-shot and 91.7/93.0/90.2 fine-tuned on RefCOCO with a 75M model, plus ablations and spectral analyses intended to support the representation-diversity argument.

Significance. If the central theoretical claim were established, the paper would make a useful conceptual contribution: a precise, dimension-based account of why an auxiliary predictive objective can preserve alignment capacity beyond what contrastive or dot-alignment objectives provide. The O365-Caption resource, the careful ablations, and the public release of code and data are also valuable, and the reported zero-shot numbers are striking relative to the model size. However, the main theorem is conditional on an assumption that essentially states the conclusion, and the empirical spectral evidence is explicitly interpreted by the authors as not supporting depth comparisons near the noise floor. These issues currently prevent the paper from substantiating its strongest claims.

major comments (5)

[Appendix B, Assumption 6 and Theorem 8] Assumption 6 (Eq. A20-A22) states that the mask-noise fluctuation ξ_J is not almost surely confined to any hyperplane, i.e., Γ_J ⪰ c_J I with c_J > 0. This is exactly the property needed to conclude that the joint gradient second moment has full rank, and Lemma 7 and Theorem 8 only propagate that assumption to the conclusion. The proof therefore does not establish that the dual-stream objective 'preserves alignment capacity in every direction' from architectural or algorithmic principles; it merely states the conclusion as an assumption. The paper needs either a constructive argument showing that stochastic mask resampling plus the predictor architecture yields fluctuation in every one of the C=768 directions, or a clearly framed conditional theorem stating that full-support fluctuation is a sufficient condition rather than a derived property.
[Section 5.5, Figure 5] The spectral evidence does not provide empirical support for Assumption 6. The effective rank is 83 for C=768, and the non-vanishing tail is around 1e-5, while the paper itself places the float32 accumulation floor near 1e-6; the authors also note that 'cliff positions, not depths, are interpretable.' This means that most of the 768 directions carry variance close to the numerical floor, which is compatible with a strictly positive but negligible c_J, and does not demonstrate that fluctuation spans every direction. A stronger test would compare the measured spectrum against a properly estimated noise floor across multiple training seeds, and report whether the number of directions above that floor is consistent with C.
[Section 5.1 and Table 2] The evaluation protocol is not apples-to-apples. Section 5.1 states that all evaluated models are benchmarked on a cleaned version of RefCOCO/+/g, but Table 2 appears to cite baseline numbers from the original papers, which typically report on the standard, uncleaned annotations. If the baselines were not re-evaluated on the same cleaned data, the reported margins over GLIP-T, GDINO-T, and PropVG may be inflated. The authors should re-run all baselines on the same cleaned benchmark, or clearly mark which numbers were re-evaluated and which were copied, and discuss the direction of the resulting bias.
[Table 1 vs. Appendix C] There is an internal inconsistency in the reported size of the dataset: Table 1 lists 9.6M annotations for O365-Caption, while Appendix C states that the pipeline produces '10.0M precise spatial-textual alignment targets.' The authors should reconcile these numbers and specify which count is used in training.
[Section 5.3 and Table 3] No error bars, seeds, or variance are reported for any experiment, and several ablation differences are small (for example, α=0.1 vs. α=0.2 differs by only 0.3-0.6 points on most splits). Without multiple seeds or some uncertainty quantification, it is difficult to tell which differences are meaningful. At minimum, the main results and key ablations should be repeated for at least three seeds and reported as mean ± std.

minor comments (4)

[Figure 2] The architecture diagram contains many tiny labels and abbreviations (e.g., 'B,P,L,C', 'E', 'R', 'S') that are not defined in the caption; please enlarge the figure and add a legend or explain the notation in the caption.
[Table 2] The column 'FT' is not defined in the caption; please state explicitly that it indicates whether the model was fine-tuned on the target benchmark.
[Appendix E, Table A2(d)] The inference latency numbers in the appendix (33.2 ms fixed text, 140.5 ms dynamic text) are not reconciled with the latency table in Section 5.5, which reports 26-27 ms for mACH. Please clarify the hardware, batch size, and caching assumptions so the two sets of numbers are comparable.
[Section 3.2] Equation (7) says the predictor receives language embedding W, but Appendix B, Lemma 5, describes the JEPA driving signal as 'text-free' and states that text-side outputs receive no gradient. The relationship between these two descriptions should be clarified in the main text, since the phrase 'text-conditioned JEPA' could mislead readers about where language information enters the gradient.

Circularity Check

1 steps flagged · score 7.0 of 10

Theorem 8's 'only paradigm preserves alignment capacity in every direction' is guaranteed by Assumption 6, which asserts exactly the full-support gradient property that the theorem is supposed to establish; no architectural derivation or independent spectral verification supports c_J > 0 across all C=768 directions.

self definitional [Appendix B, Section 6.3, Assumption 6 (after Eq. A20); used in Lemma 7 and Theorem 8 in Section 6.4]
"Assumption 6 (Nondegenerate JEPA fluctuation). The mask-noise fluctuation ξ_J is not almost surely confined to any hyperplane: for every unit u, E[(u^T ξ_J)^2] > 0. Lemma 7 (Full-support spectral floor). Under Assumption 6, Γ_J ⪰ c_J I with c_J := λ_min(Γ_J) > 0, and the joint field of L_tot satisfies k^T E[GG^T] k ≥ α^2 k^T Γ_J k ≥ α^2 c_J for every unit k."

Lemma 7's proof is literally: for every unit u, u^T Γ_J u = E[(u^T ξ_J)^2] > 0 by Assumption 6, hence Γ_J ≻ 0 and c_J > 0. Theorem 8 then concludes Γ ⪰ α^2 c_J I ≻ 0, i.e., Col(Γ) = R^C and null(Γ) = {0}, so 'only the dual-stream objective is almost surely free of alignment-blind directions.' The full-support gradient property that drives the theorem is therefore not derived from the architecture, the mask resampling mechanism, or the text-conditioned predictor; it is exactly the assumed property. Without Assumption 6, the dim = C claim collapses.

full rationale

The central theoretical claim of the paper is conditional on an assumption that is effectively the conclusion. Assumption 6 asserts that the JEPA mask-noise fluctuation spans every unit direction in gradient space; Lemma 7 restates this as a positive spectral floor; Theorem 8 converts that same positive floor into 'alignment capacity in every direction.' This is a self-definitional reduction: the result is forced by the input rather than established from the architecture. The empirical spectral evidence is suggestive but not conclusive, and the paper's own caveat limits its falsifiability. The remaining components are not circular: the mACH subspace bound dim ≤ N − N_c is a legitimate computation, the O365-Caption dataset is an external data contribution, and the benchmark results are independent empirical evaluations. The score reflects that the paper's headline theoretical contribution reduces by construction to its Assumption 6, while acknowledging that substantial non-circular empirical and dataset work remains.

Assumptions & free parameters 2 free parameters · 3 assumptions · 0 invented entities

The central theoretical claim rests on Assumption 6, which postulates the full-rank fluctuation needed for the conclusion. Separate free parameters are the JEPA weight alpha (tuned to 0.1 on the evaluation benchmarks) and the small-object coverage threshold gamma (set to 0.05%). No invented physical or conceptual entities are introduced; mACH, the JEPA stream, and O365-Caption are engineered artifacts and datasets.

free parameters (2)

JEPA loss weight alpha = 0.1
Chosen by ablation in Table 3c on RefCOCO/+/g zero-shot accuracy; higher values over-regularize and lower values under-regularize.
Small-object coverage threshold gamma = 0.05%
Hand-set in the O365-Caption curation pipeline (Appendix C, Eq. A28) to skip semantic refinement for tiny boxes; directly affects caption quality and dataset statistics.

assumptions (3)

ad hoc to paper Assumption 6: JEPA gradient fluctuation Gamma_J is nondegenerate, Gamma_J >= c_J I > 0.
This is the load-bearing premise that gives full gradient support in Lemma 7 and Theorem 8. It is not derived from the architecture, and it is essentially the conclusion that JEPA spans all feature directions.
domain assumption Weight-decay variance dynamics: X_dot = -G B - lambda X, with B >= 0 an arbitrary backbone-induced preconditioner.
Used in Lemma 2 to show that unsustained directions decay. It is exact for a terminal linear map X=WH with decayed W, but is assumed for general backbones.
domain assumption The frozen text-embedding manifold has a measurable offline effective dimension.
Invoked in Lemma 4 to discuss the union of visited gradient subspaces over training. Reasonable for a frozen encoder, but not formally established.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Scaling Representation Diversity: Modulated Attention and Reconstructive Regularization for Visual Grounding." pith.science (2026). https://pith.science/paper/33O6OSZL

@misc{pith2026260812748,
  author       = {Pith},
  title        = {Pith review of: Scaling Representation Diversity: Modulated Attention and Reconstructive Regularization for Visual Grounding},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/33O6OSZL}},
  note         = {Machine review of arXiv:2608.12748}
}

read the original abstract

Referring Expression Comprehension (REC) is commonly studied under dataset-specific fine-tuning, resulting in specialist models with limited cross-dataset generalization. In this work, we revisit REC from the perspective of unified open-vocabulary grounding and identify representation degeneration as a key obstacle to scaling a single generalist model. To preserve representation diversity, we propose a holistic data-model co-design framework. Architecturally, we introduce the Modulated Attention-Contrastive Head (mACH) for efficient token-level vision-language alignment and a text-conditioned JEPA auxiliary stream that provides complementary gradient support to preserve alignment-active representations without inference overhead. On the data side, we introduce Objects365-Caption, enriching Objects365 with context-aware referring expressions for large-scale language supervision. We further provide a theoretical analysis showing that complementary gradient subspaces preserve alignment capacity and thereby scale representation diversity. Extensive experiments demonstrate that our single-checkpoint framework achieves highly competitive performance on standard REC benchmarks while exhibiting strong generalization across heterogeneous grounding datasets without benchmark-specific adaptation.

Figures

Figures reproduced from arXiv: 2608.12748 by the authors.

**Figure 1.** Conceptual illustration of representation diversity. Different training objectives provide supervision over different subsets of the shared visual representation. Conventional contrastive learning mainly optimizes a limited set of alignment directions, while the proposed mACH expands supervision to finer token-level interactions. The auxiliary JEPA objective further supplies complementary learning signals beyond … view at source ↗

**Figure 2.** Given an input image and a set of referring ex [PITH_FULL_IMAGE:figures/full_fig_p002_2.png] view at source ↗

**Figure 2.** Overview of the proposed framework (illustrated using a CNN-based detector). The visual backbone extracts visual [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗

Figures from the paper (3 more)

**Figure 3.** Figure 3: (a) The detailed three-stage data generation pipeline of O365-Caption and (b) Comprehensive linguistic and statistical [PITH_FULL_IMAGE:figures/full_fig_p004_3.png]

**Figure 4.** Figure 4: Qualitative grounding results. Text queries and corresponding predicted bounding boxes are rendered in matching colors, demonstrating robust multi-target localization under complex natural language descriptions. Zoom in for best view. Head Components (Tab. 3a). Replaci…

**Figure 5.** Figure 5: confirms this prediction. Contrastive learning and mACH exhibit an identical spectral cliff around j ≈ 200, after which the eigenvalues fall below the numerical precision of float32 accumulation (≲10−6λ1), indicating feature variation is confined to a language-conditi…

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

287 extracted references · 8 canonical work pages

[1]

International conference on machine learning , pages=

Attention-based deep multiple instance learning , author=. International conference on machine learning , pages=. 2018 , organization=

2018
[2]

Applied Sciences , volume=

Multispectral Target Detection Based on Deep Feature Fusion of Visible and Infrared Modalities , author=. Applied Sciences , volume=. 2025 , publisher=

2025
[3]

Signal and Data Processing of Small Targets 1993 , volume=

Multispectral infrared target detection: phenomenology and modeling , author=. Signal and Data Processing of Small Targets 1993 , volume=. 1993 , organization=

1993
[4]

Sensors , volume=

Infrared dim small target detection networks: A review , author=. Sensors , volume=. 2024 , publisher=

2024
[5]

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=

RPCANet: Deep unfolding RPCA based infrared small target detection , author=. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=
[6]

Sensors , volume=

Object detection in multispectral remote sensing images based on cross-modal cross-attention , author=. Sensors , volume=. 2024 , publisher=

2024
[7]

2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , pages=

Multispectral Object Detection Enhanced by Cross-Modal Information Complementary and Cosine Similarity Channel Resampling Modules , author=. 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , pages=. 2025 , organization=

2025
[8]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Mma: Multi-modal adapter for vision-language models , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Show all 287 references

[9]

International conference on machine learning , pages=

Learning transferable visual models from natural language supervision , author=. International conference on machine learning , pages=. 2021 , organization=

2021
[10]

International Journal of Computer Vision , volume=

Learning to prompt for vision-language models , author=. International Journal of Computer Vision , volume=. 2022 , publisher=

2022
[11]

Advances in neural information processing systems , volume=

Flamingo: a visual language model for few-shot learning , author=. Advances in neural information processing systems , volume=
[12]

European conference on computer vision , pages=

Tip-adapter: Training-free adaption of clip for few-shot classification , author=. European conference on computer vision , pages=. 2022 , organization=

2022
[13]

Advances in neural information processing systems , volume=

Visual instruction tuning , author=. Advances in neural information processing systems , volume=
[14]

International conference on machine learning , pages=

Blip-2: Bootstrapping language-image pre-training with frozen image encoders and large language models , author=. International conference on machine learning , pages=. 2023 , organization=

2023
[15]

International Journal of Computer Vision , volume=

Clip-adapter: Better vision-language models with feature adapters , author=. International Journal of Computer Vision , volume=. 2024 , publisher=

2024
[16]

Infrared Physics & Technology , volume=

Infrared small target detection using kernel low-rank approximation and regularization terms for constraints , author=. Infrared Physics & Technology , volume=. 2022 , publisher=

2022
[17]

Kaur et al

Image Fusion Techniques: A Survey: H. Kaur et al. , author=. Archives of computational methods in Engineering , volume=. 2021 , publisher=

2021
[18]

, author=

Multimodal deep learning. , author=. ICML , volume=
[19]

Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

Convolutional two-stream network fusion for video action recognition , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
[20]

Advances in neural information processing systems , volume=

Language models are few-shot learners , author=. Advances in neural information processing systems , volume=
[21]

Proceedings of the AAAI Conference on Artificial Intelligence , volume=

Vilt-clip: Video and language tuning clip with multimodal prompt learning and scenario-guided optimization , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
[22]

International conference on machine learning , pages=

Vilt: Vision-and-language transformer without convolution or region supervision , author=. International conference on machine learning , pages=. 2021 , organization=

2021
[23]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Maple: Multi-modal prompt learning , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[24]

Advances in Neural Information Processing Systems , volume=

Deep correlated prompting for visual recognition with missing modalities , author=. Advances in Neural Information Processing Systems , volume=
[25]

Proceedings of the 32nd ACM International Conference on Multimedia , pages=

CP-Prompt: Composition-based cross-modal prompting for domain-incremental continual learning , author=. Proceedings of the 32nd ACM International Conference on Multimedia , pages=
[26]

Proceedings of the AAAI Conference on Artificial Intelligence , volume=

Multi-prompts learning with cross-modal alignment for attribute-based person re-identification , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
[27]

Advances in Neural Information Processing Systems , volume=

Compressed video prompt tuning , author=. Advances in Neural Information Processing Systems , volume=
[28]

International Conference on Machine Learning , pages=

Make-an-audio: Text-to-audio generation with prompt-enhanced diffusion models , author=. International Conference on Machine Learning , pages=. 2023 , organization=

2023
[29]

2024 IEEE International Conference on Robotics and Automation (ICRA) , pages=

Parameter-efficient prompt learning for 3d point cloud understanding , author=. 2024 IEEE International Conference on Robotics and Automation (ICRA) , pages=. 2024 , organization=

2024
[30]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Robust depth enhancement via polarization prompt fusion tuning , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[31]

Visual Intelligence , volume=

MIRSAM: multimodal vision-language segment anything model for infrared small target detection , author=. Visual Intelligence , volume=. 2025 , publisher=

2025
[32]

International conference on machine learning , pages=

A simple framework for contrastive learning of visual representations , author=. International conference on machine learning , pages=. 2020 , organization=

2020
[33]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Momentum contrast for unsupervised visual representation learning , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[34]

Advances in neural information processing systems , volume=

Bootstrap your own latent-a new approach to self-supervised learning , author=. Advances in neural information processing systems , volume=
[35]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Masked autoencoders are scalable vision learners , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[36]

Proceedings of the IEEE/CVF international conference on computer vision , pages=

Emerging properties in self-supervised vision transformers , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
[37]

arXiv preprint arXiv:2304.07193 , year=

Dinov2: Learning robust visual features without supervision , author=. arXiv preprint arXiv:2304.07193 , year=

arXiv
[39]

Proceedings of the AAAI conference on artificial intelligence , volume=

Film: Visual reasoning with a general conditioning layer , author=. Proceedings of the AAAI conference on artificial intelligence , volume=
[40]

arXiv preprint arXiv:2405.20985 , year=

Deco: Decoupling token compression from semantic abstraction in multimodal large language models , author=. arXiv preprint arXiv:2405.20985 , year=

arXiv
[41]

arXiv preprint arXiv:2404.16994 , year=

Pllava: Parameter-free llava extension from images to videos for video dense captioning , author=. arXiv preprint arXiv:2404.16994 , year=

arXiv
[42]

arXiv preprint arXiv:1606.01847 , year=

Multimodal compact bilinear pooling for visual question answering and visual grounding , author=. arXiv preprint arXiv:1606.01847 , year=

arXiv
[43]

International Colloquium on Automata, Languages, and Programming , pages=

Finding frequent items in data streams , author=. International Colloquium on Automata, Languages, and Programming , pages=. 2002 , organization=

2002
[44]

Proceedings of the IEEE international conference on computer vision , pages=

Mutan: Multimodal tucker fusion for visual question answering , author=. Proceedings of the IEEE international conference on computer vision , pages=
[45]

arXiv preprint arXiv:1707.07250 , year=

Tensor fusion network for multimodal sentiment analysis , author=. arXiv preprint arXiv:1707.07250 , year=

arXiv
[46]

Advances in neural information processing systems , volume=

Attention is all you need , author=. Advances in neural information processing systems , volume=
[47]

arXiv preprint arXiv:2305.13245 , year=

Gqa: Training generalized multi-query transformer models from multi-head checkpoints , author=. arXiv preprint arXiv:2305.13245 , year=

arXiv
[48]

arXiv preprint arXiv:1911.02150 , year=

Fast transformer decoding: One write-head is all you need , author=. arXiv preprint arXiv:1911.02150 , year=

1911 arXiv
[49]

Advances in neural information processing systems , volume=

Vilbert: Pretraining task-agnostic visiolinguistic representations for vision-and-language tasks , author=. Advances in neural information processing systems , volume=
[50]

arXiv preprint arXiv:1908.07490 , year=

Lxmert: Learning cross-modality encoder representations from transformers , author=. arXiv preprint arXiv:1908.07490 , year=

1908 arXiv
[51]

European conference on computer vision , pages=

Uniter: Universal image-text representation learning , author=. European conference on computer vision , pages=. 2020 , organization=

2020
[52]

Advances in neural information processing systems , volume=

Bilinear attention networks , author=. Advances in neural information processing systems , volume=
[53]

Scientific reports , volume=

Cross-modal gated feature enhancement for multimodal emotion recognition in conversations , author=. Scientific reports , volume=. 2025 , publisher=

2025
[54]

Advances in neural information processing systems , volume=

Align before fuse: Vision and language representation learning with momentum distillation , author=. Advances in neural information processing systems , volume=
[55]

International conference on machine learning , pages=

Transformers are rnns: Fast autoregressive transformers with linear attention , author=. International conference on machine learning , pages=. 2020 , organization=

2020
[56]

arXiv preprint arXiv:2312.00752 , year=

Mamba: Linear-time sequence modeling with selective state spaces , author=. arXiv preprint arXiv:2312.00752 , year=

arXiv
[57]

arXiv preprint arXiv:2307.08621 , year=

Retentive network: A successor to transformer for large language models , author=. arXiv preprint arXiv:2307.08621 , year=

arXiv
[58]

arXiv preprint arXiv:2305.13048 , year=

Rwkv: Reinventing rnns for the transformer era , author=. arXiv preprint arXiv:2305.13048 , year=

arXiv
[59]

arXiv preprint arXiv:2507.06457 , year=

A systematic analysis of hybrid linear attention , author=. arXiv preprint arXiv:2507.06457 , year=

arXiv
[60]

arXiv preprint arXiv:2501.12948 , year=

Deepseek-r1: Incentivizing reasoning capability in llms via reinforcement learning , author=. arXiv preprint arXiv:2501.12948 , year=

arXiv
[61]

IEEE Transactions on Knowledge and Data Engineering , year=

A survey on mixture of experts in large language models , author=. IEEE Transactions on Knowledge and Data Engineering , year=
[62]

arXiv preprint arXiv:1808.06670 , year=

Learning deep representations by mutual information estimation and maximization , author=. arXiv preprint arXiv:1808.06670 , year=

arXiv
[63]

Advances in Neural Information Processing Systems , volume=

Identifiable shared component analysis of unpaired multimodal mixtures , author=. Advances in Neural Information Processing Systems , volume=
[64]

arXiv preprint arXiv:2503.15352 , year=

Towards Achieving Perfect Multimodal Alignment , author=. arXiv preprint arXiv:2503.15352 , year=

arXiv
[65]

arXiv preprint arXiv:2402.16832 , year=

Cross-Modal Projection in Multimodal LLMs Doesn't Really Project Visual Attributes to Textual Space , author=. arXiv preprint arXiv:2402.16832 , year=

arXiv
[66]

The Thirteenth International Conference on Learning Representations , year=

Mitigate the gap: Improving cross-modal alignment in CLIP , author=. The Thirteenth International Conference on Learning Representations , year=
[67]

IEEE Transactions on Visualization and Computer Graphics , year=

ModalChorus: Visual probing and alignment of multi-modal embeddings via modal fusion map , author=. IEEE Transactions on Visualization and Computer Graphics , year=
[68]

International conference on machine learning , pages=

Understanding contrastive representation learning through alignment and uniformity on the hypersphere , author=. International conference on machine learning , pages=. 2020 , organization=

2020
[69]

arXiv preprint arXiv:2403.02875 , year=

Enhancing conceptual understanding in multimodal contrastive learning through hard negative samples , author=. arXiv preprint arXiv:2403.02875 , year=

arXiv
[70]

Advances in Neural Information Processing Systems , volume=

QUEST: Quadruple Multimodal Contrastive Learning with Constraints and Self-Penalization , author=. Advances in Neural Information Processing Systems , volume=
[71]

International conference on machine learning , pages=

Scaling up visual and vision-language representation learning with noisy text supervision , author=. International conference on machine learning , pages=. 2021 , organization=

2021
[72]

arXiv preprint arXiv:1807.03748 , year=

Representation learning with contrastive predictive coding , author=. arXiv preprint arXiv:1807.03748 , year=

arXiv
[73]

arXiv preprint arXiv:2010.11929 , year=

An image is worth 16x16 words: Transformers for image recognition at scale , author=. arXiv preprint arXiv:2010.11929 , year=

2010 arXiv
[74]

Proceedings of the IEEE/CVF international conference on computer vision , pages=

Swin transformer: Hierarchical vision transformer using shifted windows , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
[75]

arXiv preprint arXiv:2004.00849 , year=

Pixel-bert: Aligning image pixels with text by deep multi-modal transformers , author=. arXiv preprint arXiv:2004.00849 , year=

2004 arXiv
[76]

arXiv preprint arXiv:2411.14347 , year=

Dino-x: A unified vision model for open-world object detection and understanding , author=. arXiv preprint arXiv:2411.14347 , year=

arXiv
[77]

arXiv preprint arXiv:2405.10300 , year=

Grounding dino 1.5: Advance the" edge" of open-set object detection , author=. arXiv preprint arXiv:2405.10300 , year=

arXiv
[78]

arXiv preprint arXiv:2503.07465 , year=

Yoloe: Real-time seeing anything , author=. arXiv preprint arXiv:2503.07465 , year=
[79]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Yolo-world: Real-time open-vocabulary object detection , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[80]

Advances in Neural Information Processing Systems , volume=

Scaling open-vocabulary object detection , author=. Advances in Neural Information Processing Systems , volume=
[81]

Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

Video owl-vit: Temporally-consistent open-world localization in video , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
[82]

European conference on computer vision , pages=

Grounding dino: Marrying dino with grounded pre-training for open-set object detection , author=. European conference on computer vision , pages=. 2024 , organization=

2024
[83]

European conference on computer vision , pages=

Detecting twenty-thousand classes using image-level supervision , author=. European conference on computer vision , pages=. 2022 , organization=

2022
[84]

arXiv preprint arXiv:2104.13921 , year=

Open-vocabulary object detection via vision and language knowledge distillation , author=. arXiv preprint arXiv:2104.13921 , year=

arXiv
[85]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Grounded language-image pre-training , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[86]

Proceedings of the IEEE/CVF international conference on computer vision , pages=

Mdetr-modulated detection for end-to-end multi-modal understanding , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
[87]

European conference on computer vision , pages=

End-to-end object detection with transformers , author=. European conference on computer vision , pages=. 2020 , organization=

2020
[88]

arXiv preprint arXiv:2505.20279 , year=

VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstruction , author=. arXiv preprint arXiv:2505.20279 , year=

arXiv
[89]

arXiv preprint arXiv:2509.07295 , year=

Reconstruction Alignment Improves Unified Multimodal Models , author=. arXiv preprint arXiv:2509.07295 , year=

arXiv
[90]

arXiv preprint arXiv:2410.09575 , year=

Reconstructive visual instruction tuning , author=. arXiv preprint arXiv:2410.09575 , year=

arXiv
[91]

Proceedings of the AAAI Conference on Artificial Intelligence , volume=

Lavip: Language-grounded visual prompting , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
[92]

Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

Instance-aware dynamic prompt tuning for pre-trained point cloud models , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
[93]

arXiv preprint arXiv:2310.08381 , year=

Autovp: An automated visual prompting framework and benchmark , author=. arXiv preprint arXiv:2310.08381 , year=

arXiv
[94]

European conference on computer vision , pages=

Visual prompt tuning , author=. European conference on computer vision , pages=. 2022 , organization=

2022
[95]

arXiv preprint arXiv:2203.17274 , year=

Exploring visual prompts for adapting large-scale models , author=. arXiv preprint arXiv:2203.17274 , year=

arXiv
[96]

, author=

Lora: Low-rank adaptation of large language models. , author=. ICLR , volume=
[97]

International conference on machine learning , pages=

Parameter-efficient transfer learning for NLP , author=. International conference on machine learning , pages=. 2019 , organization=

2019
[98]

arXiv preprint arXiv:2101.00190 , year=

Prefix-tuning: Optimizing continuous prompts for generation , author=. arXiv preprint arXiv:2101.00190 , year=

arXiv
[99]

arXiv preprint arXiv:2104.08691 , year=

The power of scale for parameter-efficient prompt tuning , author=. arXiv preprint arXiv:2104.08691 , year=

arXiv
[100]

arXiv preprint arXiv:2110.07602 , year=

P-tuning v2: Prompt tuning can be comparable to fine-tuning universally across scales and tasks , author=. arXiv preprint arXiv:2110.07602 , year=

arXiv
[101]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Conditional prompt learning for vision-language models , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[102]

European Conference on Computer Vision , pages=

T-rex2: Towards generic object detection via text-visual prompt synergy , author=. European Conference on Computer Vision , pages=. 2024 , organization=

2024
[103]

Advances in neural information processing systems , volume=

Unsupervised learning of visual features by contrasting cluster assignments , author=. Advances in neural information processing systems , volume=
[104]

Proceedings of the European conference on computer vision (ECCV) , pages=

Deep clustering for unsupervised learning of visual features , author=. Proceedings of the European conference on computer vision (ECCV) , pages=
[105]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Exploring simple siamese representation learning , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[106]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Masked feature prediction for self-supervised visual pre-training , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[107]

arXiv preprint arXiv:2106.08254 , year=

Beit: Bert pre-training of image transformers , author=. arXiv preprint arXiv:2106.08254 , year=

arXiv
[108]

arXiv preprint arXiv:2105.04906 , year=

Vicreg: Variance-invariance-covariance regularization for self-supervised learning , author=. arXiv preprint arXiv:2105.04906 , year=

arXiv
[109]

International conference on machine learning , pages=

Barlow twins: Self-supervised learning via redundancy reduction , author=. International conference on machine learning , pages=. 2021 , organization=

2021
[110]

arXiv preprint arXiv:2103.11943 , year=

BERT: a review of applications in natural language processing and understanding , author=. arXiv preprint arXiv:2103.11943 , year=

arXiv
[111]

Advances in Neural Information Processing Systems , volume=

Efficientformer: Vision transformers at mobilenet speed , author=. Advances in Neural Information Processing Systems , volume=
[112]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops , pages=

CSPNet: A new backbone that can enhance learning capability of CNN , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops , pages=
[113]

arXiv 2022 , author=

Designing network design strategies through gradient path analysis. arXiv 2022 , author=. arXiv preprint arXiv:2211.04800 , year=

2022 arXiv
[114]

arXiv preprint arXiv:2402.13616 , year=

Yolov9: Learning what you want to learn using programmable gradient information , author=. arXiv preprint arXiv:2402.13616 , year=

arXiv
[115]

arXiv preprint arXiv:2502.11494 , year=

Stop looking for important tokens in multimodal language models: Duplication matters more , author=. arXiv preprint arXiv:2502.11494 , year=

arXiv
[116]

arXiv preprint arXiv:2410.04417 , year=

Sparsevlm: Visual token sparsification for efficient vision-language model inference , author=. arXiv preprint arXiv:2410.04417 , year=

arXiv
[117]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Multimodal token fusion for vision transformers , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[118]

Advances in Neural Information Processing Systems , volume=

An image is worth 32 tokens for reconstruction and generation , author=. Advances in Neural Information Processing Systems , volume=
[119]

European Conference on Computer Vision , pages=

Groma: Localized visual tokenization for grounding multimodal large language models , author=. European Conference on Computer Vision , pages=. 2024 , organization=

2024
[120]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Multi-modal alignment using representation codebook , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[121]

arXiv preprint arXiv:2502.20321 , year=

Unitok: A unified tokenizer for visual generation and understanding , author=. arXiv preprint arXiv:2502.20321 , year=
[122]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Mobileclip: Fast image-text models through multi-modal reinforced training , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[123]

CoRR , year=

Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution , author=. CoRR , year=
[124]

2023 , eprint=

Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond , author=. 2023 , eprint=

2023
[125]

5-vl technical report , author=

Qwen2. 5-vl technical report , author=. arXiv preprint arXiv:2502.13923 , year=

arXiv
[126]

Improving language understanding by generative pre-training , author=
[127]

arXiv preprint arXiv:2503.06520 , year=

Seg-zero: Reasoning-chain guided segmentation via cognitive reinforcement , author=. arXiv preprint arXiv:2503.06520 , year=

arXiv
[128]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Lisa: Reasoning segmentation via large language model , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[129]

Advances in Neural Information Processing Systems , volume=

Visionllm v2: An end-to-end generalist multimodal large language model for hundreds of vision-language tasks , author=. Advances in Neural Information Processing Systems , volume=
[130]

2023 , eprint=

NExT-Chat: An LMM for Chat, Detection and Segmentation , author=. 2023 , eprint=

2023
[131]

5-vl technical report , author=

Seed1. 5-vl technical report , author=. arXiv preprint arXiv:2505.07062 , year=

arXiv
[132]

2025 , eprint=

Referring to Any Person , author=. 2025 , eprint=

2025
[133]

arXiv preprint arXiv:2506.04034 , year=

Rex-Thinker: Grounded Object Referring via Chain-of-Thought Reasoning , author=. arXiv preprint arXiv:2506.04034 , year=

arXiv
[134]

arXiv preprint arXiv:2411.18363 , year=

ChatRex: Taming Multimodal LLM for Joint Perception and Understanding , author=. arXiv preprint arXiv:2411.18363 , year=

arXiv
[135]

arXiv preprint arXiv:2404.07973 , year=

Ferret-v2: An improved baseline for referring and grounding with large language models , author=. arXiv preprint arXiv:2404.07973 , year=

arXiv
[136]

European Conference on Computer Vision , pages=

Griffon: Spelling out all object locations at any granularity with large language models , author=. European Conference on Computer Vision , pages=. 2025 , organization=

2025
[137]

arXiv preprint arXiv:2311.03079 , year=

Cogvlm: Visual expert for pretrained language models , author=. arXiv preprint arXiv:2311.03079 , year=

arXiv
[138]

arXiv preprint arXiv:2310.07704 , year=

Ferret: Refer and ground anything anywhere at any granularity , author=. arXiv preprint arXiv:2310.07704 , year=

arXiv
[140]

arXiv preprint arXiv:2109.10852 , year=

Pix2seq: A language modeling framework for object detection , author=. arXiv preprint arXiv:2109.10852 , year=

arXiv
[141]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Florence-2: Advancing a unified representation for a variety of vision tasks , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[142]

Advances in neural information processing systems , volume=

Training language models to follow instructions with human feedback , author=. Advances in neural information processing systems , volume=
[143]

Advances in neural information processing systems , volume=

Direct preference optimization: Your language model is secretly a reward model , author=. Advances in neural information processing systems , volume=
[144]

arXiv preprint arXiv:1707.06347 , year=

Proximal policy optimization algorithms , author=. arXiv preprint arXiv:1707.06347 , year=

arXiv
[145]

arXiv preprint arXiv:2402.03300 , year=

Deepseekmath: Pushing the limits of mathematical reasoning in open language models , author=. arXiv preprint arXiv:2402.03300 , year=

arXiv
[146]

arXiv preprint arXiv:1711.05101 , year=

Decoupled weight decay regularization , author=. arXiv preprint arXiv:1711.05101 , year=

arXiv
[147]

arXiv preprint arXiv:2306.14824 , year=

Kosmos-2: Grounding Multimodal Large Language Models to the World , author=. arXiv preprint arXiv:2306.14824 , year=

arXiv
[148]

2022 , howpublished =

COYO-700M: Image-Text Pair Dataset , author =. 2022 , howpublished =

2022
[149]

Segment Anything , journal =

Alexander Kirillov and Eric Mintun and Nikhila Ravi and Hanzi Mao and Chlo. Segment Anything , journal =
[150]

arXiv preprint arXiv:2409.17146 , year=

Molmo and pixmo: Open weights and open data for state-of-the-art multimodal models , author=. arXiv preprint arXiv:2409.17146 , year=

arXiv
[151]

Proceedings of the IEEE/CVF international conference on computer vision , pages=

Objects365: A large-scale, high-quality dataset for object detection , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
[152]

Alina Kuznetsova and Hassan Rom and Neil Alldrin and Jasper R. R. Uijlings and Ivan Krasin and Jordi Pont. The Open Images Dataset. arXiv: 1811.00982 , year =

arXiv
[153]

arXiv preprint arXiv:2312.15612 , year=

APTv2: benchmarking animal pose estimation and tracking with a large-scale dataset and beyond , author=. arXiv preprint arXiv:2312.15612 , year=

arXiv
[154]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Bdd100k: A diverse driving dataset for heterogeneous multitask learning , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[155]

Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

Deepfashion: Powering robust clothes recognition and retrieval with rich annotations , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
[156]

Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

DOTA: A large-scale dataset for object detection in aerial images , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
[157]

Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

Egoobjects: A large-scale egocentric dataset for fine-grained object understanding , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
[158]

ISPRS Journal of Photogrammetry and Remote Sensing , volume=

FAIR1M: A benchmark dataset for fine-grained object recognition in high-resolution remote sensing imagery , author=. ISPRS Journal of Photogrammetry and Remote Sensing , volume=. 2022 , publisher=

2022
[159]

Asian Conference on Computer Vision , pages=

Detector-in-detector: Multi-level analysis for human-parts , author=. Asian Conference on Computer Vision , pages=. 2018 , organization=

2018
[160]

European Conference on Computer Vision , pages=

Partimagenet: A large, high-quality dataset of parts , author=. European Conference on Computer Vision , pages=. 2022 , organization=

2022
[161]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

nuscenes: A multimodal dataset for autonomous driving , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[162]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Paco: Parts and attributes of common objects , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[163]

Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

V3det: Vast vocabulary visual detection dataset , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
[164]

Proceedings of the IEEE/CVF international conference on computer vision workshops , pages=

VisDrone-DET2019: The vision meets drone object detection in image challenge results , author=. Proceedings of the IEEE/CVF international conference on computer vision workshops , pages=
[165]

International journal of computer vision , volume=

Visual genome: Connecting language and vision using crowdsourced dense image annotations , author=. International journal of computer vision , volume=. 2017 , publisher=

2017
[166]

European conference on computer vision , pages=

Modeling context in referring expressions , author=. European conference on computer vision , pages=. 2016 , organization=

2016
[167]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Humanref: Single image to 3d human generation via reference-guided diffusion , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[168]

Proceedings of the IEEE international conference on computer vision , pages=

Flickr30k entities: Collecting region-to-phrase correspondences for richer image-to-sentence models , author=. Proceedings of the IEEE international conference on computer vision , pages=
[169]

arXiv preprint arXiv:1902.09506 , volume=

Gqa: a new dataset for compositional question answering over real-world images , author=. arXiv preprint arXiv:1902.09506 , volume=

1902 arXiv
[170]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Towards end-to-end unified scene text detection and layout analysis , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[171]

arXiv preprint arXiv:1805.00123 , year=

Crowdhuman: A benchmark for detecting human in a crowd , author=. arXiv preprint arXiv:1805.00123 , year=

arXiv
[172]

European Conference on Computer Vision , pages=

Few-shot object counting and detection , author=. European Conference on Computer Vision , pages=. 2022 , organization=

2022
[173]

2019 International Conference on Document Analysis and Recognition (ICDAR) , pages=

Icdar2019 robust reading challenge on arbitrary-shaped text-rrc-art , author=. 2019 International Conference on Document Analysis and Recognition (ICDAR) , pages=. 2019 , organization=

2019
[174]

International Journal of Document Analysis and Recognition (IJDAR) , volume=

ICDAR 2003 robust reading competitions: entries, results, and future directions , author=. International Journal of Document Analysis and Recognition (IJDAR) , volume=. 2005 , publisher=

2003
[175]

2015 13th international conference on document analysis and recognition (ICDAR) , pages=

ICDAR 2015 competition on robust reading , author=. 2015 13th international conference on document analysis and recognition (ICDAR) , pages=. 2015 , organization=

2015
[176]

Proceedings of the IEEE/CVF international conference on computer vision , pages=

Chinese street view text: Large-scale chinese text reading with partially supervised learning , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
[177]

2017 14th iapr international conference on document analysis and recognition (ICDAR) , volume=

Icdar2017 competition on reading chinese text in the wild (rctw-17) , author=. 2017 14th iapr international conference on document analysis and recognition (ICDAR) , volume=. 2017 , organization=

2017
[178]

2019 international conference on document analysis and recognition (ICDAR) , pages=

Icdar 2019 robust reading challenge on reading chinese text on signboard , author=. 2019 international conference on document analysis and recognition (ICDAR) , pages=. 2019 , organization=

2019
[179]

2019 International Conference on Document Analysis and Recognition (ICDAR) , pages=

Icdar2019 competition on scanned receipt ocr and information extraction , author=. 2019 International Conference on Document Analysis and Recognition (ICDAR) , pages=. 2019 , organization=

2019
[180]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Textocr: Towards large-scale end-to-end reasoning for arbitrary-shaped scene text , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[181]

European Conference on Computer Vision , pages=

Ocr-idl: Ocr annotations for industry document library dataset , author=. European Conference on Computer Vision , pages=. 2022 , organization=

2022
[182]

arXiv preprint arXiv:2103.14470 , year=

Spatial dual-modality graph reasoning for key information extraction , author=. arXiv preprint arXiv:2103.14470 , year=

arXiv
[183]

International conference on document analysis recognition , year=

Icdar 2019 robust reading challenge on scanned receipts ocr and information extraction , author=. International conference on document analysis recognition , year=

2019
[184]

CoRR , year=

DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding , author=. CoRR , year=
[185]

5 technical report , author=

Ovis2. 5 technical report , author=. arXiv preprint arXiv:2508.11737 , year=

arXiv
[186]

2025 , eprint=

MiMo-VL Technical Report , author=. 2025 , eprint=

2025
[187]

arXiv preprint arXiv:2505.24025 , year=

DINO-R1: Incentivizing Reasoning Capability in Vision Foundation Models , author=. arXiv preprint arXiv:2505.24025 , year=

arXiv
[188]

European Conference on Computer Vision , pages=

X-detr: A versatile architecture for instance-wise vision-language tasks , author=. European Conference on Computer Vision , pages=. 2022 , organization=

2022
[189]

arXiv preprint arXiv:2512.12309 , year=

WeDetect: Fast Open-Vocabulary Object Detection as Retrieval , author=. arXiv preprint arXiv:2512.12309 , year=
[190]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Lvis: A dataset for large vocabulary instance segmentation , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[191]

Can we fix it? Yes! , author=

Is CLIP ideal? No. Can we fix it? Yes! , author=. arXiv preprint arXiv:2503.08723 , year=
[192]

Advances in Neural Information Processing Systems , volume=

Glipv2: Unifying localization and vision-language understanding , author=. Advances in Neural Information Processing Systems , volume=
[193]

arXiv preprint arXiv:2111.08276 , year=

Multi-grained vision language pre-training: Aligning texts with visual concepts , author=. arXiv preprint arXiv:2111.08276 , year=

arXiv
[194]

arXiv preprint arXiv:2510.20244 , year=

Empower Words: DualGround for Structured Phrase and Sentence-Level Temporal Grounding , author=. arXiv preprint arXiv:2510.20244 , year=
[195]

Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

Exploring geometry-aware contrast and clustering harmonization for self-supervised 3d object detection , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
[196]

2022 , organization=

Evaluating Large-Vocabulary Object Detectors: The Devil is in the Details , author=. 2022 , organization=

2022
[197]

arXiv preprint arXiv:2407.07844 , year=

Ov-dino: Unified open-vocabulary detection with language-aware selective fusion , author=. arXiv preprint arXiv:2407.07844 , year=

arXiv
[198]

Advances in Neural Information Processing Systems , volume=

Detclip: Dictionary-enriched visual-concept paralleled pre-training for open-world detection , author=. Advances in Neural Information Processing Systems , volume=
[199]

arXiv preprint arXiv:2002.05202 , year=

Glu variants improve transformer , author=. arXiv preprint arXiv:2002.05202 , year=

2002 arXiv
[200]

2024 International conference on advances in data engineering and intelligent computing systems (ADICS) , pages=

Yolov8: A novel object detection algorithm with enhanced performance and robustness , author=. 2024 International conference on advances in data engineering and intelligent computing systems (ADICS) , pages=. 2024 , organization=

2024
[201]

European conference on computer vision , pages=

Microsoft coco: Common objects in context , author=. European conference on computer vision , pages=. 2014 , organization=

2014
[202]

arXiv preprint arXiv:2408.00714 , year=

Sam 2: Segment anything in images and videos , author=. arXiv preprint arXiv:2408.00714 , year=

arXiv
[203]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Regionclip: Region-based language-image pretraining , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[204]

arXiv preprint arXiv:2503.13817 , year=

VARP: Reinforcement Learning from Vision-Language Model Feedback with Agent Regularized Preferences , author=. arXiv preprint arXiv:2503.13817 , year=

arXiv
[205]

PRLL: Policy Regularization and Reward Shaping Assisted by Large Language Models , author=
[206]

The Thirty-eighth Annual Conference on Neural Information Processing Systems , year=

Fine-Tuning Large Vision-Language Models as Decision-Making Agents via Reinforcement Learning , author=. The Thirty-eighth Annual Conference on Neural Information Processing Systems , year=
[207]

Advances in neural information processing systems , volume=

Fine-tuning large vision-language models as decision-making agents via reinforcement learning , author=. Advances in neural information processing systems , volume=
[208]

Transportation Research Part C: Emerging Technologies , volume=

Vlm-rl: A unified vision language models and reinforcement learning framework for safe autonomous driving , author=. Transportation Research Part C: Emerging Technologies , volume=. 2025 , publisher=

2025
[209]

Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

A simple framework for open-vocabulary segmentation and detection , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
[210]

arXiv preprint arXiv:2407.10655 , year=

OVLW-DETR: Open-Vocabulary Light-Weighted Detection Transformer , author=. arXiv preprint arXiv:2407.10655 , year=

arXiv
[211]

IET Computer Vision , year=

OmDet: Large-scale vision-language multi-dataset pre-training with multimodal detection network , author=. IET Computer Vision , year=
[212]

International Conference on Machine Learning , pages=

A Closer Look at Multimodal Representation Collapse , author=. International Conference on Machine Learning , pages=. 2025 , organization=

2025
[213]

Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=

Self-supervised learning from images with a joint-embedding predictive architecture , author=. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition , pages=
[216]

Proceedings of the IEEE/CVF international conference on computer vision , pages=

A fast and accurate one-stage approach to visual grounding , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
[217]

Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

Mattnet: Modular attention network for referring expression comprehension , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
[218]

Proceedings of the IEEE/CVF international conference on computer vision , pages=

Transvg: End-to-end visual grounding with transformers , author=. Proceedings of the IEEE/CVF international conference on computer vision , pages=
[219]

IEEE transactions on pattern analysis and machine intelligence , volume=

Transvg++: End-to-end visual grounding with language conditioned vision transformer , author=. IEEE transactions on pattern analysis and machine intelligence , volume=. 2023 , publisher=

2023
[220]

Proceedings of the 32nd ACM International Conference on Multimedia , pages=

Hivg: Hierarchical multimodal fine-grained modulation for visual grounding , author=. Proceedings of the 32nd ACM International Conference on Multimedia , pages=
[221]

IEEE Transactions on Multimedia , volume=

Clip-vg: Self-paced curriculum adapting of clip for visual grounding , author=. IEEE Transactions on Multimedia , volume=. 2023 , publisher=

2023
[222]

Advances in Neural Information Processing Systems , volume=

Oneref: Unified one-tower expression grounding and segmentation with mask referring modeling , author=. Advances in Neural Information Processing Systems , volume=
[223]

IEEE Transactions on Pattern Analysis and Machine Intelligence , volume=

Dynamic MDETR: A Dynamic Multimodal Transformer Decoder for Visual Grounding , author=. IEEE Transactions on Pattern Analysis and Machine Intelligence , volume=. 2024 , publisher=

2024
[224]

International Conference on Learning Representations , volume=

Ferret: Refer and ground anything anywhere at any granularity , author=. International Conference on Learning Representations , volume=
[225]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Detect anything via next point prediction , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[226]

arXiv preprint arXiv:2605.27365 , year=

LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding , author=. arXiv preprint arXiv:2605.27365 , year=

arXiv
[228]

Advances in Neural Information Processing Systems , volume=

Mind the gap: Understanding the modality gap in multi-modal contrastive representation learning , author=. Advances in Neural Information Processing Systems , volume=
[229]

Proceedings of the National Academy of Sciences , volume=

Prevalence of neural collapse during the terminal phase of deep learning training , author=. Proceedings of the National Academy of Sciences , volume=. 2020 , publisher=

2020
[230]

2, 2022-06-27 , author=

A path towards autonomous machine intelligence version 0.9. 2, 2022-06-27 , author=. Open Review , volume=

2022
[231]

V-jepa: Latent video prediction for visual representation learning , author=
[233]

2025 , eprint=

HY-MT1.5 Technical Report , author=. 2025 , eprint=

2025
[234]

Dao, Tri , booktitle=. Flash
[235]

International Conference on Learning Representations , volume=

Grounding multimodal large language models to the world , author=. International Conference on Learning Representations , volume=
[236]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Glamm: Pixel grounding large multimodal model , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[237]

arXiv preprint arXiv:2502.13898 , year=

GroundCap: A visually grounded image captioning dataset , author=. arXiv preprint arXiv:2502.13898 , year=

arXiv
[238]

2016 , publisher=

Human behavior and the principle of least effort: An introduction to human ecology , author=. 2016 , publisher=

2016
[239]

1978 , publisher=

Information retrieval: Computational and theoretical aspects , author=. 1978 , publisher=

1978
[240]

Proceedings of the ACL-02 Workshop on Effective tools and methodologies for teaching natural language processing and computational linguistics , pages=

Nltk: The natural language toolkit , author=. Proceedings of the ACL-02 Workshop on Effective tools and methodologies for teaching natural language processing and computational linguistics , pages=
[243]

Proceedings of the IEEE conference on computer vision and pattern recognition , pages=

Generation and comprehension of unambiguous object descriptions , author=. Proceedings of the IEEE conference on computer vision and pattern recognition , pages=
[244]

Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=

Reclip: A strong zero-shot baseline for referring expression comprehension , author=. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=
[246]

Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=

Propvg: End-to-end proposal-driven visual grounding with multi-granularity discrimination , author=. Proceedings of the IEEE/CVF International Conference on Computer Vision , pages=
[247]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Revisiting referring expression comprehension evaluation in the era of large multimodal models , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[248]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Universal instance perception as object discovery and retrieval , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[249]

IEEE transactions on knowledge and data engineering , volume=

Generalizing to unseen domains: A survey on domain generalization , author=. IEEE transactions on knowledge and data engineering , volume=. 2022 , publisher=

2022
[251]

International conference on machine learning , pages=

Rankme: Assessing the downstream performance of pretrained self-supervised representations by their rank , author=. International conference on machine learning , pages=. 2023 , organization=

2023
[252]

2007 15th European signal processing conference , pages=

The effective rank: A measure of effective dimensionality , author=. 2007 15th European signal processing conference , pages=. 2007 , organization=

2007
[253]

Neurocomputing , volume=

Open-category referring expression comprehension via multi-modal knowledge transfer , author=. Neurocomputing , volume=. 2024 , publisher=

2024
[254]

Proceedings of the AAAI Conference on Artificial Intelligence , volume=

Hierarchical alignment-enhanced adaptive grounding network for generalized referring expression comprehension , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
[255]

Proceedings of the AAAI Conference on Artificial Intelligence , volume=

Rethinking two-stage referring expression comprehension: A novel grounding and segmentation method modulated by point , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=
[256]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Gsva: Generalized segmentation via multimodal large language models , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=
[257]

Assran, M.; Duval, Q.; Misra, I.; Bojanowski, P.; Vincent, P.; Rabbat, M.; LeCun, Y.; and Ballas, N. 2023. Self-supervised learning from images with a joint-embedding predictive architecture. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition,...

2023
[258]

Bai, S.; Cai, Y.; Chen, R.; Chen, K.; Chen, X.; Cheng, Z.; Deng, L.; Ding, W.; Gao, C.; Ge, C.; et al. 2025. Qwen3-vl technical report. arXiv preprint arXiv:2511.21631

2025 arXiv
[259]

Bardes, A.; Garrido, Q.; Ponce, J.; Chen, X.; Rabbat, M.; LeCun, Y.; Assran, M.; and Ballas, N. 2023. V-jepa: Latent video prediction for visual representation learning

2023
[260]

Chaudhuri, A.; Dutta, A.; Bui, T.; and Georgescu, S. 2025. A Closer Look at Multimodal Representation Collapse. In International Conference on Machine Learning, 7555--7577. PMLR

2025
[261]

Chen, D.; Shukor, M.; Moutakanni, T.; Chung, W.; Yu, J.; Kasarla, T.; Bang, Y.; Bolourchi, A.; LeCun, Y.; and Fung, P. 2025 a . Vl-jepa: Joint embedding predictive architecture for vision-language. arXiv preprint arXiv:2512.10942

2025
[262]

G.; and Zhang, H

Chen, J.; Wei, F.; Zhao, J.; Song, S.; Wu, B.; Peng, Z.; Chan, S.-H. G.; and Zhang, H. 2025 b . Revisiting referring expression comprehension evaluation in the era of large multimodal models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,...

2025
[263]

Chen, K.; Zhang, Z.; Zeng, W.; Zhang, R.; Zhu, F.; and Zhao, R. 2023. Shikra: Unleashing Multimodal LLM's Referential Dialogue Magic. arXiv preprint arXiv:2306.15195

2023 arXiv
[264]

Dai, M.; Cheng, W.; Zhuang, J.; Liu, J.-j.; Zhao, H.; Feng, Z.; and Yang, W. 2025. Propvg: End-to-end proposal-driven visual grounding with multi-granularity discrimination. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 7058--7068

2025
[265]

Dao, T. 2024. Flash A ttention-2: Faster Attention with Better Parallelism and Work Partitioning. In International Conference on Learning Representations (ICLR)

2024
[266]

Deng, J.; Yang, Z.; Chen, T.; Zhou, W.; and Li, H. 2021. Transvg: End-to-end visual grounding with transformers. In Proceedings of the IEEE/CVF international conference on computer vision, 1769--1779

2021
[267]

Garrido, Q.; Balestriero, R.; Najman, L.; and Lecun, Y. 2023. Rankme: Assessing the downstream performance of pretrained self-supervised representations by their rank. In International conference on machine learning, 10929--10974. PMLR

2023
[268]

Heaps, H. S. 1978. Information retrieval: Computational and theoretical aspects. Academic Press, Inc

1978
[269]

Hu, J.; Bai, T.; Wu, F.; Li, W.; Peng, Z.; and Zhang, Y. 2026. ExpAlign: Expectation-Guided Vision-Language Alignment for Open-Vocabulary Grounding. arXiv preprint arXiv:2601.22666

2026
[270]

Huang, C.; Li, X.; Thilak, V.; Littwin, E.; and Susskind, J. 2026. Text-Conditional JEPA for Learning Semantically Rich Visual Representations. arXiv preprint arXiv:2605.03245

2026 arXiv
[271]

Jing, L.; Vincent, P.; LeCun, Y.; and Tian, Y. 2021. Understanding dimensional collapse in contrastive self-supervised learning. arXiv preprint arXiv:2110.09348

2021 arXiv
[272]

Kamath, A.; Singh, M.; LeCun, Y.; Synnaeve, G.; Misra, I.; and Carion, N. 2021. Mdetr-modulated detection for end-to-end multi-modal understanding. In Proceedings of the IEEE/CVF international conference on computer vision, 1780--1790

2021
[273]

A.; et al

Krishna, R.; Zhu, Y.; Groth, O.; Johnson, J.; Hata, K.; Kravitz, J.; Chen, S.; Kalantidis, Y.; Li, L.-J.; Shamma, D. A.; et al. 2017. Visual genome: Connecting language and vision using crowdsourced dense image annotations. International journal of computer vision, 123(1): 32--73

2017
[274]

LeCun, Y.; et al. 2022. A path towards autonomous machine intelligence version 0.9. 2, 2022-06-27. Open Review, 62(1): 1--62

2022
[275]

H.; Zhang, P.; Zhang, H.; Yang, J.; Li, C.; Zhong, Y.; Wang, L.; Yuan, L.; Zhang, L.; Hwang, J.-N.; et al

Li, L. H.; Zhang, P.; Zhang, H.; Yang, J.; Li, C.; Zhong, Y.; Wang, L.; Yuan, L.; Zhang, L.; Hwang, J.-N.; et al. 2022. Grounded language-image pre-training. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 10965--10975

2022
[276]

Li, M.; Zhang, Y.; Long, D.; Chen, K.; Song, S.; Bai, S.; Yang, Z.; Xie, P.; Yang, A.; Liu, D.; et al. 2026. Qwen3-VL-Embedding and Qwen3-VL-Reranker: A Unified Framework for State-of-the-Art Multimodal Retrieval and Ranking. arXiv preprint arXiv:2601.04720

2026 arXiv
[277]

W.; Zhang, Y.; Kwon, Y.; Yeung, S.; and Zou, J

Liang, V. W.; Zhang, Y.; Kwon, Y.; Yeung, S.; and Zou, J. Y. 2022. Mind the gap: Understanding the modality gap in multi-modal contrastive representation learning. Advances in Neural Information Processing Systems, 35: 17612--17625

2022
[278]

Liu, S.; Zeng, Z.; Ren, T.; Li, F.; Zhang, H.; Yang, J.; Jiang, Q.; Li, C.; Yang, J.; Su, H.; et al. 2024. Grounding dino: Marrying dino with grounded pre-training for open-set object detection. In European conference on computer vision, 38--55. Springer

2024
[279]

Loper, E.; and Bird, S. 2002. Nltk: The natural language toolkit. In Proceedings of the ACL-02 Workshop on Effective tools and methodologies for teaching natural language processing and computational linguistics, 63--70

2002
[280]

Mi, W.; Wang, J.; Zhuang, F.; An, Z.; and Guo, W. 2024. Open-category referring expression comprehension via multi-modal knowledge transfer. Neurocomputing, 598: 128063

2024
[281]

Nogueira, F.; Bernardino, A.; and Martins, B. 2025. Comprehension of Multilingual Expressions Referring to Target Objects in Visual Inputs. arXiv preprint arXiv:2511.11427

2025
[282]

Papyan, V.; Han, X.; and Donoho, D. L. 2020. Prevalence of neural collapse during the terminal phase of deep learning training. Proceedings of the National Academy of Sciences, 117(40): 24652--24663

2020
[283]

Peng, Z.; Wang, W.; Dong, L.; Hao, Y.; Huang, S.; Ma, S.; Ye, Q.; and Wei, F. 2024. Grounding multimodal large language models to the world. In International Conference on Learning Representations, volume 2024, 51575--51598

2024
[284]

M.; Xing, E.; Yang, M.-H.; and Khan, F

Rasheed, H.; Maaz, M.; Shaji, S.; Shaker, A.; Khan, S.; Cholakkal, H.; Anwer, R. M.; Xing, E.; Yang, M.-H.; and Khan, F. S. 2024. Glamm: Pixel grounding large multimodal model. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 13009--13018

2024
[285]

Shao, S.; Li, Z.; Zhang, T.; Peng, C.; Yu, G.; Zhang, X.; Li, J.; and Sun, J. 2019. Objects365: A large-scale, high-quality dataset for object detection. In Proceedings of the IEEE/CVF international conference on computer vision, 8430--8439

2019
[286]

V.; Seitzer, M.; Baldassarre, F.; Oquab, M.; Jose, C.; Khalidov, V.; Szafraniec, M.; Yi, S.; Ramamonjisoa, M.; et al

Sim \'e oni, O.; Vo, H. V.; Seitzer, M.; Baldassarre, F.; Oquab, M.; Jose, C.; Khalidov, V.; Szafraniec, M.; Yi, S.; Ramamonjisoa, M.; et al. 2025. Dinov3. arXiv preprint arXiv:2508.10104

2025 arXiv
[287]

Wang, J.; Lan, C.; Liu, C.; Ouyang, Y.; Qin, T.; Lu, W.; Chen, Y.; Zeng, W.; and Yu, P. S. 2022. Generalizing to unseen domains: A survey on domain generalization. IEEE transactions on knowledge and data engineering, 35(8): 8052--8072

2022
[288]

Wang, Y.; Ding, H.; He, S.; Jiang, X.; Wei, B.; and Liu, J. 2025. Hierarchical alignment-enhanced adaptive grounding network for generalized referring expression comprehension. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, 8042--8050

2025
[289]

Xia, Z.; Han, D.; Han, Y.; Pan, X.; Song, S.; and Huang, G. 2024. Gsva: Generalized segmentation via multimodal large language models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3858--3869

2024
[290]

Xiao, L.; Yang, X.; Peng, F.; Wang, Y.; and Xu, C. 2024. Hivg: Hierarchical multimodal fine-grained modulation for visual grounding. In Proceedings of the 32nd ACM International Conference on Multimedia, 5460--5469

2024
[291]

Yang, S.; Qu, T.; Lai, X.; Tian, Z.; Peng, B.; Liu, S.; and Jia, J. 2023. Lisa++: An improved baseline for reasoning segmentation with large language model. arXiv preprint arXiv:2312.17240

2023 arXiv
[292]

You, H.; Zhang, H.; Gan, Z.; Du, X.; Zhang, B.; Wang, Z.; Cao, L.; Chang, S.-F.; and Yang, Y. 2024. Ferret: Refer and ground anything anywhere at any granularity. In International Conference on Learning Representations, volume 2024, 57153--57180

2024
[293]

Yu, L.; Lin, Z.; Shen, X.; Yang, J.; Lu, X.; Bansal, M.; and Berg, T. L. 2018. Mattnet: Modular attention network for referring expression comprehension. In Proceedings of the IEEE conference on computer vision and pattern recognition, 1307--1315

2018
[294]

C.; and Berg, T

Yu, L.; Poirson, P.; Yang, S.; Berg, A. C.; and Berg, T. L. 2016. Modeling context in referring expressions. In European conference on computer vision, 69--85. Springer

2016
[295]

Zhao, P.; Zheng, S.; Zhao, W.; Xu, D.; Li, P.; Cai, Y.; and Huang, Q. 2024. Rethinking two-stage referring expression comprehension: A novel grounding and segmentation method modulated by point. In Proceedings of the AAAI Conference on Artificial Intelligence, volume 38, 7487--7495

2024
[296]

Zheng, M.; Li, Z.; Chen, T.; Song, M.; and Wang, D. 2025. HY-MT1.5 Technical Report. arXiv:2512.24092

2025
[297]

Zipf, G. K. 2016. Human behavior and the principle of least effort: An introduction to human ecology. Ravenio books

2016

Pith tools

Reviewed August 16, 2026 · model on record in the stance chip above.

[1] [1]

International conference on machine learning , pages=

Attention-based deep multiple instance learning , author=. International conference on machine learning , pages=. 2018 , organization=

2018

[2] [2]

Applied Sciences , volume=

Multispectral Target Detection Based on Deep Feature Fusion of Visible and Infrared Modalities , author=. Applied Sciences , volume=. 2025 , publisher=

2025

[3] [3]

Signal and Data Processing of Small Targets 1993 , volume=

Multispectral infrared target detection: phenomenology and modeling , author=. Signal and Data Processing of Small Targets 1993 , volume=. 1993 , organization=

1993

[4] [4]

Sensors , volume=

Infrared dim small target detection networks: A review , author=. Sensors , volume=. 2024 , publisher=

2024

[5] [5]

Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=

RPCANet: Deep unfolding RPCA based infrared small target detection , author=. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages=

[6] [6]

Sensors , volume=

Object detection in multispectral remote sensing images based on cross-modal cross-attention , author=. Sensors , volume=. 2024 , publisher=

2024

[7] [7]

2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , pages=

Multispectral Object Detection Enhanced by Cross-Modal Information Complementary and Cosine Similarity Channel Resampling Modules , author=. 2025 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , pages=. 2025 , organization=

2025

[8] [8]

Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

Mma: Multi-modal adapter for vision-language models , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=