Infant-scale VLMs discriminate size and texture visually but perform poorly on color and struggle to ground attributes in text, while web-scale models excel at color grounding.
Benchmarking Attribute Discrimination in Infant-Scale Vision-Language Models
1 Pith paper cite this work. Polarity classification is still indexing.
abstract
Infants learn not only object categories but also fine-grained visual attributes such as color, size, and texture from limited experience. Prior infant-scale vision--language models have mainly been evaluated on object recognition, leaving open whether they support within-class attribute discrimination. We introduce a controlled benchmark that varies color, size, and texture across 67 everyday object classes using synthetic rendering to decouple attribute values from object identity. We evaluate infant-trained models (CVCL and an infant-trained DINO baseline) against web-scale and ImageNet models (CLIP, SigLIP, ResNeXt) under two complementary settings: an image-only prototype test and a text--vision test with attribute--object prompts. We find a dissociation between visual and linguistic attribute information: infant-trained models form strong visual representations for size and discriminate texture comparably to other models, but perform poorly on visual color discrimination, and in the text--vision setting they struggle to ground color and show only modest size grounding. In contrast, web-trained vision--language models strongly ground color from text while exhibiting weaker visual size discrimination.
fields
cs.LG 1years
2025 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Benchmarking Attribute Discrimination in Infant-Scale Vision-Language Models
Infant-scale VLMs discriminate size and texture visually but perform poorly on color and struggle to ground attributes in text, while web-scale models excel at color grounding.