pith:Z4QTKRP5
Hide to See: Reasoning-prefix Masking for Visual-anchored Thinking in VLM Distillation
Masking the student's salient reasoning prefixes during distillation makes VLMs anchor their thinking more directly on visual evidence.
arxiv:2605.11651 v3 · 2026-05-12 · cs.CV · cs.AI · cs.CL
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{Z4QTKRP57TX45TFZGCOKCUYWGV}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
Our approach outperforms recent open-source VLMs, VLM distillation, and self-distillation methods on multimodal reasoning benchmarks, while further analyzes confirm enhanced visual utilization along the student thinking process.
That masking the student's salient reasoning prefixes will cause the student to rely more on visual evidence as an alternative source of information during distillation, as stated in the abstract's description of the framework objective.
A masking-based think-answer distillation method for VLMs that selectively hides reasoning prefixes and uses self-paced scheduling to improve visual anchoring and benchmark performance.
References
Formal links
Receipt and verification
| First computed | 2026-05-20T00:00:42.871120Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
cf213545fdfcefceccb9309ca15316356d8aa20be189b8a0c89391981e088970
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/Z4QTKRP57TX45TFZGCOKCUYWGV \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: cf213545fdfcefceccb9309ca15316356d8aa20be189b8a0c89391981e088970
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "7ef022a8ae382b90ca80b056b34399afef3aeb983bf4cdd7a3b24eeadebcab68",
"cross_cats_sorted": [
"cs.AI",
"cs.CL"
],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.CV",
"submitted_at": "2026-05-12T07:14:04Z",
"title_canon_sha256": "b6230ede9c38f08c7567fc71f0fd309a8b88e37af49e812bb2d03d94a9a36d99"
},
"schema_version": "1.0",
"source": {
"id": "2605.11651",
"kind": "arxiv",
"version": 3
}
}