pith:4KXYZZYO
Statistical Consistency and Generalization of Contrastive Representation Learning
Contrastive loss is statistically consistent with optimal ranking in retrieval tasks
arxiv:2605.02116 v2 · 2026-05-04 · cs.LG
Add to your LaTeX paper
\usepackage{pith}
\pithnumber{4KXYZZYOAL6CTQOAHW6BLN3YHB}
Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge
Record completeness
Claims
We show that the contrastive loss is statistically consistent with optimal ranking and derive generalization bounds of order O(1/m + 1/sqrt(n)) and O(1/sqrt(m) + 1/sqrt(n)) for supervised and self-supervised CRL respectively.
The paper does not state the weakest assumption explicitly in the abstract; the bounds and consistency results are likely to rest on standard statistical-learning assumptions such as i.i.d. sampling, bounded loss functions, and appropriate regularity conditions on the data distribution that are not detailed here.
Contrastive representation learning is statistically consistent for optimal retrieval and admits generalization bounds of order O(1/m + 1/sqrt(n)) supervised and O(1/sqrt(m) + 1/sqrt(n)) self-supervised that benefit from large negative-sample counts m.
Receipt and verification
| First computed | 2026-05-21T01:04:26.657450Z |
|---|---|
| Builder | pith-number-builder-2026-05-17-v1 |
| Signature | Pith Ed25519
(pith-v1-2026-05) · public key |
| Schema | pith-number/v1.0 |
Canonical hash
e2af8ce70e02fc29c1c03dbc15b7783859a0af203aa9e0e93f02205a031e5777
Aliases
· · · · ·Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/4KXYZZYOAL6CTQOAHW6BLN3YHB \
| jq -c '.canonical_record' \
| python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: e2af8ce70e02fc29c1c03dbc15b7783859a0af203aa9e0e93f02205a031e5777
Canonical record JSON
{
"metadata": {
"abstract_canon_sha256": "9800b4b057f16bb7270417674de90b5c0c839a1d45f18e8ce12d401ee95a77fc",
"cross_cats_sorted": [],
"license": "http://creativecommons.org/licenses/by/4.0/",
"primary_cat": "cs.LG",
"submitted_at": "2026-05-04T00:38:29Z",
"title_canon_sha256": "e31927de8b7349f6052390c6f4c1970324cac524aeb4393aaf41facb000fe3f1"
},
"schema_version": "1.0",
"source": {
"id": "2605.02116",
"kind": "arxiv",
"version": 2
}
}