Pith Number

pith:643GD2UB

pith:2025:643GD2UBUKDYLXOXV5IU6VRUSU

not attested not anchored not stored refs pending

CodeElo: Benchmarking Competition-level Code Generation of LLMs with Human-comparable Elo Ratings

An Yang, Binyuan Hui, Bofei Gao, Bowen Yu, Bo Zheng, Dayiheng Liu, Jian Yang, Jiaxi Yang, Junyang Lin, Shanghaoran Quan, Xuancheng Ren, Yang Fan, Yibo Miao, Yichang Zhang, Yunlong Feng, Zekun Wang, Zeyu Cui

arxiv:2501.01257 v2 · 2025-01-02 · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{643GD2UBUKDYLXOXV5IU6VRUSU}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

20 papers in Pith

Selective Left-Shift: Turning Test-Time Compute and Difficulty-based Curation into Training Data for Low-Resource Code Generation

From Execution to Education: A Bloom-Aligned Framework for Measuring Educational Control in LLMs

The Generalization Spectrum: A Chromatographic Approach to Evaluating Learning Algorithms

Sakana Fugu Technical Report

Receipt and verification

First computed	2026-07-05T09:56:39.220669Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

f73661ea81a28785ddd7af514f5634953e893826ef2c8bccecbe3b798b312a7a

Aliases

arxiv: 2501.01257 · arxiv_version: 2501.01257v2 · doi: 10.48550/arxiv.2501.01257 · pith_short_12: 643GD2UBUKDY · pith_short_16: 643GD2UBUKDYLXOX · pith_short_8: 643GD2UB

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/643GD2UBUKDYLXOXV5IU6VRUSU \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: f73661ea81a28785ddd7af514f5634953e893826ef2c8bccecbe3b798b312a7a

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "c0a20f9968dfd32aadff58b71d0921165d6e309dfda3cc37bff9ee28efb8408b",
    "cross_cats_sorted": [],
    "license": "http://creativecommons.org/licenses/by/4.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2025-01-02T13:49:00Z",
    "title_canon_sha256": "e0b31860b29d5230af3d5e8ff59497b5465951c7976da87790dfe3ab43cf74e2"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2501.01257",
    "kind": "arxiv",
    "version": 2
  }
}