Pith Number

pith:MLWZXDFU

pith:2025:MLWZXDFUCKGV67IKBCX6JRKNKI

not attested not anchored not stored refs pending

AutoCodeBench: Large Language Models are Automatic Code Benchmark Generators

Ao Liu, Bohui Zhai, Chenchen Zhang, Fengzong Lian, Haotian Zhu, Hengyi Liu, Jason Chou, Jianwei Cai, Lingyun Tan, Speed Zhu, Tao Zhang, Wiggin Zhou, Yuchi Deng, Yue Mao, Zhiying Zeng, Ziyan Xu

arxiv:2508.09101 v1 · 2025-08-12 · cs.CL · cs.SE

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{MLWZXDFUCKGV67IKBCX6JRKNKI}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

9 papers in Pith

PERFOPT-Bench: Evaluating Coding Agents on Software Performance Optimization

PBT-Bench: Benchmarking AI Agents on Property-Based Testing

Code-QA-Bench: Separating Code Reasoning from Documentation Memorization in Repository-Level QA

PBT-Bench: Benchmarking AI Agents on Property-Based Testing

PerfCodeBench: Benchmarking LLMs for System-Level High-Performance Code Optimization

Receipt and verification

First computed	2026-07-05T11:52:39.755764Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

62ed9b8cb4128d5f7d0a08afe4c54d52282cf4a63074bcbd535a5c8a0fb8d78e

Aliases

arxiv: 2508.09101 · arxiv_version: 2508.09101v1 · doi: 10.48550/arxiv.2508.09101 · pith_short_12: MLWZXDFUCKGV · pith_short_16: MLWZXDFUCKGV67IK · pith_short_8: MLWZXDFU

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/MLWZXDFUCKGV67IKBCX6JRKNKI \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: 62ed9b8cb4128d5f7d0a08afe4c54d52282cf4a63074bcbd535a5c8a0fb8d78e

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "ebb86165df40f71899a4c23dfe4d4e17bc2f4a250e2fbc80da4936b9e8d67af4",
    "cross_cats_sorted": [
      "cs.SE"
    ],
    "license": "http://creativecommons.org/publicdomain/zero/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2025-08-12T17:29:20Z",
    "title_canon_sha256": "1a2e74561b98df6b6702e0ce20634eab05a0ccf424ceb7c87b2a1a77f8d05d65"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2508.09101",
    "kind": "arxiv",
    "version": 1
  }
}