Pith Number

pith:4MO44H43

pith:2020:4MO44H43MFGMWYJMTOIQUFPLSR

not attested not anchored not stored refs pending

How Good is Your Tokenizer? On the Monolingual Performance of Multilingual Language Models

Iryna Gurevych, Ivan Vuli\'c, Jonas Pfeiffer, Phillip Rust, Sebastian Ruder

arxiv:2012.15613 v2 · 2020-12-31 · cs.CL

Open paper page JSON Open Graph Bundle Merged state Verified badge What is a Pith Number?

Add to your LaTeX paper

\usepackage{pith}
\pithnumber{4MO44H43MFGMWYJMTOIQUFPLSR}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp

2 Internet Archive

3 Author claim open · sign in to claim

4 Citations open

5 Replications open

✓ Portable graph bundle live · download bundle · merged state

The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

3 papers in Pith

Phonemes to the Rescue: Multilingual Tokenization Based on International Phonetic Alphabet

The Tokenizer Tax Across 25 European Languages: Domain Invariance, Cross-Lingual Few-Shot Effects, and the Ukrainian Penalty

SAGE Celer 2.6 Technical Card

Receipt and verification

First computed	2026-07-05T02:45:35.522920Z
Builder	pith-number-builder-2026-05-17-v1
Signature	Pith Ed25519 (`pith-v1-2026-05`) · public key
Schema	pith-number/v1.0

Canonical hash

e31dce1f9b614ccb612c9b910a15eb94471dda76c2876ae8011738fd04ba6f9f

Aliases

arxiv: 2012.15613 · arxiv_version: 2012.15613v2 · doi: 10.48550/arxiv.2012.15613 · pith_short_12: 4MO44H43MFGM · pith_short_16: 4MO44H43MFGMWYJM · pith_short_8: 4MO44H43

Agent API

Resolver JSON Graph JSON Events JSON Schema Signing key

Verify this Pith Number yourself

curl -sH 'Accept: application/ld+json' https://pith.science/pith/4MO44H43MFGMWYJMTOIQUFPLSR \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: e31dce1f9b614ccb612c9b910a15eb94471dda76c2876ae8011738fd04ba6f9f

Canonical record JSON

{
  "metadata": {
    "abstract_canon_sha256": "9a78a1fc13dc0e85bfbf4a5184cbf2d10f44165c0f4d08e3232916d282f5a869",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2020-12-31T14:11:00Z",
    "title_canon_sha256": "a5cff99452be857de6ebf49e6032efdc3099699ce25efd7fb1bbe4fcefb4bcaf"
  },
  "schema_version": "1.0",
  "source": {
    "id": "2012.15613",
    "kind": "arxiv",
    "version": 2
  }
}