Pith. sign in
Pith Number

pith:7DI3UHSA

pith:2019:7DI3UHSAISIVF7DAXIBNCI7DOP
not attested not anchored not stored refs pending

Are We Modeling the Task or the Annotator? An Investigation of Annotator Bias in Natural Language Understanding Datasets

Jonathan Berant, Mor Geva, Yoav Goldberg

arxiv:1908.07898 v2 · 2019-08-21 · cs.CL

Add to your LaTeX paper
\usepackage{pith}
\pithnumber{7DI3UHSAISIVF7DAXIBNCI7DOP}

Prints a linked badge after your title and injects PDF metadata. Compiles on arXiv. Learn more · Embed verified badge

Record completeness

1 Bitcoin timestamp
2 Internet Archive
3 Author claim open · sign in to claim
4 Citations open
5 Replications open
Portable graph bundle live · download bundle · merged state
The bundle contains the canonical record plus signed events. A mirror can host it anywhere and recompute the same current state with the deterministic merge algorithm.

Cited by

1 paper in Pith

Receipt and verification
First computed 2026-07-05T00:00:16.216007Z
Builder pith-number-builder-2026-05-17-v1
Signature Pith Ed25519 (pith-v1-2026-05) · public key
Schema pith-number/v1.0

Canonical hash

f8d1ba1e40449152fc60ba02d123e373d56ecd8503cda5e92a97955160d874c1

Aliases

arxiv: 1908.07898 · arxiv_version: 1908.07898v2 · doi: 10.48550/arxiv.1908.07898 · pith_short_12: 7DI3UHSAISIV · pith_short_16: 7DI3UHSAISIVF7DA · pith_short_8: 7DI3UHSA
Agent API
Verify this Pith Number yourself
curl -sH 'Accept: application/ld+json' https://pith.science/pith/7DI3UHSAISIVF7DAXIBNCI7DOP \
  | jq -c '.canonical_record' \
  | python3 -c "import sys,json,hashlib; b=json.dumps(json.loads(sys.stdin.read()), sort_keys=True, separators=(',',':'), ensure_ascii=False).encode(); print(hashlib.sha256(b).hexdigest())"
# expect: f8d1ba1e40449152fc60ba02d123e373d56ecd8503cda5e92a97955160d874c1
Canonical record JSON
{
  "metadata": {
    "abstract_canon_sha256": "b86083d5c0354f9348d956a26deea5105997666890fa7dd55a36766e7dbae94b",
    "cross_cats_sorted": [],
    "license": "http://arxiv.org/licenses/nonexclusive-distrib/1.0/",
    "primary_cat": "cs.CL",
    "submitted_at": "2019-08-21T14:48:01Z",
    "title_canon_sha256": "3b14f0a9509550b53ed728a25ae1ffd325c48482f8351e8d4cfec018f51769c8"
  },
  "schema_version": "1.0",
  "source": {
    "id": "1908.07898",
    "kind": "arxiv",
    "version": 2
  }
}