Pith. sign in

Paper Citation Record · LEDGER

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings

As of 9 August 2026, this Paper Citation Record lists 6 of 6 outbound references and 2 inbound Pith citation observations for arXiv:2508.11847.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.11847 v4

Coverage vector

measured 6 of 6 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-05T19:48:03.076503Z

measured 8 of 8 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T18:53:02.179782Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-11T19:21:09.575791Z

Reference resolution

6 of 6 outbound references displayed

  • verified exact0
  • verified fuzzy2
  • unresolved4
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b9c9c8d7-3f26-497b-9384-03148327efc0 · outbound

This paper cites an unresolved cited work.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-05T19:48:03.571194Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T19:48:02.933798Z digest=sha256:d316a081a9208362e97beea29020f584c489aa4cc4203b49f50ad276b03453c9

Observation f074dffe-dcf1-4b7c-be2d-388e84fa649b · outbound

This paper cites (11)) (one-step Newton scores for the Additive one-step Newton algorithm) for all matches in the arena.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings (11)) (one-step Newton scores for the Additive one-step Newton algorithm) for all matches in the arena

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T19:48:03.504612Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T19:48:02.988120Z digest=sha256:e983a585d8f4b5b3766859c1d3261f3e475e2f4b7a89d4191a2f3bd5a960f557

Observation 590ecfec-5e2f-4ab1-bfd7-adc0030bf549 · outbound

This paper cites (13)) is the largest in the negative direction (assuming that player i has a higher estimated BT score than player j on the full data).

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings (13)) is the largest in the negative direction (assuming that player i has a higher estimated BT score than player j on the full data)

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T19:48:03.415291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T19:48:03.018819Z digest=sha256:19e9d9a803b9dd99640cded075d6c691adcde8fbc5cd358df83fbafaf86b13ee

Observation 6b54d048-c471-4837-9d39-93e69be66cbb · outbound

This paper cites an unresolved cited work.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-05T19:48:03.336994Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T19:48:03.037504Z digest=sha256:e0881802d4987eb6808f8c9991d60f58bc8338de03f7488243fdaaf870295eac

Observation e23f417b-fc50-4744-a97c-ee9226d6c871 · outbound

This paper cites an unresolved cited work.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-05T19:48:03.240485Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T19:48:03.076503Z digest=sha256:8783329b0bf886049d638f33dced213f616630de98261aa72574a78ed0e67c91

Observation c6f8f12f-a139-4fe2-ad9e-89b6ee0dd628 · outbound

This paper cites an unresolved cited work.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings Unresolved cited work

Reference 1981

Resolution
unresolved
raw_fallback, observed 2026-08-05T19:48:03.669434Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-08-05T19:48:02.849955Z digest=sha256:baf33ad772d92a776e954aee4fbdc0037b35e8c45021c38a727bc6e00a967948

Pith citing papers

Observation 2017ed7c-2a02-44ff-8899-935a5e74778d · inbound

Why Global LLM Leaderboards Are Misleading: Small Portfolios for Heterogeneous Supervised ML cites this paper.

Why Global LLM Leaderboards Are Misleading: Small Portfolios for Heterogeneous Supervised ML Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings

Reference 257

Resolution
verified exact
arxiv_id, observed 2026-07-10T01:18:55.329249Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=arxiv_source observed=2026-05-08T12:05:32.881629Z digest=sha256:0bf236d1d0fc903b6c5d49c4274d51ddef4a34ae635c34034a13034de21ab3df

Observation 041cb886-3f34-466a-965e-64abfb8e579f · inbound

FinReportBench: Measuring and Improving Institution-Grade Financial Report Generation cites this paper.

FinReportBench: Measuring and Improving Institution-Grade Financial Report Generation Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings

Reference 75

Resolution
unresolved
no resolver link, observed 2026-08-08T18:53:02.179782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T18:53:02.179782Z digest=sha256:7f4d8b8011e8fa8689bea552961776b418902592e903fdcc7414c1c02f57c958