Pith. sign in

Paper Citation Record · LEDGER

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings

As of 20 August 2026, this Paper Citation Record lists 6 of 6 outbound references and 2 inbound Pith citation observations for arXiv:2508.11847.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2508.11847 v4

Coverage vector

measured 6 of 6 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-05T19:48:03.076503Z

measured 8 of 8 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-08T18:53:02.179782Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-11T19:21:09.575791Z

Reference resolution

6 of 6 outbound references displayed

  • verified exact0
  • verified fuzzy2
  • unresolved4
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation b9c9c8d7-3f26-497b-9384-03148327efc0 · outbound

This paper cites an unresolved cited work.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-05T19:48:03.571194Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-05T19:48:02.933798Z digest=sha256:6608dfb766609783974d54bbe16ff8771fd158657f51254fae53301ee5850a5c

Observation f074dffe-dcf1-4b7c-be2d-388e84fa649b · outbound

This paper cites (11)) (one-step Newton scores for the Additive one-step Newton algorithm) for all matches in the arena.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings (11)) (one-step Newton scores for the Additive one-step Newton algorithm) for all matches in the arena

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T19:48:03.504612Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-05T19:48:02.988120Z digest=sha256:8fed408ec2502dd13fe495b7b3ef4bc8764f0e685104b930e66143ebb4dc38f9

Observation 590ecfec-5e2f-4ab1-bfd7-adc0030bf549 · outbound

This paper cites (13)) is the largest in the negative direction (assuming that player i has a higher estimated BT score than player j on the full data).

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings (13)) is the largest in the negative direction (assuming that player i has a higher estimated BT score than player j on the full data)

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-05T19:48:03.415291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-05T19:48:03.018819Z digest=sha256:81c77d708d865b9d21855702b9b72cd2863ed4984b6cd92c39dc551e6daa3024

Observation 6b54d048-c471-4837-9d39-93e69be66cbb · outbound

This paper cites an unresolved cited work.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-05T19:48:03.336994Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-05T19:48:03.037504Z digest=sha256:59944a4de3192c27d51425a52f9246758c8319858c27dcded4f713ef0d65e252

Observation e23f417b-fc50-4744-a97c-ee9226d6c871 · outbound

This paper cites an unresolved cited work.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-05T19:48:03.240485Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-05T19:48:03.076503Z digest=sha256:b9eb60ffc7fc894014a11401aec5659098cc1fca10c10442363facbf6d5f05e7

Observation c6f8f12f-a139-4fe2-ad9e-89b6ee0dd628 · outbound

This paper cites an unresolved cited work.

Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings Unresolved cited work

Reference 1981

Resolution
unresolved
raw_fallback, observed 2026-08-05T19:48:03.669434Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=pdf_text observed=2026-08-05T19:48:02.849955Z digest=sha256:d4a3d08be312f4d69f137d146152c9433b27034b760cb38a61e0edf9fb61a5f2

Pith citing papers

Observation 2017ed7c-2a02-44ff-8899-935a5e74778d · inbound

Why Global LLM Leaderboards Are Misleading: Small Portfolios for Heterogeneous Supervised ML cites this paper.

Why Global LLM Leaderboards Are Misleading: Small Portfolios for Heterogeneous Supervised ML Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings

Reference 257

Resolution
verified exact
arxiv_id, observed 2026-07-10T01:18:55.329249Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

source=arxiv_source observed=2026-05-08T12:05:32.881629Z digest=sha256:43019bdea1954393cb83a2b9780fbb057f1dbfc1db64e796dc0e8bcf95d2ad0e

Observation 041cb886-3f34-466a-965e-64abfb8e579f · inbound

FinReportBench: Measuring and Improving Institution-Grade Financial Report Generation cites this paper.

FinReportBench: Measuring and Improving Institution-Grade Financial Report Generation Dropping Just a Handful of Preferences Can Change Top Large Language Model Rankings

Reference 75

Resolution
unresolved
no resolver link, observed 2026-08-08T18:53:02.179782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T18:53:02.179782Z digest=sha256:d84b0b50c443debb9ff32a1c7d9b3a076ae1e41eea97fec4dee085f3cfb80cdf