Pith. sign in

Paper Citation Record · LEDGER

Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

As of 23 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 23 inbound Pith citation observations for arXiv:2407.18370.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2407.18370 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 23 of 23 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 23 of 23 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-15T19:36:49.474899Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T18:40:02.360168Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 7090a3ea-a633-4d2a-a051-62b87f17c934 · inbound

A Survey on LLM-as-a-Judge cites this paper.

A Survey on LLM-as-a-Judge Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 60

Resolution
verified exact
arxiv_id, observed 2026-05-23T17:35:44.226111Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-23T17:33:13.394338Z digest=sha256:7bcaddec24356c94a87c1d55e173764aa4c605b37cbe2a41065c1be3691cfc1b

Observation 7e323005-48de-47f8-b179-d248f94d6e12 · inbound

A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions cites this paper.

A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 93

Resolution
unresolved
no resolver link, observed 2026-08-11T20:37:54.809269Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T20:37:54.809269Z digest=sha256:3c12ab45071ed2de76864035c90666d7cfd8b5833a9570d201630f0a0fe71c36

Observation 09bf418e-0b48-4325-b65f-7cca8c25d156 · inbound

LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods cites this paper.

LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 107

Resolution
verified exact
arxiv_id, observed 2026-05-11T23:08:36.896485Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-11T23:08:34.312466Z digest=sha256:cb15a87d1daafd5c772f400199462ad339b0af55b93cf1094f75525b744937f5

Observation 717fbb25-ced1-4ed4-b551-15a149fe3a90 · inbound

The Superalignment of Superhuman Intelligence with Large Language Models cites this paper.

The Superalignment of Superhuman Intelligence with Large Language Models Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-11T15:18:17.868903Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-11T15:18:17.868903Z digest=sha256:5ad77898f9c8b50d4194420439d809c1342ea4fb005165977b59b34015cd15ed

Observation 7760dc1e-5d28-40ab-aa8d-f3cd65ee9f3c · inbound

Can You Trust LLM Judgments? Reliability of LLM-as-a-Judge cites this paper.

Can You Trust LLM Judgments? Reliability of LLM-as-a-Judge Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-11T14:04:26.236817Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-11T14:04:26.236817Z digest=sha256:3bd9668b2860614a3805f500f16542eea7ef31e0568dab4d455e70169a35b3f0

Observation ee4205cf-a062-4d57-82a6-e64ace6345f0 · inbound

When One LLM Drools, Multi-LLM Collaboration Rules cites this paper.

When One LLM Drools, Multi-LLM Collaboration Rules Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-08T22:33:09.366665Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T22:33:09.366665Z digest=sha256:988df349516f7281e10399b44e2f2969e70e45bd59a7a9938105a4d43ac6b12d

Observation e58d48c8-f8da-4d62-92ae-dcb9336f3f37 · inbound

Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries cites this paper.

Amulet: Putting Complex Multi-Turn Conversations on the Stand with LLM Juries Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-07T13:59:54.023882Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T13:59:54.023882Z digest=sha256:35d21a53bed47ee71b84ed7a5eec655b5f98e6a1f072c00c374db2283fc14e72

Observation c424073a-bfd4-4170-a9ee-7d06548f9f18 · inbound

Conformal Arbitrage: Risk-Controlled Balancing of Competing Objectives in Language Models cites this paper.

Conformal Arbitrage: Risk-Controlled Balancing of Competing Objectives in Language Models Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-07T12:01:40.254252Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T12:01:40.254252Z digest=sha256:b9d4904dc3917403edbbad405fb8a1c0e1186a01c302eca1c2b6d1439c8a2e0c

Observation ac310bb2-807c-4fa9-96d4-77d0dae9d681 · inbound

Model Context Protocol (MCP) at First Glance: Studying the Security and Maintainability of MCP Servers cites this paper.

Model Context Protocol (MCP) at First Glance: Studying the Security and Maintainability of MCP Servers Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 69

Resolution
verified exact
arxiv_id, observed 2026-05-19T09:32:15.539528Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-19T09:32:08.596259Z digest=sha256:9cc1f9faaf904ffda04350491aad976b97dbf625029be580b92f5dc857267188

Observation 8884d101-cb9b-478e-a31d-6bd08a954b8f · inbound

RAGtifier: Evaluating RAG Generation Approaches of State-of-the-Art RAG Systems for the SIGIR LiveRAG Competition cites this paper.

RAGtifier: Evaluating RAG Generation Approaches of State-of-the-Art RAG Systems for the SIGIR LiveRAG Competition Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-07T00:23:10.389859Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T00:23:10.389859Z digest=sha256:e8e13c39bb6fd1958e3e4374c8f9930453385e3bebbffc5ce76d2638e1b4ce04

Observation 23bfdaf8-b932-4062-b746-684a6ff46bce · inbound

Watch, Listen, Understand, Mislead: Tri-modal Adversarial Attacks on Short Videos for Content Appropriateness Evaluation cites this paper.

Watch, Listen, Understand, Mislead: Tri-modal Adversarial Attacks on Short Videos for Content Appropriateness Evaluation Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T17:09:22.262209Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T17:09:22.262209Z digest=sha256:16825a51373ed78545766343f7c15690548c462e56131b589a34110d3a6333c6

Observation 63707587-9d6a-4cc8-a362-e6103c2c9a5c · inbound

How to Correctly Report LLM-as-a-Judge Evaluations cites this paper.

How to Correctly Report LLM-as-a-Judge Evaluations Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 306

Resolution
unresolved
no resolver link, observed 2026-08-03T20:08:53.242333Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-03T20:08:53.242333Z digest=sha256:c0ee2cf1daf78e2fb2da4104d1d9792278edc2f61db1614e350fd43aebf5b165

Observation 91ae4156-363b-4a1f-89d0-e105c993573f · inbound

Beyond Accuracy: Policy Invariance as a Reliability Test for LLM Safety Judges cites this paper.

Beyond Accuracy: Policy Invariance as a Reliability Test for LLM Safety Judges Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 20

Resolution
verified exact
arxiv_id, observed 2026-05-11T20:01:12.388357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-08T10:23:58.198464Z digest=sha256:0c01e75a23afe7b6101aaeb1702ba848aa0db9d72c67699804529a103c3124f6

Observation 1936330c-9434-486c-868d-4175b2912055 · inbound

Supporting System Testing with a Multi-Agent LLM-based Framework for Knowledge Graph Extraction: A Case Study with Ethernet Switch Systems cites this paper.

Supporting System Testing with a Multi-Agent LLM-based Framework for Knowledge Graph Extraction: A Case Study with Ethernet Switch Systems Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-05-20T08:33:08.865965Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-05-20T08:32:39.748993Z digest=sha256:343a4a9bcbdc6d1479969cb089e812713b8602f9274abb6f71d9f8f9b2c3f660

Observation 6c8d0b8c-a0d7-4752-85bf-e365614a927c · inbound

BalanceRAG: Joint Risk Calibration for Cascaded Retrieval-Augmented Generation cites this paper.

BalanceRAG: Joint Risk Calibration for Cascaded Retrieval-Augmented Generation Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 16

Resolution
verified exact
arxiv_id, observed 2026-05-20T05:23:03.731291Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-05-20T05:19:45.438362Z digest=sha256:7babdc37eb64eda3157ed006f9e448c2a789a074d27db89647bc67ce77090eac

Observation ec3071c8-b2b1-4db4-8ba2-038d4d6c30bf · inbound

Who judges the judges? Governance from metrics: a runtime framework for continuous LLM compliance monitoring cites this paper.

Who judges the judges? Governance from metrics: a runtime framework for continuous LLM compliance monitoring Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 9

Resolution
verified exact
arxiv_id, observed 2026-06-30T12:54:39.771070Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-30T12:53:51.591538Z digest=sha256:d6d006effb9117a28936d5d7614908449fd25c234ea9aa0ab58edfa256cc8477

Observation 9f261826-e90c-47d3-852a-b6830d20c174 · inbound

Cherry-pick Override: Unsafe Directional Commitment in LLM Judges under Mixed Evidence cites this paper.

Cherry-pick Override: Unsafe Directional Commitment in LLM Judges under Mixed Evidence Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 5

Resolution
metadata mismatch
arxiv_id, observed 2026-07-02T20:07:21.380474Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-27T21:02:12.302963Z digest=sha256:e8e2ce21401572641546b57bbd5c5221dbdd496d8493017dd7ac86b0fe43d893

Observation 042d93eb-de1a-4e9a-aa71-ec7c0af784e9 · inbound

Towards Spec Learning: Inference-Time Alignment from Preference Pairs cites this paper.

Towards Spec Learning: Inference-Time Alignment from Preference Pairs Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 49

Resolution
metadata mismatch
arxiv_id, observed 2026-07-04T11:39:47.121009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-26T07:49:36.816100Z digest=sha256:b367986970f11e60fa79938f662b2cd2435589e1c7a73a5534c585bc3824a329

Observation f3bb3349-48cc-42f1-b0bc-a2a57702cd49 · inbound

Towards Spec Learning: Inference-Time Alignment from Preference Pairs cites this paper.

Towards Spec Learning: Inference-Time Alignment from Preference Pairs Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 49

Resolution
metadata mismatch
arxiv_id, observed 2026-06-30T12:44:39.567868Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-06-30T10:17:33.176525Z digest=sha256:55b4c2e9372e17dece462e6d6027c25c68d81a49659870e9642a184e7ec30aa1

Observation 032de267-95a9-4e78-9c15-daea2dce0477 · inbound

To Isolate or to Score? Model-Adaptive Assessment for Cost-Efficient Multi-Agent RAG cites this paper.

To Isolate or to Score? Model-Adaptive Assessment for Cost-Efficient Multi-Agent RAG Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 28

Resolution
verified exact
arxiv_id, observed 2026-07-04T18:40:02.361916Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=arxiv_source observed=2026-06-25T22:44:43.951083Z digest=sha256:eda258e9c0203000b30f3aaf85dd0686c26aedd18c8d188f6490cdf5b73504b3

Observation c7b2138c-b1b1-4ced-8ca5-3cdb490c6f38 · inbound

CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents cites this paper.

CodeRescue: Budget-Calibrated Recovery Routing for Coding Agents Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-01T12:47:37.674516Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T12:47:37.674516Z digest=sha256:3cef05e81d4b9ed52b26aa07a0f2d8d949abc05eb42864bb2211b35453dfca69

Observation 4159f734-2f57-418f-9a2e-69c61e1657ef · inbound

Benchmarking LLM Judges for Mobile Agent Evaluation cites this paper.

Benchmarking LLM Judges for Mobile Agent Evaluation Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-15T14:16:31.934258Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-15T14:16:31.934258Z digest=sha256:5309a75d1733212adc15787184258f8a5ca0588622d6cbd6bda7af8fa2d7dcb5

Observation fb853e1b-0eee-4bb3-a7a4-fb4d45659a85 · inbound

Requirements-Augmented Generation for Trustworthy Acceptance Testing of LLM-Based Software cites this paper.

Requirements-Augmented Generation for Trustworthy Acceptance Testing of LLM-Based Software Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-15T19:36:49.474899Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T19:36:49.474899Z digest=sha256:ac02ec6fc0e16a14d20d671f9bb4276eaf335de870e1a04746365eb57297d55b