Pith. sign in

Paper Citation Record · LEDGER

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

As of 14 August 2026, this Paper Citation Record lists 10 of 10 outbound references and 3 inbound Pith citation observations for arXiv:2606.26185.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.26185 v1

Coverage vector

measured 10 of 10 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-06-26T01:53:46.908577Z

measured 13 of 13 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-14T06:32:32.682623+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-06T00:08:34.857363Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-06T00:08:59.601333Z

Reference resolution

10 of 10 outbound references displayed

  • verified exact6
  • verified fuzzy0
  • unresolved4
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 68dd176a-ee0a-4225-8829-24ca2bb259a4 · outbound

This paper cites Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena

Reference 1

Resolution
verified exact
local_arxiv, observed 2026-07-04T15:09:54.397648Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:a881f24a79a19c5ab84276477bc6e7c9aa33afa9549311f17fbba97ea09089e2

Observation d9252ef9-ee39-4429-9e4f-00b56cfd1ce0 · outbound

This paper cites Large Language Models are not Fair Evaluators.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Large Language Models are not Fair Evaluators

Reference 2

Resolution
verified exact
local_arxiv, observed 2026-07-04T15:09:54.394732Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:aba59bdd2b5419c9ec1a8555ebd796e3beb994c2710b1d0d529c23d423b72a9e

Observation f43997db-3bdb-474f-90a4-8c06e8722afd · outbound

This paper cites He et al.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations He et al

Reference 3

Resolution
unresolved
no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:769a507df94d50d8cb4407151822c73e1ac5dc16e140aaa13954587033eadcd1

Observation 94ef8115-7063-4838-8e90-13f09e43a0a6 · outbound

This paper cites Large Language Models are Inconsistent and Biased Evaluators.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Large Language Models are Inconsistent and Biased Evaluators

Reference 4

Resolution
verified exact
arxiv_id, observed 2026-07-04T15:09:54.390910Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:3c72c2fbc4eec03ec4a90e2804305103bf4dfa90e936c8cf68e5fa9aade1ffcd

Observation d5567166-653f-46d3-8b4f-6305a48227ae · outbound

This paper cites Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences

Reference 5

Resolution
verified exact
arxiv_id, observed 2026-07-04T15:09:54.401489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:7c6db31efd28b737900003892126796a820af1d4b6f31460d5f4e1f95d423aa9

Observation 189e457b-f67b-4553-8c8a-6da98d13c595 · outbound

This paper cites aisev issue \#25: Reproducibility Improvement Proposal.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations aisev issue \#25: Reproducibility Improvement Proposal

Reference 6

Resolution
unresolved
no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:b54aa475751e353478adce72ab2622190ec7c06d42233c8f8b5e3e72186622a1

Observation 93eabea6-89e7-4ffb-9cd1-237861675781 · outbound

This paper cites Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chain.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Your Agent Is Mine: Measuring Malicious Intermediary Attacks on the LLM Supply Chain

Reference 7

Resolution
verified exact
local_arxiv, observed 2026-07-04T15:09:54.405024Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:728923bc0244518f5a5158335375983bd52e192a82dc6c5f69bb6c14e0f94f38

Observation fd8186c6-12ef-408f-b379-cd8d87433438 · outbound

This paper cites an unresolved cited work.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:9177502d58959d26f1278f21d7d4c6ebb180f2a6ec350e4b931751f7157008e9

Observation 9195e983-de97-45ee-9943-5e3c8c0a9acb · outbound

This paper cites Route Claude CLI traffic through AI Gateway and D ash S cope.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Route Claude CLI traffic through AI Gateway and D ash S cope

Reference 9

Resolution
unresolved
no resolver link, observed 2026-06-26T01:53:46.908577Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:fa473e886b1dfb488c3fae6d2732972ceda7b2486c27ad74849eef7dabfddd1f

Observation a08f84e1-1907-4abf-82fa-c9c1ed56193b · outbound

This paper cites an unresolved cited work.

Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations Unresolved cited work

Reference 10

Resolution
verified exact
doi, observed 2026-06-26T01:58:54.253270Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-06-26T01:53:46.908577Z digest=sha256:518b7b18bfc3fa665b7769b9999516f663d28d9d9a956558f6d97f4b8626c286

Pith citing papers

Observation 992e5398-d529-4625-a9f2-499d87be3443 · inbound

Compaction as Epistemic Failure: How Agentic LLM Tools Fabricate Confirmed Results from Killed Processes cites this paper.

Compaction as Epistemic Failure: How Agentic LLM Tools Fabricate Confirmed Results from Killed Processes Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-02T07:23:27.844913Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T07:23:27.844913Z digest=sha256:f46cf1e82c383c68df74fb9f3e1514ebc55d87a171bbbeca270150df32696186

Observation e7b10dc4-40f6-412b-871d-e1e56e0109ce · inbound

Position Bias is Hidden Behind Ceiling Effects: A Permutation Diagnostic for LLM Benchmarks cites this paper.

Position Bias is Hidden Behind Ceiling Effects: A Permutation Diagnostic for LLM Benchmarks Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-01T09:13:30.692459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-01T09:13:30.692459Z digest=sha256:ab625525d7d6602814114faf8beb7b63d295e6d6863301953f0929edda5efb85

Observation c8c64de8-d069-48e4-8ef3-2b95063da1e2 · inbound

Measuring Product Quality Using Images: The CLIP Q-Score and an Application to Real Estate cites this paper.

Measuring Product Quality Using Images: The CLIP Q-Score and an Application to Real Estate Necessary but Not Sufficient: Temperature Control and Reproducibility in LLM-as-Judge Safety Evaluations

Reference 77

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T00:08:59.802374Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-14T06:32:32.682623+00:00.

source=arxiv_source observed=2026-08-06T00:08:34.857363Z digest=sha256:bcd63fa8eebb4d2f16f02a07ec0b42e1c3e895ac80c54e00719134a1ad29eb39