Pith. sign in

Paper Citation Record · LEDGER

The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

As of 10 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 18 inbound Pith citation observations for arXiv:2407.10457.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2407.10457 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 18 of 18 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 18 of 18 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-09T18:50:55.695836Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T17:48:45.447795Z

Reference resolution

0 of 0 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved0
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 77c12347-f8b1-4204-aee5-3b194378bfd0 · inbound

Large Language Monkeys: Scaling Inference Compute with Repeated Sampling cites this paper.

Large Language Monkeys: Scaling Inference Compute with Repeated Sampling The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 54

Resolution
verified exact
arxiv_id, observed 2026-05-12T04:42:23.449917Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-12T04:42:23.297389Z digest=sha256:a9dea61d8ba78774969b9702dd10deaa30c759eb47e81070a8f6fa3066fb0326

Observation 3049f1e9-da5f-4af3-b254-e8f3876c5487 · inbound

A statistically consistent measure of semantic uncertainty using Language Models cites this paper.

A statistically consistent measure of semantic uncertainty using Language Models The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-09T18:50:55.695836Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-09T18:50:55.695836Z digest=sha256:8d81cd26496da664a1a8e83f96bf0239ef5c70588a0d47cf3f9da4d65ea794f8

Observation 3ea5021e-aa06-4c4f-a1cb-bce3c7a11016 · inbound

Relative Bias: A Comparative Framework for Quantifying Bias in LLMs cites this paper.

Relative Bias: A Comparative Framework for Quantifying Bias in LLMs The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-07T15:12:24.340787Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:12:24.340787Z digest=sha256:58f31e923f12070d41c1de49d6745aa121c376ec1c552a08897128dd0d3a85b9

Observation cf93851c-6879-442c-8940-07f820961e16 · inbound

When Harry Meets Superman: The Role of The Interlocutor in Persona-Based Dialogue Generation cites this paper.

When Harry Meets Superman: The Role of The Interlocutor in Persona-Based Dialogue Generation The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T12:35:33.261795Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-07T12:35:33.261795Z digest=sha256:72025a743b270706ef5982153b22a1a728c5b20b132ec280304ff50d16db5aca

Observation 814010f8-3418-43b5-a70c-ea56cc92e6ae · inbound

Cross-Entropy Games for Language Models: From Implicit Knowledge to General Capability Measures cites this paper.

Cross-Entropy Games for Language Models: From Implicit Knowledge to General Capability Measures The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-07T05:54:34.908848Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T05:54:34.908848Z digest=sha256:c5b99b876fcf35e5475b643d761d92c12ac44932f019d3e652f089aaa99ada09

Observation 2083ec24-9664-4998-aa1a-381b6a7f2f86 · inbound

Dual-Stage Value-Guided Inference with Margin-Based Reward Adjustment for Fast and Faithful VLM Captioning cites this paper.

Dual-Stage Value-Guided Inference with Margin-Based Reward Adjustment for Fast and Faithful VLM Captioning The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-06T23:57:21.346054Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T23:57:21.346054Z digest=sha256:6db201fc526083e5af69fadbd2d44a8e40f623420df13dc55c8441f3931cfcc9

Observation 6a2e6521-c894-4df1-a800-a5eac1bfc4ca · inbound

DecoRTL: A Run-time Decoding Framework for RTL Code Generation with LLMs cites this paper.

DecoRTL: A Run-time Decoding Framework for RTL Code Generation with LLMs The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-06T20:40:18.647502Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T20:40:18.647502Z digest=sha256:b2cf8e16a0517210319f99bb0b2e372b460d205670b4e9d561aee0a77f6daac0

Observation 4b4ff39a-1a9f-4ecc-9496-2c30b67cc78b · inbound

INTER: Mitigating Hallucination in Large Vision-Language Models by Interaction Guidance Sampling cites this paper.

INTER: Mitigating Hallucination in Large Vision-Language Models by Interaction Guidance Sampling The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-06T19:38:19.498886Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T19:38:19.498886Z digest=sha256:4406a485bb42ddfea13c5cb303f911fff969f6aca57a7ff89b4709d1c40c80ae

Observation 37f20783-4d39-41ca-8a24-b059a7821d1f · inbound

xpSHACL: Explainable SHACL Validation using Retrieval-Augmented Generation and Large Language Models cites this paper.

xpSHACL: Explainable SHACL Validation using Retrieval-Augmented Generation and Large Language Models The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-06T18:24:52.743707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:24:52.743707Z digest=sha256:d4b458c8eea6987f6031230a7fa412241fee8011792c0b038fdf3ef32fd9f46f

Observation 71985320-c1e8-4ecf-a5dc-8468c119c5d6 · inbound

From Queries to Criteria: Understanding How Astronomers Evaluate LLMs cites this paper.

From Queries to Criteria: Understanding How Astronomers Evaluate LLMs The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-06T15:29:41.138123Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T15:29:41.138123Z digest=sha256:d43b3e57be8c779e80f5660377b65436f8d679cf055c71b3bf0b005e30e6ec6d

Observation a54752ae-d3fb-46d3-b33a-5853707f61c2 · inbound

Position: Intelligent Coding Systems Should Write Programs with Justifications cites this paper.

Position: Intelligent Coding Systems Should Write Programs with Justifications The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-05T23:02:03.070200Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-05T23:02:03.070200Z digest=sha256:ae5b72a85f4ad7607d6373f2c5cba65b6504e1367f5045fa76c20a3b8c30e829

Observation c64a07ba-1aca-4d10-bbe2-35b3646355a2 · inbound

The Non-Determinism of Small LLMs: Evidence of Low Answer Consistency in Repetition Trials of Standard Multiple-Choice Benchmarks cites this paper.

The Non-Determinism of Small LLMs: Evidence of Low Answer Consistency in Repetition Trials of Standard Multiple-Choice Benchmarks The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-05T05:30:12.058244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-05T05:30:12.058244Z digest=sha256:5b49c86f8699d1a282a350833f52897cff4d2da886ee5c8b905af0f18bcbb57b

Observation cc762b08-94c5-4256-ba40-cb43a3bb11b8 · inbound

Verifier-free Test-Time Sampling for Vision-Language-Action Models cites this paper.

Verifier-free Test-Time Sampling for Vision-Language-Action Models The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-04T11:20:12.536154Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-04T11:20:12.536154Z digest=sha256:ea2d5752a2d3506e4165c8530c15c0fb6e91e7763de763b51c53d0467f735398

Observation f5f89fe1-a490-4ca1-b1cc-e5f40e26081a · inbound

LLM-based Generation of Semantically Diverse and Realistic Domain Model Instances cites this paper.

LLM-based Generation of Semantically Diverse and Realistic Domain Model Instances The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 27

Resolution
verified exact
arxiv_id, observed 2026-05-11T10:36:04.165624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-10T15:25:15.447353Z digest=sha256:4fec8222df0048e42f94cc34ec0942f1733427dae3692560c5ea8431048d9998

Observation a0ef5d5a-2568-4f80-8059-4d0eddeba328 · inbound

Cross-Model Consistency of AI-Generated Exercise Prescriptions: A Repeated Generation Study Across Three Large Language Models cites this paper.

Cross-Model Consistency of AI-Generated Exercise Prescriptions: A Repeated Generation Study Across Three Large Language Models The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 42

Resolution
verified exact
arxiv_id, observed 2026-05-11T12:41:01.290765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-10T03:21:17.833685Z digest=sha256:dbde07f451faa40896e01487d3b897aa6499cd2da8535e3381ebe1e79f0b725c

Observation 3e924719-3349-4d20-8122-d8a15fbf44a5 · inbound

Introducing Background Temperature to Characterise Hidden Randomness in Large Language Models cites this paper.

Introducing Background Temperature to Characterise Hidden Randomness in Large Language Models The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 11

Resolution
verified exact
arxiv_id, observed 2026-05-11T19:21:07.498219Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-05-08T12:14:47.518940Z digest=sha256:139bea6260af3ed77b489c832bec1b3cd0f88468259fe738643bed5ea06dca1c

Observation 7f4d4cb6-4d5e-4617-83e6-0704a679fda3 · inbound

Verified Detection and Prevention of Concurrency Anomalies in Multi-Agent Large Language Model Systems cites this paper.

Verified Detection and Prevention of Concurrency Anomalies in Multi-Agent Large Language Model Systems The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 98

Resolution
verified exact
arxiv_id, observed 2026-07-03T17:48:45.449869Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

source=pdf_text observed=2026-06-27T03:53:14.728371Z digest=sha256:0f0034d210294fb2a11f47f7143d90446329617bbac6e8eff90e4cb7511f4dca

Observation 4855884f-df11-46f7-928d-54c99b0614d4 · inbound

The One-Word Census: Answer-Choice Conformity Across 44 Language Models cites this paper.

The One-Word Census: Answer-Choice Conformity Across 44 Language Models The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinism

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-02T06:23:48.374729Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T06:23:48.374729Z digest=sha256:7b40e110d01ce54f00724859f8860cb20f8f31413705c2e7d94c21cc850a3038