Pith. sign in

Paper Citation Record · LEDGER

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes

As of 18 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 0 inbound Pith citation observations for arXiv:2606.30653.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.30653 v1

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-01T07:30:49.286792Z

measured 14 of 14 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

14 of 14 outbound references displayed

  • verified exact1
  • verified fuzzy9
  • unresolved3
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 9bf3ce35-50ca-43f4-86a1-c15134938e65 · outbound

This paper cites An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarios.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarios

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-07-01T07:35:28.926367Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:4b7a0a233138b6231eae20ecef4ca8c318dab0f39a235688a0f732071ea2b85d

Observation 75b71be9-b953-42e5-8326-2ccd642d8782 · outbound

This paper cites an unresolved cited work.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-07-06T15:12:38.904660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:a976426eacc13939befa8a942207f577e96f9ecbb7ff78bc15a475f5ccc8d78b

Observation 332e1141-81e7-4606-af81-04ccf961a40f · outbound

This paper cites Multiplication.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Multiplication

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.895508Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:92c1420ae11f87f80f253920934beb77e98fd90289ed3be43a70028f1dc9e9a9

Observation 53b0df96-4499-4e01-b499-3ae4eac599c1 · outbound

This paper cites {concept}.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes {concept}

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.891572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:8ac313e27fd0d7ef3ac1d5b2f87ba5e9db7ccc7ab0ac9cd87b5804433654a4d3

Observation 8913bf32-0cc8-4941-9262-445214a313f0 · outbound

This paper cites an unresolved cited work.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-07-06T15:12:38.893550Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:8bcc3ac1d8be4cef06795f24c7e04e6b8ad4cc33e86db5f7611cd525029aad2c

Observation e343f86b-51e2-4144-9830-c5404524756f · outbound

This paper cites an unresolved cited work.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-07-06T15:12:38.887906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:05003b29f3f396d92f61587ed218e3fb2de74ce7a10b8649e3351734834cd35d

Observation 5c49140b-4fc5-40ab-923a-cdc2feef7b02 · outbound

This paper cites Multiplication.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Multiplication

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.897223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:abb5d0620350bbdc0ff194829eab2732dd63eddf6df86d9ed525089e35e564a2

Observation abea9cf6-0927-4777-872b-13063c73eb23 · outbound

This paper cites None of the Above.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes None of the Above

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.885883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:3c2f73c3407e044f6d37f6b78217ded1f54faf49d7edb00f8c2bc295f8ecc70d

Observation 018da19a-3f7e-4ed7-b008-701bfff4af87 · outbound

This paper cites case_id":.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes case_id":

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.902804Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:371521e56e6adfff2f80bb0a0aae335e9d5670ac34d6cc87e3b55f44d32abca4

Observation de4af097-d230-4f22-bc5c-597e83d610dc · outbound

This paper cites In the dataset curation process described by Proniakin et.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes In the dataset curation process described by Proniakin et

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.898984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:62b8a4356094a93e6ff09229872de8cb8ca3a3673f7ef63b7f4bb97658fc8262

Observation 8e943b96-d091-47a1-b468-226db22bf594 · outbound

This paper cites For few word tags, they should be through - like ’medication-management’.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes For few word tags, they should be through - like ’medication-management’

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.901038Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:ff59b9d7305349c26a15fec453bb629cee30efd9a89d77e7bdd82e156abc85ba

Observation 5f9871d5-ea58-4f2e-84ec-cc331088da57 · outbound

This paper cites Operationally, this is recorded as a Boolean mistake replicated field in the judgment output.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Operationally, this is recorded as a Boolean mistake replicated field in the judgment output

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.880467Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:9e20db42b2e7511410bdf9139774d390b29fe1376fd3cc15b8b9229bf4ba7257

Observation 51f59c64-4300-4ecf-a34d-808829a268ac · outbound

This paper cites Because each case may be tagged with multiple concepts, we split each case evenly across its tags so that each underlying mistake contributes total weight one across concepts.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Because each case may be tagged with multiple concepts, we split each case evenly across its tags so that each underlying mistake contributes total weight one across concepts

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.883947Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:ff6122c0ac165f7bdf624515697db463bb9113011c20058b1c11f10a371bd6c3

Observation 1ce83203-0bd2-4dcc-94ad-bb7692fff3bb · outbound

This paper cites Yes” (i.e., the model judges its own reasoning as incomplete) is scored as consistent (Z= 1), while “No.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Yes” (i.e., the model judges its own reasoning as incomplete) is scored as consistent (Z= 1), while “No

Reference 15

Resolution
malformed identifier
raw_fallback, observed 2026-07-06T15:12:38.878712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:439ead78b73e4a96881cbaf6723037b2345f59a743fd670de9112ae80b869086

Pith citing papers

No inbound Pith citation observations are available.