Pith. sign in

Paper Citation Record · LEDGER

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes

As of 18 August 2026, this Paper Citation Record lists 14 of 14 outbound references and 0 inbound Pith citation observations for arXiv:2606.30653.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2606.30653 v1

Coverage vector

measured 14 of 14 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-07-01T07:30:49.286792Z

measured 14 of 14 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

14 of 14 outbound references displayed

  • verified exact1
  • verified fuzzy9
  • unresolved3
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 9bf3ce35-50ca-43f4-86a1-c15134938e65 · outbound

This paper cites An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarios.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes An Empirical Study on Large Language Models in Accuracy and Robustness under Chinese Industrial Scenarios

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-07-01T07:35:28.926367Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:62c6200ace259088fae7157b9d862f33e76f75c51fbd3b6ca0613b32300e4c9e

Observation 75b71be9-b953-42e5-8326-2ccd642d8782 · outbound

This paper cites an unresolved cited work.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-07-06T15:12:38.904660Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:1a5887cd2a85c1f510ae9d2d5ada66add0cc8c99982ea40e10bdab93f2bc2258

Observation 332e1141-81e7-4606-af81-04ccf961a40f · outbound

This paper cites Multiplication.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Multiplication

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.895508Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:b75e7508ebf404bc2fda93ceb6eb3c928c480b5d6ca1a04aaaf55409ae77c04f

Observation 53b0df96-4499-4e01-b499-3ae4eac599c1 · outbound

This paper cites {concept}.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes {concept}

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.891572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:f059a14a46748ce33b9b844171b53781ee54a780deb223618605bb80c37e5c2d

Observation 8913bf32-0cc8-4941-9262-445214a313f0 · outbound

This paper cites an unresolved cited work.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-07-06T15:12:38.893550Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:b10ed173f9aee79fcc1f490c0caf026ff17e4637ebbf6a65b8a45c890cbc3102

Observation e343f86b-51e2-4144-9830-c5404524756f · outbound

This paper cites an unresolved cited work.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-07-06T15:12:38.887906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:c03e1c89a775d09ff5eb454673edc29c4a09dd82f4892cf2129c401620dc9507

Observation 5c49140b-4fc5-40ab-923a-cdc2feef7b02 · outbound

This paper cites Multiplication.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Multiplication

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.897223Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:92a7a9a9b81a22806f7dd3cdebcff8abafa1a03dfd1dc4bd2508c5b0aca2dcac

Observation abea9cf6-0927-4777-872b-13063c73eb23 · outbound

This paper cites None of the Above.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes None of the Above

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.885883Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:ac2ced7f38a8ff5dbb8b52313b927614e864220a9b1ba948bee009ee783b1a13

Observation 018da19a-3f7e-4ed7-b008-701bfff4af87 · outbound

This paper cites case_id":.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes case_id":

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.902804Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:d7ff3eaaa8365c3e2cca3059204f02d81a137e45aee19af65f6faee58af2a6e7

Observation de4af097-d230-4f22-bc5c-597e83d610dc · outbound

This paper cites In the dataset curation process described by Proniakin et.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes In the dataset curation process described by Proniakin et

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.898984Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:3ea1b0072774aaabfb64c06e1a67a7b67ed0b0f546d51f81c6b8fa3866d3e22b

Observation 8e943b96-d091-47a1-b468-226db22bf594 · outbound

This paper cites For few word tags, they should be through - like ’medication-management’.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes For few word tags, they should be through - like ’medication-management’

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.901038Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:52d87f8fed37309c719da2a209e606307b9b1ff67d4480a4a944fccd487c857b

Observation 5f9871d5-ea58-4f2e-84ec-cc331088da57 · outbound

This paper cites Operationally, this is recorded as a Boolean mistake replicated field in the judgment output.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Operationally, this is recorded as a Boolean mistake replicated field in the judgment output

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.880467Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:b116dfc55b24c3ace8e6319dc2f90596b93e31c781d726f15581f6af1ef77285

Observation 51f59c64-4300-4ecf-a34d-808829a268ac · outbound

This paper cites Because each case may be tagged with multiple concepts, we split each case evenly across its tags so that each underlying mistake contributes total weight one across concepts.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Because each case may be tagged with multiple concepts, we split each case evenly across its tags so that each underlying mistake contributes total weight one across concepts

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-07-06T15:12:38.883947Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:4d75494849317ec2b06d0d447a2d088e8bf46fd5906c6f0a883e46ed08d6b805

Observation 1ce83203-0bd2-4dcc-94ad-bb7692fff3bb · outbound

This paper cites Yes” (i.e., the model judges its own reasoning as incomplete) is scored as consistent (Z= 1), while “No.

The Consistency Dilemma in LLMs: Generator-Evaluator Agreement and Vulnerability to Mistakes Yes” (i.e., the model judges its own reasoning as incomplete) is scored as consistent (Z= 1), while “No

Reference 15

Resolution
malformed identifier
raw_fallback, observed 2026-07-06T15:12:38.878712Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-07-01T07:30:49.286792Z digest=sha256:d51716c5e2a3f52513274cfbbb16982f18ea00540bb786420d34b1aa795f215c

Pith citing papers

No inbound Pith citation observations are available.