Pith. sign in

Paper Citation Record · LEDGER

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

As of 18 August 2026, this Paper Citation Record lists 7 of 7 outbound references and 8 inbound Pith citation observations for arXiv:2603.25112.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2603.25112 v3

Coverage vector

measured 7 of 7 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T17:31:45.201060Z

measured 15 of 15 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 8 of 8 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-07-15T11:31:26.851193Z

measured 1 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Reference resolution

7 of 7 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved7
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

0
arxiv_reference, observed 2026-08-05T02:28:24.338817Z

Outbound references

Observation f5f0b3c4-8a3d-421f-9698-c3f7f2c99792 · outbound

This paper cites Code and data:https://anonymous.4open.science/r/sdt_calibration.

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory Code and data:https://anonymous.4open.science/r/sdt_calibration

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-02T17:31:44.864532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T17:31:44.864532Z digest=sha256:46c6d9857bddd86ca9284f544f494ff49f3c405314354c9977a844bd17696dd0

Observation bc429cb3-731c-43ca-b5e5-5a8b4c8ec344 · outbound

This paper cites Mistral 7B.

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory Mistral 7B

Reference 1995

Resolution
unresolved
no resolver link, observed 2026-08-02T17:31:45.035436Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T17:31:45.035436Z digest=sha256:f2d3f78c3ec2bc56b7c5522cab1c528bb10c050edce30cc2e7084f7d771546f6

Observation 5ce21588-6a86-4cd0-8e7c-b069a651dfcf · outbound

This paper cites Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs.

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs

Reference 1996

Resolution
unresolved
no resolver link, observed 2026-08-02T17:31:45.122211Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T17:31:45.122211Z digest=sha256:67048a3bbea354d27507813ba747654dbd1dfa2d9cf4796e206994ede6a15f82

Observation 4170011f-2608-4390-bd99-3929201552e0 · outbound

This paper cites Gemma 2: Improving Open Language Models at a Practical Size.

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory Gemma 2: Improving Open Language Models at a Practical Size

Reference 2003

Resolution
unresolved
no resolver link, observed 2026-08-02T17:31:44.929677Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T17:31:44.929677Z digest=sha256:737e2833ead2924696eff43086da806319f8cf406ac8cf447e198ca7552a696c

Observation 1112ecd9-1d1f-4fff-bb3b-243821747779 · outbound

This paper cites LLMs as signal detectors: Sensitivity, bias, and the temperature–criterion analogy.

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory LLMs as signal detectors: Sensitivity, bias, and the temperature–criterion analogy

Reference 2017

Resolution
unresolved
no resolver link, observed 2026-08-02T17:31:44.707736Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T17:31:44.707736Z digest=sha256:2c41e41d437fabaa8c0165648b459f1f9fd3d02e33034a98960e9b8fead58e8f

Observation f7708db8-b837-4190-a246-a3798107e35e · outbound

This paper cites Table 5: Accuracy by NLP quartile atT=1.0.

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory Table 5: Accuracy by NLP quartile atT=1.0

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-02T17:31:45.201060Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T17:31:45.201060Z digest=sha256:690180282b34f0a72ef1ce75ba910fb15df331f8644250b5a8faef2c8a410245

Observation a386e91a-dd2a-4cae-89e7-4323e6bbc3a3 · outbound

This paper cites Rescaling confidence: What scale design reveals about LLM metacognition.arXiv preprint arXiv:2603.09309,.

Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory Rescaling confidence: What scale design reveals about LLM metacognition.arXiv preprint arXiv:2603.09309,

Reference 2026

Resolution
unresolved
no resolver link, observed 2026-08-02T17:31:44.789477Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T17:31:44.789477Z digest=sha256:fe1fd8426ca1507f671cd6e6ee9ec673eb852a127f206d345f431977a5f8fffd

Pith citing papers

Observation 86212976-45f1-43cf-bd06-f6ddbc6dbd75 · inbound

Quantisation Reshapes the Metacognitive Geometry of Language Models cites this paper.

Quantisation Reshapes the Metacognitive Geometry of Language Models Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-07-15T01:20:58.272624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-05-10T17:32:04.455773Z digest=sha256:a8111d9f20be9146bf5511664f3ffd19b706c381add88708da087e90bc6cdeda

Observation 7b6cbf46-2f9c-435a-9bcf-9bdc28ab337c · inbound

K-Way Energy Probes for Metacognition Reduce to Softmax in Discriminative Predictive Coding Networks cites this paper.

K-Way Energy Probes for Metacognition Reduce to Softmax in Discriminative Predictive Coding Networks Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-07-15T01:20:58.272624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-05-10T15:47:31.230054Z digest=sha256:41f285935f9065cc8c8abc98251183183c89598d072ae12fe094e93e4caf910f

Observation 7687e602-be3e-4a44-9dba-c63b881910f9 · inbound

Disambiguating electrical detection of magnetization dynamics in magnetic insulators cites this paper.

Disambiguating electrical detection of magnetization dynamics in magnetic insulators Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

Reference 1

Resolution
unresolved
no resolver link, observed 2026-07-15T11:31:26.851193Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-15T11:31:26.851193Z digest=sha256:04ab7553e462be67df00b83b33861509ad325c00e386774384d9cd18d1ed6819

Observation f4a05fc5-7960-4b10-8ec3-cb40a3c67f8f · inbound

MEDLEY-BENCH: Benchmarking Behavioural Metacognition and Belief Revision Under Social Pressure in Large Language Models cites this paper.

MEDLEY-BENCH: Benchmarking Behavioural Metacognition and Belief Revision Under Social Pressure in Large Language Models Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

Reference 1

Resolution
metadata mismatch
arxiv_id, observed 2026-07-15T01:20:58.272624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-05-10T08:49:05.452010Z digest=sha256:d8871413b7b7ded697e38138eb33e16d553afd3b2f02b81c2002ddf96dcf7dbf

Observation 5a260ebb-3f6c-49ad-956b-d2dceb4ea8e7 · inbound

Before You Interpret the Profile: Validity Scaling for LLM Metacognitive Self-Report cites this paper.

Before You Interpret the Profile: Validity Scaling for LLM Metacognitive Self-Report Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-07-15T01:20:58.272624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-05-10T05:43:16.422410Z digest=sha256:41b8114b0e07e96c3b3d4c572b1af4a8a967bdfa9547e84e50417f17a77a2612

Observation cf931bc0-cb6a-4199-9121-1e74d3aa91d2 · inbound

Verbal Confidence Saturation in 3-9B Open-Weight Instruction-Tuned LLMs: A Pre-Registered Psychometric Validity Screen cites this paper.

Verbal Confidence Saturation in 3-9B Open-Weight Instruction-Tuned LLMs: A Pre-Registered Psychometric Validity Screen Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

Reference 3

Resolution
verified exact
arxiv_id, observed 2026-07-15T01:20:58.272624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-05-08T12:09:07.770260Z digest=sha256:b930012097245c86b9e717424cf949ba625e96f379b943ef70d2cfed6da032ed

Observation d7a8dd25-1125-4982-8dbc-6ea001b6f201 · inbound

Hypothesis generation and updating in large language models cites this paper.

Hypothesis generation and updating in large language models Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

Reference 27

Resolution
verified exact
arxiv_id, observed 2026-07-15T01:20:58.272624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=arxiv_source observed=2026-05-08T14:43:56.125546Z digest=sha256:0c3950f5565d5902cb236b6db22d820aa244f297d85aa8c8f7f588ae2559478a

Observation e89728f2-e83a-4e74-9a35-0f5fa0c43a8f · inbound

Do Coding Agents Understand Least-Privilege Authorization? cites this paper.

Do Coding Agents Understand Least-Privilege Authorization? Do LLMs Know What They Know? Measuring Metacognitive Efficiency with Signal Detection Theory

Reference 71

Resolution
malformed identifier
arxiv_id, observed 2026-07-15T01:20:58.272624Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-05-19T16:34:14.379419Z digest=sha256:22ac3f13380bc1c23bdf7dc223b32350325ce67d2d18a115be0a9a6861502e66