Paper Citation Record · LEDGER

Asking Again and Again: Exploring LLM Robustness to Repeated Questions

As of 18 August 2026, this Paper Citation Record lists 34 of 34 outbound references and 2 inbound Pith citation observations for arXiv:2412.07923.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.07923 v3

Coverage vector

measured 34 of 34 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T18:28:56.225848Z

measured 36 of 36 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-01T23:00:47.775717Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-02T03:16:33.629449Z

Reference resolution

34 of 34 outbound references displayed

verified exact2
verified fuzzy1
unresolved31
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 63ea7562-eef2-4998-ac61-fd750502e25a · outbound

This paper cites online" 'onlinestring :=.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions online" 'onlinestring :=

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:55.969257Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ed7834c6-239d-4557-b057-722d8627316f · outbound

This paper cites write newline.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions write newline

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:55.974089Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3e9c221a-96ed-4686-a00a-4191de2e59d5 · outbound

This paper cites Phi-4 Technical Report.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Phi-4 Technical Report

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:55.978369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c5c7ecf6-b9d9-4f5f-81d9-3468592e298f · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:55.982781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6182675c-9da3-4c50-95ad-ef9a8cca4933 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-08-11T18:28:56.655414Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 0a362fb9-6ffc-45c0-8b9e-6bc9e9a7e03f · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:55.991014Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5fe0c0ff-c010-4792-b87c-c725c9c8b946 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:55.995505Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0c74517e-34f7-4e73-ab85-b388273cba4f · outbound

This paper cites TASA: Deceiving Question Answering Models by Twin Answer Sentences Attack.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions TASA: Deceiving Question Answering Models by Twin Answer Sentences Attack

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:55.999572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 033f57c8-428c-4ef1-9b50-821c3a82bff3 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 9

Resolution: unresolved; raw_fallback, observed 2026-08-11T18:28:56.633156Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation f5ddd53f-d5f7-4e0e-935b-3c5eacbc8d4f · outbound

This paper cites PaLM: Scaling Language Modeling with Pathways.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions PaLM: Scaling Language Modeling with Pathways

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.007918Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25af1cd3-2241-4ddf-83f9-57a9d2e5afca · outbound

This paper cites DeepSeek-V3 Technical Report.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions DeepSeek-V3 Technical Report

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.012263Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f70563c4-bd62-46a8-9ec9-c334b62a714b · outbound

This paper cites The Llama 3 Herd of Models.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions The Llama 3 Herd of Models

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.020759Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7ec56d2-c1ba-4242-abfd-cc20680a5bc7 · outbound

This paper cites Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noise.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Why So Gullible? Enhancing the Robustness of Retrieval-Augmented Models against Counterfactual Noise

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.025063Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25df8f22-148b-4bd9-a1c9-c708eaf061b9 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.028727Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a915285-5e10-4a34-9f7a-a7a71172bfd2 · outbound

This paper cites Mistral 7B.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Mistral 7B

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.032292Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b733c93b-52bb-4490-8e67-aacc9ee93320 · outbound

This paper cites Large Language Models Struggle to Learn Long-Tail Knowledge.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Large Language Models Struggle to Learn Long-Tail Knowledge

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.036504Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7d2a0d11-4a3d-400f-bd15-c0d906191011 · outbound

This paper cites Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Dai, Jakob Uszkoreit, Quoc Le, and Slav Petrov

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.040576Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d83add31-e6a4-4b20-947e-cc19c386c01f · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 18

Resolution: verified exact; doi, observed 2026-08-11T18:28:56.317517Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation ffa2bc12-1680-41b8-be8c-e2184205fd1d · outbound

This paper cites Gonzalez, Ion Stoica, Xuezhe Ma, , and Hao Zhang.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Gonzalez, Ion Stoica, Xuezhe Ma, , and Hao Zhang

Reference 19

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T18:28:56.618087Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation b3418665-b40e-4a49-961e-42d3e43ffcbe · outbound

This paper cites Lost in the Middle: How Language Models Use Long Contexts.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Lost in the Middle: How Language Models Use Long Contexts

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.173864Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e6655d8e-4752-4bc3-a1bc-a9c1a2b7716e · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.178020Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4fa871d0-7836-4cbd-9850-e44898591274 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 22

Resolution: verified exact; doi, observed 2026-08-11T18:28:56.298308Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation c7712cc9-8c47-4800-826a-117419a68064 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.185835Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5457080c-6f25-496d-b329-1d3ed1b0d088 · outbound

This paper cites EchoPrompt: Instructing the Model to Rephrase Queries for Improved In-context Learning.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions EchoPrompt: Instructing the Model to Rephrase Queries for Improved In-context Learning

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.189645Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3a848ff4-6e82-49af-8c34-1e3b3a9cb5f5 · outbound

This paper cites DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions DisentQA: Disentangling Parametric and Contextual Knowledge with Counterfactual Question Answering

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.193767Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f29574a0-f49c-448b-9a64-d2133282b9d1 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.197493Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 478d112b-4eb8-45ad-865e-3602f1b33e53 · outbound

This paper cites GPT-4 Technical Report.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions GPT-4 Technical Report

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.201001Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0dd4cb36-5302-4e6d-a1c9-1b060b5ee9bd · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.204990Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3b71c841-db4a-411e-8f73-6d94b5768bf6 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 29

Resolution: unresolved; raw_fallback, observed 2026-08-11T18:28:56.595028Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 7a6a1f1d-7c12-433f-9788-b48bc2d65be7 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 30

Resolution: unresolved; raw_fallback, observed 2026-08-11T18:28:56.578980Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation fa600930-9011-49dd-bf7e-941da041854e · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.216047Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a6ceb16a-cace-44bb-9dc8-b87c059b0513 · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.219210Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cfa80569-3f67-48a8-8888-b5037ac71fca · outbound

This paper cites an unresolved cited work.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Unresolved cited work

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.222441Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3439dbbf-0934-457f-9510-01ce49def045 · outbound

This paper cites Context-faithful Prompting for Large Language Models.

Asking Again and Again: Exploring LLM Robustness to Repeated Questions Context-faithful Prompting for Large Language Models

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-11T18:28:56.225848Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation f90f72c5-55ce-4892-80bf-8ce426d6c3af · inbound

Large Language Models Are Overconfident in Their Own Responses cites this paper.

Large Language Models Are Overconfident in Their Own Responses Asking Again and Again: Exploring LLM Robustness to Repeated Questions

Reference 24

Resolution: verified exact; arxiv_id, observed 2026-07-02T03:16:33.631138Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

Observation 03573e0a-b48c-496a-a385-2499013af5cc · inbound

Ask Twice, Look Twice: Prompt Echoing Resolves the Question-First Paradox in Vision-Language Models cites this paper.

Ask Twice, Look Twice: Prompt Echoing Resolves the Question-First Paradox in Vision-Language Models Asking Again and Again: Exploring LLM Robustness to Repeated Questions

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-01T23:00:47.775717Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.