Paper Citation Record · LEDGER

IHEval: Evaluating Language Models on Following the Instruction Hierarchy

As of 10 August 2026, this Paper Citation Record lists 44 of 44 outbound references and 3 inbound Pith citation observations for arXiv:2502.08745.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2502.08745 v2

Coverage vector

measured 44 of 44 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T23:56:00.156616Z

measured 47 of 47 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-04T07:07:57.016122Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-02T17:47:18.101919Z

Reference resolution

44 of 44 outbound references displayed

verified exact0
verified fuzzy3
unresolved41
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 607cbf2d-d283-4d0e-a3e6-4e97ec681564 · outbound

This paper cites online" 'onlinestring :=.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy online" 'onlinestring :=

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-07T23:55:59.997520Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 56c3eb93-3b56-4294-a4c2-854b8ecc1356 · outbound

This paper cites write newline.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy write newline

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.002405Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9eef19b0-64f0-4eff-87d1-963be203dfae · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 3

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:01.095194Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 08eccffe-397e-40b4-a08a-31ff7145b7c3 · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:01.086284Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 80656678-415d-46e8-8308-b74ab49032ce · outbound

This paper cites DeepSeek LLM: Scaling Open-Source Language Models with Longtermism.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy DeepSeek LLM: Scaling Open-Source Language Models with Longtermism

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.014597Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ca6c628-d5be-4f66-8e47-a4b93210e660 · outbound

This paper cites AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy AgentDojo: A Dynamic Environment to Evaluate Prompt Injection Attacks and Defenses for LLM Agents

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.018968Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 76672de4-579f-4167-ad65-d7d0cb359ba3 · outbound

This paper cites The Llama 3 Herd of Models.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy The Llama 3 Herd of Models

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.023136Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 64976b4d-85d0-483d-9298-470927f2d43f · outbound

This paper cites Hashimoto.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Hashimoto

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T23:56:01.076616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 490a3992-3f23-4465-bbe6-54926605343d · outbound

This paper cites Saiful Islam, Kazi Samin Mubasshir, Yuan - Fang Li, Yong - Bin Kang, M.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Saiful Islam, Kazi Samin Mubasshir, Yuan - Fang Li, Yong - Bin Kang, M

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.031090Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8cdec556-b58c-4407-9412-8fbe6cbcbd4b · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:01.066755Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 9e7a39f2-cb02-47fd-aacd-64067ee6879c · outbound

This paper cites Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.039365Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b88fc9a4-424f-48eb-833c-b2a1a5d412fe · outbound

This paper cites FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.043351Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d2bd8d34-1b35-44a2-a6d9-a5c46a585494 · outbound

This paper cites Aligning to Thousands of Preferences via System Message Generalization.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Aligning to Thousands of Preferences via System Message Generalization

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.047280Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 95472603-c927-4321-8b78-58bc8249c025 · outbound

This paper cites Instruction-following Evaluation through Verbalizer Manipulation.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Instruction-following Evaluation through Verbalizer Manipulation

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.051037Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e10b8ee5-3365-4123-9004-b1e143342a4b · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:01.056853Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 9b47a04f-f8ae-431c-a2b6-5ebdfb772f54 · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:01.047054Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 4ddcd7f4-7fb2-4b9b-9477-953300d378b6 · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:01.036949Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 9199d62b-bd08-450e-9649-c60e5dbf1ba0 · outbound

This paper cites Can LLMs Follow Simple Rules?.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Can LLMs Follow Simple Rules?

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.064100Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 60e54fba-9f1d-4973-8fb7-3813ea6733a1 · outbound

This paper cites Orca: Progressive Learning from Complex Explanation Traces of GPT-4.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.067919Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 67f704d8-a1a4-4778-9fd1-76b19b48fbb7 · outbound

This paper cites GPT-4 Technical Report.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy GPT-4 Technical Report

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.071767Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5bee398b-bcdf-476a-ad48-61d287ae533c · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:01.026494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 198635a8-8263-4df9-91dd-396a313d3fc4 · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 22

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:01.016302Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 809ec56b-caf4-4bfb-83f3-12ca127c165b · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 23

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:01.006196Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 9fc61f3f-64a6-4631-80ce-4c3386955617 · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.085575Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4e913d6f-c7e5-46c3-ba35-28801db497c4 · outbound

This paper cites InFoBench: Evaluating Instruction Following Ability in Large Language Models.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy InFoBench: Evaluating Instruction Following Ability in Large Language Models

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.088954Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 43f86c04-0bde-4f90-b7a7-dc62db641740 · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 26

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:00.995592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 4c35e258-75f1-4e3c-9b9e-b360a0faf1e1 · outbound

This paper cites Gemma 2: Improving Open Language Models at a Practical Size.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Gemma 2: Improving Open Language Models at a Practical Size

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.095920Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c306ebd2-0f14-4552-be31-459074843cf4 · outbound

This paper cites Boyd - Graber.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Boyd - Graber

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.099460Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6455bc87-5cda-41da-b1c2-13b1201873fc · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 29

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:00.984812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation c43f9680-4104-427f-a1d0-0d7fdfb64ed1 · outbound

This paper cites Knowledge Editing on Black-box Large Language Models.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Knowledge Editing on Black-box Large Language Models

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.106274Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aed2a34f-a88b-4995-9264-f09b39d26db7 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.110055Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8e8aec86-883f-43da-95ae-6658efb62333 · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 32

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:00.974019Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 68667c66-eec4-4bdb-9a56-7a047d62d566 · outbound

This paper cites The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.117207Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fe7cbe5e-8042-4734-be24-68c29d12f9d1 · outbound

This paper cites Benchmarking Complex Instruction-Following with Multiple Constraints Composition.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Benchmarking Complex Instruction-Following with Multiple Constraints Composition

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.120962Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 39f183fd-c978-4a46-b97d-8af8cbfb2720 · outbound

This paper cites Qwen2 Technical Report.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Qwen2 Technical Report

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.124830Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1bec698a-1e6d-4541-b8ff-39f77ebb7b5b · outbound

This paper cites Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.128652Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e2087c3d-3769-4d40-8ea4-33e98979a869 · outbound

This paper cites Jailbreak Attacks and Defenses Against Large Language Models: A Survey.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Jailbreak Attacks and Defenses Against Large Language Models: A Survey

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.132302Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c65e577d-5260-40ae-b365-568b376f8123 · outbound

This paper cites an unresolved cited work.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Unresolved cited work

Reference 38

Resolution: unresolved; raw_fallback, observed 2026-08-07T23:56:00.963690Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation e6298a43-d4f6-438f-91f3-974cb3de702d · outbound

This paper cites Weinberger, and Yoav Artzi.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Weinberger, and Yoav Artzi

Reference 39

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T23:56:00.953556Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 160fedb1-064a-4e63-9a81-173b5c8dd918 · outbound

This paper cites Xing, Hao Zhang, Joseph E.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Xing, Hao Zhang, Joseph E

Reference 40

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T23:56:00.942830Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 50adf622-6645-4b93-8117-57d1fab4b59a · outbound

This paper cites When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy When "A Helpful Assistant" Is Not Really Helpful: Personas in System Prompts Do Not Improve Performances of Large Language Models

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.145464Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 249a4b41-9064-45d0-b14a-82e343dcfd36 · outbound

This paper cites Instruction-Following Evaluation for Large Language Models.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Instruction-Following Evaluation for Large Language Models

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.148868Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 797463d9-e191-4211-92b4-57155cc17e58 · outbound

This paper cites Is the System Message Really Important to Jailbreaks in Large Language Models?.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Is the System Message Really Important to Jailbreaks in Large Language Models?

Reference 43

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.152804Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b934316d-ab8c-426a-8d27-774b3c045fa5 · outbound

This paper cites Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?.

IHEval: Evaluating Language Models on Following the Instruction Hierarchy Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-07T23:56:00.156616Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 366ae52d-5b77-40c4-97ca-df69420500fb · inbound

Reasoning Up the Instruction Ladder for Controllable Language Models cites this paper.

Reasoning Up the Instruction Ladder for Controllable Language Models IHEval: Evaluating Language Models on Following the Instruction Hierarchy

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-04T07:07:57.016122Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 63959650-254d-48b9-b32b-1ad1f32fc269 · inbound

Many-Tier Instruction Hierarchy in LLM Agents cites this paper.

Many-Tier Instruction Hierarchy in LLM Agents IHEval: Evaluating Language Models on Following the Instruction Hierarchy

Reference 36

Resolution: verified exact; arxiv_id, observed 2026-05-11T07:16:02.011912Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation d5d282ec-c7c4-4317-bc06-a1ecd82cd866 · inbound

Where Instruction Hierarchy Breaks: Diagnosing and Repairing Failures in Reasoning Language Models cites this paper.

Where Instruction Hierarchy Breaks: Diagnosing and Repairing Failures in Reasoning Language Models IHEval: Evaluating Language Models on Following the Instruction Hierarchy

Reference 20

Resolution: verified exact; arxiv_id, observed 2026-07-02T17:47:18.103424Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.