Paper Citation Record · LEDGER

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework

As of 17 August 2026, this Paper Citation Record lists 100 of 230 outbound references and 2 inbound Pith citation observations for arXiv:2411.11761.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.11761 v2

Coverage vector

measured 100 of 230 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T18:15:15.675983Z

measured 102 of 102 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T04:49:43.466155Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-07T13:53:42.619268Z

Reference resolution

100 of 230 outbound references displayed

verified exact6
verified fuzzy0
unresolved91
parse uncertain0
malformed identifier2
metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2d752c3b-4af4-4f00-b275-65f66a3e1032 · outbound

This paper cites Adadi and M.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Adadi and M

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.258937Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 36d29749-6c96-4768-aa18-49df12a208c0 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.263763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c744cfb5-98ee-4085-b2a7-0300021c3d4f · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.268086Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation db9a6119-f6a3-4d68-805c-3e3e11417fd2 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.275852Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 13bbccc6-de27-46bd-a91c-bbe019bf6ea7 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.279608Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 592dbe1c-b2fd-4899-9bc2-e8401a19f5ec · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.283943Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 740dc0cc-0548-4261-913b-0478e9da3000 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 7

Resolution: malformed identifier; no resolver link, observed 2026-08-12T18:15:15.287643Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b0a8958e-c780-4598-8055-c817b9e408e4 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.291546Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bd4a84aa-fd08-4199-8ee8-92b6c71ab8f7 · outbound

This paper cites DQN-TAMER: Human-in-the-Loop Reinforcement Learning with Intractable Feedback.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework DQN-TAMER: Human-in-the-Loop Reinforcement Learning with Intractable Feedback

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.295424Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 905d39ff-fb8e-4b02-bcde-f5ec00f581b0 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.299331Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation db2cd15f-48d0-49fb-97d8-8bcf48878317 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.302932Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6de264a6-cda9-4a00-b558-30f3dc4f5026 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.306793Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 23962868-4990-4e29-a0a0-a5cd9387bf58 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 13

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.314980Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4ee6cdf7-7508-4c60-a157-e2c7becbdaf3 · outbound

This paper cites Brown, Jack Clark, Sam McCandlish, Chris Olah, and Jared Kaplan.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Brown, Jack Clark, Sam McCandlish, Chris Olah, and Jared Kaplan

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.318816Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 34b61ad4-3b72-45ce-9f37-e448032c107b · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.327265Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d440e91f-6329-49e5-b887-d28c43542209 · outbound

This paper cites Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.331348Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2ba36619-3802-424d-8632-ecac70de1879 · outbound

This paper cites Bowman, Zac Hatfield-Dodds, Ben Mann, Dario Amodei, Nicholas Joseph, Sam McCandlish, Tom Brown, and Jared Kaplan.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Bowman, Zac Hatfield-Dodds, Ben Mann, Dario Amodei, Nicholas Joseph, Sam McCandlish, Tom Brown, and Jared Kaplan

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.335705Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d954d0a2-456f-40a9-b1e2-272a80e3d77c · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.344407Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5b6e0fa8-a1cd-4c28-8b38-54da9874cea9 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.348418Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d126d785-1c3a-4ba3-a0e6-b4c3ae9b182c · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.352225Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1da7c018-86e7-4336-9842-29615477044e · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.355976Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2c7e5665-774f-4c4f-8957-a796713b0364 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.359518Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b0578416-43fc-48ff-88fe-f856c8ea42f3 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.363125Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a948aefc-a329-4426-b398-7355029ecc9f · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 24

Resolution: malformed identifier; no resolver link, observed 2026-08-12T18:15:15.367687Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6f5ea255-f732-408a-8c8c-ecbccda994d2 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.371612Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9a579aed-2e01-44ce-8dd0-61d706c1cd06 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.375186Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 826a0476-31ee-495d-ae49-e9e4b5c7579d · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.379059Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 50d6eddd-fc39-4a80-9213-bfd7c86056f1 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.383373Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2afc0f67-8c83-4a4e-b931-cd2bf5874f62 · outbound

This paper cites Bradley Knox and Peter Stone.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Bradley Knox and Peter Stone

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.386633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 236b5316-fb2e-449d-a914-67a1bd83195e · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.390454Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38053e51-ec49-4493-94ba-34a653078492 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.393863Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f16851a9-c73e-459c-afd7-1a2ec0fcc02e · outbound

This paper cites Extrapolating Beyond Suboptimal Demonstrations via Inverse Reinforcement Learning from Observations.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Extrapolating Beyond Suboptimal Demonstrations via Inverse Reinforcement Learning from Observations

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.397911Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8fab0c89-e996-4125-84e5-0f89efd1e21f · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.402559Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c505e5b3-85d8-46a6-84d1-fae0a2a3490e · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 34

Resolution: verified exact; doi, observed 2026-08-12T18:15:16.322649Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation b1b461c7-ccef-47fc-bdad-d4cc0172a7ed · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.411079Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eae2e6d3-c826-4ff8-817a-b9fb153dc9c2 · outbound

This paper cites Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.416006Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e0ceac96-28be-4c9e-aa20-228beabe503b · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.420911Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fc4425e0-ea4f-42e5-886a-a1a963056c6f · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.424902Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 36d8aedb-c8ea-4ede-af28-61b8102dd00d · outbound

This paper cites BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learning.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learning

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.428719Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3d141350-6a57-4050-a175-d00bc0df049b · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.433497Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 403a22a5-17f6-408b-84e8-a315bd384959 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.436841Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 22faeb14-3a0f-481a-b690-ff5ca53cfe7b · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.441619Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b42517da-a5a0-497a-b10e-35326d6dcb3c · outbound

This paper cites Using Machine Teaching to Investigate Human Assumptions when Teaching Reinforcement Learners.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Using Machine Teaching to Investigate Human Assumptions when Teaching Reinforcement Learners

Reference 43

Resolution: verified exact; local_arxiv, observed 2026-08-12T18:15:17.503411Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation c456124d-b35c-426d-b99d-18971ec5dd30 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 44

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.449995Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c887c3fd-fdad-4d88-89a9-185e1cbb5972 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.453645Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b53fb3c5-d9df-4863-bdca-79e6bbd58194 · outbound

This paper cites Broad-persistent Advice for Interactive Reinforcement Learning Scenarios.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Broad-persistent Advice for Interactive Reinforcement Learning Scenarios

Reference 46

Resolution: verified exact; local_arxiv, observed 2026-08-12T18:15:17.486576Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation cb0eaad1-5adf-47c4-8876-9fc4e8912278 · outbound

This paper cites Parisi, and Stefan Wermter.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Parisi, and Stefan Wermter

Reference 47

Resolution: metadata mismatch; raw_fallback, observed 2026-08-12T18:15:17.469255Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 1d1779e8-eb2d-4665-bd6f-8df5c2d5211f · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.465277Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f17038cd-ed4c-4876-9a2b-b22c339cad24 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 49

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.469194Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 72ac4b67-0907-4a47-a959-ed8a1279871c · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.473608Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 31423784-e544-4742-9dfe-40caa8ebe970 · outbound

This paper cites Deshpande, Jeff Schneider, Deepak Pathak, David Held, and Benjamin Eysenbach.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Deshpande, Jeff Schneider, Deepak Pathak, David Held, and Benjamin Eysenbach

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.478148Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e2217a00-6830-49ef-814b-375063034c84 · outbound

This paper cites Benchmarking Deep Reinforcement Learning for Continuous Control.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Benchmarking Deep Reinforcement Learning for Continuous Control

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.481768Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9d9ec737-a588-4e2e-ac96-60b613aae526 · outbound

This paper cites Dudley and Per Ola Kristensson.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Dudley and Per Ola Kristensson

Reference 53

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.486352Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6d5600ad-4b30-412f-a14f-581376d3b9fc · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 54

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.490173Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 85207a17-bd72-48cc-b808-c428b44ff3e5 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 55

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.494567Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation abcd76fe-1937-40db-a8b3-61d5df8d7be8 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.498105Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation df9c4a6b-c8da-4d27-8d25-5fb8a43da6a2 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 57

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.501801Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a87e0388-aac1-4f74-b659-7003fdfbe71a · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 58

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.505497Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d7e3483d-58e5-4aaa-84c3-91182185e39d · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 59

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.509926Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 18b47739-c21b-483a-ae57-d74a7efa4201 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 60

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.514327Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f7504670-a013-4801-bd64-273da66cc7bc · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.518319Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 399551cb-0ddf-42a6-8e8f-9c8e372ddfbb · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.522257Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 90955e1d-f4a5-48ea-8ae2-565d661e9c7d · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 63

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.527057Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 98fa9339-e45f-4463-8968-61c5f1eca636 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 64

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.530756Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 38280829-3121-4a14-a401-71c4d8deb72f · outbound

This paper cites Choice Set Misspecification in Reward Inference.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Choice Set Misspecification in Reward Inference

Reference 65

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.535401Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a70f7910-1e70-47dd-8257-e3949cae8dc5 · outbound

This paper cites Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned

Reference 66

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.539134Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cc0915c8-e1e2-4b7e-9f29-311906a8b431 · outbound

This paper cites APRIL: Interactively Learning to Summarise by Combining Active Preference Learning and Reinforcement Learning.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework APRIL: Interactively Learning to Summarise by Combining Active Preference Learning and Reinforcement Learning

Reference 67

Resolution: verified exact; local_arxiv, observed 2026-08-12T18:15:17.312037Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 959001cf-1533-4d5b-81cb-164c9a358211 · outbound

This paper cites The Effect of Modeling Human Rationality Level on Learning Rewards from Multiple Feedback Types.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework The Effect of Modeling Human Rationality Level on Learning Rewards from Multiple Feedback Types

Reference 68

Resolution: verified exact; local_arxiv, observed 2026-08-12T18:15:17.294535Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 677e93f4-aab2-4329-8f45-c761e71cee31 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 69

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.551329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 086b3363-fa59-4a44-abf8-e6665cba8458 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 70

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.554896Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1b2779a1-80aa-44b3-b3bc-48e8fc79b287 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 71

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.558855Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8c87efd5-9bc6-4862-932e-96c7caca7973 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 72

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.562881Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 781e3788-4e30-41c1-8c23-7a1904671e42 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 73

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.566355Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 52f8ca4b-b864-46a9-b15e-274c6c1c986c · outbound

This paper cites Guiding Reinforcement Learning Exploration Using Natural Language.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Guiding Reinforcement Learning Exploration Using Natural Language

Reference 74

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.569994Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9f3ca8fb-a359-4e0b-9dd7-bdfc903f89d7 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 75

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.574353Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7f4a70ad-7565-4ce6-b5dc-148ef4ca7484 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 76

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.577947Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ecd917d6-12ad-4e78-81fe-f54b023edd09 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 77

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.581791Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 90414646-2e10-4404-9d7b-fefd054b81ce · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 78

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.586469Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 10cda54b-8be0-47d6-b408-5fe6c27217d4 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 79

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.589936Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 460235c7-d02d-4c01-b567-90d8451b4c7d · outbound

This paper cites Reward-rational (implicit) choice: A unifying formalism for reward learning.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Reward-rational (implicit) choice: A unifying formalism for reward learning

Reference 80

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.593768Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7036c7d0-9413-47a1-95c5-49fd2b504709 · outbound

This paper cites Reinforcement Learning from Human Feedback with Active Queries.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Reinforcement Learning from Human Feedback with Active Queries

Reference 81

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.598159Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bbbd3ca6-8544-4c93-b4ed-cad2e0daad4c · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 82

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.602141Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c77ae9f2-60dc-44f9-95fb-6ab9316319b7 · outbound

This paper cites Unity: A General Platform for Intelligent Agents.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unity: A General Platform for Intelligent Agents

Reference 83

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.606433Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9152dc1f-8198-42a5-9725-5b3d25deedf7 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 84

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.610358Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a5e3a24-1f6b-4ee2-b526-ce70f5d5aaf8 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 85

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.614077Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b6a5b2ad-a0f3-4074-93b2-4f77659522f6 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 86

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.617960Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7d0c4ba9-5f89-41fc-baa0-0917ca0df6a3 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 87

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.621309Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 28a8f9d2-ef66-4feb-b706-0b4a43bd62b4 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 88

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.624743Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97b6bf3a-2340-4d28-8df5-5af889e7d89d · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 89

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.629155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 56ca0346-2d9e-44f8-8d5b-9cb8d1ca6412 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 90

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.633116Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6c0d7e9b-c666-43c8-871a-20cae22bde0b · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 91

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.636948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ff8c5cf9-8561-4054-95f8-db97ca544c7e · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 92

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.640997Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 25ddf0f6-d3a3-489a-8adb-d24ef185bf13 · outbound

This paper cites Newtonian Action Advice: Integrating Human Verbal Instruction with Reinforcement Learning.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Newtonian Action Advice: Integrating Human Verbal Instruction with Reinforcement Learning

Reference 93

Resolution: verified exact; local_arxiv, observed 2026-08-12T18:15:17.170546Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

Observation 1edb2320-9c7f-4296-bd4a-f986f6cb4c0d · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 94

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.648600Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a7d13dff-6008-4b40-855c-20eeff157093 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 95

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.652311Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 916bad6c-62a5-49af-b8f6-f6b48381e6ad · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 96

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.655707Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6e8e549f-d12f-4466-81fd-0e72a7c171b3 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 97

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.659541Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c0434bbf-afd9-46d1-bab9-797afd16f6fe · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 99

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.668131Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b4e6b976-6b24-49e4-9c2e-bc8d9b8dfa3c · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 100

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.671740Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 63f0c3ea-8a03-49e1-a3b7-d3c65a034cf5 · outbound

This paper cites an unresolved cited work.

Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework Unresolved cited work

Reference 101

Resolution: unresolved; no resolver link, observed 2026-08-12T18:15:15.675983Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 937736bc-582b-4837-9cce-bfb969b4967d · inbound

Optimal Interactive Learning on the Job via Facility Location Planning cites this paper.

Optimal Interactive Learning on the Job via Facility Location Planning Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-16T04:49:43.466155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation db71e279-304a-40eb-babd-6ef30e623a54 · inbound

LLM-Guided Reinforcement Learning: Addressing Training Bottlenecks through Policy Modulation cites this paper.

LLM-Guided Reinforcement Learning: Addressing Training Bottlenecks through Policy Modulation Mapping out the Space of Human Feedback for Reinforcement Learning: A Conceptual Framework

Reference 18

Resolution: verified exact; local_arxiv, observed 2026-08-07T13:53:42.823242Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.