Paper Citation Record · LEDGER

Mitigating Preference Hacking in Policy Optimization with Pessimism

As of 10 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 4 inbound Pith citation observations for arXiv:2503.06810.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2503.06810 v1

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 4 of 4 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 4 of 4 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:01:04.976843Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T01:37:30.401380Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 1a636902-5b51-4f76-86a8-8078c4290c71 · inbound

Learning a Pessimistic Reward Model in RLHF cites this paper.

Learning a Pessimistic Reward Model in RLHF Mitigating Preference Hacking in Policy Optimization with Pessimism

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-07T14:01:04.976843Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 69ef8545-8747-4541-8b62-3bd3b33517fc · inbound

Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challenges cites this paper.

Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challenges Mitigating Preference Hacking in Policy Optimization with Pessimism

Reference 100

Resolution: verified exact; arxiv_id, observed 2026-05-10T14:00:28.731714Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 7334a1dc-dd06-473a-ac42-ebe0038fb0d8 · inbound

A Unifying Lens on Reward Uncertainty in RLHF cites this paper.

A Unifying Lens on Reward Uncertainty in RLHF Mitigating Preference Hacking in Policy Optimization with Pessimism

Reference 6

Resolution: verified exact; arxiv_id, observed 2026-07-03T00:27:29.849052Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

Observation 52438c25-12a8-4347-804a-01e02a8ea1fc · inbound

Proxy Reward Internalization and Mechanistic Exploitation: A Learned Precursor to Reward Hacking and Its Generalization cites this paper.

Proxy Reward Internalization and Mechanistic Exploitation: A Learned Precursor to Reward Hacking and Its Generalization Mitigating Preference Hacking in Policy Optimization with Pessimism

Reference 203

Resolution: metadata mismatch; arxiv_id, observed 2026-07-03T01:37:30.402765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.