Paper Citation Record · LEDGER

Dueling RL: Reinforcement Learning with Trajectory Preferences

As of 13 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 15 inbound Pith citation observations for arXiv:2111.04850.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2111.04850 v3

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 15 of 15 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 15 of 15 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-11T10:21:33.356599Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-04T13:09:51.333293Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 102e7f13-4d9e-4e7b-b86e-24dd6689a6e8 · inbound

Online Learning from Strategic Human Feedback in LLM Fine-Tuning cites this paper.

Online Learning from Strategic Human Feedback in LLM Fine-Tuning Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-11T10:21:33.356599Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dd549d22-6eaf-4d51-b6c9-afd1c0b4758b · inbound

Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step cites this paper.

Can We Generate Images with CoT? Let's Verify and Reinforce Image Generation Step by Step Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 56

Resolution: unresolved; no resolver link, observed 2026-08-10T15:32:46.438395Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 24eb2a2f-3a01-4507-98d8-ef79d8fa9179 · inbound

Leveraging Sparsity for Sample-Efficient Preference Learning: A Theoretical Perspective cites this paper.

Leveraging Sparsity for Sample-Efficient Preference Learning: A Theoretical Perspective Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 62

Resolution: unresolved; no resolver link, observed 2026-08-10T00:11:59.266988Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d4263822-9942-4e16-8e67-8b2d01b6219e · inbound

BRiTE: Bootstrapping Reinforced Thinking Process to Enhance Language Model Reasoning cites this paper.

BRiTE: Bootstrapping Reinforced Thinking Process to Enhance Language Model Reasoning Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-09T22:20:13.781528Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d9904036-a23e-4ef2-b25c-ac1113470fd4 · inbound

A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO cites this paper.

A Unified Theoretical Analysis of Private and Robust Offline Alignment: from RLHF to DPO Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-07T15:19:09.343297Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d1835f1e-c6e8-4cb5-9847-3189e666cdff · inbound

Outcome-Based Online Reinforcement Learning: Algorithms and Fundamental Limits cites this paper.

Outcome-Based Online Reinforcement Learning: Algorithms and Fundamental Limits Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-07T14:10:42.530610Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0c62cbf0-9062-4a4a-99ed-a51ca34dc1f6 · inbound

On the optimization dynamics of RLVR: Gradient gap and step size thresholds cites this paper.

On the optimization dynamics of RLVR: Gradient gap and step size thresholds Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 15

Resolution: verified exact; arxiv_id, observed 2026-05-18T08:36:07.354937Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation defe716c-5c46-480f-a793-7748213f5d3a · inbound

OPRIDE: Offline Preference-based Reinforcement Learning via In-Dataset Exploration cites this paper.

OPRIDE: Offline Preference-based Reinforcement Learning via In-Dataset Exploration Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 36

Resolution: metadata mismatch; arxiv_id, observed 2026-05-15T21:40:21.050286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 07ba240b-ae6f-4e58-b5e9-813337454882 · inbound

Online KL-Regularized Reinforcement Learning with Function Approximation under Misspecification cites this paper.

Online KL-Regularized Reinforcement Learning with Function Approximation under Misspecification Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 11

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T12:06:55.881408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 5a19d89e-b388-4be5-b1cd-d27469ec0e8d · inbound

Online KL-Regularized Reinforcement Learning with Function Approximation under Misspecification cites this paper.

Online KL-Regularized Reinforcement Learning with Function Approximation under Misspecification Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 11

Resolution: unresolved; no resolver link, observed 2026-07-14T18:23:21.126826Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 781d6f84-532b-4e3a-83e9-be6b92614edf · inbound

Finding Stationary Points by Comparisons cites this paper.

Finding Stationary Points by Comparisons Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 41

Resolution: metadata mismatch; arxiv_id, observed 2026-07-04T13:09:51.334817Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 244e8fb4-b71c-45f9-8612-a7f08767163e · inbound

Preference-Based Reward Learning under Partial Observability with Inexact Dynamics cites this paper.

Preference-Based Reward Learning under Partial Observability with Inexact Dynamics Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 14

Resolution: verified exact; arxiv_id, observed 2026-06-30T14:44:45.876543Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation ad2d9dad-f5ce-435c-8795-433203f26192 · inbound

SPLC: Social Preference Learning for Crowd Robot Navigation cites this paper.

SPLC: Social Preference Learning for Crowd Robot Navigation Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 31

Resolution: metadata mismatch; arxiv_id, observed 2026-07-03T12:18:06.219993Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

Observation 09abf6a9-e868-4936-8a26-b281ca942b1e · inbound

Multi-Turn On-Policy Distillation with Prefix Replay cites this paper.

Multi-Turn On-Policy Distillation with Prefix Replay Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 264

Resolution: unresolved; no resolver link, observed 2026-07-11T13:53:36.775836Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 83ae8a47-bfda-4f03-ad99-e042ad21549f · inbound

Multi-Turn On-Policy Distillation with Prefix Replay cites this paper.

Multi-Turn On-Policy Distillation with Prefix Replay Dueling RL: Reinforcement Learning with Trajectory Preferences

Reference 265

Resolution: unresolved; no resolver link, observed 2026-08-02T08:41:03.234561Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.