Paper Citation Record · LEDGER

Token-level Direct Preference Optimization

As of 20 August 2026, this Paper Citation Record lists 0 of 0 outbound references and 39 inbound Pith citation observations for arXiv:2404.11999.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2404.11999 v5

Coverage vector

measured 0 of 0 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links

measured 39 of 39 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-20T06:33:59.587034+00:00

measured 39 of 39 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T12:19:43.539104Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-07-03T10:48:02.074671Z

Reference resolution

0 of 0 outbound references displayed

verified exact0
verified fuzzy0
unresolved0
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

No outbound reference observations are available for this paper version.

Pith citing papers

Observation 078580d8-a1a5-4ca6-b1db-d8247483d942 · inbound

UNA: A Unified Supervised Framework for Efficient LLM Alignment Across Feedback Types cites this paper.

UNA: A Unified Supervised Framework for Efficient LLM Alignment Across Feedback Types Token-level Direct Preference Optimization

Reference 25

Resolution: verified exact; arxiv_id, observed 2026-05-23T21:23:27.487999Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation ba846ef6-2e07-4e29-a80a-bb825c1e5a78 · inbound

Reward Modeling with Ordinal Feedback: Wisdom of the Crowd cites this paper.

Reward Modeling with Ordinal Feedback: Wisdom of the Crowd Token-level Direct Preference Optimization

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-12T17:15:47.958038Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 412575e6-f16c-4f16-b4a6-be6655f7d600 · inbound

Critical Tokens Matter: Token-Level Contrastive Estimation Enhances LLM's Reasoning Capability cites this paper.

Critical Tokens Matter: Token-Level Contrastive Estimation Enhances LLM's Reasoning Capability Token-level Direct Preference Optimization

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-12T05:43:32.080953Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 44648541-cb76-49be-8203-d9cce74a5e55 · inbound

T-REG: Preference Optimization with Token-Level Reward Regularization cites this paper.

T-REG: Preference Optimization with Token-Level Reward Regularization Token-level Direct Preference Optimization

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-11T23:15:56.448673Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation df554fa1-4c4e-4e47-8839-3d33f48fea7a · inbound

Cal-DPO: Calibrated Direct Preference Optimization for Language Model Alignment cites this paper.

Cal-DPO: Calibrated Direct Preference Optimization for Language Model Alignment Token-level Direct Preference Optimization

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-11T12:16:31.898358Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5614f044-9ccb-4a5a-902d-271b8ddd9c13 · inbound

SDPO: Segment-Level Direct Preference Optimization for Social Agents cites this paper.

SDPO: Segment-Level Direct Preference Optimization for Social Agents Token-level Direct Preference Optimization

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-10T22:28:56.807793Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 404700b7-9a2b-4d46-9a65-bf8dc02287f0 · inbound

PIPA: Preference Alignment as Prior-Informed Statistical Estimation cites this paper.

PIPA: Preference Alignment as Prior-Informed Statistical Estimation Token-level Direct Preference Optimization

Reference 31

Resolution: unresolved; no resolver link, observed 2026-08-08T18:10:53.442993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 10e4deab-3929-4688-bbd8-84862fb74085 · inbound

VistaDPO: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Models cites this paper.

VistaDPO: Video Hierarchical Spatial-Temporal Direct Preference Optimization for Large Video Models Token-level Direct Preference Optimization

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-16T12:19:43.539104Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5cd4cba5-630c-4b7c-9577-6982d9e9e87a · inbound

Inducing Robustness in a 2 Dimensional Direct Preference Optimization Paradigm cites this paper.

Inducing Robustness in a 2 Dimensional Direct Preference Optimization Paradigm Token-level Direct Preference Optimization

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-16T04:18:40.424127Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fd73f9b8-ffdf-4584-8b9a-66948967a9b3 · inbound

A Survey on Progress in LLM Alignment from the Perspective of Reward Design cites this paper.

A Survey on Progress in LLM Alignment from the Perspective of Reward Design Token-level Direct Preference Optimization

Reference 106

Resolution: unresolved; no resolver link, observed 2026-08-16T00:52:06.958529Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c6c3cc89-936e-48cb-92b4-9bd3348890fb · inbound

Policy-labeled Preference Learning: Is Preference Enough for RLHF? cites this paper.

Policy-labeled Preference Learning: Is Preference Enough for RLHF? Token-level Direct Preference Optimization

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-15T23:58:38.862316Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 113a36c2-1c1d-4bd1-90a2-8ee91dc66bb3 · inbound

SGDPO: Self-Guided Direct Preference Optimization for Language Model Alignment cites this paper.

SGDPO: Self-Guided Direct Preference Optimization for Language Model Alignment Token-level Direct Preference Optimization

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-15T20:40:51.057004Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8cc37db7-4a5c-40ce-99ae-84eaceba409b · inbound

Probability-Consistent Preference Optimization for Enhanced LLM Reasoning cites this paper.

Probability-Consistent Preference Optimization for Enhanced LLM Reasoning Token-level Direct Preference Optimization

Reference 52

Resolution: unresolved; no resolver link, observed 2026-08-07T12:48:54.646894Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 74b81ec1-c15b-4fb3-a0bb-fb078d10d9bd · inbound

Learning Safety Constraints for Large Language Models cites this paper.

Learning Safety Constraints for Large Language Models Token-level Direct Preference Optimization

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-07T12:30:16.341645Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation afa98307-1de3-4953-b0fe-9cce2510cb6e · inbound

AI Agent Behavioral Science cites this paper.

AI Agent Behavioral Science Token-level Direct Preference Optimization

Reference 186

Resolution: unresolved; no resolver link, observed 2026-08-07T11:00:54.142086Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b868000e-f0a3-40b4-b6c6-1f723f5999fd · inbound

From Fragments to Facts: A Curriculum-Driven DPO Approach for Generating Hindi News Veracity Explanations cites this paper.

From Fragments to Facts: A Curriculum-Driven DPO Approach for Generating Hindi News Veracity Explanations Token-level Direct Preference Optimization

Reference 55

Resolution: metadata mismatch; arxiv_id, observed 2026-05-19T06:12:07.126000Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation c89f84c3-6e88-4ad9-9a0f-a6ab33c4fc8e · inbound

Difficulty-Based Preference Data Selection by DPO Implicit Reward Gap cites this paper.

Difficulty-Based Preference Data Selection by DPO Implicit Reward Gap Token-level Direct Preference Optimization

Reference 41

Resolution: metadata mismatch; arxiv_id, observed 2026-05-21T23:50:47.536613Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation d8f6c5cd-fbb1-44ae-8344-3539981e24fd · inbound

FocusDPO: Dynamic Preference Optimization for Multi-Subject Personalized Image Generation via Adaptive Focus cites this paper.

FocusDPO: Dynamic Preference Optimization for Multi-Subject Personalized Image Generation via Adaptive Focus Token-level Direct Preference Optimization

Reference 41

Resolution: unresolved; no resolver link, observed 2026-08-05T12:53:42.473198Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eb7e1abf-09c4-4a9e-9392-c24a0c7a4d6c · inbound

Enhancing Speech Large Language Models through Reinforced Behavior Alignment cites this paper.

Enhancing Speech Large Language Models through Reinforced Behavior Alignment Token-level Direct Preference Optimization

Reference 58

Resolution: verified exact; arxiv_id, observed 2026-05-21T22:24:23.532009Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 39310ff7-28d9-4fea-889c-7381e850af02 · inbound

Distribution Preference Optimization: A Fine-grained Perspective for LLM Unlearning cites this paper.

Distribution Preference Optimization: A Fine-grained Perspective for LLM Unlearning Token-level Direct Preference Optimization

Reference 51

Resolution: unresolved; no resolver link, observed 2026-08-04T11:27:22.852709Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 107e3e7e-742e-4fc4-8ce9-5a2438b9cac2 · inbound

LLM Harms: A Taxonomy and Discussion cites this paper.

LLM Harms: A Taxonomy and Discussion Token-level Direct Preference Optimization

Reference 226

Resolution: metadata mismatch; arxiv_id, observed 2026-05-17T00:31:24.845889Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 7edaff37-1b18-4831-ae58-90fd720dcab3 · inbound

LLM Harms: A Taxonomy and Discussion cites this paper.

LLM Harms: A Taxonomy and Discussion Token-level Direct Preference Optimization

Reference 226

Resolution: unresolved; no resolver link, observed 2026-08-03T18:19:31.598779Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e113064d-c96d-4e01-a4e1-845eef5436fa · inbound

Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution cites this paper.

Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution Token-level Direct Preference Optimization

Reference 37

Resolution: metadata mismatch; arxiv_id, observed 2026-05-16T06:37:28.588973Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation b989e5c4-d7dc-4c55-9f54-8ec5a7a0c8d1 · inbound

Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution cites this paper.

Provably avoiding over-optimization in Direct Preference Optimization without knowing the data distribution Token-level Direct Preference Optimization

Reference 37

Resolution: metadata mismatch; arxiv_id, observed 2026-05-21T13:10:10.502504Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 1004e4b8-4187-433f-a6bd-8bc92db8614c · inbound

rePIRL: Learn PRM with Inverse RL for LLM Reasoning cites this paper.

rePIRL: Learn PRM with Inverse RL for LLM Reasoning Token-level Direct Preference Optimization

Reference 42

Resolution: metadata mismatch; arxiv_id, observed 2026-05-21T13:14:10.968376Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation e8366876-ff4a-4a68-9242-88144359e01e · inbound

rePIRL: Learn PRM with Inverse RL for LLM Reasoning cites this paper.

rePIRL: Learn PRM with Inverse RL for LLM Reasoning Token-level Direct Preference Optimization

Reference 42

Resolution: unresolved; no resolver link, observed 2026-08-03T03:33:46.578112Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 05ac2df2-b9ff-45cf-9199-d8e5fcbf58e0 · inbound

RAD-DPO: Robust Adaptive Denoising Direct Preference Optimization for Generative Retrieval in E-commerce cites this paper.

RAD-DPO: Robust Adaptive Denoising Direct Preference Optimization for Generative Retrieval in E-commerce Token-level Direct Preference Optimization

Reference 32

Resolution: verified exact; arxiv_id, observed 2026-05-15T19:06:30.691681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 658ce455-d299-478c-9890-70c9f127eba5 · inbound

Mobile GUI Agent Privacy Personalization with Trajectory Induced Preference Optimization cites this paper.

Mobile GUI Agent Privacy Personalization with Trajectory Induced Preference Optimization Token-level Direct Preference Optimization

Reference 39

Resolution: verified exact; arxiv_id, observed 2026-05-11T09:11:01.145338Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 3fd45605-c623-4937-a472-9f913ea078d2 · inbound

Step-level Denoising-time Diffusion Alignment with Multiple Objectives cites this paper.

Step-level Denoising-time Diffusion Alignment with Multiple Objectives Token-level Direct Preference Optimization

Reference 40

Resolution: metadata mismatch; arxiv_id, observed 2026-05-10T13:15:25.868966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 1325efea-62bc-48c4-8707-c6fde731cd83 · inbound

ResRL: Boosting LLM Reasoning via Negative Sample Projection Residual Reinforcement Learning cites this paper.

ResRL: Boosting LLM Reasoning via Negative Sample Projection Residual Reinforcement Learning Token-level Direct Preference Optimization

Reference 53

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T15:41:44.376403Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation f0ca4aaf-90d5-4706-bdf6-b147accde66f · inbound

ResRL: Boosting LLM Reasoning via Negative Sample Projection Residual Reinforcement Learning cites this paper.

ResRL: Boosting LLM Reasoning via Negative Sample Projection Residual Reinforcement Learning Token-level Direct Preference Optimization

Reference 53

Resolution: metadata mismatch; arxiv_id, observed 2026-05-11T03:55:56.600639Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 57c9d52e-3b80-44bf-9d55-2c43f27631dc · inbound

TokenRatio: Principled Token-Level Preference Optimization via Ratio Matching cites this paper.

TokenRatio: Principled Token-Level Preference Optimization via Ratio Matching Token-level Direct Preference Optimization

Reference 192

Resolution: metadata mismatch; arxiv_id, observed 2026-05-13T04:57:17.310837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation 94827eba-847a-4d7b-9b89-3502ab126c78 · inbound

TokenRatio: Principled Token-Level Preference Optimization via Ratio Matching cites this paper.

TokenRatio: Principled Token-Level Preference Optimization via Ratio Matching Token-level Direct Preference Optimization

Reference 8

Resolution: metadata mismatch; arxiv_id, observed 2026-07-01T14:05:47.253592Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation a8e2813e-a815-4476-8a2a-e98ae7d2016c · inbound

DyCo-RL: Dynamic Cross-Modal Coordination for Visual Reasoning cites this paper.

DyCo-RL: Dynamic Cross-Modal Coordination for Visual Reasoning Token-level Direct Preference Optimization

Reference 34

Resolution: metadata mismatch; arxiv_id, observed 2026-07-02T20:47:23.097979Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation a5ba103b-130b-4b35-b5e4-2252069b86d8 · inbound

Analyzing and Improving Fine-grained Preference Optimization in Medical LVLMs cites this paper.

Analyzing and Improving Fine-grained Preference Optimization in Medical LVLMs Token-level Direct Preference Optimization

Reference 32

Resolution: metadata mismatch; arxiv_id, observed 2026-07-03T10:48:02.076164Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation ac02c51d-db5c-49a4-8a67-44dc879a8e09 · inbound

Flow Reasoning Models: Scaling Reasoning Through Iterative Self-Refinement cites this paper.

Flow Reasoning Models: Scaling Reasoning Through Iterative Self-Refinement Token-level Direct Preference Optimization

Reference 31

Resolution: verified exact; arxiv_id, observed 2026-06-30T08:04:28.458045Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-20T06:33:59.587034+00:00.

Observation e631884d-355e-47d0-9e7c-6c823cd3d4cd · inbound

Token-Level Off-Policy Learning for Faithful Generation Under Distribution Shift cites this paper.

Token-Level Off-Policy Learning for Faithful Generation Under Distribution Shift Token-level Direct Preference Optimization

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-01T17:47:42.921201Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6cb38f9a-977e-4430-8c10-a4f24d11d9dc · inbound

Test-Time Scaling via Error Localization cites this paper.

Test-Time Scaling via Error Localization Token-level Direct Preference Optimization

Reference 182

Resolution: unresolved; no resolver link, observed 2026-08-01T07:28:36.606953Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 54293756-9f1b-415b-aaa1-5be4700cd828 · inbound

Token-Level Credit Assignment Optimization for Generative Document Retrieval cites this paper.

Token-Level Credit Assignment Optimization for Generative Document Retrieval Token-level Direct Preference Optimization

Reference 45

Resolution: unresolved; no resolver link, observed 2026-08-16T00:23:45.924802Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.