Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-15T21:08:56.977697Z
Paper Citation Record · LEDGER
As of 23 August 2026, this Paper Citation Record lists 62 of 62 outbound references and 3 inbound Pith citation observations for arXiv:2505.10892.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-15T21:08:56.977697Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-07-12T08:52:34.039089Z
A source-named dated measurement, never combined with another source.
Source: pith, observed 2026-08-05T02:28:24.338817Z
62 of 62 outbound references displayed
External citation measurements
0
pith, observed 2026-08-05T02:28:24.338817Z
Observation 105f9312-5888-4084-a3d8-a1e01985d193 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models GPT-4 Technical Report
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 83c854ab-e810-460a-9b1b-59be6dc88438 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Agnihotri, R
Reference 2
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation e8de9cd9-9b15-4cce-8d72-2b7cc90129f4 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Agnihotri, R
Reference 3
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 78ffbc57-53dc-4415-a587-4c2f3dd468d9 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 4
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 3926a990-920f-41bc-91c1-fcda019f91bd · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7e23d1bb-d8a5-431c-881c-0952b41b01e1 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2b2e651f-988d-4485-b9d1-b048739ab88b · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 06055c03-1ca4-4c4b-acf6-91ef81907a33 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9c5ce716-0b9e-4e6d-a9ba-75bc9456c04e · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 9
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation fb1562da-c785-4105-9329-f3f2b0623316 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 10
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 0b2bd1b1-6df3-413d-a873-b1808da60bbd · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 11
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 58d45108-64b3-4cce-8227-6193b3d3e271 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Efron and R
Reference 12
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 28faa723-bfc5-4951-84b7-726389ab41d3 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Gheshlaghi Azar, Z
Reference 13
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 766d6ed0-76c0-4859-aade-e7ab2841a7e4 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models The Llama 3 Herd of Models
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bdbb9e00-543d-4ec9-ac7b-2017fbd23f8e · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2a0676ce-b45c-4989-bd44-a8b01b82fddc · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Controllable Preference Optimization: Toward Controllable Multi-Objective Alignment
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fc99bbc1-4db5-44f1-8a80-f7d11356335a · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 17
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 8cd5aaee-f7ae-4d6e-943e-4f70dbc71bb2 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 18
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation f27c4b67-d78f-46d7-aca5-8187db0c70a6 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Aligning Language Models with Offline Learning from Human Feedback
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 580db4c9-4cb3-4d74-831b-9c2edd48f800 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Huang, A
Reference 20
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation ac85fcf5-3744-4e26-89a1-59bb0f23865e · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cad7586f-a052-4093-af39-af5e3c51c5ac · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 00a2dd24-dc43-498f-84ca-0a124e823fa5 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Adam: A Method for Stochastic Optimization
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5f76ffc1-0cc8-4b63-bcff-535e3fd580ac · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f839d209-68a9-4d12-bd70-3086b445ef82 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 25
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 8dae53ae-623d-4beb-8510-8949d7117130 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 73a526ea-6440-4f5c-9389-5392865a2fa3 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Textbooks Are All You Need II: phi-1.5 technical report
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9219ab43-7c5e-4305-969b-4431df926d3b · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models C-MORL: Multi-Objective Reinforcement Learning through Efficient Discovery of Pareto Front
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8f537bb4-cba6-4aae-aa08-89f635c58bf8 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Pack of LLMs: Model Fusion at Test-Time via Perplexity Optimization
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5b424fa6-521f-40bd-8ebd-71fd51511d39 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Miettinen
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b3dd2f31-c10e-454a-80d8-943543c47e6b · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Playing Atari with Deep Reinforcement Learning
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f5bbc9b6-96cf-43ae-bbab-10479171ff50 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Multi-Objective Alignment of Large Language Models Through Hypervolume Maximization
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4a02459c-9a13-4c0b-bd04-d4fe2ce87cc6 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Nash Learning from Human Feedback
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fac20a13-0c40-406d-a9b7-4a1e03449bed · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Nesterov.Lectures on Convex Optimization
Reference 34
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation c2e6e737-dd3e-4f36-8a1f-4b68a7768097 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Ouyang, J
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 105e4be2-4440-4070-a3b7-8e5af5cf5807 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 36
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation f6a8772d-65a1-4d8c-b3b7-20b6c374bccb · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Instruction Tuning with GPT-4
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3967cbdb-e400-4cc1-ba9c-428c0dc91d7f · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Rafailov, A
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 2291ff78-929f-4d2e-8784-b2e19075bac4 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 6be56b49-96bb-4a5f-8214-c123907126df · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 40
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation e5cda545-9fa3-4340-b923-cc82302bcf30 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Proximal Policy Optimization Algorithms
Reference 41
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation afd30265-c73c-4dce-989c-88dd644cec04 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 42
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 51222244-0ed7-4f36-8d8c-ce489914eb3b · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Stiennon, L
Reference 43
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c2a6a508-17ed-428c-8f7d-aed6243c3c26 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Gemma 3 Technical Report
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 94072b2a-6de9-48cb-b716-30cbd0683cb7 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Van Moffaert and A
Reference 45
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 6b764e25-b99b-4bd2-8694-1900509d9bc4 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models von Werra, Y
Reference 46
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 042a9d0a-0f3c-4566-a3e3-91228f7fd0a9 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models von Werra, Y
Reference 47
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 31b027a1-7302-4f0f-9d53-6502de4fb9bd · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 48
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 3aee28d5-a3a3-47f9-bc4f-ad5443d8e10b · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 49
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 63933835-d9dd-44a5-b42f-57788a1a3070 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards
Reference 50
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b4da37b9-4d56-488c-8df6-daeba4423801 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models HuggingFace's Transformers: State-of-the-art Natural Language Processing
Reference 51
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 35c71cd1-2d5f-4f56-8bd6-3f102cdcf0ec · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Wortsman, G
Reference 52
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 4a7fa947-b0db-4897-8338-4ba6e0f838a1 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 53
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 33380517-f687-4950-98ab-c8daa1119659 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Unresolved cited work
Reference 54
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 8a0f6e7d-2ea4-48ed-8701-b3a5af2080f3 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models RRHF: Rank Responses to Align Language Models with Human Feedback without tears
Reference 55
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9974e1cf-4a27-4df4-9986-444f91439db5 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention
Reference 56
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation da7eb7c4-a63a-408c-972c-234aaa23fa80 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Zhang, S
Reference 57
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation f60cd730-7c06-47ff-ba87-002bce33f06b · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Zhong, C
Reference 58
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 5c9d276b-a7b8-433e-ae9b-1d89198140ca · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Beyond One-Preference-Fits-All Alignment: Multi-Objective Direct Preference Optimization
Reference 59
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a712e480-ee0c-4e85-a4b2-1c3ea06ad12f · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models Fine-Tuning Language Models from Human Preferences
Reference 60
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation faa9016d-dcc0-421d-a4e5-f2b6e5e7d29c · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models KX i=1 wiRi(y) # =p +q +r +s. (18) While by the selection ofk, we have E y∼πA,w
Reference 61
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation d1343081-3ca8-4c45-8cf3-e47cb7e7f967 · outbound
Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models reverse_kld
Reference 62
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation 2d5844c4-8adb-4f7a-8a6c-5936bd1060f1 · inbound
MGDA-Decoupled: Geometry-Aware Multi-Objective Optimisation for DPO-based LLM Alignment Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models
Reference 74
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation eccd3dea-1ffc-4b32-947f-b1be0bdb3176 · inbound
Multi-Objective Exploration and Preference Optimization via Mutual Information Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models
Reference 101
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.
Observation ff0edeb1-b97d-4968-97f2-3708657bd0e7 · inbound
Multi-Objective Exploration and Preference Optimization via Mutual Information Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.