Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-04T14:52:27.322147Z
Paper Citation Record · LEDGER
As of 9 August 2026, this Paper Citation Record lists 69 of 69 outbound references and 0 inbound Pith citation observations for arXiv:2509.22851.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-04T14:52:27.322147Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
69 of 69 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation d26ae2f7-df07-4591-ab61-cb299ee78d85 · outbound
Adaptive Margin RLHF via Preference over Preferences Direct Preference Optimization with an Offset
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4deb9cf5-bfb4-4a4e-a885-a13706c67041 · outbound
Adaptive Margin RLHF via Preference over Preferences A General Theoretical Paradigm to Understand Learning from Human Preferences
Reference 2
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 40e0d324-70e7-478c-8376-f3279d3e5fbb · outbound
Adaptive Margin RLHF via Preference over Preferences Bousquet, S
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 931f9ebc-bfbc-4231-8f18-1f5a1edb4f66 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 4
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a0d963fd-66b3-4871-b322-c35f6d0c173c · outbound
Adaptive Margin RLHF via Preference over Preferences Burton, M
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 32637181-00ce-4796-a516-eaa778829233 · outbound
Adaptive Margin RLHF via Preference over Preferences Reinforcement Learning from Human Feedback with High-Confidence Safety Constraints
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b5410bf6-2633-4911-bb22-02f398f49f7f · outbound
Adaptive Margin RLHF via Preference over Preferences Cortes and V
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5b0d4bfe-b7ad-411a-ac61-fff73e42d8f6 · outbound
Adaptive Margin RLHF via Preference over Preferences UltraFeedback: Boosting Language Models with Scaled AI Feedback
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3e996b52-e079-416a-b208-9bc0465b48fd · outbound
Adaptive Margin RLHF via Preference over Preferences Safe RLHF: Safe Reinforcement Learning from Human Feedback
Reference 9
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ffbc1c1f-7249-426c-9576-bb1c3d3078bc · outbound
Adaptive Margin RLHF via Preference over Preferences Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c9f67d72-0320-4973-874b-7c2fa63207ed · outbound
Adaptive Margin RLHF via Preference over Preferences Freund, R
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bdc8121d-fda6-4bc6-b99a-12aa39ffd21d · outbound
Adaptive Margin RLHF via Preference over Preferences Grattafiori et al
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2e7b1d4a-22e4-4918-a44a-4d50c35ee4ea · outbound
Adaptive Margin RLHF via Preference over Preferences Deep Ranking with Adaptive Margin Triplet Loss
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b135e933-e8ff-4e02-a62b-2745286621fe · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 07170c3e-662a-4c99-8ea6-9f5da5ce5873 · outbound
Adaptive Margin RLHF via Preference over Preferences Herbrich and J
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.
Observation 5cc9a423-2cf1-48c2-a280-0d7b0eabde7b · outbound
Adaptive Margin RLHF via Preference over Preferences Huang, Y
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bcb942e4-821c-45b6-b63f-d85de30a8e5b · outbound
Adaptive Margin RLHF via Preference over Preferences Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialog
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7fa6e70b-4141-4aea-b59c-03c5577fc3fa · outbound
Adaptive Margin RLHF via Preference over Preferences Best-Worst Scaling More Reliable than Rating Scales: A Case Study on Sentiment Intensity Annotation
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1e925bf3-af47-4214-bfe5-5b02f232054a · outbound
Adaptive Margin RLHF via Preference over Preferences RewardBench: Evaluating Reward Models for Language Modeling
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation aa2d5130-5b08-4c55-bbb2-df410334c849 · outbound
Adaptive Margin RLHF via Preference over Preferences Ledoux and M
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c0f3625f-7d29-4853-98e3-d2093ffff08a · outbound
Adaptive Margin RLHF via Preference over Preferences Ouyang, J
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ab919cad-b1d9-4238-8dfc-285aae93f89d · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 22
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fa7afd46-3c23-46f2-9c88-84e69c0d9b98 · outbound
Adaptive Margin RLHF via Preference over Preferences Peters and S
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation fdbcda8b-ed8c-43ae-9c2f-8b4c3593c9c2 · outbound
Adaptive Margin RLHF via Preference over Preferences Towards Understanding the Influence of Reward Margin on Preference Model Performance
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3b0f04f9-5a26-44f5-aa62-e5839e6ae26b · outbound
Adaptive Margin RLHF via Preference over Preferences Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3d63d4ca-da49-4ff5-b230-8f1f9c880fcc · outbound
Adaptive Margin RLHF via Preference over Preferences Direct Preference Optimization: Your Language Model is Secretly a Reward Model
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7e076658-0a5c-4316-a66f-74e70d1cae92 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 03cac645-6536-4014-9036-d4ab7967df3a · outbound
Adaptive Margin RLHF via Preference over Preferences Shalev-Shwartz and S
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b2c2bc61-a198-446a-9200-9fa6941cfa6a · outbound
Adaptive Margin RLHF via Preference over Preferences Learning to summarize from human feedback
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 35854391-623f-4756-b624-e2e1b12ea2ed · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 62422090-11c8-440a-9b8b-5b9b17d101ae · outbound
Adaptive Margin RLHF via Preference over Preferences Llama 2: Open Foundation and Fine-Tuned Chat Models
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ad48c468-41f6-4d02-b234-1c325540d4b9 · outbound
Adaptive Margin RLHF via Preference over Preferences Using Natural Language Explanations to Rescale Human Judgments
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6e2155e5-e488-4033-a71f-79949deb1a4c · outbound
Adaptive Margin RLHF via Preference over Preferences Secrets of RLHF in Large Language Models Part II: Reward Modeling
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 930e524d-670e-4629-90cb-11db64921b0a · outbound
Adaptive Margin RLHF via Preference over Preferences Reward Difference Optimization For Sample Reweighting In Offline RLHF
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a8ebfb0e-6e6d-484e-99f7-8832427597a9 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b4039719-d289-4f68-abe4-e1b8e027db86 · outbound
Adaptive Margin RLHF via Preference over Preferences HelpSteer2-Preference: Complementing Ratings with Preferences
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9402494a-17ff-40a8-a70f-fee6e656ded9 · outbound
Adaptive Margin RLHF via Preference over Preferences AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 34d1da5e-9660-4de1-8f71-242207ba596a · outbound
Adaptive Margin RLHF via Preference over Preferences $\beta$-DPO: Direct Preference Optimization with Dynamic $\beta$
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a7872236-7bbf-40f2-a2a6-75a9f0eeba6e · outbound
Adaptive Margin RLHF via Preference over Preferences Zhang, R
Reference 39
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dca28929-3147-44b8-80dc-00812939bbea · outbound
Adaptive Margin RLHF via Preference over Preferences SLiC-HF: Sequence Likelihood Calibration with Human Feedback
Reference 40
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4195abd2-6dd2-466c-9378-df0b02df4e4e · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 42
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 33823365-27bd-4322-a321-50012d02e943 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 43
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ba6ec33e-dac8-4464-aa14-a986278fc4ac · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ae76b861-3e3a-4385-bd13-6c4d87631726 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 45
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b183f1b7-2860-4c41-9765-ed3591a2c7a1 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 46
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation becc15a5-a966-456d-8d73-6f5e5ae7094f · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 47
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 18a40dff-31c5-4a95-99fd-589c4fa50ef3 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 48
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation df5b5ed2-91a0-4b42-8d8f-32f52c2bc217 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 49
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 46703fff-72b9-4720-a0e6-e0bbc6f9801b · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 50
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 19396117-59ba-4b42-89df-68333583a515 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 51
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6c25a5f6-86cc-4ca9-958b-055af1d78953 · outbound
Adaptive Margin RLHF via Preference over Preferences Trailer Park
Reference 52
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0eacef87-9bdd-47b8-be7e-b47458e2265c · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 53
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4f33b784-df1c-4897-9197-736c156c6e89 · outbound
Adaptive Margin RLHF via Preference over Preferences It comes in various toppings including classic pepperoni but also more unique options such as cathead (a combination of prosciutto and arugula)
Reference 54
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7d7a2a36-3ae1-4e81-a092-4ef92aa583cb · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 55
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f0047949-78bb-42c4-bc94-29c180a70d5a · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 56
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dd6a007a-d963-4e73-a11e-2c5528730d26 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 57
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bd327419-9064-4441-8af6-cc07ab337fd8 · outbound
Adaptive Margin RLHF via Preference over Preferences These are just a taste of what Austin has to offer when it comes to street food culture
Reference 58
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 43a863ae-88c2-437f-a5b5-9639a4e27c6a · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 59
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1b523c27-65b4-49c9-aa95-71dd2e7c5d37 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 60
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 80c953cb-459c-4c94-bb2d-d88893718526 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 61
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 80241729-884a-4899-a568-d88f50667a00 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 62
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 42c6f05d-10b4-494e-83b3-bee6ed28f842 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 63
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 28510f25-63f7-410c-94b6-ecd3adb4bb55 · outbound
Adaptive Margin RLHF via Preference over Preferences Big As Yo´Face
Reference 64
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 62559684-b2ae-41ab-aea6-8b968a5a706c · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 65
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 600040fb-d03d-4019-8689-363ce8530dba · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 66
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cb8e8394-cc1c-4420-8ac0-4f9e068db294 · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 67
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a5b037e6-d769-4eca-9431-eee23b86fe8c · outbound
Adaptive Margin RLHF via Preference over Preferences Unresolved cited work
Reference 68
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7fb140ae-8efa-435e-8c29-f93029f42f82 · outbound
Adaptive Margin RLHF via Preference over Preferences Lion Burgers,
Reference 69
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cc987b26-76a4-4d61-82ee-429d539bd995 · outbound
Adaptive Margin RLHF via Preference over Preferences HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM
Reference 2023
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
No inbound Pith citation observations are available.