Paper Citation Record · LEDGER

Interpreting Language Reward Models via Contrastive Explanations

As of 13 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 2 inbound Pith citation observations for arXiv:2411.16502.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.16502 v2

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T13:06:27.935915Z

measured 26 of 26 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-07T14:05:09.068412Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-19T05:17:05.898300Z

Reference resolution

24 of 24 outbound references displayed

verified exact0
verified fuzzy4
unresolved20
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 4260fdf5-defc-4136-ba5e-e23247df9345 · outbound

This paper cites GPT-4 Technical Report.

Interpreting Language Reward Models via Contrastive Explanations GPT-4 Technical Report

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.823032Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2a8407de-de5f-4ac3-b3d0-59503440c3a6 · outbound

This paper cites Understanding Large Language Model Behaviors through Interactive Counterfactual Generation and Analysis.

Interpreting Language Reward Models via Contrastive Explanations Understanding Large Language Model Behaviors through Interactive Counterfactual Generation and Analysis

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.844021Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bf93350a-3f2f-4db3-a1c9-46396bea7ff0 · outbound

This paper cites LLM-Assisted Content Analysis: Using Large Language Models to Support Deductive Coding.

Interpreting Language Reward Models via Contrastive Explanations LLM-Assisted Content Analysis: Using Large Language Models to Support Deductive Coding

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.849086Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1f7ab228-acbd-4c88-948b-60baf42d76f6 · outbound

This paper cites UltraFeedback: Boosting Language Models with Scaled AI Feedback.

Interpreting Language Reward Models via Contrastive Explanations UltraFeedback: Boosting Language Models with Scaled AI Feedback

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.854568Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e0ef8185-27d1-4a00-8b97-20b8f0e31e14 · outbound

This paper cites Research agenda for sociotechnical approaches to ai safety.

Interpreting Language Reward Models via Contrastive Explanations Research agenda for sociotechnical approaches to ai safety

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T13:06:28.329790Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 78c0272d-2e56-4c3c-b869-616027a62d37 · outbound

This paper cites RewardBench: Evaluating Reward Models for Language Modeling.

Interpreting Language Reward Models via Contrastive Explanations RewardBench: Evaluating Reward Models for Language Modeling

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.864403Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 806e2465-5eb5-476e-bc01-c1b1365b123a · outbound

This paper cites Skywork-Reward: Bag of Tricks for Reward Modeling in LLMs.

Interpreting Language Reward Models via Contrastive Explanations Skywork-Reward: Bag of Tricks for Reward Modeling in LLMs

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.869259Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 54e709d8-f3bf-411e-bd0d-f11e9e3d3622 · outbound

This paper cites an unresolved cited work.

Interpreting Language Reward Models via Contrastive Explanations Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-08-12T13:06:28.315477Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 799ea82e-acc6-4756-a6cd-24210f785702 · outbound

This paper cites A Baseline Analysis of Reward Models' Ability To Accurately Analyze Foundation Models Under Distribution Shift.

Interpreting Language Reward Models via Contrastive Explanations A Baseline Analysis of Reward Models' Ability To Accurately Analyze Foundation Models Under Distribution Shift

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.888214Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bda6611a-462d-4a5e-a4f9-bfdf8590a683 · outbound

This paper cites A Long Way to Go: Investigating Length Correlations in RLHF.

Interpreting Language Reward Models via Contrastive Explanations A Long Way to Go: Investigating Length Correlations in RLHF

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.901889Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ce12127a-aba2-41c0-aedc-27fc53cc946c · outbound

This paper cites HelpSteer2: Open-source dataset for training top-performing reward models.

Interpreting Language Reward Models via Contrastive Explanations HelpSteer2: Open-source dataset for training top-performing reward models

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.910817Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e6b60194-1e5c-4833-91d6-83c0220a4464 · outbound

This paper cites an unresolved cited work.

Interpreting Language Reward Models via Contrastive Explanations Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-12T13:06:28.254424Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 66cf38e7-971b-45ae-98a9-ca71a2643add · outbound

This paper cites As the former is not the focus of the datasets we experiment with, we only additionally include honesty, relabelled to avoid-to-answer for better relevance.

Interpreting Language Reward Models via Contrastive Explanations As the former is not the focus of the datasets we experiment with, we only additionally include honesty, relabelled to avoid-to-answer for better relevance

Reference 22

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T13:06:28.239664Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation bad868db-86aa-44ce-b783-ccd53aae4468 · outbound

This paper cites an unresolved cited work.

Interpreting Language Reward Models via Contrastive Explanations Unresolved cited work

Reference 23

Resolution: unresolved; raw_fallback, observed 2026-08-12T13:06:28.224411Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation f8ba8052-758f-4831-9ab8-a62d6d24fecc · outbound

This paper cites an unresolved cited work.

Interpreting Language Reward Models via Contrastive Explanations Unresolved cited work

Reference 24

Resolution: unresolved; raw_fallback, observed 2026-08-12T13:06:28.209311Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation eef2f67f-fc87-40da-a019-8cb8cd92a048 · outbound

This paper cites OffsetBias: Leveraging Debiased Data for Tuning Evaluators.

Interpreting Language Reward Models via Contrastive Explanations OffsetBias: Leveraging Debiased Data for Tuning Evaluators

Reference 2001

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.883420Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0db6ba71-ca46-4a62-bae2-e4c9d57fd807 · outbound

This paper cites an unresolved cited work.

Interpreting Language Reward Models via Contrastive Explanations Unresolved cited work

Reference 2016

Resolution: unresolved; raw_fallback, observed 2026-08-12T13:06:28.285887Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 179382e3-09a0-4fee-93bb-aa3b7174946c · outbound

This paper cites Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Experts.

Interpreting Language Reward Models via Contrastive Explanations Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Experts

Reference 2017

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.906346Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 976b738c-f2fe-4636-bcb8-7c61adfba7ac · outbound

This paper cites LLMs for Generating and Evaluating Counterfactuals: A Comprehensive Study.

Interpreting Language Reward Models via Contrastive Explanations LLMs for Generating and Evaluating Counterfactuals: A Comprehensive Study

Reference 2019

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.873949Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c5cada5c-4f92-4315-88a9-e02035c7ed41 · outbound

This paper cites Sentence-bert: Sentence embeddings using siamese bert- networks.

Interpreting Language Reward Models via Contrastive Explanations Sentence-bert: Sentence embeddings using siamese bert- networks

Reference 2020

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T13:06:28.301157Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation dd32ea03-4936-41ca-8d3c-19452fd37c60 · outbound

This paper cites Vera Liao, Rania Abdelghani, and Pierre-Yves Oudeyer.

Interpreting Language Reward Models via Contrastive Explanations Vera Liao, Rania Abdelghani, and Pierre-Yves Oudeyer

Reference 2021

Resolution: verified fuzzy; raw_fallback, observed 2026-08-12T13:06:28.269477Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation f241e812-535e-4449-89cb-9b246075f74b · outbound

This paper cites Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation.

Interpreting Language Reward Models via Contrastive Explanations Zero-shot LLM-guided Counterfactual Generation: A Case Study on NLP Model Evaluation

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.833762Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cfd0785c-10d6-4195-afdc-11c6e3de6449 · outbound

This paper cites Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback.

Interpreting Language Reward Models via Contrastive Explanations Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.828613Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1581f68e-0b0f-4f49-9b4a-763df987c986 · outbound

This paper cites RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs.

Interpreting Language Reward Models via Contrastive Explanations RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs

Reference 2024

Resolution: unresolved; no resolver link, observed 2026-08-12T13:06:27.839076Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation eb42c8bb-e6f5-46c5-bd0c-475a44b6d185 · inbound

Multi-Domain Explainability of Preferences cites this paper.

Multi-Domain Explainability of Preferences Interpreting Language Reward Models via Contrastive Explanations

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-07T14:05:09.068412Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a250044e-9fae-47e7-a728-f8814d8e2bf9 · inbound

Teach a Reward Model to Correct Itself: Reward Guided Adversarial Failure Discovery for Robust Reward Modeling cites this paper.

Teach a Reward Model to Correct Itself: Reward Guided Adversarial Failure Discovery for Robust Reward Modeling Interpreting Language Reward Models via Contrastive Explanations

Reference 13

Resolution: verified exact; arxiv_id, observed 2026-05-19T05:17:05.901461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.