Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T14:02:53.986004Z
Paper Citation Record · LEDGER
As of 19 August 2026, this Paper Citation Record lists 67 of 67 outbound references and 7 inbound Pith citation observations for arXiv:2505.20417.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-07T14:02:53.986004Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links, observed 2026-08-07T22:50:33.128296Z
A source-named dated measurement, never combined with another source.
Source: arxiv_reference, observed 2026-07-02T22:27:26.359636Z
67 of 67 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 93a28207-45ea-4c27-82c9-c496b2345950 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Cooperative games with coalition structures.International Journal of game theory, 3:217–237, 1974
Reference 1
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation b7dc906d-390f-49f4-ad9f-c7e1ac83c4aa · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF An actor-critic algorithm for sequence prediction
Reference 2
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 16a1f1bc-5379-46a6-8497-db378f42cd70 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 65f877f9-1128-41a4-b173-02d16aed082c · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Unifying count-based exploration and intrinsic motivation
Reference 4
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 86571453-5e38-4dac-aa1e-515a88c7e1be · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Pythia: A suite for analyzing large language models across training and scaling
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1f9d92d6-8e4e-4b4d-afcb-8a46a38f7bd1 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Language models are few-shot learners
Reference 6
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation a8f90ea3-32e2-4385-8b64-fc512ace053e · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Ask the right questions: Active question reformulation with reinforcement learning
Reference 7
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 18cb1723-1f98-4958-bcc1-4c7412ce00c7 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Enhancing reinforcement learning with dense rewards from language model critic
Reference 8
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 6c1b17a7-a780-406c-a64b-40a90f983198 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Dense reward for free in reinforcement learning from human feedback
Reference 9
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation fcb1f168-f636-4714-8814-808d94e3bd8d · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Deep reinforcementlearningfromhumanpreferences
Reference 10
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 3fe0eff9-d9f5-4570-aa71-86c8e849f1e6 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5daf9793-6240-42d7-a356-d1543e156e40 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Openllama: An open reproduction of llama, May 2023
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8296700f-95dd-4ec6-8f94-59f15666e962 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Transformer feed-forward layers build predictions by promoting concepts in the vocabulary space
Reference 13
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 84fbbc30-e86c-4816-b44e-6a58d97433d2 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF TokenSHAP: Interpreting Large Language Models with Monte Carlo Shapley Value Estimation
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 265f0e68-e43a-494b-a39d-2ad998bff0c9 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF A duality approach for regret minimization in average-award ergodic markov decision processes
Reference 15
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation dc2e7ed3-6589-478f-8935-61ef15aaacef · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Dealing with Sparse Rewards in Reinforcement Learning
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 95a37907-86cf-491c-a877-0a13910a9711 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 20620372-b769-4c87-a658-bac228dd19d7 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Deep reinforcement learning that matters
Reference 18
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation bbece51e-00d4-4d24-9192-5dba9d4db59c · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF The n+ implementation details of RLHF with PPO: A case study on TL;DR summariza- tion
Reference 19
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation b8124faf-1bc8-4262-ace1-63db75208665 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Unresolved cited work
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 3a866c0b-c22a-409f-87a4-802f1b20f79c · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Motif: Intrinsic motivation from artificial intelligence feedback
Reference 21
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 923e16fe-d3d4-41ca-817b-2a72a70795c5 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Learning Explainable Dense Reward Shapes via Bayesian Optimization
Reference 22
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 5940e98e-e964-4d66-8e02-ca2dd45ca717 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Learning to solve the credit assignment problem
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4835cd1c-2cea-4f25-aabb-df4c48127f05 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Rlaif: Scaling reinforcement learning from human feedback with ai feedback
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 45ea0ea5-28d8-4e8f-9854-0378078a8d77 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Deep reinforcement learning for dialogue generation
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 80478d1d-be3a-4130-9c7c-98cf6fc8935e · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Hashimoto
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a1950545-a088-4993-90f3-3b0cfbd807ed · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Let's Verify Step by Step
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 74aac5d7-e680-41ab-a8e3-85739a0e9154 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Prompt Valuation Based on Shapley Values
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 65d8eec0-3b77-4132-b50a-e3b47ed93c33 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF A unified approach to interpreting model predic- tions
Reference 29
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation e3e7845f-221a-4602-b7b2-e0b08359ac53 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Maas, Raymond E
Reference 30
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 0807961e-8681-4744-b617-c924d736c279 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Marcus, Beatrice Santorini, and Mary Ann Marcinkiewicz
Reference 31
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation ddaf35c0-ae1c-48bf-aea9-5bcfbc7d9fb6 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Locating and editing factual associations in GPT
Reference 32
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation dca35289-70b3-431c-8ae7-0b78b4f706d2 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Explaining Large Language Models Decisions Using Shapley Values
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a6080ae3-068c-4a6a-8166-4cf33dea9cb2 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Policy invariance under reward transformations: Theory and application to reward shaping
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2fa9f7c1-b7f7-4ab6-8851-ddc99fdf2336 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Ng, Daishi Harada, and Stuart J
Reference 35
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation a700ab1d-62d4-4f04-add5-c1a60e894881 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Reward augmented maximum likelihood for neural struc- tured prediction
Reference 36
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 90596834-08fb-4250-ad11-3fcc7c2833f6 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Bellemare, Aäron van den Oord, and Rémi Munos
Reference 37
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 0cfec407-c9bb-4838-934f-68b10a999775 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Training language models to follow instructions with human feedback
Reference 38
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 954a79f2-696a-4a13-86af-90209ad4f045 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Values of games with a priori unions
Reference 39
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation a39eb9cf-4926-4acd-9ef3-04925f6e2663 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Efros, and Trevor Darrell
Reference 40
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 7c57fb9f-e409-4cff-b1f6-ad1f9f889039 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Language models are unsupervised multitask learners
Reference 41
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c904d407-6045-46f1-913d-b07e2d52f4da · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Susskind, and Etai Littwin
Reference 42
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation e78090d4-39f5-414a-a6de-c02fe68a4f00 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Framework of automatic text summarization using rein- forcement learning
Reference 43
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation cea8bb73-321f-4be0-81c6-6553b11fd787 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Proximal Policy Optimization Algorithms
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e3395b6f-3312-4a39-b806-1bd7a4cbbad8 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Stochastic games
Reference 45
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 9a2a059f-6e12-4b66-ae16-ad5840a7275b · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Learning to summarize with human feed- back
Reference 46
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation a12e3bc6-8b46-4e75-af21-20a83437b598 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Efficient Shapley Value-based Non-Uniform Pruning of Large Language Models
Reference 47
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation cd1b4c7f-7d06-4c2c-8bf5-07408b0c8e49 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Temporal credit assignment in reinforcement learning
Reference 48
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation b607ae6b-4b0e-40e2-85f0-d00d753071b1 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF #exploration: A study of count-based exploration for deep reinforcement learning
Reference 49
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 0fc0b3de-ddf5-4983-ae3e-385933ce9652 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF LLaMA: Open and Efficient Foundation Language Models
Reference 50
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ceb5e297-400e-479b-9d3e-a0312e9eb73c · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF TL;DR: Mining Reddit to learn automatic summarization
Reference 51
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 54967368-bfc6-4e27-b5d5-f40b6db3c159 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Attention is not not explanation
Reference 52
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0f9c59b6-a227-4413-9fa7-a3c260287e58 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Fine-grained human feedback gives better rewards for language model training
Reference 53
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation dcd0fd4d-46e1-47a7-b188-d535a4742fa0 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Fine-Grained Human Feedback Gives Better Rewards for Language Model Training
Reference 54
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5c805033-244a-4388-aa75-5328eaf7dde1 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF TLCR: Token-level continuous reward for fine-grained reinforcement learning from human feedback
Reference 55
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation a4599d54-49a6-4ccc-b274-fa6ff5df1efc · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Towards sample efficient reinforcement learning
Reference 56
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 997aa4d8-bef1-47c0-9a3b-f9acda86f54e · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Gonzalez, and Ion Stoica
Reference 57
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation d94d93f9-bbb6-48ef-8764-c998ec17354c · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Summary A
Reference 58
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 68c6fe87-c730-4df0-a51b-1104d04f532c · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Unresolved cited work
Reference 61
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation f21578aa-b144-4895-94c1-0a92d105c0b9 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Unresolved cited work
Reference 62
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 4f5eb674-6310-4e38-89f9-e76c90d7e602 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Unresolved cited work
Reference 63
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 8f6aeceb-76b3-4941-9f63-e54b287d6aff · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Unresolved cited work
Reference 64
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation bad3c019-ddff-4c15-9f90-9b7593a92d39 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Unresolved cited work
Reference 65
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 5ac46d6f-82c3-43d0-a1d2-7b304b548185 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Regarding Accuracy, Summary A does X well, while Summary B struggles with Y
Reference 66
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 2661a80d-17e4-4de1-820d-106304b625a4 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF Overall Decision:
Reference 67
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation b0533bca-8468-4552-83e4-a6813b4cbb14 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF doi: 10.18653/v1/2022.emnlp-main.3
Reference 2022
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 21074c05-c255-462c-a146-800729a97539 · outbound
SCAR: Shapley Credit Assignment for More Efficient RLHF doi: 10.18653/v1/2024.emnlp-main.515
Reference 2024
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 619b6d7f-1445-49bd-87e2-8a004485d264 · inbound
Game Theory Meets Large Language Models: A Systematic Survey with Taxonomy and New Frontiers SCAR: Shapley Credit Assignment for More Efficient RLHF
Reference 124
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6fa6716e-04e7-41c2-a61f-c2dcbd4576e4 · inbound
Who Gets the Reward & Who Gets the Blame? Evaluation-Aligned Training Signals for Multi-LLM Agents SCAR: Shapley Credit Assignment for More Efficient RLHF
Reference 2025
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 8960c0f9-2673-479a-ae7b-632506a527a7 · inbound
From Reasoning to Agentic: Credit Assignment in Reinforcement Learning for Large Language Models SCAR: Shapley Credit Assignment for More Efficient RLHF
Reference 1
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation cf666e19-0e8c-438b-bb20-cd208cea4c1f · inbound
ARCA: Adapter-Residual Credit Assignment When Token Signals Degenerate SCAR: Shapley Credit Assignment for More Efficient RLHF
Reference 13
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 1f7f29c1-b6aa-4e99-aa72-7a6820d4e224 · inbound
When RL Fails after SFT: Rejuvenating Model Plasticity for Robust SFT-to-RL Handoff SCAR: Shapley Credit Assignment for More Efficient RLHF
Reference 140
Source-reported events for the cited work
No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.
Observation 033c1848-ef05-4e5d-80ec-ad830e59491a · inbound
S2T-RLHF: Hierarchical Credit Assignment for Stable Preference-Based RLHF SCAR: Shapley Credit Assignment for More Efficient RLHF
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9b46fde3-7666-4fc7-9a59-dc7a74bc6b9d · inbound
Element-Aware Group Learning for E-Commerce Image Generation SCAR: Shapley Credit Assignment for More Efficient RLHF
Reference 2025
Source-reported events for the cited work
Unavailable: canonical work link unavailable.