Pith. sign in

Paper Citation Record · LEDGER

Rater State Bias in RLHF Preference Data: An Audit Framework

As of 9 August 2026, this Paper Citation Record lists 64 of 64 outbound references and 0 inbound Pith citation observations for arXiv:2607.16195.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.16195 v2

Coverage vector

measured 64 of 64 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T16:22:43.961967Z

measured 64 of 64 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

64 of 64 outbound references displayed

  • verified exact5
  • verified fuzzy0
  • unresolved57
  • parse uncertain0
  • malformed identifier2
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 084d44c5-e294-425d-915c-b488beef04f5 · outbound

This paper cites Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei.

Rater State Bias in RLHF Preference Data: An Audit Framework Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.816602Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.816602Z digest=sha256:006394c79fa8b5705bf51d47e611f7ebe6460ef267a383b4be623e95f9e229d3

Observation 1c17dd9a-bd2e-41fd-87eb-f00f3d48659c · outbound

This paper cites Training language models to follow instructions with human feedback.

Rater State Bias in RLHF Preference Data: An Audit Framework Training language models to follow instructions with human feedback

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.819806Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.819806Z digest=sha256:4b8aa2322bfd9cd1406e1339463263e9c213fdadb2ecede451e39513f808e9b7

Observation 838797b2-39b5-4fe3-af65-0c8c3157c4f1 · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.822119Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.822119Z digest=sha256:24ad04c9f78c20b670b9c02f27d96ccc2ce8043b2953191a7b3b619bf147b30a

Observation 05089b5a-d15f-4c47-87c2-df4a91aa4dbe · outbound

This paper cites NLPo- sitionality: Characterizing design biases of datasets and models.

Rater State Bias in RLHF Preference Data: An Audit Framework NLPo- sitionality: Characterizing design biases of datasets and models

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.824952Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.824952Z digest=sha256:326fb70b150ed5f0d50aca090359ebc5494967846d09055daafc78081768942c

Observation f2fcf41c-f25e-4192-b40e-8a250c190a85 · outbound

This paper cites Gordon, Michelle S.

Rater State Bias in RLHF Preference Data: An Audit Framework Gordon, Michelle S

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.827349Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.827349Z digest=sha256:16dbf912bde9b524e6f6f532f903b11950e3591264a4a5fe6f3a3a387955d95d

Observation f04f14b4-3fa5-4eb9-b1b6-72a142774208 · outbound

This paper cites Truth is a lie: Crowd truth and the seven myths of human annotation.AI Magazine, 36(1):15–24, 2015.

Rater State Bias in RLHF Preference Data: An Audit Framework Truth is a lie: Crowd truth and the seven myths of human annotation.AI Magazine, 36(1):15–24, 2015

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.831944Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.831944Z digest=sha256:6d45bcf19ca730f14b5c25cbb8d6e8fb6f5c56bedbf35335c0e06891ada50bb4

Observation 3af34338-b788-4208-91ed-1e8d1ecf0d8f · outbound

This paper cites The “problem” of human label variation: On ground truth in data, modeling and evaluation.

Rater State Bias in RLHF Preference Data: An Audit Framework The “problem” of human label variation: On ground truth in data, modeling and evaluation

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.834517Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.834517Z digest=sha256:080a9c198a085e330d7e24dde5753120d0fb2b8f9938cfacebdeeb3f9fc22491

Observation ede7f414-bae7-4ff3-af50-907bebd9e89e · outbound

This paper cites Dealing with dis- agreements: Looking beyond the majority vote in subjective annotations.Transactions of the Association for Computational Linguistics, 10:92–110, 2022.

Rater State Bias in RLHF Preference Data: An Audit Framework Dealing with dis- agreements: Looking beyond the majority vote in subjective annotations.Transactions of the Association for Computational Linguistics, 10:92–110, 2022

Reference 8

Resolution
malformed identifier
no resolver link, observed 2026-08-02T16:22:43.836967Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.836967Z digest=sha256:a91295a98eded2c04bc97eb8e4c96b3057bacaee5d428512169cf1328209d328

Observation 62355181-bc2b-4d37-a12e-3c4338c7388f · outbound

This paper cites Gray and Siddharth Suri.Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass.

Rater State Bias in RLHF Preference Data: An Audit Framework Gray and Siddharth Suri.Ghost Work: How to Stop Silicon Valley from Building a New Global Underclass

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.839738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.839738Z digest=sha256:395a43e9db20c2d179426d10d5ef38ecc23e0874286b64eda877a7f6a4bc9e47

Observation 73966c39-c097-414d-9490-5d97e5ca70b9 · outbound

This paper cites Roberts.Behind the Screen: Content Moderation in the Shadows of Social Media.

Rater State Bias in RLHF Preference Data: An Audit Framework Roberts.Behind the Screen: Content Moderation in the Shadows of Social Media

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.841881Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.841881Z digest=sha256:5d6b609c728cbe6209380d29a3c4364eeb3a3b814b4e4d4f8a7ede5321641e18

Observation ca714fd2-f0c1-409a-84ec-3fdd7dd4b881 · outbound

This paper cites Incorporating worker perspectives into MTurk annotation practices for NLP.

Rater State Bias in RLHF Preference Data: An Audit Framework Incorporating worker perspectives into MTurk annotation practices for NLP

Reference 11

Resolution
verified exact
doi, observed 2026-08-02T16:24:02.909900Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-02T16:22:43.843986Z digest=sha256:194761d8ec52b769317d1e8fd8082400ba89fba6a85e7ac4837138d48c6a682a

Observation 16e0434f-9546-4ef5-87ca-280826a39a01 · outbound

This paper cites Analyzing dataset anno- tation quality management in the wild.Computational Linguistics, 50(3):817–866, September.

Rater State Bias in RLHF Preference Data: An Audit Framework Analyzing dataset anno- tation quality management in the wild.Computational Linguistics, 50(3):817–866, September

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.846420Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.846420Z digest=sha256:3ab4f8eabb18f1c63839706206557cf90ced0d0c98e1e3d9715ad42237c6f5a8

Observation c4a97cfa-2167-448e-95a6-de2396d1b732 · outbound

This paper cites Discovering Language Model Behaviors with Model-Written Evaluations.

Rater State Bias in RLHF Preference Data: An Audit Framework Discovering Language Model Behaviors with Model-Written Evaluations

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.850952Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.850952Z digest=sha256:15996b978fc282d18d99c5ea814fd979d449d12b5275de8200ac1b879825c5af

Observation 04bb209c-e75c-4d06-a5ca-91007072748d · outbound

This paper cites Towards Understanding Sycophancy in Language Models.

Rater State Bias in RLHF Preference Data: An Audit Framework Towards Understanding Sycophancy in Language Models

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.853514Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.853514Z digest=sha256:f594d53411cdb5384f56358358c2372ab35544b094b2f8c0c408e4be6c286862

Observation 078accd6-2358-4db9-8db6-8aaa86422955 · outbound

This paper cites Procaccia.

Rater State Bias in RLHF Preference Data: An Audit Framework Procaccia

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.856125Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.856125Z digest=sha256:4226405995ea26f374c038af919dfcb08cba8ebb7e1c9ca64c80f436c39d47e1

Observation 9f172cd5-dace-4aed-9541-6d3a8c27824b · outbound

This paper cites A survey on intersectional fairness in machine learning: Notions, mitigation, and challenges.

Rater State Bias in RLHF Preference Data: An Audit Framework A survey on intersectional fairness in machine learning: Notions, mitigation, and challenges

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.858377Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.858377Z digest=sha256:b47e4014882c814a447a0f00a2511acd1d0649dea64063e2a2050de6ab44c25c

Observation d3c5f64d-7351-4b6b-9c7d-d17dcc66250c · outbound

This paper cites Scaling laws for reward model overopti- mization.

Rater State Bias in RLHF Preference Data: An Audit Framework Scaling laws for reward model overopti- mization

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.860923Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.860923Z digest=sha256:126d348afec0d245781290fe57c90c4593391708e7055e1569751244f94606b1

Observation c101aeed-a13c-4375-bc23-474edfb88b27 · outbound

This paper cites Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms.

Rater State Bias in RLHF Preference Data: An Audit Framework Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.863555Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.863555Z digest=sha256:a5398f55a9054fb5d919d4b7ef5560d43ae70cac3c2d844d7f8cffa49672bd4d

Observation 5cbb23cb-9415-4682-84ef-57d145869c67 · outbound

This paper cites Men also like shopping: Reducing gender bias amplification using corpus-level constraints.

Rater State Bias in RLHF Preference Data: An Audit Framework Men also like shopping: Reducing gender bias amplification using corpus-level constraints

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.866634Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.866634Z digest=sha256:53e81017bb33841614c8e72c9c85a3b9f88e5876a76f9a44cac365441cb18af8

Observation 3c450bc8-9232-4ac7-a061-45d7681b9cdc · outbound

This paper cites Directional bias amplification.

Rater State Bias in RLHF Preference Data: An Audit Framework Directional bias amplification

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.868680Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.868680Z digest=sha256:d158642410e1d992952b0b0fe3950be298134a7df6be40b782c038aab16dace0

Observation b3acaeac-c525-4fc9-b1c8-b8a5b32a3757 · outbound

This paper cites A Systematic Study of Bias Amplification.

Rater State Bias in RLHF Preference Data: An Audit Framework A Systematic Study of Bias Amplification

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.870674Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.870674Z digest=sha256:690cd6ceda2528e456aef871af81fdd8d9bcba314feeb9367c4c37b6ac4441ea

Observation e7af49f6-515f-4ccc-bb2a-a0271021b1e9 · outbound

This paper cites An Effective Theory of Bias Amplification.

Rater State Bias in RLHF Preference Data: An Audit Framework An Effective Theory of Bias Amplification

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.873098Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.873098Z digest=sha256:727850b9dd5fc27256487c3c270c296ef263fd60258f3615ab3bff9df14c6dce

Observation cc998d77-1e6c-40d0-aebb-6d64d9e6efa7 · outbound

This paper cites Pennebaker, Ryan L.

Rater State Bias in RLHF Preference Data: An Audit Framework Pennebaker, Ryan L

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.875494Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.875494Z digest=sha256:94704da99c0e502f9474d7b644ac7cb4e299b33d1cbc492d738a400ad31580ec

Observation 6ba803b2-bf2d-49ab-8c4c-55a19c48fd0b · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.877484Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.877484Z digest=sha256:fc5d5cdb2cb1ec3d9e3bb2460cf633904fed6dfa59b293204ec077fbe582227e

Observation d28a753e-9ab8-4a50-b1b4-29f3107b9943 · outbound

This paper cites Mohammad and Peter D.

Rater State Bias in RLHF Preference Data: An Audit Framework Mohammad and Peter D

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.879812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.879812Z digest=sha256:a23d570182e033149c9e8a0a22b8e18578f087a0857784e130688da128a9ba92

Observation 1ac62b7a-f5b9-4304-ba0b-b953f8eb2701 · outbound

This paper cites GoEmotions: A dataset of fine-grained emotions.

Rater State Bias in RLHF Preference Data: An Audit Framework GoEmotions: A dataset of fine-grained emotions

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.882036Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.882036Z digest=sha256:5625e48c8d344d398fc7c2331d724bdba02565e6b6e2946e0a9ad88be5acda30

Observation d645810e-e238-4cd2-8dbf-618fd1560f92 · outbound

This paper cites Towards empa- thetic open-domain conversation models: A new benchmark and dataset.

Rater State Bias in RLHF Preference Data: An Audit Framework Towards empa- thetic open-domain conversation models: A new benchmark and dataset

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.884189Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.884189Z digest=sha256:b69695d457172aa00cbbdd3917c3b61775368d09caaec47b630794b2c95979fc

Observation 2eae4f2c-d52f-4b5c-b74b-ce42caaec621 · outbound

This paper cites Basic Books, 1969.

Rater State Bias in RLHF Preference Data: An Audit Framework Basic Books, 1969

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.886207Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.886207Z digest=sha256:b7668cd2107e72511699da0a329e1ea89592f73e7cf0dc04d6a95c2c0ce49d9e

Observation f5954eb4-91f9-4d6b-b93b-14cd742ed739 · outbound

This paper cites Shaver, and Daphna Pereg.

Rater State Bias in RLHF Preference Data: An Audit Framework Shaver, and Daphna Pereg

Reference 29

Resolution
verified exact
doi, observed 2026-08-02T16:24:02.687749Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-02T16:22:43.888483Z digest=sha256:3dc5ca605d7ef2e91a5e34fd9d5842fd195f9e3ddb5508467214286cf0b89cc9

Observation 3a301433-c54e-4fb8-9c35-6a262111ec4c · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.890793Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.890793Z digest=sha256:a26553084cb76614c138451599d9a33b909bbda7192d832501f6609513ba2a98

Observation 55d6efff-048b-40a1-bdf3-f149476a9b01 · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.892636Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.892636Z digest=sha256:27734e3b6ad8d6370afc5ff24f000e3129c44c952981965d3bd42ce4fbe7b28c

Observation c16e0f71-701a-4044-9096-e9ae3a974496 · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.894564Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.894564Z digest=sha256:59ac6a661d8d38cb54fb7ffea0987593767c3277cf8e0a488c450a0a9a8ed0f4

Observation 614d75bf-8c0c-48a2-a645-8bffe771d031 · outbound

This paper cites Truax and Robert R.

Rater State Bias in RLHF Preference Data: An Audit Framework Truax and Robert R

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.896701Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.896701Z digest=sha256:b78e94cbd5664a5b819f7f931130702aad0888094e58425763e980b2ea4b2b19

Observation 0305f818-b175-4cd4-920e-e8efeb7aebd0 · outbound

This paper cites Stern.The Interpersonal World of the Infant.

Rater State Bias in RLHF Preference Data: An Audit Framework Stern.The Interpersonal World of the Infant

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.898531Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.898531Z digest=sha256:73a5c9883a0ee23f44bc37fa6e1a85bde427594548860cff6acb3711085726f8

Observation dd600a0b-a0c2-4a1b-8a81-991827375c16 · outbound

This paper cites Feeney and Nancy L.

Rater State Bias in RLHF Preference Data: An Audit Framework Feeney and Nancy L

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.900468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.900468Z digest=sha256:ecadd38f2f3bcd0e5a093d6461219b5f61c6528422a362ab0d9b8154910b12a1

Observation 3ae04b27-e69d-4d16-a4b7-8963835c34c1 · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.902232Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.902232Z digest=sha256:fcdda49a17465e1ba609cafb8301f0caa70dbe03f63e39119a1595f86e6a25ec

Observation 40e6dc80-0923-4c83-b7cf-0f3015506024 · outbound

This paper cites Exclusive: OpenAI used kenyan workers on less than$2 per hour to make ChatGPT less toxic, January 2023.

Rater State Bias in RLHF Preference Data: An Audit Framework Exclusive: OpenAI used kenyan workers on less than$2 per hour to make ChatGPT less toxic, January 2023

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.904650Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.904650Z digest=sha256:dfe3dd50b7651c87e37ecdf010cff46887e4054ac34e61cac507b3e9a4ba560a

Observation d0b5ea29-34c7-4473-8085-db6cc0910a2f · outbound

This paper cites Kenyan workers with AI jobs thought they had tickets to the future until the grim reality set in, November 2024.

Rater State Bias in RLHF Preference Data: An Audit Framework Kenyan workers with AI jobs thought they had tickets to the future until the grim reality set in, November 2024

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.906587Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.906587Z digest=sha256:b703710a87b24bf3e49dc7ac210cdcae6699046f96d8606e0ba862b9b5b4d571

Observation 40a1e518-2b40-495d-9109-a8d025d86529 · outbound

This paper cites SF tech startup Scale AI, worth$13.8b, accused of widespread wage theft, December 2024.

Rater State Bias in RLHF Preference Data: An Audit Framework SF tech startup Scale AI, worth$13.8b, accused of widespread wage theft, December 2024

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.908326Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.908326Z digest=sha256:3809bfa7f5bfc56ff3b542c326aa14b2242142661b4f508e60bc1427dc7c44c6

Observation a11c5c7b-5d03-4788-adaa-6879185f201c · outbound

This paper cites What is an intracluster correlation coef- ficient? crucial concepts for primary care researchers.The Annals of Family Medicine, 2(3): 204–208, 2004.

Rater State Bias in RLHF Preference Data: An Audit Framework What is an intracluster correlation coef- ficient? crucial concepts for primary care researchers.The Annals of Family Medicine, 2(3): 204–208, 2004

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.910334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.910334Z digest=sha256:12cb22544e285e5214223e86819c67f1d3741b013366b9b090d1dcaf64212cc1

Observation 98a5743c-b42c-43f1-8743-80cc040278d4 · outbound

This paper cites John Wiley & Sons, New York, 1965.

Rater State Bias in RLHF Preference Data: An Audit Framework John Wiley & Sons, New York, 1965

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.912329Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.912329Z digest=sha256:d0f0784beaa36c9ef3e453f74bdf4b9eea6c67d2f733593450aa421cefe8fdd2

Observation 569fea05-c1c7-4857-b135-3cafd5cc7d03 · outbound

This paper cites Thompson, Douglas H.

Rater State Bias in RLHF Preference Data: An Audit Framework Thompson, Douglas H

Reference 42

Resolution
verified exact
doi, observed 2026-08-02T16:24:02.443365Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-02T16:22:43.914130Z digest=sha256:b0cf68a2d4e86afeb7a0b861ffadad2891ed0ad65938d5488c1a889e21825887

Observation 9be8f67b-cfee-4408-b03c-c889f152c5f3 · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 43

Resolution
verified exact
doi, observed 2026-08-02T16:24:02.266790Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-02T16:22:43.916499Z digest=sha256:873d95a6eb9ab155311725f4c8c40ade15b3e29631c92aed6595daacc5c87b14

Observation 114e80ec-929d-4fed-a94a-67ab4e386bdb · outbound

This paper cites Deep Learning is Robust to Massive Label Noise.

Rater State Bias in RLHF Preference Data: An Audit Framework Deep Learning is Robust to Massive Label Noise

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.918789Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.918789Z digest=sha256:9b57b43af172f362ac4cc1ff8dbee02ca1c890c99a50da465c904735adf2635d

Observation cdbb0533-4d06-45b9-a71c-49bbbe02b012 · outbound

This paper cites Dhillon, Pradeep K.

Rater State Bias in RLHF Preference Data: An Audit Framework Dhillon, Pradeep K

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.921124Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.921124Z digest=sha256:4d676f7d7b87307295774fb9c8fc32076c4953a3b24dd9e3dfe537c8f0156be0

Observation 17c0234a-babc-4955-955f-17dc5c3ba8c0 · outbound

This paper cites Learning from noisy labels with deep neural networks: A survey.IEEE Transactions on Neural Networks and Learning Systems, 34(11):8135–8153, 2023.

Rater State Bias in RLHF Preference Data: An Audit Framework Learning from noisy labels with deep neural networks: A survey.IEEE Transactions on Neural Networks and Learning Systems, 34(11):8135–8153, 2023

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.925958Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.925958Z digest=sha256:1589d1860c087a086755d357f8252bb52c88e09253eead49486792cc995d21d3

Observation 48634d05-a5de-47f4-b151-7d97aea37079 · outbound

This paper cites Bharucha, Sukrit Venkatagiri, Martin J.

Rater State Bias in RLHF Preference Data: An Audit Framework Bharucha, Sukrit Venkatagiri, Martin J

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.928812Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.928812Z digest=sha256:ed6c79fa8d0378350f33f2897cd39bcdbfb1d58e71f4b3b40c2d716f5807a34a

Observation 3968aab4-6931-43d4-849c-0a64d71f3c9f · outbound

This paper cites ‘it’s destroyed me completely’: Kenyan moderators decry toll of training of AI models, August 2023.

Rater State Bias in RLHF Preference Data: An Audit Framework ‘it’s destroyed me completely’: Kenyan moderators decry toll of training of AI models, August 2023

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.931017Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.931017Z digest=sha256:439031706578b45cf818c70bd737db839b5adeba23f440a74c4782e82931de42

Observation 10d13d61-9499-4106-b0c6-668458e87668 · outbound

This paper cites Kim, David K.

Rater State Bias in RLHF Preference Data: An Audit Framework Kim, David K

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.933129Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.933129Z digest=sha256:07c2d60f2dc081e36b2852d6f9aefd28331581ff5f97140232b33e85f6252701

Observation 6abdc2c6-cd85-4d17-bbf5-44bc97196052 · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 50

Resolution
verified exact
doi, observed 2026-08-02T16:24:02.054809Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-02T16:22:43.935320Z digest=sha256:0a1183dd531932930340e847000fec59790dd3ac457ae85aa312d2ab10a43e3f

Observation f10761a4-5f7c-4bfb-be2e-3ee7c97c3056 · outbound

This paper cites On the universality and cultural specificity of emotion recognition: A meta-analysis.Psychological Bulletin, 128(2):203–235, 2002.

Rater State Bias in RLHF Preference Data: An Audit Framework On the universality and cultural specificity of emotion recognition: A meta-analysis.Psychological Bulletin, 128(2):203–235, 2002

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.937699Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.937699Z digest=sha256:5951dd80986adf883fc7f9566fe8dce27a7e5ec4fae5d6190438ef1ab7fafdc2

Observation 15230fa5-cbcd-4983-a875-d9061c5145c1 · outbound

This paper cites Heine, and Ara Norenzayan.

Rater State Bias in RLHF Preference Data: An Audit Framework Heine, and Ara Norenzayan

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.940104Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.940104Z digest=sha256:7fe0285a1d536d797ecefaa42f51e7b89640ded5390b88a433dede6d07900566

Observation 1a07ba85-303a-4629-8c93-00e17026092e · outbound

This paper cites The GPT-4o shock: Emotional attachment to AI models and its impact on regulatory acceptance: A cross-cultural analysis of the immediate transition from GPT-4o to GPT-5, 2025.

Rater State Bias in RLHF Preference Data: An Audit Framework The GPT-4o shock: Emotional attachment to AI models and its impact on regulatory acceptance: A cross-cultural analysis of the immediate transition from GPT-4o to GPT-5, 2025

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.942251Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.942251Z digest=sha256:c3518c74952c08b33ab444c0761a087833b33018f0e1a7cfdcf3bb595d36e0d4

Observation b0284220-2b6c-419a-abdd-99d935bda08a · outbound

This paper cites The backlash over OpenAI’s decision to retire GPT-4o shows how danger- ous AI companions can be, February 2026.

Rater State Bias in RLHF Preference Data: An Audit Framework The backlash over OpenAI’s decision to retire GPT-4o shows how danger- ous AI companions can be, February 2026

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.944311Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.944311Z digest=sha256:9a1259d9592779cbc9babdb1f9b34c0393270a453db1cb50b4ee4d0ad7c6b5d4

Observation fd27ff06-3ae9-4c25-a211-9066c38ee42d · outbound

This paper cites Barsalou.

Rater State Bias in RLHF Preference Data: An Audit Framework Barsalou

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.946319Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.946319Z digest=sha256:05f77857049ff74c9ad9075f9d7e1d08bae8acff1ee693447dba578d395893d5

Observation 0887bbb8-331d-40bb-b304-c7a76969be59 · outbound

This paper cites Feelings-as-information theory.

Rater State Bias in RLHF Preference Data: An Audit Framework Feelings-as-information theory

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.948415Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.948415Z digest=sha256:33662e5dacdb5b106389a9d4cc623dac25565d89ec3c7066830b29fb54431d79

Observation 4564dc3c-3a6d-4949-9d12-f2e1694c0d0a · outbound

This paper cites When human-AI interactions become parasocial.

Rater State Bias in RLHF Preference Data: An Audit Framework When human-AI interactions become parasocial

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.950760Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.950760Z digest=sha256:9a55d3688abf2fe56b07a5f133b0b9de27446340ee8e6121f4cb8af1ed7dde12

Observation c05c9c1a-cba9-4649-9876-235b98f50186 · outbound

This paper cites Continuum, 2005.

Rater State Bias in RLHF Preference Data: An Audit Framework Continuum, 2005

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.953334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.953334Z digest=sha256:43269b0b210e2643fc253d890a8a7812bd7e75de9f985106ffbc494e0a9319a7

Observation c838e419-26ba-472c-87e3-c20d242c2968 · outbound

This paper cites Dailydialog: A manually labelled multi-turn dialogue dataset.

Rater State Bias in RLHF Preference Data: An Audit Framework Dailydialog: A manually labelled multi-turn dialogue dataset

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.955314Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.955314Z digest=sha256:26b9df800082496a07cb97ed77df8aef7062c8b53245fd6c72be38e3d71d01ae

Observation 2791cd16-ca4a-49e8-b3a7-033d30f686f5 · outbound

This paper cites How AI and Human Behaviors Shape Psychosocial Effects of Extended Chatbot Use: A Longitudinal Randomized Controlled Study.

Rater State Bias in RLHF Preference Data: An Audit Framework How AI and Human Behaviors Shape Psychosocial Effects of Extended Chatbot Use: A Longitudinal Randomized Controlled Study

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.958241Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.958241Z digest=sha256:81187b6cd9af11b5919bf4887918f3772af7a1bbcea227abb164549aa23ef904

Observation f1882e12-ff35-475b-8e79-8631ca515a65 · outbound

This paper cites Investigating Affective Use and Emotional Well-being on ChatGPT.

Rater State Bias in RLHF Preference Data: An Audit Framework Investigating Affective Use and Emotional Well-being on ChatGPT

Reference 61

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.961967Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.961967Z digest=sha256:0522a500c6d92a0c3830f4fc7275ecaedde37cca97b85dc6501c2d3de5001c44

Observation 9b537275-6c1e-4f81-9ce2-38c3dd86324a · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 2013

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.923727Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.923727Z digest=sha256:fc1218c81eb5e63b75af9d1c1fe555f2190d34b8cc7d7fde4a3aa939c584a5e6

Observation 4823dbd9-dc98-4276-bcbc-c8982578e3bd · outbound

This paper cites an unresolved cited work.

Rater State Bias in RLHF Preference Data: An Audit Framework Unresolved cited work

Reference 2022

Resolution
unresolved
no resolver link, observed 2026-08-02T16:22:43.829641Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.829641Z digest=sha256:2fb796840a4fb967ac409679d4fc9b66e0afff8b9cf472b6d3dd64aa17d189eb

Observation fa7504ad-88c7-413b-b7bc-d3c5fde75226 · outbound

This paper cites URL https://aclanthology.org/2024.cl-3.1/.

Rater State Bias in RLHF Preference Data: An Audit Framework URL https://aclanthology.org/2024.cl-3.1/

Reference 2024

Resolution
malformed identifier
no resolver link, observed 2026-08-02T16:22:43.848580Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T16:22:43.848580Z digest=sha256:9a61433ff9037272fca2ddead3c62392ab38c301ca96516a168f92afd53be41a

Pith citing papers

No inbound Pith citation observations are available.