Pith. sign in

Paper Citation Record · LEDGER

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity

As of 9 August 2026, this Paper Citation Record lists 32 of 32 outbound references and 0 inbound Pith citation observations for arXiv:2608.04463.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.04463 v1

Coverage vector

measured 32 of 32 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T23:42:20.824820Z

measured 32 of 32 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

32 of 32 outbound references displayed

  • verified exact3
  • verified fuzzy3
  • unresolved25
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch1

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 3d856f8c-e6df-4be4-822f-96c2ae7ce2ee · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:22.121314Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:16.513334Z digest=sha256:4dbea466fee0f61320072e2e4bae94cee98fede8ae5082bfaa45a8e097e72976

Observation fff7da8b-4467-4195-ac35-49c897914a3d · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:22.100702Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:17.291632Z digest=sha256:0614942262f98d32f094983dda50f672096da3acdbdec94b9695a821ec806a4a

Observation dceace40-0f5b-42da-9618-5445ebe84097 · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 3

Resolution
verified exact
doi, observed 2026-08-06T23:42:21.221348Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:17.680160Z digest=sha256:42ccb5c82a3542edffb6b94c775d7f69fd9fda441e1d160fb9f9b20bf6d81f6e

Observation ece0d6f4-9224-40b0-adde-1afd7597bcab · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:22.075076Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:17.837379Z digest=sha256:d8f8ce4fff81b9a3048e03c0c46b6419dccf4d200f1800fa70141e174a590952

Observation 8516f171-cc71-4753-93f9-f0660078a12b · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:17.988468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:17.988468Z digest=sha256:4ecca969035ef73a01767dffb3f02fbcb313fcf94e0cdd7bb0a8a4318165eed3

Observation 3199f565-13e8-445d-9ba8-3f5f21128cc1 · outbound

This paper cites Herd Behavior: Investigating Peer Influence in LLM-based Multi-Agent Systems.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Herd Behavior: Investigating Peer Influence in LLM-based Multi-Agent Systems

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:18.137522Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:18.137522Z digest=sha256:3ebd95077d80bcee809a46cb2893f42d7313f2be02a8cd12e4463c3bd74b33bd

Observation 0e8a6225-c0b1-4230-a99c-8ad8264b2168 · outbound

This paper cites Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:18.148787Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:18.148787Z digest=sha256:bf02df1c5c13972a596d8e005624101ff1d772158372aa5194c0349411dd9dd4

Observation 85b02130-3d5b-4239-8892-22f3590edfcc · outbound

This paper cites Tenenbaum, and Igor Mordatch.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Tenenbaum, and Igor Mordatch

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T23:42:22.049678Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:18.215779Z digest=sha256:4f9fdde052e27c57d73635f874ce100e8af4fae6e6a46babbf22bd3dbae6b926

Observation 67e27f39-12db-4a9a-9bb0-284bf7212b6f · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:22.033591Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:18.411039Z digest=sha256:707e74fcdbb34268cb4b28750b13bf5cf20138ee426ceae66e200df07d5ce731

Observation 4f108ed1-3817-456d-b473-5d795d301393 · outbound

This paper cites Gemma 2: Improving Open Language Models at a Practical Size.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Gemma 2: Improving Open Language Models at a Practical Size

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:18.525054Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:18.525054Z digest=sha256:b135eef35d4b6e4fa709498eccefc1b7c893fdd9942bc70bc7ff9205458964cd

Observation 4e552a74-9d89-4253-be5d-acdb3b3b8689 · outbound

This paper cites The Llama 3 Herd of Models.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity The Llama 3 Herd of Models

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:18.633603Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:18.633603Z digest=sha256:a6fe76aaeda180acf0a67ebd077eb3e337dadf63da4704203501ba7eb7d9df4d

Observation 4bcc6a75-0609-4606-8027-158e51ecccb5 · outbound

This paper cites It's Not Always Sycophancy: Measuring LLM Conformity as a Function of Epistemic Uncertainty.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity It's Not Always Sycophancy: Measuring LLM Conformity as a Function of Epistemic Uncertainty

Reference 12

Resolution
metadata mismatch
local_arxiv, observed 2026-08-06T23:42:21.819679Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:18.735495Z digest=sha256:d0e486cf9b68ba2d3cc294780e17b50a46dd3313d55d3f32306d8cf382aa72ac

Observation ba5984bb-9254-4818-8295-d779d9508916 · outbound

This paper cites Hoffman and Andrew Gelman.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Hoffman and Andrew Gelman

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T23:42:22.014268Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:18.864821Z digest=sha256:f3145e23cc56101186f0df34fddb867856ace92143ffaff2bcce71814e6b1bb1

Observation 82acde84-9c05-4c31-a919-a8e79edc9df8 · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:19.017895Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:19.017895Z digest=sha256:16329112e3a82a512e45b8ef8bc6f33f1bf96083f8ba0057537c3563259e787f

Observation 695ca1b3-a818-4708-a9ea-c42f08a0d3ac · outbound

This paper cites Most LLM Conformity Needs No Speaker: Measuring the Speaker-Free Floor in Peer-Pressure Benchmarks.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Most LLM Conformity Needs No Speaker: Measuring the Speaker-Free Floor in Peer-Pressure Benchmarks

Reference 15

Resolution
verified exact
local_arxiv, observed 2026-08-06T23:42:21.794341Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:19.134818Z digest=sha256:5510eb21736f6f5b484f72536167d2d3e66325bacdf03db2c7fbe6856cbf11a1

Observation 60ade3c8-464c-4831-b71e-742820af860b · outbound

This paper cites Mistral 7B.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Mistral 7B

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:19.256974Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:19.256974Z digest=sha256:eb5b432e4453afdd43c56963f7c0c982c05870369da244633e5346ce52d11aea

Observation 2685f72a-87bc-47df-93b8-845d11d775ef · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:21.997167Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:19.370553Z digest=sha256:43e3873a64a395a9e3957ccb5f84dc2bf49754a5933411a4c209afa979366c0a

Observation d550353e-7b4d-4160-b748-31da75cae6c8 · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:19.505833Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:19.505833Z digest=sha256:68253e744fbfdfec16a362a23afaeaec56c5141e75232956a6cc773807415316

Observation 27f180c6-f44b-4daf-91a5-ba50bdc8ec44 · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:21.964071Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:19.665078Z digest=sha256:58f342b42d202caabc630ca3b5bc4ca54dc4fe2be956b33039b89a2a3f4d839c

Observation 49c6e7e3-4cda-44cf-86bc-6239c0381352 · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:19.785754Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:19.785754Z digest=sha256:0a6d633bb11d7effaca2b6bfd314828ffa72fd233a267edb8cdf66cb2307bc41

Observation af6783c9-db6a-4e21-8308-88df468b0c66 · outbound

This paper cites Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Composable Effects for Flexible and Accelerated Probabilistic Programming in NumPyro

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:19.851810Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:19.851810Z digest=sha256:bdc663fe163ed913d85e8c3af5380f0d5eb0cda4014d2f4cf4dbd3453b2c3379

Observation 36d6bedb-c083-4a13-a275-e9504dc4234a · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:20.001478Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:20.001478Z digest=sha256:2fae143818d0f8f617d4e4d4251565dc9c6057817391bb3c72a5ae12bed5a504

Observation 6ddab794-17be-4124-903d-35e1c399e69c · outbound

This paper cites Easier to Mislead Than to Correct: Harmful and Beneficial Revision in LLM Conformity.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Easier to Mislead Than to Correct: Harmful and Beneficial Revision in LLM Conformity

Reference 23

Resolution
verified exact
local_arxiv, observed 2026-08-06T23:42:21.565319Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:20.132531Z digest=sha256:4c387c18d5042d5e1d5e0c88d0a7b517239512028516cc563d590ef9c76c795a

Observation a96f5d90-1c8a-4ce4-b923-6715104a54c6 · outbound

This paper cites When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviour.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity When Large Language Models contradict humans? Large Language Models' Sycophantic Behaviour

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:20.275733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:20.275733Z digest=sha256:3a449f7f5aca20308deea5f2600d2cc936aa62c7baabc6b1f3f97c0bc534173f

Observation 4b5e46ef-e38d-4dec-82ca-7a17eed7ea8c · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:21.945589Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:20.354948Z digest=sha256:3875a54c79a5ed48005a4d6856db91e8867023724c7777b728ada893a3e3010d

Observation 3cec911e-20ca-4c68-a027-3d1632fb5a97 · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:21.926099Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:20.429412Z digest=sha256:f8d0b846c8b5949a700d0650545020e45123817ca16b9de24ab59c452ec7ef12

Observation dcfe79df-f2d7-412c-9b34-e01bb50dddef · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:21.910226Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:20.490969Z digest=sha256:47d856e399e966bacce78d33128c56846654c6413de35abc5f09384899f08d84

Observation 454677fc-d46a-43dc-adbb-365cf29df915 · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:21.891993Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:20.574762Z digest=sha256:6f8f87e84ac26ad5a627c327c7770d2a1e93b025739593b7597403d449d8fdb4

Observation ef22d428-7555-4cca-949a-74054eabb730 · outbound

This paper cites Self-Preference Bias in LLM-as-a-Judge.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Self-Preference Bias in LLM-as-a-Judge

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:20.634672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:20.634672Z digest=sha256:04faadbfbd008bf2c3054116eb5002375d8a5af754cf0e27ec1e2f04db88774d

Observation fb09f51e-6958-4ca4-8429-d67aa84da6ec · outbound

This paper cites an unresolved cited work.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-06T23:42:21.874702Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:20.732500Z digest=sha256:c5759921bc80083027ba727507db626dd7a921dc258c731d15a2b328ed215879

Observation 7e9a0995-3c0f-4df6-83a7-4db87e03bd36 · outbound

This paper cites Qwen2.5 Technical Report.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Qwen2.5 Technical Report

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-06T23:42:20.812060Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-06T23:42:20.812060Z digest=sha256:bc385d9009d15e68a8d76c0b2656920ebe054b3b3bad812bf1fb144ce30ccbc9

Observation 64a8ce92-1a42-4515-824e-58be52460140 · outbound

This paper cites Weinberger, and Yoav Artzi.

The Evaluator Is Part of the Experiment: Measuring Open-Ended LLM Conformity Weinberger, and Yoav Artzi

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T23:42:21.857351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=arxiv_source observed=2026-08-06T23:42:20.824820Z digest=sha256:d56630aae472be177eb097d8e685cc6f82210543faa13c639d84de47edf4ac95

Pith citing papers

No inbound Pith citation observations are available.