Pith. sign in

Paper Citation Record · LEDGER

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement

As of 3 August 2026, this Paper Citation Record lists 21 of 21 outbound references and 0 inbound Pith citation observations for arXiv:2605.06283.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2605.06283 v1

Coverage vector

measured 21 of 21 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-08T10:32:15.938575Z

measured 21 of 21 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-03T06:30:56.289259+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

21 of 21 outbound references displayed

  • verified exact1
  • verified fuzzy10
  • unresolved10
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 9832c778-716b-484b-b9f1-5cc675053839 · outbound

This paper cites Can Large Language Models Be an Alternative to Human Evaluations?.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Can Large Language Models Be an Alternative to Human Evaluations?

Reference 1

Resolution
verified exact
arxiv_id, observed 2026-05-11T20:01:10.260954Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:06c1a8e61ba4558abaa6e37649b026ce2a7ffa52e8c51118488fe8b9202b3126

Observation 2168c922-7aec-494e-9e69-8aa812027445 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.946499Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:01b64df68143f29f8615c4b21c2e1ecd02dd767137a7590d73f22e4d1d2b84a3

Observation d1237a91-29d5-49a1-917a-f8a67d8393c0 · outbound

This paper cites Each score point on that scale is described by an overall statement which captures the essence of the response.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Each score point on that scale is described by an overall statement which captures the essence of the response

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.968788Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:178f7c61d4c36dca7e6d0bfeb93215cd9783927a0d83d9690574d03a376a1f72

Observation 0c46cafb-1e40-441b-bf80-62bd5d3ca631 · outbound

This paper cites Anchor papers are exam- ples of actual student work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Anchor papers are exam- ples of actual student work

Reference 4

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.951911Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:76a232e0d18027e29b7375721b079c1e705492c1745d0df17d8934eaeb64de89

Observation 071fadc7-f3a8-48c0-8602-38f952d9b725 · outbound

This paper cites Also, papers receive a score based on the work the student did complete even if they seem to be unfinished.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Also, papers receive a score based on the work the student did complete even if they seem to be unfinished

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.954280Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:1448c586f7d7d1e049280aaeb10c01e9fef2f0fb8d3a8e9ef1d1e2723f282973

Observation 9fd1820f-9b93-4beb-9c57-2481277c4c83 · outbound

This paper cites Prompt 4 Holistic Context Instructions.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Prompt 4 Holistic Context Instructions

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.949154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:efda9c4dc2c2e55b72d7b786cb6bad796d0de639818ff2a0a44ca6dff5b36014

Observation 842ca462-28d4-4554-8dc3-0e2c92ed037e · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.963124Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:d8997cf60f624108d016c0af66d1992dc1e010607f1802941247f113f4926ee7

Observation ca8167d1-4fc0-4873-a1ea-e2c85db5f02a · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.959940Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:18c25cd42a15694ace2248670efaddc4b5fcce6b271f021c5ee7497d9ca80e71

Observation c457ad2e-a217-446e-901f-83be0a7d8559 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.965503Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:4c84ac10fb5e951a376a26695db390f9deb6d89bad34e1b23b7ea95b287b7f48

Observation 2c6ac5b2-8e7a-4d94-8246-61442080613b · outbound

This paper cites Prompt 6 Holistic Context Instructions.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Prompt 6 Holistic Context Instructions

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.957378Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:3a79918a14a8df4a6f21be1a4db628f5621946eb7989d9c31512b5aa6bab8df1

Observation 34e0ee1f-039c-4e93-b4e6-9f3a7337224d · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.915697Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:a0da2f029c982fa0c26f4cf229d632ab8b8b732dd4b13c306391a4a6914213da

Observation 5e7bd8bb-6ecd-44a9-b5cf-90b3d652c8c3 · outbound

This paper cites You are not a teacher, substitute teacher, support staff, tutor, administrator, etc., who is currently under contract or em- ployed by or in schools, or under 18 years of age.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement You are not a teacher, substitute teacher, support staff, tutor, administrator, etc., who is currently under contract or em- ployed by or in schools, or under 18 years of age

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.929615Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:a573bfcec73f1118e872e890fca9509569c7d6016197f66df9fc776096e0d430

Observation 50839513-2525-4031-8747-3874af932a13 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.943722Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:820b974d6afd26acdabaa1f5a96ae3536d9637fb1054ce24b4a0ed4e7ba4c623

Observation dfe17bba-663a-4bad-a68c-58f25dabe1a0 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.925041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:40db535a8363eb2cf79cd37c76fc837c630367a917bcb8295f4d7f6e24922235

Observation 3cf3b326-37a5-482e-9f46-fa3d81baa3e3 · outbound

This paper cites Example of context given to an analytic prompt for separate (Prompt 1) Instructions.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Example of context given to an analytic prompt for separate (Prompt 1) Instructions

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.921770Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:ca7de96e864c56b167e9306da77fa04470342879c86b9e0f2aa79465e2975e3c

Observation 7c702ef3-d4c9-4a90-892a-683aecd3a20c · outbound

This paper cites Example of context given to an analytic prompt for edited (Prompt 1) Instructions.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Example of context given to an analytic prompt for edited (Prompt 1) Instructions

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.940942Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:13af37bf6fb089dc49c633f3e0f261e9f1193fb57dec0ed5ed4b43cac40b29f6

Observation 37904974-f614-4ba9-b39f-a37c82178661 · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.932227Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:4ca0df406bf91633edcbcd867e71f65471c849da55c74fbe0d4d3d9a1028ff00

Observation fb5b094e-b31e-4552-a78e-2326a8bfe01a · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.937936Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:870d46f90a3f40152e22196b6f1cad1e2e3ecc50ecabbe93a01eaa4b1000aee3

Observation a00ce2cd-227e-40c1-a1b1-c1ed8d50bed8 · outbound

This paper cites Anchor papers are exam- ples of actual student work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Anchor papers are exam- ples of actual student work

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.910825Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:10e99e4dfc7924ec49677b4f1b596543451db49a8f5ade21b50d98558866612c

Observation 9175e785-005a-4f54-82a2-df6566d28cab · outbound

This paper cites an unresolved cited work.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-05-26T15:07:51.918783Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:b7c8ab7a9430ff00ceaa1fc8d27941cc25912c6b05fda36a093dbdf4676f88fa

Observation a52a8574-f2de-425c-b9da-af52fab6b024 · outbound

This paper cites Does each sentence in the generated text use a second person?.

Quantifying the Statistical Effect of Rubric Modifications on Human-Autorater Agreement Does each sentence in the generated text use a second person?

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-05-26T15:07:51.935322Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-03T06:30:56.289259+00:00.

source=pdf_text observed=2026-05-08T10:32:15.938575Z digest=sha256:da67d501a718e751338e8a35792bd1c32fff5aa7c684c16e81ebc16f69fe3a48

Pith citing papers

No inbound Pith citation observations are available.