Paper Citation Record · LEDGER

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators

As of 16 August 2026, this Paper Citation Record lists 18 of 18 outbound references and 2 inbound Pith citation observations for arXiv:2503.06778.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2503.06778 v3

Coverage vector

measured 18 of 18 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-22T23:59:27.228553Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-15T06:32:42.880941+00:00

measured 2 of 2 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-29T21:36:22.389047Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-06-29T21:43:59.679289Z

Reference resolution

18 of 18 outbound references displayed

verified exact1
verified fuzzy7
unresolved10
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 036b47f6-3f3d-4a17-a733-fb33d56c5908 · outbound

This paper cites In 2012 IEEE International Conference on Intelli- gence and Security Informatics, pages 84–89.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators In 2012 IEEE International Conference on Intelli- gence and Security Informatics, pages 84–89

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-05-23T00:05:14.773332Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation c7da2b9e-57c2-4e4f-849a-f43e1f0e1fb6 · outbound

This paper cites Martin Riedl and Chris Biemann.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Martin Riedl and Chris Biemann

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-05-23T00:05:14.769065Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation b32719bc-b44b-438a-b58d-6cdea0a1f50e · outbound

This paper cites Are Expert-Level Language Models Expert-Level Annotators?.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Are Expert-Level Language Models Expert-Level Annotators?

Reference 3

Resolution: verified exact; arxiv_id, observed 2026-05-23T00:02:17.565591Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 78940c54-a6e8-45bb-863f-7b3b5390581d · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.765635Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation c1fccb54-fbcc-4c56-85ed-7c7b8f67dd79 · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.776536Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 56babd15-2d77-4f40-b523-fa8ecef76607 · outbound

This paper cites State-level is excluded from the database.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators State-level is excluded from the database

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-05-23T00:05:14.762740Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 2027c533-d31f-433b-8727-97b8c6d54266 · outbound

This paper cites In terms of economic goals, the exclusive pur- suit of profit does not satisfy this criterion.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators In terms of economic goals, the exclusive pur- suit of profit does not satisfy this criterion

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-05-23T00:05:14.757144Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation c8c519cf-45f6-431b-9e67-81cb44fe4428 · outbound

This paper cites It is the act taken as a totality that is considered, irrespec- tive if every individual involved in carrying out the act was aware of this intention.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators It is the act taken as a totality that is considered, irrespec- tive if every individual involved in carrying out the act was aware of this intention

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-05-23T00:05:14.753745Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 3783e175-a87e-4cae-bb2b-2714000051ac · outbound

This paper cites That is, the act must be outside the parameters permitted by international humanitarian law, insofar as it targets non-combatants.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators That is, the act must be outside the parameters permitted by international humanitarian law, insofar as it targets non-combatants

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-05-23T00:05:14.750016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation c317fe2b-1c9b-4a0e-96db-c2a084999fef · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.746470Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation d2fdc716-a724-4b63-9a36-ed76ccf4746e · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 11

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.742425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation db7f8cd0-245d-4716-a4ff-6a9ac7067db4 · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 12

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.738673Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 9392907c-b11b-43c2-b39b-1ac4f4b7d82e · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 13

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.735815Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 1a047fa0-7667-433c-b240-6a13e5bbdbeb · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 14

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.732864Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation d127e857-0606-4013-9d33-c91e4491e48f · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.729674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation a677b72b-abe8-48f7-b01d-cefec3203c38 · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.726730Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 463ebff3-f767-4b85-8603-88ee38f77172 · outbound

This paper cites an unresolved cited work.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Unresolved cited work

Reference 17

Resolution: unresolved; raw_fallback, observed 2026-05-23T00:05:14.779558Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 3e8c0690-ffbd-4535-bc4b-43b22c202345 · outbound

This paper cites Determine whether the following articles de- scribe the same incident: {article 1} {article 2}.

Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators Determine whether the following articles de- scribe the same incident: {article 1} {article 2}

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-05-23T00:05:14.723584Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Pith citing papers

Observation de931b22-7eff-4ee5-b9b4-0f9d11984113 · inbound

SMARTER: A Data-efficient Framework to Improve Toxicity Detection with Explanation via Self-augmenting Large Language Models cites this paper.

SMARTER: A Data-efficient Framework to Improve Toxicity Detection with Explanation via Self-augmenting Large Language Models Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators

Reference 5

Resolution: metadata mismatch; local_arxiv, observed 2026-05-18T15:52:42.305774Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation e3e9b147-a84e-4d9b-b1c5-8817be6572c5 · inbound

Double Triangle Annotation: A Scalable Human-in-the-Loop Framework for High-Precision Historical Document Annotation cites this paper.

Double Triangle Annotation: A Scalable Human-in-the-Loop Framework for High-Precision Historical Document Annotation Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators

Reference 1

Resolution: metadata mismatch; local_arxiv, observed 2026-06-29T21:43:59.680571Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.