Paper Citation Record · LEDGER

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks

As of 9 August 2026, this Paper Citation Record lists 18 of 18 outbound references and 1 inbound Pith citation observation for arXiv:2507.15821.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.15821 v1

Coverage vector

measured 18 of 18 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T15:27:04.289211Z

measured 19 of 19 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-09T06:31:02.800959+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-06-29T18:26:08.996052Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-06-29T18:33:50.911769Z

Reference resolution

18 of 18 outbound references displayed

verified exact0
verified fuzzy15
unresolved3
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation d086f73d-4787-448f-8ec2-25c9bea2dfe8 · outbound

This paper cites My church helped me find alternative childcare during the pandemic.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks My church helped me find alternative childcare during the pandemic

Reference 1

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.725168Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 8ccdfd48-7b60-4061-ad7d-500d555038fc · outbound

This paper cites My church helped me find alternative childcare during the pandemic.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks My church helped me find alternative childcare during the pandemic

Reference 2

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.707407Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 2131aaf9-b762-4022-bfa0-98ad3aa74ff2 · outbound

This paper cites A community health person came to my school and explained what was going on in the pandemic and the latest research on masking. So that’s when we started masking.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks A community health person came to my school and explained what was going on in the pandemic and the latest research on masking. So that’s when we started masking

Reference 3

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.687199Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 70bb3772-657e-4c77-801e-3dd7eb7c3734 · outbound

This paper cites We would have been so lost without the food bank that restocked each week.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks We would have been so lost without the food bank that restocked each week

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.667512Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 1425df20-68a1-4e81-809b-db18167ac5e3 · outbound

This paper cites I just couldn’t get over how scary it was that my sister had this reaction to the vaccine. I know it could happen to me. So no I did not go through with the vaccine.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks I just couldn’t get over how scary it was that my sister had this reaction to the vaccine. I know it could happen to me. So no I did not go through with the vaccine

Reference 5

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.642096Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 103873b0-598a-4456-b47f-977e582a7bf9 · outbound

This paper cites Helping at my church made me feel like I was making a difference even though the world was going crazy.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks Helping at my church made me feel like I was making a difference even though the world was going crazy

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.618656Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation d6026bd4-ae28-4aa2-a4cb-2485cd240e96 · outbound

This paper cites Talking about this has made me remember how hard that period was for our family.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks Talking about this has made me remember how hard that period was for our family

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.598047Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 9ab69242-ac60-4f4c-8a11-15cba93d521e · outbound

This paper cites an unresolved cited work.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks Unresolved cited work

Reference 8

Resolution: unresolved; raw_fallback, observed 2026-08-06T15:27:04.416792Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 91dcad6f-df35-4297-93a4-42737a7e2882 · outbound

This paper cites will tell you anything just to get your vote.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks will tell you anything just to get your vote

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.571375Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 2e74af17-72bf-4fea-80de-09a0b7383e7f · outbound

This paper cites The responses and resources intended to support healing from those traumas.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks The responses and resources intended to support healing from those traumas

Reference 10

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.544734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation c4ceb4ac-d423-4e8c-9f3c-b5c3e6c2db86 · outbound

This paper cites • Street Violence: Refers to situations like street fighting, assaults on the street, unintentional harm of bystanders, etc.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks • Street Violence: Refers to situations like street fighting, assaults on the street, unintentional harm of bystanders, etc

Reference 11

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.525888Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 517a50fd-3645-4fb3-aa91-243e2803ae0a · outbound

This paper cites • Transportation: Public transportation like the buses and trains, quality of transportation, affordability and accessibility of transportation, safety of public transit.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks • Transportation: Public transportation like the buses and trains, quality of transportation, affordability and accessibility of transportation, safety of public transit

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.500881Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation e57be86a-b6e2-4a3c-940e-4859ed779a8b · outbound

This paper cites • Housing Instability: Difficulty paying rent, having frequent moves, living in overcrowded conditions, or doubling up with friends and relatives.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks • Housing Instability: Difficulty paying rent, having frequent moves, living in overcrowded conditions, or doubling up with friends and relatives

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.476799Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 80be85e4-8876-4c51-acf2-a4819980854d · outbound

This paper cites Quality and nature of those relationships.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks Quality and nature of those relationships

Reference 14

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.454535Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation 513195d5-d151-40fb-8b9e-84dfe0ef8e57 · outbound

This paper cites an unresolved cited work.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks Unresolved cited work

Reference 15

Resolution: unresolved; raw_fallback, observed 2026-08-06T15:27:04.434837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation b5f4488e-283f-447b-a37f-a3a372277e89 · outbound

This paper cites annotation_schemes.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks annotation_schemes

Reference 17

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.396681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation cc38ea48-1c16-4715-9557-d564b8152848 · outbound

This paper cites Community Life: Community Resources.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks Community Life: Community Resources

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T15:27:04.377536Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.

Observation c2b645b4-8125-4f13-aa1f-d0ae38348701 · outbound

This paper cites ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks.

Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks

Reference 2023

Resolution: unresolved; no resolver link, observed 2026-08-06T15:27:04.188426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

Observation 3362b7a2-33c7-45fc-ab47-ec2a29372362 · inbound

Telenor Nordics Customer Service self-help corpus cites this paper.

Telenor Nordics Customer Service self-help corpus Just Put a Human in the Loop? Investigating LLM-Assisted Annotation for Subjective Tasks

Reference 12

Resolution: verified exact; arxiv_id, observed 2026-06-29T18:33:50.913258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-09T06:31:02.800959+00:00.