Pith. sign in

Paper Citation Record · LEDGER

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications

As of 10 August 2026, this Paper Citation Record lists 90 of 90 outbound references and 0 inbound Pith citation observations for arXiv:2507.00543.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.00543 v1

Coverage vector

measured 90 of 90 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T21:19:36.686958Z

measured 90 of 90 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

90 of 90 outbound references displayed

  • verified exact3
  • verified fuzzy4
  • unresolved83
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation f208de42-da86-466b-aba6-440229c53dad · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:29.585740Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:29.585740Z digest=sha256:365eea5dc5b4ae477510ec90e1a4463f718af1030e4ef6d9e6e61739de157269

Observation aa6ad3d6-b3d0-4dd7-b5b1-49aebbfbfdb0 · outbound

This paper cites GPT-4 Technical Report.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications GPT-4 Technical Report

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:29.708066Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:29.708066Z digest=sha256:8d65f4b63460afe4a1e71b174daa12517970f539e85130a91a2fda11c78b402b

Observation 8b6c09cc-aa09-43e7-9fa7-8be2f8e0c52e · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:29.823485Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:29.823485Z digest=sha256:f71de9871c7ed4c8000e01cd183f5f68beaf5ff74e10abb12e3aada9152fadce

Observation d91097c4-1416-4634-be00-1ee6a38a24cf · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:29.912778Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:29.912778Z digest=sha256:fc9a22df0dcccd3115a6fe7299a1216cd3a3a64efd3b0bfbc69385fc0a56b062

Observation 8f38635b-2d4c-4716-9281-c4c68ceef55d · outbound

This paper cites ConvAI3: Generating Clarifying Questions for Open-Domain Dialogue Systems (ClariQ).

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications ConvAI3: Generating Clarifying Questions for Open-Domain Dialogue Systems (ClariQ)

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:29.987752Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:29.987752Z digest=sha256:f22ccc31b835062ba056c79a057cce9dcb5dedf0cbf340f7746dbedcabb1c0d4

Observation 323ef50f-3074-48d6-91e9-a073e615086b · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.053765Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.053765Z digest=sha256:fd6cfa30f033adda0f67070ebcec71af28ec9baeabcd79bea5af719842feae70

Observation e3bfb64a-b552-4833-937c-372c05629403 · outbound

This paper cites Open-Source LLMs for Text Annotation: A Practical Guide for Model Setting and Fine-Tuning.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Open-Source LLMs for Text Annotation: A Practical Guide for Model Setting and Fine-Tuning

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.128678Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.128678Z digest=sha256:7bcb39ee9b0517fc4fdc77c40adc68667a59d1895956e2f416d02a277207281e

Observation a4fd6f73-ee9e-40f4-805d-b9ab2a71de22 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.184851Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.184851Z digest=sha256:67bb9ed87a848f70c1448a599a3cb41242a37e81493189479874fe855049f865

Observation 24698dc7-efde-41d7-b489-220aa8141ec9 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.295072Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.295072Z digest=sha256:64efd278ae7c2d426923a952860e08614263120e1168e285875df8b7f0353363

Observation bbdf3594-e652-4a39-b68a-59832cb7dc02 · outbound

This paper cites Using Large Language Models for Qualitative Analysis can Introduce Serious Bias.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Using Large Language Models for Qualitative Analysis can Introduce Serious Bias

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.368240Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.368240Z digest=sha256:227874c0fb0b04622d757861b516f394e0310b1441903a050af19dadcc3a4a62

Observation e5961797-b856-4e45-ad50-440762131f20 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.461442Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.461442Z digest=sha256:841f8a5c7d04045c40bdd8b8e8f2cacaa7981dfb3e2ea77877296cededef6cfd

Observation b71c7d7f-70c5-42e7-a326-d5e2b115f097 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.533403Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.533403Z digest=sha256:fadc6948e245581bdf4c2025f2fb4ebac36e5e1e70a7f1f30debd79f166ba1fd

Observation 7ecd7e20-d194-46ac-bb3a-7cfac7870e20 · outbound

This paper cites Human-in-the-Loop through Chain-of-Thought.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Human-in-the-Loop through Chain-of-Thought

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.612792Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.612792Z digest=sha256:854f3f120f13d6f5ab1cf09bef1502c2df3c86d910a0c4b4b61815c27be447a3

Observation f1358a98-5999-4dc4-a645-689f5ab20764 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.660894Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.660894Z digest=sha256:54ea14676d64ad0155409596352812c773b4d93ab1fa602fed94ebf26274a599

Observation aae7b140-6371-47d1-a3fe-a3515e382254 · outbound

This paper cites Certainly Uncertain: A Benchmark and Metric for Multimodal Epistemic and Aleatoric Awareness.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Certainly Uncertain: A Benchmark and Metric for Multimodal Epistemic and Aleatoric Awareness

Reference 15

Resolution
verified exact
local_arxiv, observed 2026-08-06T21:19:37.356797Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:30.714069Z digest=sha256:28b7623c8bfb0763e2d80b831a1809b278a2e0c13bce923b388665d2478d82cd

Observation e9a5e465-4954-4228-a72a-ab5e00cdc9c7 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:45.046231Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:30.795212Z digest=sha256:79ab87162dea7de9f3d9a9df00d874ab148e38af0113173b0d652015f9efcb25

Observation 3bed86ab-039b-4fdf-af0c-27bb37dca73d · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.847584Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.847584Z digest=sha256:bfe13586d3cd623faf6b9bbae2f368fea63a2e5a81b67c2a0154b20edd646715

Observation 74789b3a-e980-4a7a-8219-14db7e9ed10e · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.911374Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.911374Z digest=sha256:357e9315729f250862d2204d5ed1ff552b8793479621263fb267c78e36de5303

Observation 72d5eb7f-ac54-434b-8534-2eff34c81a1f · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:45.022895Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:30.993112Z digest=sha256:9fcb34860c28236667802ebc0104c918453ac450fa5a6673099b8e6755846f6e

Observation 2f9169e6-95a5-4b30-8748-d14e31d0f188 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:45.009301Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:31.054206Z digest=sha256:681200ad1948ab7a8e9b6f3c439b596134b855b44b8dee3adf6c53bb3c431280

Observation f98c4201-2b26-46da-9ad9-c5834d3e9eeb · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.996357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:31.156987Z digest=sha256:8a87311e69a69844a067595c3621f670f64e281760709f963f98c33fba62efd5

Observation b4044ef6-6361-4417-abef-b18b20c96c4b · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.984318Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:31.283169Z digest=sha256:a0ce8c5f73b1172256dcad6da3a15a7d0061df291d50d3c467628c7fef165d9d

Observation 9471724c-504f-42d6-aeaf-c028aa4399ff · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.971990Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:31.373466Z digest=sha256:4c22584d11031d247eea8ee146239f7d02a7ec68dbb1ea206675ecc3f4500501

Observation 2beb8373-5170-4a46-9dbe-cb3944e4a71c · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.959731Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:31.445013Z digest=sha256:9cb4a8434dc8cfd0bb22302184b32a95c999695ddbecc5ef803e880eed294ecb

Observation 4c963ea0-ad86-494a-be59-7d9fa6aef930 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.947383Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:31.524587Z digest=sha256:6f95ff846ead4434fc42923bf2cc9ea373b0ff1c5f2bad9472d2ea3e57669563

Observation 741f0943-23d7-4e97-a828-35f987c12e2a · outbound

This paper cites Human-like Summarization Evaluation with ChatGPT.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Human-like Summarization Evaluation with ChatGPT

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:31.638854Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:31.638854Z digest=sha256:de4b58bd2c7836a89f981f92dbdae730528500dfcfea3bb93d754f186552f47b

Observation 24836614-28c6-43ca-8d52-f6841c3c8888 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.934112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:31.699804Z digest=sha256:0ea9ec205aa8963985647772c88bb41f48f4cef667101ea6068eef1506c1868d

Observation 7cfdd01d-72ac-4dd9-8362-076bce053c85 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.920766Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:31.781634Z digest=sha256:ad923d713f06e46457196cf94df8ca138aa530b1435b9a5fdd23d0f747a5b424

Observation e37c2423-9605-4d99-9eae-ff0683d39f4b · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.881455Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:31.916147Z digest=sha256:1103be05f7d78c9a912ccff41491461d14c437df6ec7f8f0826142482dd9ed39

Observation 8252f34b-37c0-491c-acc4-d297333591db · outbound

This paper cites AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotators

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:32.068733Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:32.068733Z digest=sha256:f941cf6a10899c9d108d2027a99d395c674a04ed330aa4e874b69b2ea9eedb85

Observation 744240b1-a9c3-4861-9b7c-7f5e1a3c2709 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.704344Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:32.148617Z digest=sha256:80ee394f58cb572064826949b4bd3b06f051d65adacf97122ce610458a044302

Observation de2af80b-c916-4f40-9282-f7fb0376ff64 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.482755Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:32.217327Z digest=sha256:90ca263e88184146fbc803f4d8be784c36c65a9ee43861a243aa50740a1a986b

Observation 14bcecc0-956a-4dfb-a98c-fd84c555027f · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 33

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.289792Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:32.287755Z digest=sha256:aa8dedf166dc7e21ca82a2a746fbbd6619a41efff55ebe1a1dc4d81c1ede9687

Observation 2313358e-8bed-4535-88be-ecfff32d778c · outbound

This paper cites Mistral 7B.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Mistral 7B

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:32.355153Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:32.355153Z digest=sha256:0fddde60a8c4ce9cc80c01b1036b10f55b280d9df5d04548eed18179ce7b4252

Observation 7223a35f-4d8f-4ca0-b418-d1c4109b338d · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 35

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:44.115480Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:32.443102Z digest=sha256:2926bb5e63fa7569ad99642ecbeb590066c5291b4e2b7de2759de9ebdf9704cf

Observation 3c920925-dc2b-4e55-908e-b14dfa18af2c · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:43.915002Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:32.513781Z digest=sha256:3ed76580cbf2af78702b66d423b4e7d4b3306513f7f73a1b73c7dc98c37c372b

Observation f3eddd78-1e54-49a7-9275-a3cb6d94c53a · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:43.630919Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:32.592919Z digest=sha256:b5cfb06713fdd359ae62e6223c38af8f2a907fe2682993a7d3c08b06af5c1991

Observation cca0811f-8ae0-4310-96f9-6b8ed28f557a · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:32.770330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:32.770330Z digest=sha256:df5fb199abbaab2d01a3c1816d664eaddd199d8ba2f7fc606c8476a93d62e546

Observation 1e7bf7c2-3ab5-46f3-a77d-2bf89799e67b · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:32.861616Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:32.861616Z digest=sha256:6f50bf9717fcb2a254931b9357892e2287d8b1fddf26bfb644e33c0aecdb5d93

Observation b9855cc4-d1fb-4b0b-b56a-43dccb4cc917 · outbound

This paper cites In Pro- ceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications In Pro- ceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics: System Demonstrations

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T21:19:43.516601Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:32.686033Z digest=sha256:f35624a7e6ad77b79bd34a651ad24e9425c55b380df954d911230aca3499b616

Observation 6270cbd3-db6f-47bf-a7bb-ecafc7c5d13a · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:43.243793Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:32.972794Z digest=sha256:18dbb0ad946e0176dcd12a09d69a2d1b985cc9ff864f7caad60b5932939f5df4

Observation d4b7f0fb-bb43-4819-9e47-58fc403f8260 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 42

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:43.118614Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:33.060668Z digest=sha256:b45b5615414121701970080cc00ea0b49239bef985f44f952dc1b1e9bcd43fa4

Observation ce7dca65-e762-4b00-bafc-209a83c06f22 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:43.392040Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:32.928138Z digest=sha256:2ff5cfaf1eea35b10f3710e45435ec1ec5fbde08a3ec454deee38b40691a6d87

Observation f4a04aa4-e2ec-4c82-bd03-a7c96a355230 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:42.883963Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:33.216201Z digest=sha256:b2e94fa7bf337da2aef4c7fdb6c78ee9468ad32a497457e68cd147f712096294

Observation 55e1d1cb-daa1-47a2-bbc9-3928e15b3bde · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:42.765347Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:33.306156Z digest=sha256:73e1e61d95867638f6260ebbe1302e8e40ceb0e425740db903d3249e70cc29f4

Observation fd99e1b9-1e85-4779-91c5-6cc705f51825 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:43.006565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:33.144519Z digest=sha256:b806504016d38321a93345e3b68b23d3f73e8ffeee3023de825d6af1134533f1

Observation d469ef17-cb17-4b70-9262-71a8bcd8de0e · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:42.182331Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:33.510281Z digest=sha256:cdffca0e6b93b74449643d0097254759d6452095c5a9fcf2cdfa0d995b658473

Observation df3d9e5a-3ea5-4af6-b0e2-2d80da52dbd4 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 48

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:41.833966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:33.622570Z digest=sha256:4f5dac516dfcd5c3d8478e665c4f0ab1e6930e07b1d0c635fb9698f14222ce94

Observation 41a766e7-025b-4323-8150-47c8020dec75 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:42.496124Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:33.359616Z digest=sha256:121092ce57c2b20c8d20e82e5dd6e088fa13b7b33ce24e7eee45b1d23acdd4fd

Observation 9a2f2919-faa9-4511-92fe-c55ce7dc46b1 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:33.801992Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:33.801992Z digest=sha256:801e4220bbd253565af818298280042ab6be5fa8764878cfa47cf9d99f89ed50

Observation 893c1800-3066-463f-9d8c-315ef13d2789 · outbound

This paper cites Keeping Humans in the Loop: Human-Centered Automated Annotation with Generative AI.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Keeping Humans in the Loop: Human-Centered Automated Annotation with Generative AI

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:33.867799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:33.867799Z digest=sha256:2512e828e2ea87b0e6c514ff10c1e0f2a201ed9245c6da0608afddafa3bc0e1d

Observation 9a9bef9a-7f14-4ae9-bcf6-4a8afc2e38a6 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 52

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:41.488330Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:33.713502Z digest=sha256:cdcda776f4b79702f77ff54d457ae32086f65e0b6c26b469b8c53f0b73ccd505

Observation 8119ca48-50ac-4a3b-811e-c0e5f3cce48e · outbound

This paper cites Large Language Model Confidence Estimation via Black-Box Access.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Large Language Model Confidence Estimation via Black-Box Access

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:34.050237Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:34.050237Z digest=sha256:dc11bd0ccda8f0b0247bf42d2a7d52bb25a454b1b47c970d440953baaa943404

Observation 3f2177d5-209b-414e-92e9-6e3e91c792c1 · outbound

This paper cites LLMJudge: LLMs for Relevance Judgments.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications LLMJudge: LLMs for Relevance Judgments

Reference 54

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:34.141231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:34.141231Z digest=sha256:7a55f6232e9554d0ec3b2ad8fad33360b695e7410376a920de7feea178bc9f3e

Observation dbac3210-2636-4df4-aac0-fe356c764e7f · outbound

This paper cites Automated Annotation with Generative AI Requires Validation.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Automated Annotation with Generative AI Requires Validation

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:33.977301Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:33.977301Z digest=sha256:4591049ef429a03655f7ffb90719cf82226bbe031b7f38b3abfe390d9b6cf812

Observation b47afd9e-46c5-418e-9b40-7346e54d8ce0 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:41.146772Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:34.306809Z digest=sha256:269f3177c92992c942764b8a3aec1492447cac5b7f90dcb01c5db9777e114aa9

Observation e07c1e9a-bec2-430b-906b-f21badc5222c · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 57

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:40.791149Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:34.380583Z digest=sha256:0a2d5f1201303a41bb389a908de6dac3215d5efbf81aba42f5e8cf2aebf6e641

Observation 7cf48a22-342a-467c-85f3-49af76bb632a · outbound

This paper cites Testing the Reliability of ChatGPT for Text Annotation and Classification: A Cautionary Remark.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Testing the Reliability of ChatGPT for Text Annotation and Classification: A Cautionary Remark

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:34.215880Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:34.215880Z digest=sha256:a74fe1c86c9167e390b150c87cccef90e2a7ab1c33b7da10cb462f6815a36193

Observation 496a43bf-eef8-424b-9c8c-abbf40d282f7 · outbound

This paper cites Don't Use LLMs to Make Relevance Judgments.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Don't Use LLMs to Make Relevance Judgments

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:34.559687Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:34.559687Z digest=sha256:619928f071be0e1bdf0876032ce01d8aa7947f5bc4eae84cce7202fc3368c416

Observation 6ecb0b64-59b4-4132-b579-c962fc95a026 · outbound

This paper cites Confidence Estimation for LLM-Based Dialogue State Tracking.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Confidence Estimation for LLM-Based Dialogue State Tracking

Reference 60

Resolution
verified exact
local_arxiv, observed 2026-08-06T21:19:37.046406Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:34.661463Z digest=sha256:fc8ccb2670ad7ac91f5f0a223b199da2715fcd52dba4a18c7cbc17f409a0e2a8

Observation a58deb4d-dbbf-48a4-9c0c-5e921d3e6860 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 61

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:40.431598Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:34.458914Z digest=sha256:d2abdbc62c2fd87a188caea446ec152b706cd8e31af9a1e8a5ad5ed2bbd28afa

Observation 7184185f-8af1-4535-90a7-985e5629e148 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 62

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:40.128947Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:34.819545Z digest=sha256:499d078c798827a2232799b19c6e97b64a84e8233c91f46e33709999549eb625

Observation 82ff5340-e2c1-4227-9102-88bacb5a226e · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 63

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:39.786576Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:34.899547Z digest=sha256:adb692942f8d7d70e0570efecb3f40720dc38e8067a3a29ac333c82c79db984e

Observation 9889b8c6-be3d-46b0-b873-933210bc6e01 · outbound

This paper cites LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help?.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help?

Reference 64

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:34.737761Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:34.737761Z digest=sha256:5f5e75ae4f5d73cf274f103bcd7b5c58d57c2dc1229253b48e440e846bcda688

Observation 0d1eed7d-6936-4e68-8ae6-62fcf24a0eb4 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 65

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:39.449079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:35.074221Z digest=sha256:3ed4ec25caf8991a2598752005211074a29a71ee0df689084d62419518716099

Observation 59040f85-48c5-497d-aad7-46160ca8301d · outbound

This paper cites ChatGPT-4 Outperforms Experts and Crowd Workers in Annotating Political Twitter Messages with Zero-Shot Learning.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications ChatGPT-4 Outperforms Experts and Crowd Workers in Annotating Political Twitter Messages with Zero-Shot Learning

Reference 66

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:35.155795Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:35.155795Z digest=sha256:0aaf57be6b8157e67b1972179425577ee4c0baf2104b978ae8702b97e8b59b09

Observation 398fe303-5172-4a07-8765-a9a37d0a6b8f · outbound

This paper cites Large language models can accurately predict searcher preferences.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Large language models can accurately predict searcher preferences

Reference 67

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:34.975946Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:34.975946Z digest=sha256:38709ab847357d28288f2502b3d8e429f2c9887db47879adc84ab3b042556c8e

Observation 36767d8b-666d-47eb-9376-6c25ddaeb1ef · outbound

This paper cites A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look

Reference 68

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:35.295196Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:35.295196Z digest=sha256:d82317cdd9e85abb4ece63b2aaf132e8690ec4b265bb18203c7cae63a613b79d

Observation 5daa4733-52fe-4620-924e-66d265864a3b · outbound

This paper cites Voorhees.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Voorhees

Reference 69

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T21:19:39.074380Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:35.392447Z digest=sha256:912983f150551852850e1e969ed0ea18c42d5caa1327cdd060002d9304f8d4c0

Observation c8d00bf7-4e14-449f-9062-bc83927bc18a · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 70

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:35.233676Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:35.233676Z digest=sha256:189f0120d3dc4441a39c168cb57a3294763f34d0a0f5c278eefa05ea7bcd0b02

Observation 96bd77ac-1376-4e47-8ae8-8f103d4e81c7 · outbound

This paper cites Large Language Models are not Fair Evaluators.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Large Language Models are not Fair Evaluators

Reference 71

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:35.600481Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:35.600481Z digest=sha256:8eb5463233fc7efe666592ebaa6f6ec8b8636a338ea8c0a44f1d504d715fc531

Observation 734ba7e8-ed15-4d6e-9e1d-bffd1d974143 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 72

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:38.580529Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:35.679063Z digest=sha256:b0542baaa81e7bf39114884667e0378ce00a215049c63c9cbde7e7118eccafe4

Observation 88c43384-5337-4fa0-aa91-cf677064c977 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 73

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:35.729471Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:35.729471Z digest=sha256:07848f94b1e6160484bcc00027a626d751f26942db828e0a70aedcea93f2b088

Observation 441ae689-ca96-41a6-b5ca-9dbdf7364f64 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 74

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:38.790724Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:35.521371Z digest=sha256:eb20a02ca38154b760d53b9028247917d05fe1319cdc4e55ac64aa3626a31e6d

Observation 0756f31f-bb3f-4e3c-9ed9-38d72b43b733 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 75

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:38.240780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:35.974024Z digest=sha256:861ad3b044e51618a29e82780f5364b79346f446b2a0017f6748a944af1436e4

Observation c30289ea-f9ec-44f5-8e8e-7795af3d9dd8 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 76

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:38.037118Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:36.028672Z digest=sha256:facb2a4d4c7b9abbe5d5fa72066484a4620801dc9965a3527c6afe0be7091fa7

Observation 965d2f41-a4c6-44af-bb6a-c0470d9a7861 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 77

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:37.883230Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:36.126538Z digest=sha256:db0a93fd77ef083b7d5f87e94d143991a8a2da6b655990d1fec48f4fc0c57093

Observation e25c87f3-fdff-4c8a-89f1-467102b768fe · outbound

This paper cites In Proceedings of the CHI Conference on Human Factors in Computing Systems.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications In Proceedings of the CHI Conference on Human Factors in Computing Systems

Reference 78

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T21:19:38.340042Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:35.813118Z digest=sha256:3b05710f249970a2e8b1175b8eb3767de21a0f308e4bb6ef27bd443ac38ff3d2

Observation 3eda6db4-60f4-4369-a821-f0ac6e6a1f7e · outbound

This paper cites Aligning Large Language Models with Human: A Survey.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Aligning Large Language Models with Human: A Survey

Reference 79

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:35.876176Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:35.876176Z digest=sha256:35baae312cd97cbf22367c2e134627376901ceb9bef72f2fb7cc24032618c93a

Observation c0ac5555-e499-43e7-a818-af96c4f153a4 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 80

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:36.419307Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:36.419307Z digest=sha256:e6d362cfbf3cd0bd3fd1425b4f2764195332f22657cd1f37cec09b03652a14e9

Observation 93c2f745-2741-448f-989d-c211c74e6153 · outbound

This paper cites Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Can ChatGPT Understand Too? A Comparative Study on ChatGPT and Fine-tuned BERT

Reference 81

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:36.498252Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:36.498252Z digest=sha256:91d0c7278df300357ebc16baa5f6eb437dfa6be78bb427be62b72e40a624f349

Observation 90100463-4cc6-45e7-a7b6-bf6efaca33ff · outbound

This paper cites Large Language Models Are Human-Level Prompt Engineers.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Large Language Models Are Human-Level Prompt Engineers

Reference 82

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:36.567977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:36.567977Z digest=sha256:13543e5c56b0ba3c64e37c0a6299eca35c7a029789ff1f4d2064c7abd677892d

Observation ef0bcfd4-59a0-4d8e-aecf-b0a830c732a3 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 83

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:36.213237Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:36.213237Z digest=sha256:45ba51e1fc92b39d3c14e273d724bef58d2e7b4aa77b64e57938779b9e035643

Observation 83311a57-26fc-4ff6-a92c-a7465324b56c · outbound

This paper cites INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning

Reference 84

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:36.686958Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:36.686958Z digest=sha256:acbdbf085e7cf5416dc3ed84ffa814ffbd8ce33d58250c0d19b25ad4371b560d

Observation be712188-273b-49a4-858b-bebf8dbe1729 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 85

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:37.658093Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:36.350079Z digest=sha256:4c5d07d7d2952cd96e1f19cb78f3d5df487cc0d1beee41bcbbc81a1d50790e35

Observation 80656fcd-669a-42a2-8655-a89e0c5fe34e · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 89

Resolution
unresolved
raw_fallback, observed 2026-08-06T21:19:37.535868Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:36.629083Z digest=sha256:edeeebcbed3dafa07c5ea2ad0276e7d012be42cf8fa6d0c28baf616cb92207d0

Observation c505bb44-c619-4488-b093-62a1266549d3 · outbound

This paper cites an unresolved cited work.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Unresolved cited work

Reference 716

Resolution
verified exact
doi, observed 2026-08-06T21:19:36.818949Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:35.454461Z digest=sha256:75b6951e0a5f0c0a735e0ef4655a62d1f0a847c59d94bd5c400f09c2335a5e4f

Observation 66fdd4e7-8ddd-4efc-b8b8-d991b600690b · outbound

This paper cites In Proceedings of The Web Conference 2020.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications In Proceedings of The Web Conference 2020

Reference 2020

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T21:19:37.765190Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-08-06T21:19:36.274256Z digest=sha256:8b88f183e0ff735f99a9334d1b38bffa60851f29d3fc1e5ccb08c972cc271274

Observation d9ee5d5b-1a92-4d24-bd32-664317f39040 · outbound

This paper cites Can We Use Large Language Models to Fill Relevance Judgment Holes?.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:29.629492Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:29.629492Z digest=sha256:f9558e9023a8124d3a0437848dc71c1c2d25602a1d4cce06ada8dff68627d015

Observation 10294345-feb5-448a-8501-494f8dc84b39 · outbound

This paper cites Journal of Computational Social Science 8, 1 (2025), 1–25.

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications Journal of Computational Social Science 8, 1 (2025), 1–25

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-06T21:19:30.239881Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T21:19:30.239881Z digest=sha256:e8ace435741e67c9bd1aaecf4bc67e56ce8f4ad159648959631d061f9269591a

Pith citing papers

No inbound Pith citation observations are available.