Pith. sign in

Paper Citation Record · LEDGER

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems

As of 12 August 2026, this Paper Citation Record lists 57 of 57 outbound references and 0 inbound Pith citation observations for arXiv:2507.07924.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.07924 v1

Coverage vector

measured 57 of 57 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T18:34:46.191064Z

measured 57 of 57 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

57 of 57 outbound references displayed

  • verified exact1
  • verified fuzzy1
  • unresolved55
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 60b43399-20ac-4854-a4f5-58b9184837a8 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.893727Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.893727Z digest=sha256:dde60a5879a4b13e046448504a64a5fbc862b7444b1340f48f469fe17fc031f4

Observation 8e1f742d-1d54-4ef5-91b9-8eb7316151c1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.167572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.903920Z digest=sha256:71d83712eacef8793e5edaa3cc172d3bbbba75177f878f7e16d095e729da25d1

Observation 4e0fe0b1-70de-4ceb-9362-07412b97b242 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.151628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.908651Z digest=sha256:4184daef926a239e38b5a4f4fdd64588f6fd00c4383c5926331ba7726eb18093

Observation fd410787-82a7-47c8-b6a8-db2e38a61add · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.136949Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.913365Z digest=sha256:ab6aeeac330555e421ca6be0d5fa638c5bdae50096443d679092ea06ff3a4a08

Observation cea8f4c9-6b31-4f3e-aa80-f43bbc339433 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.121345Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.918336Z digest=sha256:86eabcb3a0b3cd6844fe2cae021c8f7091649e071b02f111dd1652d004f6e220

Observation 0a558aa9-ab42-4ec2-85be-426ac4f9bd81 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.106776Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.922651Z digest=sha256:1210635614443c82a73b2598f652591dddb6c9f8543a30e86013ddeb2258e649

Observation 8f182f2d-c0ec-4ddf-82a4-9d5953c62c10 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.091848Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.928384Z digest=sha256:760dc8b94307459da1de01d018c700440a7ff2e6a03c66ab65997a6a6a983f0f

Observation c398df54-5182-422d-be8f-e608025c282d · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.076928Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.932813Z digest=sha256:37417dd34890cd0c446eee238b7b67be8a4195fcc86e30fbc1f83d8f3aed982a

Observation 9450e197-d373-4499-8ad2-ffd84ec6eac5 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.061751Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.937422Z digest=sha256:82bebaee638bf14dd01c84ea463816fb4016974474414285b29f05900f2d8ee2

Observation bed375c1-f9b8-4883-95e8-7e84eecd6452 · outbound

This paper cites Overview of the TREC 2020 deep learning track.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Overview of the TREC 2020 deep learning track

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.942093Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.942093Z digest=sha256:74e2555ab007125eda50f7ee2ae359948487baeed9c6f585750e7162739b9a64

Observation d076a121-96bc-4154-9af5-bb263ca68686 · outbound

This paper cites Overview of the TREC 2019 deep learning track.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Overview of the TREC 2019 deep learning track

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.947206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.947206Z digest=sha256:214a326d1fecda544a09875a8be7fa444357ba6ca56e408488ddbae82472776f

Observation 79dd812b-8bf9-46db-8368-582237c87042 · outbound

This paper cites The Llama 3 Herd of Models.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems The Llama 3 Herd of Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.952508Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.952508Z digest=sha256:1d27aa5bc74cb9d2b639c04f0a5767c38730ef2302845e71980e115328d57a5c

Observation 21843c68-a25e-4be1-8ca5-820c1ae3ebc0 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.046893Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.957060Z digest=sha256:73156c9f0b2eab5533fe9279bfae2035ef3c968e78352b300ff53fbce21a84ff

Observation 13ffcf20-c539-4acb-965b-41252026b37a · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.031564Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.961916Z digest=sha256:793aa829e3d6a99d52de54497d8d4627b0124717c0eea0d4041db84ff07535f7

Observation effb50a9-16a5-4f38-9071-7ced31bcc648 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.016488Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.966474Z digest=sha256:8d47e67ab1da06b82e3f2eab34145bc8ee12687987a7c01bdd04a882897b3cdc

Observation 4a0500b7-371c-466a-8959-94764f5bd2f1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.001685Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.972546Z digest=sha256:ba748953d574f51efcc407facb6a4c539a3182ae9843181938296d2382f05a29

Observation 0135dc01-5db8-4320-9924-00a47b89ceb5 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.986149Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.980893Z digest=sha256:263f72ec506650a396cad6f6d820aec748797ff6efa24beef0ee867e71a6e000

Observation 6a6452ff-0022-4355-9dac-e1eb49b49006 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.971089Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.986074Z digest=sha256:b6224c85967806269b0262df231e43fe7a3bd21f648591c9a48d8f9a83f31cd3

Observation de26fbdf-850c-40a6-9743-f50cf896668c · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.956709Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.992292Z digest=sha256:f61e5c4135a71ebdd529196221d5b7dd8e99125fa3dac83549fb0a0d55bd7863

Observation b5160d1b-784f-4c3e-b0c3-45c8877def9c · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.940456Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:45.996525Z digest=sha256:63af9232d0c969eb92cb3db7611d8daa101d8ee976f8077c76f06b82440474ee

Observation b3957398-5571-42c6-ae54-2e336a3a7412 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.925362Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.001242Z digest=sha256:34bcea82be0fb34a230c6c153ec8a57d42231f065915e15fff728b2b5df9fb68

Observation 653029c3-e2b0-40d8-aec3-cccfcdfd0d96 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.909686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.006704Z digest=sha256:a79fae8ff43ae121dbdd287fbf83870317d156a94766d1e3c0df783d05a780bc

Observation 3794312d-0135-42c0-b998-953226a0f137 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.893642Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.011130Z digest=sha256:0ca210fda0999a7840cd215d618b69bef1c106dc103d50174c9ea798db6dbb78

Observation a1e03fe4-b310-4262-a3b6-3c30d6e3e9bb · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.878593Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.016045Z digest=sha256:baf82a2613fbe24835ed8efb52ababa9d41655b7a1fcb61eb190d5371819cc21

Observation 905ea6b5-7b93-4808-9c9b-ef92f78cdae9 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.855694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.021235Z digest=sha256:b888abd75e1d75b85eec70e0fe4f223cda5b3d6b744b23ebfd21314dd8cd7bdb

Observation 6735ae77-267d-4866-9e36-719ff5ed64f9 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.840812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.026633Z digest=sha256:8778e1f4f663fa92b78a3bdc1e52faac3572520a842d0a1df56c9f2fe06d6a9a

Observation dc2a996a-ef66-4bf1-a5d1-87044fd8b3c8 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.825911Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.031565Z digest=sha256:58f09336c181c9d1b70e16384e839a726c02626a1a1f01009c18bba75b91287b

Observation 196ca538-6440-4aa3-9382-8ba33360b024 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.810017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.036421Z digest=sha256:c13b5c1a917a45c7b0bea7fe299940c8930becfa98bdd602132b6b472c22bcee

Observation 2c85cfff-5a6f-459f-99be-d818bf3f29e7 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.791705Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.042438Z digest=sha256:4527bb085562219aab203dc9c38fd3304f7a28b4064fd3300b112155d1430ee8

Observation 30b83920-e438-4cf1-a7b2-de8487618587 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.774398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.048248Z digest=sha256:ada097ac4cdd10dda58cab3f3ce0b64450140ce2a4058683dff7079b0c56823e

Observation 996e2fc0-529d-447e-89ac-453795c39913 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.756809Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.053406Z digest=sha256:d9d37cc85018c2b9a8e8d9d9d82369cda2e4248006513cd26b8d4b012d53b6ba

Observation bf0da052-c52a-496f-b1d2-36cd9404dcbe · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.741668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.059729Z digest=sha256:f2df799b41bf77bb9fd2a05df06e9ef84d1b8348e5dbbc605c1a1d70ece652e9

Observation cab0368d-b210-4a3e-a510-e886ce9788ef · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 33

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.726722Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.065929Z digest=sha256:c25a573cd312dd92c9cced0195f32e252db5f1a171d6941192b73bc649ff869b

Observation 88a85b88-5bd4-4337-9b21-f37968758b47 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.712123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.070973Z digest=sha256:6413f921cd09b6da7756fc91b9f433cf9a2af7266bfd8038f19ffcee7d810f62

Observation ea865e4b-7f90-4fd5-b574-1f63fb54ca71 · outbound

This paper cites Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024

Reference 35

Resolution
verified exact
local_arxiv, observed 2026-08-06T18:34:46.279906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.075998Z digest=sha256:6ae4de7b5b5141c7e71208cbf3708718a99019aa5f18b8a5bb8d41e4e81b3cdd

Observation 168572aa-b0e7-41b4-868e-c1e011346552 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.694613Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.083229Z digest=sha256:d305df41466c4de91a000d15728a51750a53ceac9ac8e8a072d261a50d39c5f9

Observation 9e6c2a77-622b-4aa4-a505-745b4b6c38b1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.677118Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.088984Z digest=sha256:bb127fa5420f049f568e37e01552a86066e423f85934b15a5c59b72181509a0b

Observation 3e4fbb3a-291c-421d-88cf-08ae36bf6a49 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 38

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.662151Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.095602Z digest=sha256:3fa554e7918b013bf74ec7862de00f6b5abdddec5e766b0f51ee7c5730fd9f62

Observation 41d330c8-ee7e-44e9-bb06-a5708d14f262 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.647977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.100804Z digest=sha256:bbebd5c0df980b56bb629932f884657c424ab7b46b166116dd1e84d4727aff00

Observation 4c966a6d-727e-44bf-b201-0442995eeac9 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 40

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.631305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.105982Z digest=sha256:a941733b03f299cb2fdb693d03e0dd469b712d0870edab65620467a92bb32b17

Observation dbdb542d-bde2-4bcf-a7d6-5e6e829da786 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.612603Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.110200Z digest=sha256:b5f55c7ae1b72fc52340b4096cbe5e6db9c82ab13315e28ef234a8539c69dd47

Observation b50f9a29-dad3-4bca-9c8a-dea17f915679 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 42

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.594161Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.115687Z digest=sha256:2eb1db70ad33f7426cbbf253fb448726546c05009ce538ea2378d531eebca87c

Observation 0080b839-196a-46ba-9a5a-2977602f9613 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.577426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.121367Z digest=sha256:263cd430a5554ae0feba9291a487b73c8443a4f33b08d316c6754838c2ff9541

Observation 3de9d11f-598d-4a4e-a97a-75d0f43e7bd4 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.561601Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.127742Z digest=sha256:f2a37915473fab33d175da3b491384e29e2c8a96c102b2fa021ac7947fbbc55d

Observation 8f9a0ace-ca93-457e-8e4f-39aaa05e8f6d · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.544622Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.134606Z digest=sha256:fc5f0af1d960a9d38418afd2b33333cf4af548b9faa7060b5a015dac7587f39a

Observation d8e814c2-b4e8-4ef1-b13b-0dac3413d236 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.529479Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.140766Z digest=sha256:ab7f347344372b0a2a5c0a4bf4d6a09afb3ddb5af33814cb880c1b9195a26a42

Observation 0a8a785d-1cff-4b54-9d08-b9e6cb8fc049 · outbound

This paper cites LLMs Can Patch Up Missing Relevance Judgments in Evaluation.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems LLMs Can Patch Up Missing Relevance Judgments in Evaluation

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:46.145334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:46.145334Z digest=sha256:b9e05a75f90623882117d2305b8eb5c8c859427d6725153448c0b4753b57657d

Observation d3952dc7-acb1-43d8-a2b8-0e8420b83035 · outbound

This paper cites UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:46.150987Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:46.150987Z digest=sha256:103ca3a0472d82a8184909a8fa21446fccc518b8e9ef3e61daad418adfadfa95

Observation cb13201e-0d48-4937-a5d4-2297a140927d · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.511275Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.156529Z digest=sha256:5fe61fa15b1a50580147cb4c00e0a5bc062acea71bb00b2b817dff6542558439

Observation c1185a08-f397-482e-bce0-f85fce76b9a1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 50

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.491491Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.161502Z digest=sha256:882306c002480df855b8b5590cacbb7837b6d421ae8681e2e7016a931f0be748

Observation e019b683-6d45-4382-851a-e939365ea8b1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.466739Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.166109Z digest=sha256:86691e8d0e8ff6fa99e33bf6279040866480534f2103d26587c8260d1aca45cf

Observation c362450b-c209-4e0c-8894-27c7787a02dc · outbound

This paper cites Voorhees and Donna Harman.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Voorhees and Donna Harman

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T18:34:46.448018Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.170871Z digest=sha256:1670267f687ac9ff8b4dba61ddd3fdad21cc16e00bf8671600e35174117227b0

Observation a90ace5c-135a-491f-899d-c26487fa0896 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.418226Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.176298Z digest=sha256:f460c34f2fbbff6d05f3a45f2465589f3c5997e74ebf39e1f21925d1100e4b0b

Observation ad8d292a-ef28-416e-8aeb-ffd787fb7131 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 54

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.401501Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.181643Z digest=sha256:11a1b092e9d32340998a6327bf15af1257c30324da5648cfbcd4610731742f09

Observation 90ad40d0-4116-4f4d-9675-3d20e6c1c198 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.385765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.186693Z digest=sha256:c7481841e6b99392c207f68a925ba1d54aba512d663c7980456286b593b09e6b

Observation 8a209eb6-3dbb-4910-b253-d2b3ba04a310 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.370408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-06T18:34:46.191064Z digest=sha256:67cda175bb21404327bd1123e6008e0348629c2c2f5800acadc3bd7e6a10dfe9

Observation 3d61a8f9-4c98-414f-a52b-df08af21d2a5 · outbound

This paper cites Can We Use Large Language Models to Fill Relevance Judgment Holes?.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.899164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.899164Z digest=sha256:f4d890643d085e11af5b91dccd273f38fbcd0ecc8d9fe368ce64ae99bee130a5

Pith citing papers

No inbound Pith citation observations are available.