Pith. sign in

Paper Citation Record · LEDGER

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems

As of 8 August 2026, this Paper Citation Record lists 57 of 57 outbound references and 0 inbound Pith citation observations for arXiv:2507.07924.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.07924 v1

Coverage vector

measured 57 of 57 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T18:34:46.191064Z

measured 57 of 57 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

57 of 57 outbound references displayed

  • verified exact1
  • verified fuzzy1
  • unresolved55
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 60b43399-20ac-4854-a4f5-58b9184837a8 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.893727Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.893727Z digest=sha256:e398387b127edac10d63222f68e4ee5c43afa00bca5146ed98b1ecaac7f97df8

Observation 8e1f742d-1d54-4ef5-91b9-8eb7316151c1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.167572Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.903920Z digest=sha256:cac0ad54e791d9c3d7750243b1f0ae805251fcee73be773ff08be2b9a17eb08e

Observation 4e0fe0b1-70de-4ceb-9362-07412b97b242 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.151628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.908651Z digest=sha256:17e434ad4b61b189157a088237dc21a9f69febbab8bb40aab51b60ce7b8de38e

Observation fd410787-82a7-47c8-b6a8-db2e38a61add · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.136949Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.913365Z digest=sha256:e1f88224b179b32f4b3a921ef5354deb8b7e80edd8d9cb3c5a7a9f8662cc2cde

Observation cea8f4c9-6b31-4f3e-aa80-f43bbc339433 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.121345Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.918336Z digest=sha256:56a8a29960c35aaebfdb27550de1bf5610856039506b3471a588d8cc18654c82

Observation 0a558aa9-ab42-4ec2-85be-426ac4f9bd81 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.106776Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.922651Z digest=sha256:c73315a93bd55efcfcef96bdb29c895a312be50a081a20875b2f0ed4ab4cba8f

Observation 8f182f2d-c0ec-4ddf-82a4-9d5953c62c10 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.091848Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.928384Z digest=sha256:fc75a1ec67e506e8f24923e4499c5dfbb8daebb9fb227377d706ea772f6d9758

Observation c398df54-5182-422d-be8f-e608025c282d · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.076928Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.932813Z digest=sha256:57433d3c86741dbec8cdfcc59e97390d67f950c06c627750e7418fd45bda0b0a

Observation 9450e197-d373-4499-8ad2-ffd84ec6eac5 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 9

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.061751Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.937422Z digest=sha256:1a08cc77667b26c453e49b2fbb1186a27e9e923b44e315fe8d11cd86e589af54

Observation bed375c1-f9b8-4883-95e8-7e84eecd6452 · outbound

This paper cites Overview of the TREC 2020 deep learning track.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Overview of the TREC 2020 deep learning track

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.942093Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.942093Z digest=sha256:c69dc4be5c8ee37b286a2c5bc9abb09a9b8de8e9e9de39eae04629f107dccb2a

Observation d076a121-96bc-4154-9af5-bb263ca68686 · outbound

This paper cites Overview of the TREC 2019 deep learning track.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Overview of the TREC 2019 deep learning track

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.947206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.947206Z digest=sha256:59b99dd0f6bcaec84f42433a57b782ee2b2acda98b77b59419dd8164c9d9ccbe

Observation 79dd812b-8bf9-46db-8368-582237c87042 · outbound

This paper cites The Llama 3 Herd of Models.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems The Llama 3 Herd of Models

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.952508Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.952508Z digest=sha256:cc842a77a61fb3e3ad02e265f326da9b93507f217ae15ba7af5eda80c566fe24

Observation 21843c68-a25e-4be1-8ca5-820c1ae3ebc0 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 13

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.046893Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.957060Z digest=sha256:65c14ab02bef891b6b8cd2e2661ae9de3422e81d2a8950451ff1ecdf01c58976

Observation 13ffcf20-c539-4acb-965b-41252026b37a · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.031564Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.961916Z digest=sha256:13168761a9de40ed178a9056c3fb675f321b85e3d207e0f7df24c9efff97c370

Observation effb50a9-16a5-4f38-9071-7ced31bcc648 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.016488Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.966474Z digest=sha256:d7f2628fbc9dc777293dcd3edbadc356c2e15c58dbdc0c608ed9199e3293760e

Observation 4a0500b7-371c-466a-8959-94764f5bd2f1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:47.001685Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.972546Z digest=sha256:a395f5658ea9bc1dbc3688b7c164e0901af6b8c632df09479704e561eebcea97

Observation 0135dc01-5db8-4320-9924-00a47b89ceb5 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.986149Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.980893Z digest=sha256:da8dd7cbec4a6b731bd7db62e5cc923fb6df81dc393fd6aa1516c20950beb775

Observation 6a6452ff-0022-4355-9dac-e1eb49b49006 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.971089Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.986074Z digest=sha256:df660be5109c38e6d4230291fcd3dd2c66ef46595d55376bf1eaa889865af575

Observation de26fbdf-850c-40a6-9743-f50cf896668c · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.956709Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.992292Z digest=sha256:f99612bf78e1789ebc7fa3fa4b8d4f94566cbb2458318a75b8f2ae0be187b3e5

Observation b5160d1b-784f-4c3e-b0c3-45c8877def9c · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.940456Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:45.996525Z digest=sha256:b0eda1b0003f19241754bc0bb36e0d0e683c3042cbd85a40333e0082b124162d

Observation b3957398-5571-42c6-ae54-2e336a3a7412 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.925362Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.001242Z digest=sha256:454f3af3b20759300070efe6c5ab8973f5a820cb0e1f43d3dfcffed4fc28835e

Observation 653029c3-e2b0-40d8-aec3-cccfcdfd0d96 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.909686Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.006704Z digest=sha256:3df4d14fa167e7027d818b57ee968397dcb139efc92f146905f2601126cc6d75

Observation 3794312d-0135-42c0-b998-953226a0f137 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.893642Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.011130Z digest=sha256:352c7d88e65cd27b90f49e1d11ff4f4139eeccbf709808f39d2346d1bc967cd3

Observation a1e03fe4-b310-4262-a3b6-3c30d6e3e9bb · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.878593Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.016045Z digest=sha256:29a06ca150f0ac2954360a50c04724c0de2404e8a1f7ec06fd0d84b8cce2bc60

Observation 905ea6b5-7b93-4808-9c9b-ef92f78cdae9 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.855694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.021235Z digest=sha256:9684c3d0432eb081f6ec2969d11840dc2c4beb77839fe441ae0bf6aeb1af3f9e

Observation 6735ae77-267d-4866-9e36-719ff5ed64f9 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.840812Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.026633Z digest=sha256:2ab6ddff5b585c898895737ff7904ceffa7ab4b2bb09e27d9f024b3ed9f735ec

Observation dc2a996a-ef66-4bf1-a5d1-87044fd8b3c8 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.825911Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.031565Z digest=sha256:30a201ff628be6c89879606be929b8f41268947c71bbec5d3ce930a60c1304aa

Observation 196ca538-6440-4aa3-9382-8ba33360b024 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 28

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.810017Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.036421Z digest=sha256:656419ced4f1cef9481b61f95e09da05ce51eb55adadb179049be99a89033ef4

Observation 2c85cfff-5a6f-459f-99be-d818bf3f29e7 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 29

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.791705Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.042438Z digest=sha256:9bd1c9b5448e3614ef99834c3988a45b0fea5c68a852bbe4a14281de3caad9fe

Observation 30b83920-e438-4cf1-a7b2-de8487618587 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 30

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.774398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.048248Z digest=sha256:9ba9967debfc699dc05822e7a2763c6dadad8e09fa19bda899c1e220cc88ae2d

Observation 996e2fc0-529d-447e-89ac-453795c39913 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.756809Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.053406Z digest=sha256:e3e4e5fe7efeab72986da45fe57d86110d845e08ceec9693bd9723725525387b

Observation bf0da052-c52a-496f-b1d2-36cd9404dcbe · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.741668Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.059729Z digest=sha256:7a06a795b64eb446c2a1013c7baa53892b1ed860aa831d4a7bbcfb16c7e6881e

Observation cab0368d-b210-4a3e-a510-e886ce9788ef · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 33

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.726722Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.065929Z digest=sha256:af904b6a66c8698bce835a2769c6502cf2721d18679deb9f3a075655cbdb67ec

Observation 88a85b88-5bd4-4337-9b21-f37968758b47 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.712123Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.070973Z digest=sha256:4cd3cca204a1062b504a013a95ae1af4a6cd8829db60b4d41325810d6e0e24ab

Observation ea865e4b-7f90-4fd5-b574-1f63fb54ca71 · outbound

This paper cites Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024

Reference 35

Resolution
verified exact
local_arxiv, observed 2026-08-06T18:34:46.279906Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.075998Z digest=sha256:6184439a11c7aa66ac94e4df60fbe3fd83e4d3f0b4d4b37e5df0989d8778aaef

Observation 168572aa-b0e7-41b4-868e-c1e011346552 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.694613Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.083229Z digest=sha256:6fc46911c7d0d02522048cace851e39ea0961134586daccf7f8b4a0d4a55f71e

Observation 9e6c2a77-622b-4aa4-a505-745b4b6c38b1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.677118Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.088984Z digest=sha256:13c26e83917bd6b8f0db22db60c99962f0258b9d7b076a51b125c87038b14c3f

Observation 3e4fbb3a-291c-421d-88cf-08ae36bf6a49 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 38

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.662151Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.095602Z digest=sha256:d5bec04a300dbae3b71724bdd360e2997b7528c3cb81a15b71e1a6b50ef647a3

Observation 41d330c8-ee7e-44e9-bb06-a5708d14f262 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 39

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.647977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.100804Z digest=sha256:baca69801c597e476f8a32a6153157549819e6489c843ba68f282891748492db

Observation 4c966a6d-727e-44bf-b201-0442995eeac9 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 40

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.631305Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.105982Z digest=sha256:397bc6699234038f5618ae9d59fb3f27645a0cafa5f93949a41e1497e0fba802

Observation dbdb542d-bde2-4bcf-a7d6-5e6e829da786 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.612603Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.110200Z digest=sha256:a9810701523aca79bef46c4f24aea15fca68b353800c04de946d9b6b2f4befbe

Observation b50f9a29-dad3-4bca-9c8a-dea17f915679 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 42

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.594161Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.115687Z digest=sha256:81e39d04579b890b7ed0930918f47b9337a03f6b592274335ac3d0177dbd4195

Observation 0080b839-196a-46ba-9a5a-2977602f9613 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 43

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.577426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.121367Z digest=sha256:a7a6f2bf431bc1f6a3e15fedb1aa99a99aca5ee10ecc5bbaa6082960dc9b940a

Observation 3de9d11f-598d-4a4e-a97a-75d0f43e7bd4 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.561601Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.127742Z digest=sha256:45cc3bfef51dc3659fc1ac990968abddc560e5935c0346c0e4a235c00836000b

Observation 8f9a0ace-ca93-457e-8e4f-39aaa05e8f6d · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.544622Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.134606Z digest=sha256:8e2dde8ebf8d7907ded27dfe8e185528924ee5ded75ca5998441bdef6c61b082

Observation d8e814c2-b4e8-4ef1-b13b-0dac3413d236 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.529479Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.140766Z digest=sha256:dba9ac988fbb587c58d21baec21009d83675591afab66fd1b4797a71d1c51079

Observation 0a8a785d-1cff-4b54-9d08-b9e6cb8fc049 · outbound

This paper cites LLMs Can Patch Up Missing Relevance Judgments in Evaluation.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems LLMs Can Patch Up Missing Relevance Judgments in Evaluation

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:46.145334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:46.145334Z digest=sha256:79b056b3216970e5072e673de8b13cca026ef46383160bf9b3d190862fd86a1a

Observation d3952dc7-acb1-43d8-a2b8-0e8420b83035 · outbound

This paper cites UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:46.150987Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:46.150987Z digest=sha256:1c26540ab573cacf9d7491ed2b568c1301836c89443fa3ba252aa9aa48a669e6

Observation cb13201e-0d48-4937-a5d4-2297a140927d · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.511275Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.156529Z digest=sha256:285a1570bfd5433c313b68dd45d8b4656c4ed358be5433a2402011a9381b1396

Observation c1185a08-f397-482e-bce0-f85fce76b9a1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 50

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.491491Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.161502Z digest=sha256:afb274c60f15730c8535b0bae0c1d0cc89d0cde3955a37c1211314b80ca987df

Observation e019b683-6d45-4382-851a-e939365ea8b1 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.466739Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.166109Z digest=sha256:17a978343c04600217f456bab9e24d319c15b93691755e1a3b13f8c3e1bacc1b

Observation c362450b-c209-4e0c-8894-27c7787a02dc · outbound

This paper cites Voorhees and Donna Harman.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Voorhees and Donna Harman

Reference 52

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T18:34:46.448018Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.170871Z digest=sha256:6389a19938d13bcb50b3d11b88a05302b92ec4bbc2f5c0b0f5aa8ea1ba73b3f5

Observation a90ace5c-135a-491f-899d-c26487fa0896 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.418226Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.176298Z digest=sha256:393981b6b1470d3cd8bc5ae0e5fb27930c01c8fca2b6acf6b5b45f4c53b17410

Observation ad8d292a-ef28-416e-8aeb-ffd787fb7131 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 54

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.401501Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.181643Z digest=sha256:bd807fcfcacffec6ac9a8d61d632e65525c545de1c4ba5c1388439f0b586056d

Observation 90ad40d0-4116-4f4d-9675-3d20e6c1c198 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.385765Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.186693Z digest=sha256:bbaee25ea73a64945589af6305f3e01e45af1d810482072586d239ace252ca3f

Observation 8a209eb6-3dbb-4910-b253-d2b3ba04a310 · outbound

This paper cites an unresolved cited work.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-06T18:34:46.370408Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-06T18:34:46.191064Z digest=sha256:b209f9d526ac9c1c743961b78bdc9ba29e2fb3b4b0c89aa1834d952c1811f9db

Observation 3d61a8f9-4c98-414f-a52b-df08af21d2a5 · outbound

This paper cites Can We Use Large Language Models to Fill Relevance Judgment Holes?.

Measuring Hypothesis Testing Errors in the Evaluation of Retrieval Systems Can We Use Large Language Models to Fill Relevance Judgment Holes?

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-06T18:34:45.899164Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T18:34:45.899164Z digest=sha256:6a9bd4c63d1e27521384ec4c3c6d43762434773a3fa1d83047722450c4c5416b

Pith citing papers

No inbound Pith citation observations are available.