Paper Citation Record · LEDGER

Does UMBRELA Work on Other LLMs?

As of 8 August 2026, this Paper Citation Record lists 13 of 13 outbound references and 0 inbound Pith citation observations for arXiv:2507.09483.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2507.09483 v1

Coverage vector

measured 13 of 13 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T17:59:20.353388Z

measured 13 of 13 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

13 of 13 outbound references displayed

verified exact1
verified fuzzy3
unresolved9
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 7459c6bb-abcb-4079-a5db-9d6df3ee70d1 · outbound

This paper cites an unresolved cited work.

Does UMBRELA Work on Other LLMs? Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-06T17:59:21.499459Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 92285331-d7b2-420f-90f8-01dbb5ebcc5d · outbound

This paper cites Overview of the TREC 2020 deep learning track.

Does UMBRELA Work on Other LLMs? Overview of the TREC 2020 deep learning track

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-06T17:59:19.412582Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1136e2f-d287-483b-af58-03053c96692e · outbound

This paper cites Overview of the TREC 2019 deep learning track.

Does UMBRELA Work on Other LLMs? Overview of the TREC 2019 deep learning track

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-06T17:59:19.511528Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bb8e4783-2f8c-4091-bfef-b42057fe4786 · outbound

This paper cites DeepSeek-V3 Technical Report.

Does UMBRELA Work on Other LLMs? DeepSeek-V3 Technical Report

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-06T17:59:19.571981Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 08a6ee26-ca0d-437c-9089-106370e1143e · outbound

This paper cites an unresolved cited work.

Does UMBRELA Work on Other LLMs? Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-08-06T17:59:21.360179Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation fc892353-f32e-4752-a6c9-98426a9219ab · outbound

This paper cites Pencils down! automatic rubric-based evaluation of retrieve/generate systems.

Does UMBRELA Work on Other LLMs? Pencils down! automatic rubric-based evaluation of retrieve/generate systems

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T17:59:21.220245Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation d8e84039-a9e4-4e30-a81a-872e90009676 · outbound

This paper cites an unresolved cited work.

Does UMBRELA Work on Other LLMs? Unresolved cited work

Reference 7

Resolution: unresolved; raw_fallback, observed 2026-08-06T17:59:21.095224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 89dfd1b3-aede-490d-8474-9d410142f98b · outbound

This paper cites GPT-4o System Card.

Does UMBRELA Work on Other LLMs? GPT-4o System Card

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-06T17:59:19.842320Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a931623c-411a-42fc-adae-16f69624bbe3 · outbound

This paper cites LLMJudge: LLMs for Relevance Judgments.

Does UMBRELA Work on Other LLMs? LLMJudge: LLMs for Relevance Judgments

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-06T17:59:19.956491Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation be0dd02e-a57a-4baa-9349-11dbf27a2f58 · outbound

This paper cites Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents.

Does UMBRELA Work on Other LLMs? Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-06T17:59:20.035254Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f98b3d6d-4460-414c-ae5b-54315a354be2 · outbound

This paper cites LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help?.

Does UMBRELA Work on Other LLMs? LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help?

Reference 11

Resolution: verified exact; local_arxiv, observed 2026-08-06T17:59:20.563515Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation bbfa75c1-cb33-4603-abaa-f2079c0352a8 · outbound

This paper cites Large language models can accurately predict searcher preferences.

Does UMBRELA Work on Other LLMs? Large language models can accurately predict searcher preferences

Reference 12

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T17:59:20.978986Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Observation 8ea026ac-6044-4486-9f69-bda034b3a249 · outbound

This paper cites Umbrela: Umbrela is the (open-source reproduction of the) bing relevance assessor, 2024.

Does UMBRELA Work on Other LLMs? Umbrela: Umbrela is the (open-source reproduction of the) bing relevance assessor, 2024

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-06T17:59:20.806729Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

Pith citing papers

No inbound Pith citation observations are available.