Pith. sign in

Paper Citation Record · LEDGER

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models

As of 16 August 2026, this Paper Citation Record lists 20 of 20 outbound references and 0 inbound Pith citation observations for arXiv:2505.15094.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15094 v1

Coverage vector

measured 20 of 20 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:28:54.724615Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-16T06:30:59.297886+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

20 of 20 outbound references displayed

  • verified exact0
  • verified fuzzy10
  • unresolved9
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation f8798d0d-70ce-4337-a32a-e225fd48601e · outbound

This paper cites Given the follow- ing four materials: mp-xxxxx, mp-xxxxx, mp-xxxxx, mp-xxxxx.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Given the follow- ing four materials: mp-xxxxx, mp-xxxxx, mp-xxxxx, mp-xxxxx

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:59.318916Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:52.588990Z digest=sha256:de5a79d7b5dfc9b3ea728083da70bea6473e3d2a80bdd5f9cb027c3aaac747f4

Observation f160ef1d-ea84-411d-b4b2-465306eb50db · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:59.055039Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:52.741538Z digest=sha256:eacfcdac9cd18ac631c8fa595e691d5ba758b44d9799aa3d2a7d6704aba2bc32

Observation 02420a4d-3df6-4e17-a903-71ed5ef4739b · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:58.697425Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:52.915943Z digest=sha256:976a66476aa596479e842891f3dab80e740318248cacbea470abdd9c7696aecb

Observation 88d53d9a-68e3-4d94-a20c-796ddcaefb33 · outbound

This paper cites Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:52.184799Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.184799Z digest=sha256:cba9a97293f7adce201d2f81d9847ae9dce33ac4a3468aa72f9b3c720bee15ea

Observation 490e0345-2ccd-49f8-9268-75f2dba23498 · outbound

This paper cites [Unable to generate question].

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models [Unable to generate question]

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.119972Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:53.650564Z digest=sha256:fd8453eede42eb447ff6113816463cca962b3c053fa2ecc61b061bd9bbf2c4b1

Observation f21874ac-4a1a-4e27-a05d-218b66c67ba6 · outbound

This paper cites [Unable to generate question].

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models [Unable to generate question]

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:56.869596Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:53.760144Z digest=sha256:c1e900f039588db2ab8a4e5ae564e11d400f15e99ca4340f57264a32bcff4500

Observation 92d68279-fd3b-495e-b407-5130aa6a3437 · outbound

This paper cites question.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models question

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:58.354945Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:53.056558Z digest=sha256:0736c64f9554aab689c2a592e47e492267436d225b5f25f6719518d0c6de2e22

Observation 8c169448-cf77-4e6d-a64f-fb11ff725b98 · outbound

This paper cites The question should require at least a university-level edu- 16 cation to answer.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models The question should require at least a university-level edu- 16 cation to answer

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:58.069780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:53.223393Z digest=sha256:e5fa21cc865e615f339a21cd8eced63ee063853667405fbb1af4726802d5eb21

Observation c8d3db24-30ba-4abc-a30a-5457985c0f09 · outbound

This paper cites It should not be directly deducible but should require complex reasoning to ar- rive at the correct answer.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models It should not be directly deducible but should require complex reasoning to ar- rive at the correct answer

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.702130Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:53.382855Z digest=sha256:cd822c46839b1343645b558b2dfbbe7e34d2a8c9fa1d1d311e21876cb4f8c821

Observation 1ff2388c-7163-49b6-93e0-7c2ae86a4909 · outbound

This paper cites The incorrect options should sound reasonable, but the content must be wrong.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models The incorrect options should sound reasonable, but the content must be wrong

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:57.412736Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:53.528011Z digest=sha256:df96c1d9adc618007a775ab790e13a344f8668beb1e8139de8474bbaee0910d2

Observation b73682ae-bf53-4918-a876-6c98f4938c66 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:56.562780Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:53.887089Z digest=sha256:c329840d4adf969a8db5ac8e02fd224221254074d20d46a3ea12bc0f8809b47d

Observation c3559958-5c7b-4771-a90c-4111c641973a · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:56.315170Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:54.079648Z digest=sha256:ce766743fc6fb1ee9d81ead96d50cc4632f7d17353f47fdb8d5118d1efcfb5a1

Observation d1618e54-79ed-486e-b4a3-41e34db3a655 · outbound

This paper cites Yes". If it does not meet the standard, output.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Yes". If it does not meet the standard, output

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:56.026681Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:54.256510Z digest=sha256:154dcc76daac2e3fb39801771d2d8701090564a082ed31fbcfb4ce547d6402ef

Observation 16c83ba5-43f0-47a0-b1c0-2e10e76d1bb9 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:55.747944Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:54.410683Z digest=sha256:5d88b25c25e0593f49be7c979ee50427402551dc82454a102264c75d117f2de3

Observation 9ada5ac4-05f7-4503-b228-cbd879fbe380 · outbound

This paper cites an unresolved cited work.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:28:55.473669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:54.546949Z digest=sha256:e8eeecdde14203fe8535fbe095bbdffdfc15c0eb6cc72269ebf4884da5a25f21

Observation 2bd093ad-9093-49c0-9253-a85e88c86a1f · outbound

This paper cites nbc 1" and.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models nbc 1" and

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:55.156106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:54.724615Z digest=sha256:fcf660df9d5d306e3de91740a1447b11ad5419a75a667d304f41b39ca86bd1a2

Observation 4528266f-5dca-4c6a-b9b0-2e26d855846e · outbound

This paper cites FinQA: A Dataset of Numerical Reasoning over Financial Data.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models FinQA: A Dataset of Numerical Reasoning over Financial Data

Reference 2021

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:52.044053Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.044053Z digest=sha256:4081ae247c842775d6bbb281e350808f0daa362284ee7e1cf2a78435adbd4386

Observation 078f9fa3-f587-49cd-b0a1-b5275c0cc268 · outbound

This paper cites Jiawei Chen, Hongyu Lin, Xianpei Han, and Le Sun.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models Jiawei Chen, Hongyu Lin, Xianpei Han, and Le Sun

Reference 2023

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:28:59.623145Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-16T06:30:59.297886+00:00.

source=pdf_text observed=2026-08-07T15:28:51.839113Z digest=sha256:c87de74ce86010f714cb23f87c7793edc9f1e147c5af159c2a38e15515cafe10

Observation f76dcc90-76e7-4bf0-9de3-5bfc4bf1af09 · outbound

This paper cites HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-07T15:28:51.925610Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:51.925610Z digest=sha256:448f77ec89ec517171179394213e409af03ee61adabfd2436201c7bbfc82a6a7

Observation 5607c524-dc4c-4466-9b7e-6d5f5f3351ce · outbound

This paper cites question_type.

SciCUEval: A Comprehensive Dataset for Evaluating Scientific Context Understanding in Large Language Models question_type

Reference 2025

Resolution
malformed identifier
no resolver link, observed 2026-08-07T15:28:52.397552Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:28:52.397552Z digest=sha256:d20acbcac975a5a8c6d5643f0419e8866b723c3d4c59aaf6c48ac9fbc70f316c

Pith citing papers

No inbound Pith citation observations are available.