Paper Citation Record · LEDGER

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving

As of 13 August 2026, this Paper Citation Record lists 40 of 40 outbound references and 0 inbound Pith citation observations for arXiv:2506.08349.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.08349 v1

Coverage vector

measured 40 of 40 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T05:19:33.245710Z

measured 40 of 40 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

40 of 40 outbound references displayed

verified exact1
verified fuzzy16
unresolved23
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a78a2827-c586-419e-b5d6-48029857868f · outbound

This paper cites Phi-4 Technical Report.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Phi-4 Technical Report

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.126829Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation baaad06f-1a16-4614-83fb-429004cf21ea · outbound

This paper cites Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.130742Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e6fd8e85-c75c-4a90-b8dd-048bf80acbe6 · outbound

This paper cites GPT-4 Technical Report.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving GPT-4 Technical Report

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.134332Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e1edc71c-ca9c-4b06-9973-ca92efbb74a8 · outbound

This paper cites an unresolved cited work.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Unresolved cited work

Reference 4

Resolution: unresolved; raw_fallback, observed 2026-08-07T05:19:33.594125Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 73a37a47-5b85-4ec6-8b57-89151924ac1a · outbound

This paper cites Gemini: A Family of Highly Capable Multimodal Models.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Gemini: A Family of Highly Capable Multimodal Models

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.142732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation b8962460-be4d-4715-a13a-e32a85b439d3 · outbound

This paper cites Qwen Technical Report.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Qwen Technical Report

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.146797Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a1e12a8d-ce13-4f17-b6a5-19d07d4e3f56 · outbound

This paper cites Overview of the medical question answering task at trec 2017 liveqa.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Overview of the medical question answering task at trec 2017 liveqa

Reference 7

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.586684Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation e4be78c0-33bf-47be-a4e8-95f3a2c3a249 · outbound

This paper cites S., Englehart, M.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving S., Englehart, M

Reference 8

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.578962Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 5d9070cc-4f18-475a-a428-33118c443882 · outbound

This paper cites The unified medical language system (umls): integrating biomedical terminology.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving The unified medical language system (umls): integrating biomedical terminology

Reference 9

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.571091Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation cbc39d3a-86ce-4bad-803a-46ab91b44a48 · outbound

This paper cites an unresolved cited work.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Unresolved cited work

Reference 10

Resolution: unresolved; raw_fallback, observed 2026-08-07T05:19:33.562957Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 72be59a9-6e3a-4dc2-bef3-47e54e26ec34 · outbound

This paper cites Medbench: A large-scale chinese benchmark for evaluating medical large language models.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Medbench: A large-scale chinese benchmark for evaluating medical large language models

Reference 11

Resolution: verified exact; doi, observed 2026-08-07T05:19:33.554631Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 7b449a13-136e-4b1c-8e37-a8137733ce75 · outbound

This paper cites MEDITRON-70B: Scaling Medical Pretraining for Large Language Models.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving MEDITRON-70B: Scaling Medical Pretraining for Large Language Models

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.164270Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8d05d94c-dc3b-458f-b289-ff7c5e008b1b · outbound

This paper cites U., Pimentel, M.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving U., Pimentel, M

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.546163Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 9a8cf196-9e57-404c-9580-351919d5c879 · outbound

This paper cites Med42-v2: A Suite of Clinical LLMs.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Med42-v2: A Suite of Clinical LLMs

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.170913Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 2f11382f-c86c-4fa6-a23b-6ceab1eb99e8 · outbound

This paper cites The Llama 3 Herd of Models.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving The Llama 3 Herd of Models

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.173687Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 105f22a7-a464-4273-91fb-2c2102d96403 · outbound

This paper cites Evaluation and mitigation of the limitations of large language models in clinical decision-making.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Evaluation and mitigation of the limitations of large language models in clinical decision-making

Reference 16

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.538983Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 0fcbfc62-bd5c-45bf-aff3-08c2a3a698a8 · outbound

This paper cites Qwen2.5-Coder Technical Report.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Qwen2.5-Coder Technical Report

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.178782Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f86ec334-4259-4823-86f7-b98d40e9386d · outbound

This paper cites What disease does this patient have? a large-scale open domain question answering dataset from medical exams.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving What disease does this patient have? a large-scale open domain question answering dataset from medical exams

Reference 18

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.531079Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 4c0cd703-4887-4223-9258-4fd8c83a4fd0 · outbound

This paper cites P ub M ed QA : A dataset for biomedical research question answering.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving P ub M ed QA : A dataset for biomedical research question answering

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.184334Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eaca3cc6-1e9f-43ff-a53f-6ab39b6068f4 · outbound

This paper cites E., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving E., Bulgarelli, L., Shen, L., Gayles, A., Shammout, A., Horng, S., Pollard, T

Reference 20

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.522628Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation b9c83da7-d8bd-4a6c-b933-c0c64d238864 · outbound

This paper cites A., Roberts, A., et al.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving A., Roberts, A., et al

Reference 21

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.514149Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation c46d6e30-cdb6-46b1-82cf-70978be20cd9 · outbound

This paper cites DeepSeek-V3 Technical Report.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving DeepSeek-V3 Technical Report

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.193159Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97da048d-0f1c-41db-bd60-efe06806f59d · outbound

This paper cites Gemma: Open Models Based on Gemini Research and Technology.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Gemma: Open Models Based on Gemini Research and Technology

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.196012Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f6b9cd02-c8d5-4bcd-a317-cb386966799b · outbound

This paper cites Capabilities of GPT-4 on Medical Challenge Problems.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Capabilities of GPT-4 on Medical Challenge Problems

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.198772Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3cd2eaad-b15f-42f2-bf48-c9c9468ef675 · outbound

This paper cites Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicine

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.202015Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a5c9893b-15d8-47a0-bc03-e45d70f23d47 · outbound

This paper cites Gpt-4o mini: advancing cost-efficient intelligence, 2024.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Gpt-4o mini: advancing cost-efficient intelligence, 2024

Reference 26

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.506444Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation c3795670-7509-4275-a135-76acf6b41bc6 · outbound

This paper cites L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving L., Mishkin, P., Zhang, C., Agarwal, S., Slama, K., Ray, A., Schulman, J., Hilton, J., Kelton, F., Miller, L., Simens, M., Askell, A., Welinder, P., Christiano, P

Reference 27

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.498276Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation bfc94c8e-6edd-48f9-8d71-382c70598620 · outbound

This paper cites Climedbench: A large-scale chinese benchmark for evaluating medical large language models in clinical scenarios.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Climedbench: A large-scale chinese benchmark for evaluating medical large language models in clinical scenarios

Reference 28

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.489846Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation c8987b34-d0f1-4c58-9a8f-96e2a294843f · outbound

This paper cites K., and Sankarasubbu, M.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving K., and Sankarasubbu, M

Reference 29

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.480318Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 248fa337-d7e6-4676-bf79-384226bffc17 · outbound

This paper cites Towards building multilingual language model for medicine.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Towards building multilingual language model for medicine

Reference 30

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.472154Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 5e131aa7-9c55-476c-9375-e08872162d29 · outbound

This paper cites S., Wei, J., Chung, H.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving S., Wei, J., Chung, H

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.463569Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation af6a1063-7661-448a-adea-d5ba1c302f63 · outbound

This paper cites Towards Expert-Level Medical Question Answering with Large Language Models.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Towards Expert-Level Medical Question Answering with Large Language Models

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.221544Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3ffb2cb6-3710-49b2-8cef-d42da69b3dad · outbound

This paper cites Gemma 2: Improving Open Language Models at a Practical Size.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Gemma 2: Improving Open Language Models at a Practical Size

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.224344Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8336a65d-d5a4-4049-9261-69fb63164818 · outbound

This paper cites Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Clinical Camel: An Open Expert-Level Medical Language Model with Dialogue-Based Knowledge Encoding

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.227231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0acfdcce-ad1c-497e-8b42-1212f8ceea78 · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving LLaMA: Open and Efficient Foundation Language Models

Reference 35

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.231310Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d8504776-e4c1-4978-96c2-9dc051e9a5e8 · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 36

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.234201Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 17dcdb23-6cf0-47ba-9eb7-35b378b4663f · outbound

This paper cites CMB : A comprehensive medical benchmark in C hinese.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving CMB : A comprehensive medical benchmark in C hinese

Reference 37

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.454966Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation ef377819-65cf-4f80-9436-19ae876ac2df · outbound

This paper cites C., Wu, J., and Liu, X.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving C., Wu, J., and Liu, X

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-07T05:19:33.445187Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 02be86c3-a349-4375-a67d-3d21bc6e14cf · outbound

This paper cites Qwen2 Technical Report.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving Qwen2 Technical Report

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.242615Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation aa18151f-2968-4c77-9337-cd03dc8dcd71 · outbound

This paper cites write newline.

Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving write newline

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-07T05:19:33.245710Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.