Paper Citation Record · LEDGER

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models

As of 12 August 2026, this Paper Citation Record lists 39 of 39 outbound references and 0 inbound Pith citation observations for arXiv:2412.11453.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.11453 v1

Coverage vector

measured 39 of 39 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-11T14:58:45.981001Z

measured 39 of 39 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

39 of 39 outbound references displayed

verified exact0
verified fuzzy3
unresolved36
parse uncertain0
malformed identifier0
metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 2f7daa66-4c84-4675-a7d0-4bfc9c7132f7 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 1

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:58:47.140082Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 3410428a-e668-4542-be5b-fa9b82a2677c · outbound

This paper cites Chateval: Towards better llm-based evaluators through multi-agent debate.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Chateval: Towards better llm-based evaluators through multi-agent debate

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.438324Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 231f0d3d-545f-449d-a9fb-be999c421999 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.442555Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c445bfc6-868d-41ef-b82e-88835f5a4178 · outbound

This paper cites Chexagent: Towards a foundation model for chest x-ray interpretation.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Chexagent: Towards a foundation model for chest x-ray interpretation

Reference 4

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T14:58:47.021103Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation ac7a3e42-2c0b-4978-bdc8-5bc257a25ea5 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 5

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:58:47.009217Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 0996da3c-16a2-4d2a-9ffe-ea1e11bd61ce · outbound

This paper cites Flashattention-2: Faster attention with better parallelism and work partitioning.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Flashattention-2: Faster attention with better parallelism and work partitioning

Reference 6

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T14:58:46.866747Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation dfc595f1-a9da-4ffc-ba92-43f6d133f5a8 · outbound

This paper cites Fu, Stefano Ermon, Atri Rudra, and Christopher R \'e.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Fu, Stefano Ermon, Atri Rudra, and Christopher R \'e

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.459138Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 506ec475-032b-48d4-9f46-dab81a164fca · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.462665Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fcf69be2-14f6-4494-a09e-17410f662136 · outbound

This paper cites MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Data.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models MedAlpaca -- An Open-Source Collection of Medical Conversational AI Models and Training Data

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.466238Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6bac68f5-a5ac-4a9e-8417-8f7fcee5d256 · outbound

This paper cites PathVQA: 30000+ Questions for Medical Visual Question Answering.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models PathVQA: 30000+ Questions for Medical Visual Question Answering

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.470722Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f506cbe7-15b9-4522-b901-6b08f774508d · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.475582Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ed6d7ffe-5fd1-4b4b-b9d2-916e41607c22 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.480420Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8a3f7615-3241-4e5c-a9ac-41be88c59333 · outbound

This paper cites Generative judge for evaluating alignment.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Generative judge for evaluating alignment

Reference 13

Resolution: verified fuzzy; raw_fallback, observed 2026-08-11T14:58:46.830107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 0c38217a-4f92-49d3-8a54-0260e924ee9d · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.486952Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5d0a54fe-95da-4fb9-834a-114a85a676a1 · outbound

This paper cites Leveraging Large Language Models for NLG Evaluation: Advances and Challenges.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Leveraging Large Language Models for NLG Evaluation: Advances and Challenges

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.497919Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9c36f67f-efe1-4d03-9e38-e3ca63d4e194 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 16

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:58:46.809875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 0e7ef28e-5f1c-4362-9631-344b0973ceb2 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.640622Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 56558ea0-df7d-4bd1-b9e0-60b2d509fa5d · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.644764Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 72d6cd95-a9c0-4a09-aefd-4846d054e942 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.648732Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 63d7d7e5-9621-4227-b2a2-457665752242 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 20

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:58:46.784561Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 8f9599b8-38e2-4177-85ee-344ca4421f34 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 21

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:58:46.573325Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 9ed2a86a-f4a9-40bf-9ff0-d1c5770f7800 · outbound

This paper cites Capabilities of GPT-4 on Medical Challenge Problems.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Capabilities of GPT-4 on Medical Challenge Problems

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.658675Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation cc8ee2b4-9d62-4973-9f37-c3e6ac612a22 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.662231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation dac4a831-8d9f-4497-be8a-0186a49abe79 · outbound

This paper cites RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models RaDialog: A Large Vision-Language Model for Radiology Report Generation and Conversational Assistance

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.665572Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6f9ca47b-d970-4a38-88f6-090f5e407a20 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.669489Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3ac496ab-bc6f-42f3-b750-dcabe91e55f7 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.672819Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 835d6b36-92ec-48a7-a9d4-7aef95301d7b · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.676468Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 41da5873-aca0-4542-b6cb-077e1e48f742 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.680280Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 75a752ff-38b4-4d60-ab72-98b37ad6e660 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.683764Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1e721a90-f93b-431b-b701-66b37eec824e · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 30

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:58:46.465563Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation c7552a36-98c4-4adb-ba86-5ef9684f2744 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 31

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:58:46.452172Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation 6e51bc22-dfa1-4ed7-9d9a-c5bd1247c7db · outbound

This paper cites MedGPTEval: A Dataset and Benchmark to Evaluate Responses of Large Language Models in Medicine.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models MedGPTEval: A Dataset and Benchmark to Evaluate Responses of Large Language Models in Medicine

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.695547Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6b6c7294-3278-4557-8b5b-4c898a30671f · outbound

This paper cites Advancing Multimodal Medical Capabilities of Gemini.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Advancing Multimodal Medical Capabilities of Gemini

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.699956Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9f5a4b3d-981a-40c8-9cd2-4b285903d15a · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 34

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.740605Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f809da8d-cc29-4a44-bc1e-bc4db657882a · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 35

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:58:46.432461Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation e563872d-722e-44eb-a0e5-a67b9ef7721e · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 36

Resolution: unresolved; raw_fallback, observed 2026-08-11T14:58:46.319426Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

Observation e36f00db-00c4-4877-b70a-632261ea1bf4 · outbound

This paper cites BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.972370Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 0f1597b5-ee11-4609-b215-3fac1c1cedb2 · outbound

This paper cites Bertscore: Evaluating text generation with bert.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Bertscore: Evaluating text generation with bert

Reference 38

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.976333Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f3c6f303-f5b2-4b4e-ba82-3d20eb83b032 · outbound

This paper cites an unresolved cited work.

ACE-$M^3$: Automatic Capability Evaluator for Multimodal Medical Models Unresolved cited work

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-11T14:58:45.981001Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Pith citing papers

No inbound Pith citation observations are available.