Pith. sign in

Paper Citation Record · LEDGER

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems

As of 11 August 2026, this Paper Citation Record lists 27 of 27 outbound references and 3 inbound Pith citation observations for arXiv:2601.15161.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2601.15161 v2

Coverage vector

measured 27 of 27 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-16T12:15:13.993477Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-11T06:34:44.6726+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-02T07:43:31.569388Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

27 of 27 outbound references displayed

  • verified exact0
  • verified fuzzy13
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 39d257bb-81df-416b-94ef-67d884a0c02f · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.942354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:9973c2a26a65a57420df0607a606c786ffb6f4632b5cbf5ab6207b57c20fca28

Observation 56b171ef-e298-492d-a964-2b2f3dc1379f · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.946776Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:cabcabb95284d13b471252c2f9b39acb6d1edd662e6e275f719906fba5f85cf5

Observation 95355d56-5d96-42e0-8ebe-de28af1e90cc · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.960908Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:8f3be1f45db0377a2fa6f4cc5ddb6315f7da1cb81a7d9ea1f1b83efd58e3a8a4

Observation 25d2c07f-87a8-4726-bd3e-fc1c25c316d5 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.944421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:ea502889842fa2cd2845a8377f4a3b6f44b3bc9d3d40b809af1c47089de74028

Observation f475507e-6ef5-4805-aa57-c1a9f179d5a9 · outbound

This paper cites intent”: “string.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems intent”: “string

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.993694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:d1e6bdbe57f33e357fb2eb69a9a188acd5b568d49d3b3a1d677b0d9a4318a53a

Observation eb2be8f7-f2e1-4e46-93a5-4a8b2051f96b · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.976031Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:71f3c2d33af9c690a3e546171fdef1c5517eb743f503ea2620d860ae342f6623

Observation 9f0d9769-2233-47e0-a617-23e0a76486e2 · outbound

This paper cites synthesis.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems synthesis

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.981952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:baee8454da9da32e6aa4f51427d48c4ffaffab0bbba2a47047a5c6e3aaf701f7

Observation 1f4f3e0a-c675-4301-99c7-670efa91b62e · outbound

This paper cites evidence_sources.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems evidence_sources

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.972046Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:267e2069cff55e7b3ab5ff81b548275d1235564f79de1046263023353e8bf573

Observation 3dd3d269-dc01-43d0-a80c-9ad5c764d190 · outbound

This paper cites synthesis.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems synthesis

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.991283Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:5760c6fb9028557afe8f293a6a7717b628b443667a7aef754180adebf661c315

Observation b5a6994c-e9e9-47c3-b3b0-050f9749e32b · outbound

This paper cites ATOMIC FACT.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems ATOMIC FACT

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.964838Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:43831d02b2cd96cb7dd4a182179b25d5316dae010f18531a7bc2bf44bcea7c21

Observation 99b42564-0e1f-4d2c-ab71-9eb878b02bed · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.977872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:fe71b1193e8d4544c9c6b83a7fbdf117ab0643a08ffcc829f8a6123741a5bc80

Observation 9f14dd4d-2a08-4e7d-bad4-a31ce6355970 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.968405Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:c0ec613a211b57547756c3e15299864a813968eac27e5fe2a1679d51d8fbdc4a

Observation 277c1c4a-fe8c-4b0a-82db-25c72a232a94 · outbound

This paper cites If X, then Y.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems If X, then Y

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.970196Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:d787fcdb1392cf10cabb54910768b116e45314a8810fdf0b4c45f67c7e74cf01

Observation 2c74476d-9bd5-4873-afdc-96b6979682c3 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.973977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:a396629aa7e072487ac223a56e8d77e9ca7b445f1b8672686146215ad3665f79

Observation 9406fa61-1684-465b-9b92-e22728dad813 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.959052Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:f526893841222aa3267b879b7b93408c7a39bad55722e43d80dbb224e8356b5d

Observation bd5e3008-fc7b-4137-8ee1-14e606db5eb0 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.988701Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:f04de9574a67f336bd26b75d85d31d72b7cf6f461c4b82d75f6630c3edb6139f

Observation 9bfa97e8-0fae-44a4-8efc-c2bf201d5cec · outbound

This paper cites relevant_positive_facts.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems relevant_positive_facts

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.962875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:7a82f2bb1bdbf9ef436ef275c2fcd54329dad65296c2b55e29f869702f7279db

Observation d35bb255-707d-4bff-8a64-44ea006b90a2 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.983705Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:47c2cd68d31a288a274bf64063e5b9ece0ba0573b4a75a6558d4ccd885c4b1b7

Observation a0261109-d8c2-454a-8384-bce4cd266a0b · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.985788Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:d9cb02b43e0d19e2afe374347cb1a2b69e448fe5e03865ec3d54083c52723eca

Observation 61b62f8e-ee1f-4d91-8de3-3268d4a08b5b · outbound

This paper cites user_persona.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems user_persona

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.966654Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:ceaf03d00c860e7b142a3dc3a269fdc7dc548088558ee496d6b77c78b4fa3d7b

Observation 53b77851-8acc-4076-9554-c1107a31d4c8 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.953135Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:54b0a10749c0189676b954ee825b6a663ab3d7aa5171a286727d0d763f983af7

Observation 31c2f9c4-a6ff-4270-b327-abe713b03458 · outbound

This paper cites CONSOLIDATION STRATEGY (Cluster & Enumerate): – Group related medical concepts into coherent evaluation criteria.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems CONSOLIDATION STRATEGY (Cluster & Enumerate): – Group related medical concepts into coherent evaluation criteria

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.979957Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:8b8d0766495be7da94fb7c929c8d8e2df241facdbd95832e8b26c697d2312492

Observation f1ea6e7e-e1c0-452a-8396-723cfda75559 · outbound

This paper cites – High magnitude (−10to−8or8to10): safety-critical or accuracy-critical items.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems – High magnitude (−10to−8or8to10): safety-critical or accuracy-critical items

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.948959Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:927b8d9f5af3f8ca483322b2bdba2854ac90d7da03593c3e3cf547da76323524

Observation 2a2bd9ad-e63c-4ee9-8f11-a2d75c099a7a · outbound

This paper cites Correctly identifies the recommended dosage of 500 mg.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Correctly identifies the recommended dosage of 500 mg

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.951099Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:15c91584f7e5e5186e0118a4a7a71e5a3b113241e9289576d69f1f82c59b06e0

Observation 9523bd3c-d13b-4d81-9ec7-9de4852d60ec · outbound

This paper cites {user_query}.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems {user_query}

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.957248Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:9a30c43a78a35079f19e1777f0e0eb42f69c8bdaaad89e514e788a9b977cdb70

Observation de94ad6b-a929-4239-ab48-2add2f806f33 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.995868Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:238054e911abcb135ddc8d40b651bf9aa2d0f65fa7b91afbbe269fb03ac39369

Observation 978af91c-f3cc-46d4-a524-d1453ff2aed9 · outbound

This paper cites rubrics”: [ { “criterion.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems rubrics”: [ { “criterion

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.955243Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-11T06:34:44.6726+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:3fc40ba7f9643710f9184d09bace8b727fa9b68bf94051fc2904e8555e8414dd

Pith citing papers

Observation ea558101-6e05-421a-9543-d2c65522bd06 · inbound

MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation cites this paper.

MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems

Reference 42

Resolution
unresolved
no resolver link, observed 2026-07-13T05:07:42.040673Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-13T05:07:42.040673Z digest=sha256:eeb213d69f1adff57289f82b0e9fc5188a025554a31f82f1f26187a196ab3e28

Observation 06ee9cf1-7695-493b-bb5d-11eacaead115 · inbound

MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation cites this paper.

MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-02T07:43:31.569388Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T07:43:31.569388Z digest=sha256:1dfa03b9f1d0113ad103dd92676ae3c8cabbb05b9f4a89ff018723c152b64a6f

Observation cdc478ff-a4e1-4d1f-9cea-c22ec7c08386 · inbound

The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy cites this paper.

The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems

Reference 35

Resolution
unresolved
no resolver link, observed 2026-07-14T06:30:16.612345Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T06:30:16.612345Z digest=sha256:ea2547ad38aa90f24659a28c7cce00cc5338ab334c7cb302b4e9557df51dbdfd