Pith. sign in

Paper Citation Record · LEDGER

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems

As of 11 August 2026, this Paper Citation Record lists 27 of 27 outbound references and 3 inbound Pith citation observations for arXiv:2601.15161.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2601.15161 v2

Coverage vector

measured 27 of 27 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-05-16T12:15:13.993477Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-10T06:31:04.303077+00:00

measured 3 of 3 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-02T07:43:31.569388Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

27 of 27 outbound references displayed

  • verified exact0
  • verified fuzzy13
  • unresolved14
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 39d257bb-81df-416b-94ef-67d884a0c02f · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 1

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.942354Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:3dddec44ec74f8a6089c7361fb371f01b149497781e60626fe716113b05d3b9b

Observation 56b171ef-e298-492d-a964-2b2f3dc1379f · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 2

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.946776Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:c6f1c543d01a5fa6f2d24f1140ca7e1f2ffc01b6ab92a5ccd6eca7ca5e5dd018

Observation 95355d56-5d96-42e0-8ebe-de28af1e90cc · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.960908Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:e4a3d7e3671a1b70a40731b42cd007f7faa10ce79ed9ec1f00d5c2d5b0bd0000

Observation 25d2c07f-87a8-4726-bd3e-fc1c25c316d5 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.944421Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:1c75386d5f397675e297fd9522cdb07485e25eb42f98b49dab0c2562eb163052

Observation f475507e-6ef5-4805-aa57-c1a9f179d5a9 · outbound

This paper cites intent”: “string.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems intent”: “string

Reference 5

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.993694Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:afdb03a9287d0d3ed3f55fc9a816e40b5725d8e5bb2f1f49d7c2ac0f24fc32ac

Observation eb2be8f7-f2e1-4e46-93a5-4a8b2051f96b · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.976031Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:eb2894bae95b982bb26636c81a00dd778120cb1cef589a7ecac221f68c4f1ee9

Observation 9f0d9769-2233-47e0-a617-23e0a76486e2 · outbound

This paper cites synthesis.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems synthesis

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.981952Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:8f6c8c81de456acd1562d5a867fa970093f176b63f18037235be07adb3bf98f7

Observation 1f4f3e0a-c675-4301-99c7-670efa91b62e · outbound

This paper cites evidence_sources.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems evidence_sources

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.972046Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:d6be8a4209867d4be413c281ee66d44e3d73fba66a3f9e42789bc01b3b05473f

Observation 3dd3d269-dc01-43d0-a80c-9ad5c764d190 · outbound

This paper cites synthesis.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems synthesis

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.991283Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:8c8a8284bdc69a191c1295c6f319b22958530bb490c3e7368853a389427fc366

Observation b5a6994c-e9e9-47c3-b3b0-050f9749e32b · outbound

This paper cites ATOMIC FACT.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems ATOMIC FACT

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.964838Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:67bd0fe87d279eeb59fd7245e407d906c019f0842538512e3b8166bba90edcfb

Observation 99b42564-0e1f-4d2c-ab71-9eb878b02bed · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.977872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:629504fba9cff40bf40dd3dcc97ac01f97faafb211f4dff18ceccab7603aa9e0

Observation 9f14dd4d-2a08-4e7d-bad4-a31ce6355970 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.968405Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:9fc14672421f8cee55cc8bd16876eafafc94ff38924dd7c3854947f8a9d52fe2

Observation 277c1c4a-fe8c-4b0a-82db-25c72a232a94 · outbound

This paper cites If X, then Y.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems If X, then Y

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.970196Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:2e756f506a1071809bc45e6597d23626e7e927d728a5bd66d8e4b83f42fa674e

Observation 2c74476d-9bd5-4873-afdc-96b6979682c3 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.973977Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:0db9ea8964010a0763632102521ef3481a8b23eafcc0421b95b516a4e0cbd280

Observation 9406fa61-1684-465b-9b92-e22728dad813 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.959052Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:31a80c854bec804bfef094f1eccb761073937e89fdafb0a0006a15571280a5de

Observation bd5e3008-fc7b-4137-8ee1-14e606db5eb0 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 16

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.988701Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:2de7691a4ed0d0457b7bc609c34c5c634eedf2505a9b8b0b09acb0f9ffbbbff6

Observation 9bfa97e8-0fae-44a4-8efc-c2bf201d5cec · outbound

This paper cites relevant_positive_facts.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems relevant_positive_facts

Reference 17

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.962875Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:eb0e377544a8593852e7c9a63b1c3a0522554130012d7d1982dcee6d50b675d1

Observation d35bb255-707d-4bff-8a64-44ea006b90a2 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.983705Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:a3916ab52731169a0f6a76a9098bb249fb80ba99ae97fce81d095a6222636068

Observation a0261109-d8c2-454a-8384-bce4cd266a0b · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.985788Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:6d77166c1b5bfcf39fe25ba3cde4e5a3beadcee5aca0699a096a9b0e667fff8d

Observation 61b62f8e-ee1f-4d91-8de3-3268d4a08b5b · outbound

This paper cites user_persona.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems user_persona

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.966654Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:16df72de6c66ef9f4fd991a939a48e4705a079ac470709127fe7efcf57aeaaab

Observation 53b77851-8acc-4076-9554-c1107a31d4c8 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.953135Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:474393cf3cec37e4f7abdc64d2bf745e72715732679e5b2d2dfcd0cbb27e6fa9

Observation 31c2f9c4-a6ff-4270-b327-abe713b03458 · outbound

This paper cites CONSOLIDATION STRATEGY (Cluster & Enumerate): – Group related medical concepts into coherent evaluation criteria.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems CONSOLIDATION STRATEGY (Cluster & Enumerate): – Group related medical concepts into coherent evaluation criteria

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.979957Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:08d6fb7ed75dc748a4cb3dbba378d0bae955e90c7d3cd0e9fa64776d0b6ea83b

Observation f1ea6e7e-e1c0-452a-8396-723cfda75559 · outbound

This paper cites – High magnitude (−10to−8or8to10): safety-critical or accuracy-critical items.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems – High magnitude (−10to−8or8to10): safety-critical or accuracy-critical items

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.948959Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:bf917ec3cc4e79e1b9e15baa24e5586d6ce06f1dbca35fd08d927862250f47b6

Observation 2a2bd9ad-e63c-4ee9-8f11-a2d75c099a7a · outbound

This paper cites Correctly identifies the recommended dosage of 500 mg.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Correctly identifies the recommended dosage of 500 mg

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.951099Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:d20adf305280ddf1b751e27d6051287c8081e2077088e57d158b1213cb7885b3

Observation 9523bd3c-d13b-4d81-9ec7-9de4852d60ec · outbound

This paper cites {user_query}.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems {user_query}

Reference 25

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.957248Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:bd265768c468280175350a02457e0e092554bd472dc2916c33b49058b15fd7cd

Observation de94ad6b-a929-4239-ab48-2add2f806f33 · outbound

This paper cites an unresolved cited work.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-05-16T12:22:52.995868Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:12c7372bcf50a42db0252c0af9a8a25b89fd51c479888453404db7aa2c70fdde

Observation 978af91c-f3cc-46d4-a524-d1453ff2aed9 · outbound

This paper cites rubrics”: [ { “criterion.

Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems rubrics”: [ { “criterion

Reference 27

Resolution
verified fuzzy
raw_fallback, observed 2026-05-16T12:22:52.955243Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-10T06:31:04.303077+00:00.

source=pdf_text observed=2026-05-16T12:15:13.993477Z digest=sha256:8c0dc4df5d6f5f3db8e7c813b30cc05b300a318702bd88c8710ad1d4304d76dc

Pith citing papers

Observation ea558101-6e05-421a-9543-d2c65522bd06 · inbound

MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation cites this paper.

MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems

Reference 42

Resolution
unresolved
no resolver link, observed 2026-07-13T05:07:42.040673Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-13T05:07:42.040673Z digest=sha256:eeb213d69f1adff57289f82b0e9fc5188a025554a31f82f1f26187a196ab3e28

Observation 06ee9cf1-7695-493b-bb5d-11eacaead115 · inbound

MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation cites this paper.

MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-02T07:43:31.569388Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T07:43:31.569388Z digest=sha256:1dfa03b9f1d0113ad103dd92676ae3c8cabbb05b9f4a89ff018723c152b64a6f

Observation cdc478ff-a4e1-4d1f-9cea-c22ec7c08386 · inbound

The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy cites this paper.

The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy Automated Rubrics for Reliable Evaluation of Medical Dialogue Systems

Reference 35

Resolution
unresolved
no resolver link, observed 2026-07-14T06:30:16.612345Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-07-14T06:30:16.612345Z digest=sha256:ea2547ad38aa90f24659a28c7cce00cc5338ab334c7cb302b4e9557df51dbdfd