Pith. sign in

REVIEW 4 major objections 6 minor 99 references

MExplore: an entity-based visual analytics approach for medical expertise acquisition

T0 review · 4 major / 6 minor · reviewed 2026-08-06 · deepseek-v4-flash

Pith's one-line read MExplore visual analytics boosts illness-script accuracy and retention.

desk verdict A well-integrated medical-text visual analytics system whose headline learning-gain claim is not yet supported by the reported user study, and whose unvalidated NER transfer to the target corpus is the main risk to the whole pipeline. read the letter →

arxiv 2507.12337 v1 pith:ELU7LDK7 submitted 2025-07-16 cs.HC

classification cs.HC
keywords medicalexpertiseacquisitionillnessscriptvisualanalyticsnamedentityrecognitiontextmultilevelvisualizationeducationinteractivelearning
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

MExplore is an interactive visual analytics system that helps medical learners turn unstructured clinical texts into structured expertise by extracting named medical entities and organizing them into a multi-level visual exploration. The paper's central claim is that this entity-based workflow improves the acquisition and retention of medical expertise: in a randomized study with 20 undergraduate medical students, MExplore users built illness scripts that were 3–6% more accurate, retained 6–13% more of the material two weeks later, and finished 1.5–3 minutes faster than a control group using textbooks and searches. The authors interpret the result through the cognitive-science lens of illness scripts, which organize clinical knowledge into enabling conditions, pathophysiological faults, and consequences. Three case studies and expert interviews support the same conclusion.

What carries the argument

The engine of the system is a three-level 'cosmic space, star map, planet cross-section' visual framework built on top of an automated entity-extraction pipeline. A fine-tuned BERT-family model extracts medical entities from each paragraph; paragraphs are embedded and connected by co-occurrence and similarity, then partitioned into subgraphs by the KaFFPa algorithm; and the four coordinated views render the resulting structure—medical document space, paragraph star map, association tree, and focused sectional view—so that a learner can drill from the whole corpus down to a single entity's context. The focused sectional view encodes the entity's co-occurring entity-set composition in a polar-axis area chart, giving each focal entity a visual signature that the paper ties to dual-coding theory.

What would settle it

Score a hand-labeled random sample of the hospital corpus for entity precision and recall; if the fine-tuned model's F1 on that sample is substantially below its benchmark performance, the visual structures—and the learning gains built on them—would rest on unreliable units.

Watch

Extended reading notes

Core claim

The central discovery claim is that a system which externalizes medical entities and their relations at increasing granularities can accelerate expertise acquisition from free-form medical text. Using the illness script as the operational definition of expertise, the paper reports that MExplore's users outperformed a traditional-learning control group on script accuracy, two-week retention, and completion time across three diseases. The authors argue that the progressive, metaphor-guided exploration—from a document-space overview to paragraph constellations, to association trees, to entity-focused sectional views—reduces extraneous cognitive load and creates dual memory traces, which together explain the learning benefit.

Load-bearing premise

The pipeline assumes that the entity-extraction model fine-tuned on the public CBLUE benchmark also extracts medical entities accurately from the private hospital corpus used in the study, but the paper reports no precision or recall measurement on that hospital corpus.

Editorial extensions

If this is right

  • If the claim holds, entity-based visual analytics could become a standard complement to textbooks and search in pre-clinical medical education, especially for building and refining illness scripts.
  • The retention advantage persisting at two weeks suggests the interactive exploration itself acts as a learning intervention, not merely a lookup aid.
  • The same pipeline can transfer to other specialties or to structured professional knowledge outside medicine, as the authors propose for legal texts.
  • The paper's evaluation protocol—illness-script accuracy scored against expert templates with a two-week retention follow-up—offers a reusable template for testing future learning tools.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The effect sizes come from a single 20-participant study; a larger, pre-registered replication would be needed to confirm the magnitude, though the direction was consistent across all three diseases and all script components.
  • Because no entity-extraction quality numbers are reported on the hospital corpus, the system's real-world accuracy is unknown; reporting precision and recall there would convert the pipeline's central transfer assumption into a testable metric.
  • A comparison against an equally interactive but entity-free interface would separate the contribution of the multi-level metaphor from the benefit of interaction itself.
  • The multi-level metaphor could plausibly be the active ingredient for retention, since the dual-coding explanation predicts larger gains for visual learners; this could be tested by measuring individual differences in spatial ability or learning style.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 6 minor

Summary. The paper introduces MExplore, a visual analytics system that extracts medical entities (MEs) from unstructured Chinese medical texts using a fine-tuned Mac-BERT model, then presents a multi-level, metaphor-based interface (MD space view, MP star map, association analysis view, focused sectional view) to help medical learners acquire expertise by constructing illness scripts. The authors report three expert case studies, a randomized user study with 20 medical students comparing MExplore against traditional resources, and expert interviews. The central claim is that MExplore significantly enhances medical expertise acquisition, as measured by illness-script accuracy, two-week retention accuracy, and completion time. The manuscript also proposes a workflow, four design requirements (R1-R4), five visual analytics tasks (T1-T5), and a tree-construction algorithm for grouping medical entity sets.

Significance. If the central claim were fully supported, the paper would make a useful contribution to human-computer interaction and medical education: it addresses a real problem (extracting expertise from unstructured clinical text), proposes a concrete multi-level visual analytics framework, and reports a substantial design study with iterative expert involvement. The use of a real clinical corpus (MWCSS) and the alignment of the design with illness-script theory are strengths, as is the explicit workflow from entity extraction to coordinated visualizations. However, the effectiveness evidence as presented is not yet conclusive: the quantitative user study lacks inferential statistics, the entity extraction transfer to the private corpus is unvalidated, and the evaluation design does not isolate the contribution of the entity-based visualization mechanism. The case-study parameter choices also appear to have been tuned during the reported analyses. These issues are addressable but currently prevent the paper from supporting its 'significantly enhances' claim.

major comments (4)
  1. [§6.2, Table 1] The claim that MExplore 'significantly enhances' medical expertise acquisition is not supported by the statistics reported in Table 1. The table lists only group means for accuracy, retention accuracy, and completion time; there are no standard deviations, confidence intervals, test statistics, effect sizes, or per-participant data. With N=10 per group, the observed 3-6 percentage-point accuracy differences and 1.5-3 minute time differences could plausibly arise from sampling variability. Please report appropriate inferential analyses (e.g., mixed-effects models or non-parametric tests with effect sizes) or revise the abstract and conclusions to say the results are descriptively positive but not statistically confirmed.
  2. [§4.2] The fine-tuned Mac-BERT NER model is transferred from the public CBLUE corpus to the private MWCSS corpus without any evaluation on MWCSS. The manuscript cites only past CBLUE benchmark performance (Ref. [71]) and reports no precision, recall, or F1 on the target stomatology notes. Because every downstream view depends on the extracted MEs—the star-map spring forces (Eq. 3), the association tree construction (Algorithm 1), the sectional view composition, and document similarity—unmeasured NER noise on MWCSS could make the visualizations show spurious structure and confound the user-study results. Please provide a held-out annotated sample from MWCSS scored with the same nine entity types, or explicitly state this transfer as an unvalidated limitation in Section 7.
  3. [§6.2] The user study is confounded as an evaluation of the entity-based visual analytics approach. The MEX group received a 20-minute training session and used the full interactive system, while the OTH group used textbooks and case retrieval with no analogous structured visual interface. The observed differences may reflect general benefits of interactive learning, the novelty of a new tool, or differences in available resources, rather than the specific ME-based multilevel design. Please add an active control condition that uses a comparable non-entity-based or single-level visualization, or substantially temper the attribution of the effect to the entity-based framework.
  4. [§5.2.2 and §6.1.1] The evaluation narrative indicates that key parameters were tuned during the reported case study: the maximum subgraph size was 'found during their free exploration and works well for the segmentation of medical records.' More generally, the force model in Eqs. (1)-(3) contains free parameters (unit force ∥F∥, similarity threshold θ, pole types Vj, and the area chart height factor ht in §5.2.4) whose values are not reported or varied. As presented, the case studies do not demonstrate that the system's behavior is robust to these choices. Please report the parameter values used and provide a sensitivity analysis, or argue independently of the reported cases that the results are not artifacts of parameter selection.
minor comments (6)
  1. [§6.3, Table 2] The text states that the experts completed a questionnaire with 11 items, but Table 2 lists only ten items (Q1-Q10). Please correct the count or add the missing item.
  2. [Figure 10] The caption of Figure 10 appears to be a copy-paste error: it says 'The association analysis view of the MES and MEs...' but the figure shows questionnaire results. Please replace the caption with one describing the Likert-scale responses.
  3. [Algorithm 1, §5.2.3] The pseudocode for tree construction uses undefined variables and functions, including N, Mchecked, LN, and CommonFatherNode. Please define these terms in the text so the algorithm can be understood and reproduced.
  4. [§5.2.3] The statement that the computational complexity of the algorithm is 'appropriate for the typical node count' is not substantiated; no complexity analysis or runtime measurement is given. Either provide the complexity or remove the claim.
  5. [Throughout] There are several typographical and consistency errors: 'examicnations' in §4.1, 'consturct' in Table 2, inconsistent acronyms 'MORNJ'/'MRNOJ'/'MRONJ' for medication-related osteonecrosis of the jaw, and inconsistent capitalization of 'MExplore' (e.g., 'Mexplore' in Section 7). Please copyedit the manuscript.
  6. [Table 1] The table footnote 'MEX1 OTH2' is cryptic and does not explain the superscripts. Please clarify what the numbers denote or remove them.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the effectiveness claim rests on an empirical user study, not on a fitted or self-referential derivation.

full rationale

The paper's central claim is that MExplore enhances medical expertise acquisition, supported by case studies, a user study, and expert interviews. This is an empirical evaluation claim, not a mathematical derivation whose output is encoded in its inputs. The data-processing pipeline (Mac-BERT fine-tuned on CBLUE, SimCSE similarities, BERTopic topics) is applied to the private MWCSS corpus and then visualized; the user-study outcomes are measured independently of the pipeline's parameters. No equation in the paper defines the effectiveness result in terms of the fitted model, and no fitted parameter is renamed as a prediction. The Mac-BERT NER transfer from CBLUE to MWCSS is unvalidated on the target corpus, which is a legitimate correctness-risk concern, but it is not circularity: the system's visualizations could be noisy without the effectiveness conclusion being true by construction. The cited prior work (CBLUE, Mac-BERT, SimCSE, BERTopic) is external and not authored by the present paper's authors, so no load-bearing self-citation chain is present. The in-house nature of the evaluation and the tuning of the subgraph-size parameter during the case study raise internal-validity questions, but these are threats to empirical validity, not circular reasoning. Therefore the circularity score is 0.

Assumptions & free parameters 5 free parameters · 5 assumptions · 0 invented entities

The visualization design contains several hand-set constants and thresholds. None are fit to predict the learning outcome, but they affect layout and user flow, and the subgraph size was tuned during the reported case study. They do not directly encode the central claim.

free parameters (5)
  • Similarity threshold θ = user adjustable (e.g., 0.5 in case study)
    Controls which pairwise MP similarities become edges Es and the gravitational force in Eq. 2; chosen by user during exploration.
  • Unit force magnitude ∥F∥ = unspecified
    Appears in Eqs. 1-3; an arbitrary scale constant for the star map layout, not fitted to data but not justified either.
  • ME type poles Vj = 9 uniform poles on circle boundary
    Fixed design choice in Eq. 3 for spring forces; no justification for uniformity.
  • Maximum subgraph size = 10
    Set by experts during free exploration (Section 6.1.1) and used for the MP star map; tuned during the same case study that serves as evidence.
  • Area chart height factor ht = unspecified
    Scales the polar-axis area chart in the focused sectional view (Section 5.2.4); chosen by hand.
assumptions (5)
  • domain assumption Illness scripts (enabling conditions, faults, consequences) are the correct model of medical expertise acquisition.
    Adopted from Schmidt & Boshuizen [3] and Feltovich et al. [57]; used to define requirements R1-R4 and to score the user study.
  • domain assumption Medical entities extracted by NER are sufficient semantic units for representing the core knowledge of a medical text.
    Stated in Section 1 and 2.3; if entities alone cannot capture the semantics, the whole visual structure loses fidelity.
  • domain assumption Mac-BERT fine-tuned on CBLUE transfers to MWCSS without material loss of accuracy.
    Section 4.2; no performance metrics on MWCSS are provided, yet all downstream analysis depends on this transfer.
  • domain assumption Cognitive load theory: reducing extraneous load through multi-level visual metaphors improves learning.
    Standard HCI/education theory invoked throughout Section 5; it underpins the design rationale.
  • domain assumption The KaFFPa graph partitioning of paragraph similarity graphs yields semantically meaningful subgraphs.
    Section 5.2.2; no evaluation of cluster quality is reported.

how reviews work

0 comments
Cite this review

Pith. "Pith review of MExplore: an entity-based visual analytics approach for medical expertise acquisition." pith.science (2026). https://pith.science/paper/ELU7LDK7

@misc{pith2026250712337,
  author       = {Pith},
  title        = {Pith review of: MExplore: an entity-based visual analytics approach for medical expertise acquisition},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/ELU7LDK7}},
  note         = {Machine review of arXiv:2507.12337}
}
read the original abstract

Acquiring medical expertise is a critical component of medical education and professional development. While existing studies focus primarily on constructing medical knowledge bases or developing learning tools based on the structured, private healthcare data, they often lack methods for extracting expertise from unstructured medical texts. These texts constitute a significant portion of medical literature and offer greater flexibility and detail compared to structured data formats. Furthermore, many studies fail to provide explicit analytical and learning pathways in this context. This paper introduces MExplore, an interactive visual analytics system designed to support the acquisition of medical expertise. To address the challenges of the inconsistencies and confidentiality concerns inherent in unstructured medical texts, we propose a workflow that employs a fine-tuned BERT-based model to extract medical entities (MEs) from them. We then present a novel multilevel visual analysis framework that integrates multiple coordinated visualizations, enabling a progressive and interactive exploration of medical knowledge. To assess the effectiveness of MExplore, we conducted three case studies, a user study, and interviews with domain experts. The results indicate that the system significantly enhances the medical expertise acquisition process, providing an effective interactive approach for acquiring and retaining knowledge from medical texts.

Figures

Figures reproduced from arXiv: 2507.12337 by the authors.

Figure 1
Figure 1. Overview of the MExplore system. A Displays the spatial and thematic distribution of the document, allowing users to select the exploration range. B Analyzes paragraph subgraphs to identify areas of interest for further exploration. C Visualizes the relationships between entities for a comprehensive understanding. D Focuses on a specific entity for detailed, in-depth analysis. E Provides access to the original text … view at source ↗
Figure 2
Figure 2. The MExplore workflow outlines a systematic process, [PITH_FULL_IMAGE:figures/full_fig_p004_2.png] view at source ↗
Figure 4
Figure 4. The MExplore framework: (A) the MD space view, inspired [PITH_FULL_IMAGE:figures/full_fig_p005_4.png] view at source ↗
Figures from the paper (5 more)
Figure 5
Figure 5. Figure 5: For detailed analysis, MDs are decomposed into MPs. (A) [PITH_FULL_IMAGE:figures/full_fig_p006_5.png]
Figure 6
Figure 6. Figure 6: A Topics and distribution of keyword-related MDs, with a connection threshold set to 0.5. B Distribution of MP subgraphs within the MDs in A2. C Corresponding MD text for the subgraph of interest identified for further review [PITH_FULL_IMAGE:figures/full_fig_p007_6.png]
Figure 7
Figure 7. Figure 7: The association analysis view of the MES and MEs within [PITH_FULL_IMAGE:figures/full_fig_p007_7.png]
Figure 8
Figure 8. Figure 8: A Focused analysis of zoledronic acid B Focused analysis of medical history MES including tooth extraction C Focused analysis of MRNOJ when bisphosphonates (BPs) are used in patients receiving cancer treatment and is associated with dental procedures such as tooth extr…
Figure 9
Figure 9. Figure 9: User study results. A Comparison of completion times. B Comparison of accuracy and retention accuracy. ME: Use MExplore for expertise acquisition; OTH: Acquiring expertise without MExplore but other resources [PITH_FULL_IMAGE:figures/full_fig_p009_9.png]

Discussion (0). Sign in to comment.

Reference graph

Works this paper leans on

99 extracted references · 69 canonical work pages

  1. [71]

    Zhang, M

    N. Zhang, M. Chen, Z. Bi, X. Liang, L. Li, X. Shang, K. Yin, C. Tan, J. Xu, F. Huang, et al. Cblue: A chinese biomedical language un- derstanding evaluation benchmark. arXiv preprint arXiv:2106.08087,

  2. [1]

    China health statistics yearbook 2022, 2025

    National Health Commission of the People’s Republic of China. China health statistics yearbook 2022, 2025. Accessed: 2025-01-24. 2

  3. [2]

    Medical school enrollment reaches new high, 2025

    Association of American Medical Colleges (AAMC). Medical school enrollment reaches new high, 2025. Accessed: 2025-02-15. 2

  4. [3]

    H. G. Schmidt and H. P. Boshuizen. On acquiring expertise in medicine. Educational psychology review, 5:205–221, 1993. 2, 3

  5. [4]

    Charlin, H

    B. Charlin, H. P. Boshuizen, E. J. Custers, and P. J. Feltovich. Scripts and clinical reasoning. Medical education, 41(12):1178–1184, 2007. 2

  6. [5]

    Griot, C

    M. Griot, C. Hemptinne, J. Vanderdonckt, and D. Yuksel. Large lan- guage models lack essential metacognition for reliable medical rea- soning. Nature communications, 16(1):642, 2025. 2

  7. [6]

    Y . Kim, H. Jeong, S. Chen, S. S. Li, M. Lu, K. Alhamoud, J. Mun, C. Grau, M. Jung, R. Gameiro, et al. Medical hallucinations in foundation models and their impact on healthcare. arXiv preprint arXiv:2503.05777, 2025. 2

  8. [7]

    C. W. Safranek, A. E. Sidamon-Eristoff, A. Gilson, and D. Chartash. The role of large language models in medical education: applications and implications, 2023. 2

Show all 99 references
  1. [8]

    Dergaa, H

    I. Dergaa, H. Ben Saad, J. M. Glenn, B. Amamou, M. Ben Aissa, N. Guelmami, F. Fekih-Romdhane, and K. Chamari. From tools to threats: a reflection on the impact of artificial-intelligence chatbots on cognitive health. Frontiers in psychology, 15:1259845, 2024. 2

  2. [9]

    Stadler, M

    M. Stadler, M. Bannert, and M. Sailer. Cognitive ease at a cost: Llms reduce mental effort but compromise depth in student scientific in- quiry. Computers in Human Behavior, 160:108386, 2024. 2

  3. [10]

    H.-P. Lee, A. Sarkar, L. Tankelevitch, I. Drosos, S. Rintel, R. Banks, and N. Wilson. The impact of generative ai on critical thinking: Self- reported reductions in cognitive effort and confidence effects from a survey of knowledge workers. In Proceedings of the 2025 CHI con- ...

  4. [11]

    Roustan, F

    D. Roustan, F. Bastardot, et al. The clinicians’ guide to large lan- guage models: A general perspective with a focus on hallucinations. Interactive journal of medical research, 14(1):e59823, 2025. 2

  5. [12]

    Z. Jin, S. Cui, S. Guo, D. Gotz, J. Sun, and N. Cao. Carepre: An intelligent clinical decision assistance system. ACM Transactions on Computing for Healthcare, 1(1):1–20, 2020. 2, 3

  6. [13]

    T. Xu, Y . Ma, T. Pan, Y . Chen, Y . Liu, F. Zhu, Z. Zhou, Q. Chen, et al. Visual analytics of multidimensional oral health surveys: Data mining study. JMIR Medical Informatics, 11(1):e46275, 2023. 2

  7. [14]

    Bernard, D

    J. Bernard, D. Sessler, J. Kohlhammer, and R. A. Ruddle. Using dash- board networks to visualize multiple patient histories: a design study on post-operative prostate cancer. IEEE transactions on visualization and computer graphics, 25(3):1615–1628, 2018. 2

  8. [15]

    Permana, P

    B. Permana, P. N. Harris, L. W. Roberts, T. Cuddihy, D. L. Paterson, S. A. Beatson, and B. M. Forde. Haiviz: an interactive dashboard for visualising and integrating healthcare-associated genomic epidemio- logical data. Microbial Genomics, 10(2):001200, 2024. 2

  9. [16]

    Siirtola, J

    H. Siirtola, J. Gracia-Tabuenca, R. Raisamo, M. Niemi, M. P. Reeve, and T. Laitinen. Glyph-based visualization of health trajectories. In 2022 26th international conference information visualisation (IV), pp. 418–425. IEEE, 2022. 2

  10. [17]

    Gabrilovich, S

    E. Gabrilovich, S. Markovitch, et al. Computing semantic relatedness using wikipedia-based explicit semantic analysis. In IJcAI, vol. 7, pp. 1606–1611, 2007. 2

  11. [18]

    Yamada, H

    I. Yamada, H. Shindo, H. Takeda, and Y . Takefuji. Learning dis- tributed representations of texts and entities from knowledge base. Transactions of the Association for Computational Linguistics, 5:397– 411, 2017. 2

  12. [19]

    J. Ling, N. FitzGerald, Z. Shan, L. B. Soares, T. F ´evry, D. Weiss, and T. Kwiatkowski. Learning cross-context entity representations from text. arXiv preprint arXiv:2001.03765, 2020. 2

  13. [20]

    Lelong, L

    R. Lelong, L. F. Soualmia, J. Grosjean, M. Taalba, S. J. Darmoni, et al. Building a semantic health data warehouse in the context of clinical trials: development and usability study. JMIR Medical Informatics , 7(4):e13917, 2019. 2

  14. [21]

    L. F. Soualmia, B. Dahamna, and S. J. Darmoni. Extracting and eval- uating knowledge from e-health documents: a contribution to infor- mation retrieval and indexing. Information Extraction from Internet, 89:108, 2011. 2

  15. [22]

    Kinast, H

    B. Kinast, H. Ulrich, B. Bergh, and B. Schreiweis. Functional re- quirements for medical data integration into knowledge management environments: Requirements elicitation approach based on systematic literature analysis. Journal of Medical Internet Research, 25:e41344,

  16. [23]

    F. Gong, Y . Chen, H. Wang, and H. Lu. On building a diabetes centric knowledge base via mining the web. BMC Medical Informatics and Decision Making, 19:185–197, 2019. 2

  17. [24]

    M. J. Landrum, S. Chitipiralla, G. R. Brown, C. Chen, B. Gu, J. Hart, D. Hoffman, W. Jang, K. Kaur, C. Liu, et al. Clinvar: improvements to accessing data. Nucleic acids research, 48(D1):D835–D844, 2020. 2

  18. [25]

    L. F. Soualmia and S. J. Darmoni. Combining knowledge-based meth- ods to refine and expand queries in medicine. In International Con- ference on Flexible Query Answering Systems, pp. 243–255. Springer,

  19. [26]

    Zagury-Orly, D

    I. Zagury-Orly, D. S. Kamin, E. Krupat, B. Charlin, N. Fernandez, and K. Fischer. The student-generated reasoning tool (sgrt): Linking medi- cal knowledge and clinical reasoning in preclinical education.Medical Teacher, 44(2):158–166, 2022. 2

  20. [27]

    Hayward, A

    J. Hayward, A. Cheung, A. Velji, J. Altarejos, P. Gill, A. Scarfe, and M. Lewis. Script-theory virtual case: A novel tool for education and research. Medical teacher, 38(11):1130–1138, 2016. 2

  21. [28]

    Sophark, C

    P. Sophark, C. Limratchapong, and T. Liabsuetrakul. Clinical reason- ing development using case-based direct illness scripts teaching on an online gamified learning platform. 2023. 2

  22. [29]

    L. H. Fall, R. English, T. B. Fulton, D. M. Harris, K. Ngo, J. Nixon, J. Hembrook-Short, and A. Wilson-Delfosse. Thinking slow more quickly: Development of integrated illness scripts to support cogni- tively integrated learning and improve clinical decision-making.Med- ical Sc...

  23. [30]

    E. B. Cloude, N. A. M. Ballelos, R. Azevedo, A. Castiglioni, J. LaRochelle, A. Andrews, and C. Hernandez. Designing intelligent systems to support medical diagnostic reasoning using process data. In International Conference on Artificial Intelligence in Education , pp. 109–113...

  24. [31]

    Yanagita, D

    Y . Yanagita, D. Yokokawa, F. Fukuzawa, S. Uchida, T. Uehara, and M. Ikusaka. Assessing the ability of gpt to generate illness scripts: An evaluation study. medRxiv, pp. 2023–12, 2023. 2

  25. [32]

    Grishman and B

    R. Grishman and B. M. Sundheim. Message understanding conference-6: A brief history. In COLING 1996 volume 1: The 16th international conference on computational linguistics, 1996. 2

  26. [33]

    Mehmood, I

    T. Mehmood, I. Serina, A. Lavelli, L. Putelli, and A. Gerevini. On the use of knowledge transfer techniques for biomedical named entity recognition. Future Internet, 15(2):79, 2023. 2

  27. [34]

    J. C. Nesbit and O. O. Adesope. Learning with concept and knowledge maps: A meta-analysis. Review of educational research, 76(3):413– 448, 2006. 2

  28. [35]

    Hanisch, K

    D. Hanisch, K. Fundel, H.-T. Mevissen, R. Zimmer, and J. Fluck. Prominer: rule-based protein and gene entity recognition. BMC bioin- formatics, 6:1–9, 2005. 2

  29. [36]

    Huang, W

    Z. Huang, W. Xu, and K. Yu. Bidirectional lstm-crf models for se- quence tagging. arXiv preprint arXiv:1508.01991, 2015. 2

  30. [37]

    Lample, M

    G. Lample, M. Ballesteros, S. Subramanian, K. Kawakami, and C. Dyer. Neural architectures for named entity recognition. arXiv preprint arXiv:1603.01360, 2016. 2

  31. [38]

    Devlin, M.-W

    J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova. Bert: Pre-training of deep bidirectional transformers for language understanding. InPro- ceedings of the 2019 conference of the North American chapter of the association for computational linguistics: human language technolo- g...

  32. [39]

    Vaswani, N

    A. Vaswani, N. Shazeer, N. Parmar, J. Uszkoreit, L. Jones, A. N. Gomez, Ł. Kaiser, and I. Polosukhin. Attention is all you need. Ad- vances in neural information processing systems, 30, 2017. 2

  33. [40]

    S. Wang, X. Sun, X. Li, R. Ouyang, F. Wu, T. Zhang, J. Li, and G. Wang. Gpt-ner: Named entity recognition via large language mod- els. arXiv preprint arXiv:2304.10428, 2023. 2

  34. [41]

    R. Han, C. Yang, T. Peng, P. Tiwari, X. Wan, L. Liu, and B. Wang. An empirical study on information extraction using large language models. arXiv preprint arXiv:2305.14450, 2023. 2

  35. [42]

    Keraghel, S

    I. Keraghel, S. Morbieu, and M. Nadif. Recent advances in named entity recognition: A comprehensive survey and comparative study

  36. [43]

    D. T. Wu, A. T. Chen, J. D. Manning, G. Levy-Fix, U. Backonja, D. Borland, J. J. Caban, D. W. Dowding, H. Hochheiser, V . Kagan, et al. Evaluating visual analytics for health informatics applications: a systematic review from the american medical informatics association visual...

  37. [44]

    J. P. Wanderer, S. E. Nelson, J. M. Ehrenfeld, S. Monahan, and S. Park. Clinical data visualization: the current state and future needs. Journal of medical systems, 40:1–9, 2016. 3

  38. [45]

    Nawroth, M

    C. Nawroth, M. Herrmann, F. Engel, P. Mc Kevitt, and M. L. Hemmje. Emerging knowledge extraction and visualization in medical docu- ment corpora. In CERC, pp. 236–254, 2020. 3

  39. [46]

    Yang and H

    H. Yang and H. J. Lee. Research trend visualization by mesh terms from pubmed. International journal of environmental research and public health, 15(6):1113, 2018. 3

  40. [47]

    G. Mancini. Development of a text-analytics based framework to support automated clinical literature research and study classifica- tion. PhD thesis, Scuola di Ingegneria Industriale e dell’Informazione,

  41. [48]

    Y . Chen, Y . Dong, Y . Zeng, X. Yang, J. Shen, L. Zheng, J. Jiang, L. Pu, and Q. Bao. Mapping of diseases from clinical medicine research—a visualization study. Scientometrics, 125:171–185, 2020. 3

  42. [49]

    Dancy-Scott, G

    N. Dancy-Scott, G. A. Dutcher, A. Keselman, C. Hochstein, C. Copty, D. Ben-Senia, S. Rajan, M. G. Asencio, J. J. Choi, et al. Trends in hiv terminology: text mining and data visualization assessment of inter- national aids conference abstracts over 25 years. JMIR public health...

  43. [50]

    C. Zhou, Z. Wang, and Z. Jiang. Construction of medical knowl- edge atlas and information visualization. In Proceedings of the 2022 2nd International Conference on Control and Intelligent Robotics, pp. 247–253, 2022. 3

  44. [51]

    C. D. Linhares, D. M. Lima, J. R. Ponciano, M. M. Olivatto, M. A. Gutierrez, J. Poco, C. Traina, and A. J. Traina. Clinicalpath: a vi- sualization tool to improve the evaluation of electronic health records in clinical decision-making. IEEE transactions on visualization and co...

  45. [52]

    B. C. Kwon, V . Anand, K. A. Severson, S. Ghosh, Z. Sun, B. I. Frohn- ert, M. Lundgren, and K. Ng. Dpvis: Visual analytics with hidden markov models for disease progression pathways. IEEE transactions on visualization and computer graphics, 27(9):3685–3700, 2020. 3

  46. [53]

    Sultanum, F

    N. Sultanum, F. Naeem, M. Brudno, and F. Chevalier. Chartwalk: Navigating large collections of text notes in electronic health records for clinical chart review. IEEE Transactions on Visualization and Computer Graphics, 29(1):1244–1254, 2022. 3

  47. [54]

    J. Kenei. Supporting Information Retrieval From Clinical Narrative Texts Using Text Classification and Visualization Techniques . PhD thesis, University of Nairobi, 2022. 3

  48. [55]

    Y . J. Msosa, D. Codling, T. Wang, M. Broadbent, A. Roberts, R. Har- land, P. McGuire, R. Stewart, and R. J. Dobson. Viewer: An electronic audit and feedback tool for the delivery of population health manage- ment applied to mental health care. 2023. 3

  49. [56]

    G. Jung, H. Lim, K. Han, H. Kim, and U. Lee. Designing a visual analytics tool to support data analysis tasks of digital mental health interventions: Case study. JMIR Human Factors, 12:e64967, 2025. 3

  50. [57]

    P. J. Feltovich and H. S. Barrows. Issues of generality in medical problem solving. Tutorials in problem-based learning, pp. 128–142,

  51. [58]

    E. J. Custers. Thirty years of illness scripts: theoretical origins and practical applications. Medical teacher, 37(5):457–462, 2015. 3, 8

  52. [59]

    Bagheri, A

    A. Bagheri, A. Giachanou, P. Mosteiro, and S. Verberne. Natural language processing and text mining (turning unstructured data into structured). In Clinical Applications of Artificial Intelligence in Real- World Data, pp. 69–93. Springer, 2023. 3

  53. [60]

    Mancinetti, S

    M. Mancinetti, S. Guttormsen, and C. Berendonk. Cognitive load in internal medicine: what every clinical teacher should know about cognitive load theory. European journal of internal medicine, 60:4–8,

  54. [61]

    C. A. Perfetti. Cognitive research can inform reading education. Jour- nal of research in reading, 1995. 3

  55. [62]

    J. Sweller. Cognitive load during problem solving: Effects on learn- ing. Cognitive science, 12(2):257–285, 1988. 3

  56. [63]

    Cognitive load theory: A guide to applying cognitive load theory to your teaching, 2022

    Office of Educational Improvement. Cognitive load theory: A guide to applying cognitive load theory to your teaching, 2022. Accessed October 14, 2023. 3

  57. [64]

    Ganascia

    J.-G. Ganascia. Abstraction of levels of abstraction. Journal of Exper- imental & Theoretical Artificial Intelligence , 27(1):23–35, 2015. 3, 6

  58. [65]

    Natesan, J

    S. Natesan, J. Bailitz, A. King, S. M. Krzyzaniak, S. K. Kennedy, A. J. Kim, R. Byyny, and M. Gottlieb. Clinical teaching: an evidence-based guide to best practices from the council of emergency medicine resi- dency directors. Western Journal of Emergency Medicine, 21(4):985,

  59. [66]

    Y . Q. Qiao, J. Shen, X. Liang, S. Ding, F. Y . Chen, L. Shao, Q. Zheng, and Z. H. Ran. Using cognitive theory to facilitate medical education. BMC medical education, 14(1):79, 2014. 3, 6

  60. [67]

    H. L. Lujan and S. E. DiCarlo. The paradox of knowledge: Why medical students know more but understand less. Medical Science Educator, pp. 1–6, 2025. 3

  61. [68]

    Mayer, I

    A. Mayer, I. Hege, A. A. Kononowicz, A. M ¨uller, and M. Su- dacka. Collaborative development of feedback concept maps for vir- tual patient–based clinical reasoning education: mixed methods study. JMIR Medical Education, 11:e57331, 2025. 3

  62. [69]

    A. U. Etukakpan, M. G. Waldhuber, K. K. Janke, A. K. Netere, T. An- gelo, and P. J. White. Core concept identification in stem and related domain education: a scoping review of rationales, methods, and out- puts. In Frontiers in Education, vol. 10, p. 1547994. Frontiers Media ...

  63. [70]

    Medwell and D

    J. Medwell and D. Wray. Concept-based teaching and learning: A review of the research literature. ICERI2020 Proceedings, pp. 486– 496, 2020. 3, 4

  64. [72]

    Y . Cui, W. Che, T. Liu, B. Qin, S. Wang, and G. Hu. Revisiting pre- trained models for chinese natural language processing.arXiv preprint arXiv:2004.13922, 2020. 4

  65. [73]

    T. Gao, X. Yao, and D. Chen. Simcse: Simple contrastive learning of sentence embeddings. arXiv preprint arXiv:2104.08821, 2021. 4

  66. [74]

    Grootendorst

    M. Grootendorst. Bertopic: Neural topic modeling with a class-based tf-idf procedure. arXiv preprint arXiv:2203.05794, 2022. 4

  67. [75]

    T. Munzner. A nested model for visualization design and valida- tion. IEEE transactions on visualization and computer graphics , 15(6):921–928, 2009. 5

  68. [76]

    J. C. Roberts. State of the art: Coordinated & multiple views in ex- ploratory visualization. In Fifth international conference on coordi- nated and multiple views in exploratory visualization (CMV 2007) , pp. 61–71. IEEE, 2007. 5

  69. [77]

    J. M. Carroll, R. L. Mack, and W. A. Kellogg. Interface metaphors and user interface design. In Handbook of human-computer interaction , pp. 67–85. Elsevier, 1988. 5

  70. [78]

    Shneiderman

    B. Shneiderman. Designing the user interface: strategies for effective human-computer interaction. Pearson Education India, 2010. 5

  71. [79]

    J. Sweller. Cognitive load theory, learning difficulty, and instructional design. Learning and instruction, 4(4):295–312, 1994. 5, 6, 7

  72. [80]

    C. Ware. Information visualization: perception for design . Morgan Kaufmann, 2019. 5

  73. [81]

    Sanders and C

    P. Sanders and C. Schulz. Engineering multilevel graph partition- ing algorithms. In European Symposium on algorithms, pp. 469–480. Springer, 2011. 5

  74. [82]

    L. Wang, J. Giesen, K. T. McDonnell, P. Zolliker, and K. Mueller. Color design for illustrative visualization. IEEE Transactions on Vi- sualization and Computer Graphics, 14(6):1739–1754, 2008. 5

  75. [83]

    Huang, M

    L. Huang, M. Xu, Z. Chen, and F. Liu. Syllabus design for teacher education moocs (massive open online courses): A mixed methods approach. In Technology in Education: Pedagogical Innovations: 4th International Conference, ICTE 2019, Guangzhou, China, March 15- 17, 2019, Revise...

  76. [84]

    Z. Zhou, L. Cai, J. Guo, Y . Zhang, B. Chang, T. Xu, and Y . Wang. Exevis: concept-based visualization of exercises in online learning. Journal of Visualization, 27(2):235–254, 2024. 6

  77. [85]

    H. Dong, J. Lio, R. Sherer, and I. Jiang. Some learning theories for medical educators. Medical science educator , 31(3):1157–1172,

  78. [86]

    Fonseca, P

    M. Fonseca, P. Broeiro-Gonc ¸alves, M. Barosa, P. Marv ˜ao, M. Car- reira, S. Azeredo-Lopes, J. Pires, A. Rendas, P. Rosado-Pinto, and B. Heleno. Concept mapping to promote clinical reasoning in multi- morbidity: a mixed methods study in undergraduate family medicine. BMC Medi...

  79. [87]

    R. C. Clark and R. E. Mayer. E-learning and the science of instruc- tion: Proven guidelines for consumers and designers of multimedia learning. john Wiley & sons, 2023. 6

  80. [88]

    B. Tversky. Visualizing thought. In Handbook of human centric visu- alization, pp. 3–40. Springer, 2013. 6

  81. [89]

    E. F. Barkley and C. H. Major. Student engagement techniques: A handbook for college faculty. John Wiley & Sons, 2020. 6

  82. [90]

    Ibrahim and O

    M. Ibrahim and O. Al-Shara. Impact of interactive learning on knowl- edge retention. In Symposium on Human Interface and the Manage- ment of Information, pp. 347–355. Springer, 2007. 7

  83. [91]

    Keemink, E

    Y . Keemink, E. J. Custers, S. van Dijk, and O. Ten Cate. Illness script development in pre-clinical education through case-based clin- ical reasoning training. International journal of medical education , 9:35, 2018. 8

  84. [92]

    Moghadami, M

    M. Moghadami, M. Amini, M. Moghadami, B. Dalal, and B. Char- lin. Teaching clinical reasoning to undergraduate medical students by illness script method: a randomized controlled trial. BMC medical education, 21(1):87, 2021. 8

  85. [93]

    J. Q. Young, S. M. Van Dijk, P. S. O”Sullivan, E. J. Custers, D. M. Irby, and O. Ten Cate. Influence of learner knowledge and case complexity on handover accuracy and cognitive load: results from a simulation study. Medical Education, 50(9):969–978, 2016. 8

  86. [94]

    T. Xu, Y . Ma, T. Pan, Y . Chen, Y . Liu, F. Zhu, Z. Zhou, and Q. Chen. Visual analytics of multidimensional oral health surveys: Data mining study. JMIR Medical Informatics, 11, 2023. doi: 10.2196/46275 8

  87. [95]

    N. J. Cepeda, H. Pashler, E. Vul, J. T. Wixted, and D. Rohrer. Dis- tributed practice in verbal recall tasks: A review and quantitative syn- thesis. Psychological bulletin, 132(3):354, 2006. 8

  88. [96]

    E. J. Custers, H. P. Boshuizen, and H. G. Schmidt. The role of illness scripts in the development of medical diagnostic expertise: Results from an interview study. Cognition and instruction , 16(4):367–398,

  89. [97]

    A. C. Bland, C. D. Kreiter, and J. A. Gordon. The psychometric prop- erties of five scoring methods applied to the script concordance test. Academic Medicine, 80(4):395–399, 2005. 8

  90. [98]

    R. Likert. A technique for the measurement of attitudes. Archives of psychology, 22 140:1–55, 1932. 9

  91. [99]

    T. Lin, R. Singh, Y . Yang, C. Nobre, J. Beyer, M. A. Smith, and H. Pfister. Towards an understanding of situated ar visualization for basketball free-throw training. In Proceedings of the 2021 CHI Con- ference on Human Factors in Computing Systems, pp. 1–13, 2021. 9

Pith tools

Reviewed August 6, 2026 · model on record in the stance chip above.