Pith. sign in

REVIEW 3 major objections 5 minor 1 cited by

Explainable Artificial Intelligence for Medical Applications: A Review

T0 review · 3 major / 5 minor · reviewed 2026-08-12 · deepseek-v4-flash

Pith's one-line read This review claims that medical AI can be made accountable with a single four-criteria taxonomy grid spanning 19 explanation techniques, and that current practice skews toward visual, post-hoc, model-specific methods.

desk verdict Useful survey with a solid taxonomy, but the 'over 100 papers' claim doesn't match the paper's own tables — a fixable overstatement, not a fatal flaw. read the letter →

arxiv 2412.01829 v1 pith:PGP3ZYAU submitted 2024-11-15 cs.LG cs.CV

classification cs.LGcs.CV
keywords ExplainableArtificialIntelligence(XAI)MachineLearningLiteratureReviewMedicalInformationSystemimagingaudioXAImultimodalpost-hocexplanation
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This review argues that medical AI's accountability gap can be addressed by a structured map of explanation techniques, and that the field currently over-relies on visual, post-hoc, model-specific methods. It consolidates four existing taxonomy criteria into one framework covering 19 XAI techniques. It then uses that framework to organize over 100 recent medical XAI studies across vision, audio, and multimodal data, drawing out trends and limitations. The value of the work is giving future researchers a shared vocabulary and grid for comparing explanation methods in clinical settings.

What carries the argument

The central organizing device is a four-criteria taxonomy grid, adapted from prior frameworks: perceptive interpretability versus interpretability by mathematical structures, ante-hoc versus post-hoc, model-agnostic versus model-specific, and local versus global. The paper maps 19 XAI techniques onto this grid and groups them by implementation principle into perturbation-based, backpropagation-based, gradient-based, instance-based, and other approaches. This grid carries the review's arguments by letting the authors compare disparate medical studies on the same terms and extract trends about what the field is and is not doing.

What would settle it

A formal systematic review of medical XAI published from 2018 to 2024 with a pre-registered protocol that found audio and multimodal explanation studies about as numerous as visual ones, or that found most techniques ante-hoc rather than post-hoc, would directly contradict the trends the paper reports.

Watch

Extended reading notes

Core claim

On its own terms, the paper's discovery is that the scattered XAI literature for medicine can be unified: the four criteria (perceptive versus mathematical, ante-hoc versus post-hoc, model-agnostic versus model-specific, local versus global) are jointly enough to describe 19 commonly used techniques such as LIME, SHAP, Grad-CAM, LRP, and counterfactuals. Classifying those techniques by implementation principle into perturbation-based, backpropagation-based, gradient-based, instance-based, and other approaches reveals that most medical deployments are perceptive, post-hoc, and model-specific. Applied to over 100 studies from 2018 to 2024, the framework shows that visual explanations dominate, audio and multimodal XAI are underdeveloped, and no single technique covers all four criteria.

Load-bearing premise

The paper's trend claims rest on the assumption that its chosen studies, picked for anatomical coverage, technique variety, and recency rather than through a formal systematic protocol, represent the whole body of medical XAI work.

Editorial extensions

If this is right

  • Researchers entering medical XAI can use the 19-technique grid as a checklist, making it easier to see which explanatory perspective a new method covers and which it leaves out.
  • The observed dominance of visual, post-hoc, gradient-based explanations implies that audio and multimodal explanations are an open, comparatively empty niche for new work.
  • The finding that explanations are rarely combined suggests that multi-technique and multi-criteria evaluation, rather than any single saliency map, is the route to clinically usable explanations.
  • The paper's outlook implies that standardizing terminology and adopting quantitative evaluation frameworks would make medical XAI comparisons more meaningful.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The same four-criteria grid could be applied outside medicine to high-stakes domains such as credit or criminal justice, where the local/global distinction maps onto individual decisions versus policy-level audits; the authors do not draw this comparison.
  • A testable extension of the paper's scarcity claim is that audio XAI would grow faster if explainability shifted from pixel-level heatmaps to time-frequency segmentations and listenable sonified explanations, a direction the authors mention only as outlook.
  • The paper's own selection logic could be stress-tested by a formal systematic review with pre-registered inclusion criteria; the authors explicitly state that their choices were based on anatomical location, technique diversity, and publication timeframe rather than a systematic protocol.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

3 major / 5 minor

Summary. This paper is a narrative review of explainable artificial intelligence (XAI) in medical applications. It consolidates four existing taxonomy criteria (perception/mathematics, ante-hoc/post-hoc, model-agnostic/model-specific, local/global) into a framework of 19 XAI techniques, assigns those techniques to the criteria in Table 1, and organizes recent medical XAI studies into three application domains: visual (Table 2), audio (Table 3), and multimodal (Table 4). The authors state in Section 1 that they analyze over 100 papers from the past five years, and in Section 7 they claim to have gathered a 'multitude' of application cases spanning visual, audio, and multimodal domains. The paper also discusses challenges and future directions, including standardization, quantitative evaluation, formal XAI, and multimodal/personalized explanations.

Significance. If the central claims were fully supported, the consolidated taxonomy and cross-modality synthesis would be a useful entry point for researchers and medical practitioners navigating the XAI literature. The paper's Table 1 and Figure 3 provide a compact comparison of 19 XAI techniques, and the division into visual, audio, and multimodal applications is a sensible organizing principle. However, the review's quantitative claim of analyzing over 100 papers is contradicted by its own tables, which enumerate 87 unique studies, and the selection of studies is explicitly subjective as described in Section 4. These issues directly affect the claimed comprehensiveness and the generality of the empirical trends reported in Section 5. The taxonomy itself is a reasonable contribution, but the review's scope claims and the evidentiary support for its observations need to be reconciled with the presented data.

major comments (3)
  1. [§1, Introduction] Section 1 states 'we analyse over 100 papers published in the past five years', but Tables 2, 3, and 4 enumerate 71, 5, and 11 unique studies, respectively, totalling 87; no additional analyzed studies appear outside these tables, and the background citations in §4.2 (e.g., [1], [42], [6], [35], [67], [100], [118], [153], [160]) are not XAI application papers. The quantitative claim is therefore unsupported by the evidence presented, and the authors should either expand the included studies to exceed 100 or revise the claim to match the actual count.
  2. [§4, XAI Applications in Medicine Review] In Section 4 the authors write that they 'selected the representative XAI medical applications based on medical anatomical locations, diversity of XAI techniques, and publication timeframe' and that this selection rests on 'our subjective assessment'. No inclusion/exclusion criteria, search results, or screening decisions are reported, so the study set is not reproducible. Because the cross-domain trends in §5.2 (e.g., that audio and multimodal XAI are 'less abundant') are derived from this selected sample rather than from a systematic census, the observed imbalances may be artifacts of the selection rather than robust properties of the literature. The authors should either supply a reproducible selection protocol with a defined inclusion count or moderate the generality of the empirical observations.
  3. [§5.1, Observation on Criteria Taxonomy and Techniques] Section 5.1 makes unquantified frequency claims such as 'the majority of XAI techniques used in the medical field are perception-based' and 'The majority of XAI techniques currently used in medical AI applications are model-specific' without providing an aggregation of the per-study technique entries in Tables 2-4. Table 1 is a taxonomy of techniques rather than an application survey and cannot by itself substantiate these frequency statements. The authors should add explicit counts or a summary table cross-tabulating the reviewed studies by the four taxonomy criteria, or replace these claims with hedged observations that reflect the small, subjectively selected sample.
minor comments (5)
  1. [§1, Introduction] The phrase 'past five years' is inconsistent with the search window '2018 and 2024' described in Section 4, which spans six calendar years; please align the wording.
  2. [Multiple sections] Several typographical errors need correction: 'according approaches' (§1), 'explainablility' (§2.2), 'we are not reiterate' (§3.1), 'a implementation-based approaches' (§7), 'Data Sacarcity' (Table 4), and 'In 2022, 10% of patients assumed they did not feel involved' (§2.1).
  3. [Table 1] In Table 1, multiple techniques receive checks in both members of a binary criterion (e.g., CAM is checked for both Perception and Mathematics, and SM for both Local and Global); because §3.3 introduces each pair as an alternative, please add a note explaining that the criteria are treated as multi-label axes.
  4. [Tables 2-4] The 'Cons' column in Tables 2-4 is not defined; please spell it out in the table footnotes as, for example, 'shortcomings identified by the authors from the original paper's limitations section and their own assessment'.
  5. [§4, Selection methodology] The Boolean search string in §4 ('XAI' OR 'explainable artificial intelligence' AND 'healthcare' OR 'medicine') is missing parentheses and therefore has an ambiguous parse; adding explicit grouping would clarify the intended query.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: this is a narrative review that synthesizes external literature; the 'over 100 papers' count mismatch is a scope inconsistency, not a circular derivation.

full rationale

The paper is a review, not a derivation. Its taxonomy is assembled from four independently published frameworks ([183], [70], [34], and [106]), and the 19-technique table is an annotated synthesis; Section 3.4 explicitly says 'The contents of table are derived from previous research summaries and our subjective understanding,' so the classification is presented as interpretation rather than as a derived prediction. The application survey (Tables 2–4) summarizes external studies, and no parameter is fitted nor is any quantity 'predicted' from a fitted input. The authors' self-citations ([6], [18], [35], [151], [179], [200]) are used as example applications or background context, not as load-bearing justification for the taxonomy or for the survey's conclusions. The one substantive weakness—the Introduction and Section 7 claim 'over 100 papers' while Tables 2–4 contain roughly 87 unique entries—is a scope/consistency problem, not a circular derivation: the review does not define its conclusions into existence by assuming its own output. No equation is reused by construction, no fitted value is renamed as a prediction, and no uniqueness or ansatz is imported from the authors' prior work. Therefore no circular step is present.

Assumptions & free parameters 0 free parameters · 0 assumptions · 0 invented entities

This paper is a literature review. It introduces no free parameters, no postulates, and no new entities. All definitions and taxonomies are attributed to prior literature.

how reviews work

0 comments
Cite this review

Pith. "Pith review of Explainable Artificial Intelligence for Medical Applications: A Review." pith.science (2026). https://pith.science/paper/PGP3ZYAU

@misc{pith2026241201829,
  author       = {Pith},
  title        = {Pith review of: Explainable Artificial Intelligence for Medical Applications: A Review},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/PGP3ZYAU}},
  note         = {Machine review of arXiv:2412.01829}
}
read the original abstract

The continuous development of artificial intelligence (AI) theory has propelled this field to unprecedented heights, owing to the relentless efforts of scholars and researchers. In the medical realm, AI takes a pivotal role, leveraging robust machine learning (ML) algorithms. AI technology in medical imaging aids physicians in X-ray, computed tomography (CT) scans, and magnetic resonance imaging (MRI) diagnoses, conducts pattern recognition and disease prediction based on acoustic data, delivers prognoses on disease types and developmental trends for patients, and employs intelligent health management wearable devices with human-computer interaction technology to name but a few. While these well-established applications have significantly assisted in medical field diagnoses, clinical decision-making, and management, collaboration between the medical and AI sectors faces an urgent challenge: How to substantiate the reliability of decision-making? The underlying issue stems from the conflict between the demand for accountability and result transparency in medical scenarios and the black-box model traits of AI. This article reviews recent research grounded in explainable artificial intelligence (XAI), with an emphasis on medical practices within the visual, audio, and multimodal perspectives. We endeavour to categorise and synthesise these practices, aiming to provide support and guidance for future researchers and healthcare professionals.

Figures

Figures reproduced from arXiv: 2412.01829 by the authors.

Figure 1
Figure 1. Overview of XAI-related publications retrieved from Google Scholar. Data collected on December 26, 2023, using the [PITH_FULL_IMAGE:figures/full_fig_p005_1.png] view at source ↗
Figure 2
Figure 2. The interrelationship among XAI-related terms [PITH_FULL_IMAGE:figures/full_fig_p006_2.png] view at source ↗
Figure 3
Figure 3. Demonstration of some XAI techniques. Original images are from ISIC2016 Challenge skin lesion datasets [ [PITH_FULL_IMAGE:figures/full_fig_p013_3.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Towards Friendly AI: A Comprehensive Review and New Perspectives on Human-AI Alignment

    cs.AI 2024-12 conditional novelty 2.0 of 10

    A literature review that synthesizes definitions of Friendly AI and catalogs ethical arguments and technical subfields relevant to human-AI alignment.

Reference graph

Works this paper leans on

214 extracted references · 52 canonical work pages · cited by 1 Pith paper

  1. [1]

    Sidra Abbas, Stephen Ojo, Abdullah Al Hejaili, Gabriel Avelino Sampedro, Ahmad Almadhor, Monji Mohamed Zaidi, and Natalia Kryvinska. 2024. Artificial intelligence framework for heart disease classification from audio signals. Scientific Reports 14, 1 (2024), 3123

  2. [42]

    Muqing Deng, Tingting Meng, Jiuwen Cao, Shimin Wang, Jing Zhang, and Huijie Fan. 2020. Heart sound classification based on improved MFCC features and convolutional recurrent neural networks. Neural Networks 130 (2020), 22–32

  3. [6]

    Schuller

    Alican Akman, Harry Coppock, Alexander Gaskell, Panagiotis Tzirakis, Lyn Jones, and Björn W. Schuller. 2022. Evaluating the COVID-19 Identification ResNet (CIdeR) on the INTERSPEECH COVID-19 From Audio Challenges. Frontiers in Digital Health 4 (2022). https://doi.org/10.3389/fdgth.2022.789980

  4. [35]

    Harry Coppock, Alex Gaskell, Panagiotis Tzirakis, Alice Baird, Lyn Jones, and Björn Schuller. 2021. End-to-end convolutional neural network enables COVID-19 detection from breath and cough audio: a pilot study. BMJ Innovations 7, 2 (2021), 356–362. https://doi.org/10.1136/bmjinnov-2021-000668 arXiv:https://innovations.bmj.com/content/7/2/356.full.pdf

  5. [67]

    R’mani Haulcy and James Glass. 2021. Classifying Alzheimer’s Disease Using Audio and Text-Based Representations of Speech. Frontiers in Psychology 11 (2021). https://doi.org/10.3389/fpsyg.2020.624137

  6. [100]

    Lin Liu, Shenghui Zhao, Haibao Chen, and Aiguo Wang. 2020. A new machine learning method for identifying Alzheimer’s disease. Simulation Modelling Practice and Theory 99 (2020), 102023

  7. [118]

    Kyungeun Min, Jeewoo Yoon, Migyeong Kang, Daeun Lee, Eunil Park, and Jinyoung Han. 2023. Detecting depression on video logs using audiovisual features. Humanities and Social Sciences Communications 10, 1 (2023), 1–8

  8. [153]

    Abhishek Singh Rathore, Siddhartha Kumar Arjaria, Manish Gupta, Gyanendra Chaubey, Amit Kumar Mishra, and Vikram Rajpoot

  9. [160]

    Sara Sardari, Bahareh Nakisa, Mohammed Naim Rastgoo, and Peter Eklund. 2022. Audio based depression detection using Convolutional Autoencoder. Expert Systems with Applications 189 (2022), 116076. https://doi.org/10.1016/j.eswa.2021.116076

Show all 214 references
  1. [2]

    Rahib H Abiyev, Mohamad Ziad Altabel, Manal Darwish, and Abdulkader Helwan. 2024. A Multimodal Transformer Model for Recognition of Images from Complex Laparoscopic Surgical Videos. Diagnostics 14, 7 (2024), 681

  2. [4]

    Reduan Achtibat, Maximilian Dreyer, Ilona Eisenbraun, Sebastian Bosse, Thomas Wiegand, Wojciech Samek, and Sebastian Lapuschkin

  3. [5]

    Namita Agarwal and Saikat Das. 2020. Interpretable machine learning tools: A survey. In 2020 IEEE Symposium Series on Computational Intelligence (SSCI). IEEE, 1528–1534

  4. [7]

    Malik AL-Essa, Giuseppina Andresini, Annalisa Appice, and Donato Malerba. 2022. Xai to explore robustness of features in adversarial training for cybersecurity. In International Symposium on Methodologies for Intelligent Systems . Springer, 117–126

  5. [8]

    Bader Aldughayfiq, Farzeen Ashfaq, NZ Jhanjhi, and Mamoona Humayun. 2023. Explainable AI for Retinoblastoma Diagnosis: Interpreting Deep Learning Models with LIME and SHAP. Diagnostics 13, 11 (2023), 1932

  6. [9]

    Sajid Ali, Tamer Abuhmed, Shaker El-Sappagh, Khan Muhammad, Jose M Alonso-Moral, Roberto Confalonieri, Riccardo Guidotti, Javier Del Ser, Natalia Díaz-Rodríguez, and Francisco Herrera. 2023. Explainable Artificial Intelligence (XAI): What we know and what is left to attain Tru...

  7. [10]

    Atul Anand, Tushar Kadian, Manu Kumar Shetty, and Anubha Gupta. 2022. Explainable AI decision model for ECG data of cardiac disorders. Biomedical Signal Processing and Control 75 (2022), 103584

  8. [11]

    Marco Ancona, Enea Ceolini, Cengiz Öztireli, and Markus Gross. 2017. Towards better understanding of gradient-based attribution methods for deep neural networks. arXiv preprint arXiv:1711.06104 (2017)

  9. [12]

    Plamen P Angelov, Eduardo A Soares, Richard Jiang, Nicholas I Arnold, and Peter M Atkinson. 2021. Explainable artificial intelligence: an analytical review. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery 11, 5 (2021), e1424

  10. [13]

    Alessa Angerschmid, Jianlong Zhou, Kevin Theuermann, Fang Chen, and Andreas Holzinger. 2022. Fairness and explanation in AI-informed decision making. Machine Learning and Knowledge Extraction 4, 2 (2022), 556–579

  11. [14]

    Alejandro Barredo Arrieta, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador García, Sergio Gil-López, Daniel Molina, Richard Benjamins, et al . 2020. Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities a...

  12. [15]

    Fahima Hasan Athina, Sadaf Ahmed Sara, Quazi Sabrina Sarwar, Nishat Tabassum, Mun Tarin Jannat Era, Faisal Bin Ashraf, and Muhammad Iqbal Hossain. 2022. Multi-classification Network for Detecting Skin Diseases using Deep Learning and XAI. In 2022 International Conference on In...

  13. [16]

    Muhammad Muzzammil Auzine, Maleika Heenaye-Mamode Khan, Sunilduth Baichoo, Nuzhah Gooda Sahib, Xiaohong Gao, and Preeti Bissoonauth-Daiboo. 2023. Classification of Gastrointestinal Cancer through Explainable AI and Ensemble Learning. In 2023 Sixth International Conference of W...

  14. [17]

    Sebastian Bach, Alexander Binder, Grégoire Montavon, Frederick Klauschen, Klaus-Robert Müller, and Wojciech Samek. 2015. On pixel-wise explanations for non-linear classifier decisions by layer-wise relevance propagation. PloS one 10, 7 (2015), e0130140

  15. [18]

    Alice Baird and Björn Schuller. 2020. Considerations for a more ethical approach to data in ai: on data representation and infrastructure. Frontiers in big Data 3 (2020), 25

  16. [19]

    Gayatri Shrinivas Ballari, Shantala Giraddi, Satyadhyan Chickerur, and Suvarna Kanakareddi. 2022. An Explainable AI-Based Skin Disease Detection. In ICT Infrastructure and Computing: Proceedings of ICT4SD 2022 . Springer, 287–295

  17. [20]

    Shahab S Band, Atefeh Yarahmadi, Chung-Chian Hsu, Meghdad Biyari, Mehdi Sookhak, Rasoul Ameri, Iman Dehzangi, An- thony Theodore Chronopoulos, and Huey-Wen Liang. 2023. Application of explainable artificial intelligence in medical health: A systematic review of interpretabilit...

  18. [21]

    Francesco Bardozzo, Mattia Delli Priscoli, Toby Collins, Antonello Forgione, Alexandre Hostettler, and Roberto Tagliaferri. 2022. Cross X-AI: Explainable Semantic Segmentation of Laparoscopic Images in Relation to Depth Estimation. In2022 International Joint Conference on Neur...

  19. [22]

    Shahaf Bassan and Guy Katz. 2023. Towards formal XAI: formally approximate minimal explanations of neural networks. InInternational Conference on Tools and Algorithms for the Construction and Analysis of Systems . Springer, 187–207

  20. [23]

    Mohan Bhandari, Tej Bahadur Shahi, Birat Siku, and Arjun Neupane. 2022. Explanatory classification of CXR images into COVID-19, Pneumonia and Tuberculosis using deep learning and XAI. Computers in Biology and Medicine 150 (2022), 106156

  21. [24]

    Mohan Bhandari, Pratheepan Yogarajah, Muthu Subash Kavitha, and Joan Condell. 2023. Exploring the Capabilities of a Lightweight CNN Model in Accurately Identifying Renal Abnormalities: Cysts, Stones, and Tumors, Using LIME and SHAP. Applied Sciences 13, 5 (2023), 3125

  22. [25]

    Kunal Bhatia, Sabrina Dhalla, Ajay Mittal, Savita Gupta, Aastha Gupta, and Alka Jindal. 2023. Integrating explainability into deep learning-based models for white blood cells classification. Computers and Electrical Engineering 110 (2023), 108913

  23. [26]

    David A Broniatowski et al. 2021. Psychological foundations of explainability and interpretability in artificial intelligence. NIST, Tech. Rep (2021)

  24. [27]

    Martha Büttner, Lisa Schneider, Aleksander Krasowski, Joachim Krois, Ben Feldberg, and Falk Schwendicke. 2023. Impact of Noisy Labels on Dental Deep Learning—Calculus Detection on Bitewing Radiographs. Journal of Clinical Medicine 12, 9 (2023), 3058

  25. [28]

    Ahmad Chaddad, Jihao Peng, Jian Xu, and Ahmed Bouridane. 2023. Survey of explainable AI techniques in healthcare. Sensors 23, 2 (2023), 634

  26. [29]

    Aditya Chattopadhay, Anirban Sarkar, Prantik Howlader, and Vineeth N Balasubramanian. 2018. Grad-cam++: Generalized gradient- based visual explanations for deep convolutional networks. In 2018 IEEE winter conference on applications of computer vision (W ACV). IEEE, 839–847

  27. [30]

    Touhidul Islam Chayan, Anita Islam, Eftykhar Rahman, Md Tanzim Reza, Tasnim Sakib Apon, and MD Golam Rabiul Alam. 2022. Explainable AI based Glaucoma Detection using Transfer Learning and LIME. In 2022 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE...

  28. [31]

    A Chempak Kumar and D Muhammad Noorul Mubarak. 2022. Evaluation of Gastric Cancer Using Explainable AI Techniques. In International Conference on Information and Management Engineering . Springer, 87–98

  29. [32]

    Dehua Chen, Hongjin Zhao, Jianrong He, Qiao Pan, and Weiliang Zhao. 2021. An Causal XAI Diagnostic Model for Breast Cancer Based on Mammography Reports. In 2021 IEEE International Conference on Bioinformatics and Biomedicine (BIBM) . 3341–3349. https: //doi.org/10.1109/BIBM526...

  30. [33]

    Richard J Chen, Judy J Wang, Drew FK Williamson, Tiffany Y Chen, Jana Lipkova, Ming Y Lu, Sharifa Sahai, and Faisal Mahmood. 2023. Algorithmic fairness in artificial intelligence for medicine and healthcare. Nature biomedical engineering 7, 6 (2023), 719–742

  31. [34]

    Carlo Combi, Beatrice Amico, Riccardo Bellazzi, Andreas Holzinger, Jason H Moore, Marinka Zitnik, and John H Holmes. 2022. A manifesto on explainability for artificial intelligence in medicine. Artificial Intelligence in Medicine 133 (2022), 102423

  32. [36]

    Adam Corbin and Oge Marques. 2023. Assessing Bias in Skin Lesion Classifiers with Contemporary Deep Learning and Post-Hoc Explainability Techniques. IEEE Access (2023)

  33. [37]

    Nicholas Cummins, Zhao Ren, Adria Mallol-Ragolta, and Björn Schuller. 2020. Machine learning in digital health, recent trends, and ongoing challenges. In Artificial Intelligence in Precision Health . Elsevier, 121–148

  34. [38]

    Diogo Baptista Martins da Mata. 2022. Biomedical Multimodal Explanations-Increasing Diversity and Complementarity in Explainable Artificial Intelligence. (2022)

  35. [39]

    Getamesay Haile Dagnaw and Meryam El Mouthadi. 2023. Towards Explainable Artificial Intelligence for Pneumonia and Tuberculosis Classification from Chest X-Ray. In 2023 International Conference on Information and Communication Technology for Development for Africa (ICT4DA). IE...

  36. [40]

    Paul B De Laat. 2018. Algorithmic decision-making based on machine learning from big data: can transparency restore accountability? Philosophy & technology 31, 4 (2018), 525–541

  37. [41]

    Luis A de Souza Jr, Robert Mendel, Sophia Strasser, Alanna Ebigbo, Andreas Probst, Helmut Messmann, Joao P Papa, and Christoph Palm. 2021. Convolutional Neural Networks for the evaluation of cancer in Barrett’s esophagus: Explainable AI to lighten up the black-box. Computers i...

  38. [43]

    Vincenzo Dentamaro, Donato Impedovo, Luca Musti, Giuseppe Pirlo, and Paolo Taurisano. 2024. Enhancing early Parkinson’s disease detection through multimodal deep learning and explainable AI: insights from the PPMI database. Scientific Reports 14, 1 (2024), 20941

  39. [44]

    Omer Deperlioglu, Utku Kose, Deepak Gupta, Ashish Khanna, Fabio Giampaolo, and Giancarlo Fortino. 2022. Explainable framework for Glaucoma diagnosis by image processing and convolutional neural network synergy: analysis with doctor evaluation. Future Generation Computer System...

  40. [45]

    Jose Luis Diaz Resendiz, Volodymyr Ponomaryov, Rogelio Reyes Reyes, and Sergiy Sadovnychiy. 2023. Explainable CAD System for Classification of Acute Lymphoblastic Leukemia Based on a Robust White Blood Cell Segmentation. Cancers 15, 13 (2023), 3376

  41. [46]

    Shakib Mahmud Dipto, Md Tanzim Reza, Mst Nasrin Akhter, Nadia Tasnim Mim, and Md Ashraful Alam. 2023. PNEXAI: An Explainable AI Driven Decipherable Pneumonia Classification System Leveraging Ensemble Neural Network. In 2023 IEEE World AI IoT Congress (AIIoT). IEEE, 0001–0006

  42. [47]

    Shakib Mahmud Dipto, Md Tanzim Reza, Md Nowroz Junaed Rahman, Mohammad Zavid Parvez, Prabal Datta Barua, and Subrata Chakraborty. 2023. An XAI Integrated Identification System of White Blood Cell Type Using Variants of Vision Transformer. In International Conference on Interac...

  43. [48]

    Jamie Duell, Xiuyi Fan, Bruce Burnett, Gert Aarts, and Shang Ming Zhou. 2021. A Comparison of Explanations Given by Explainable Artificial Intelligence Methods on Analysing Electronic Health Records. 2021 IEEE EMBS International Conference on Biomedical and Health Informatics ...

  44. [49]

    Ken W Dunn and Mark A de Belder. 2022. Using data to drive service improvement: false dawns and a promised land?Future Healthcare Journal 9, 2 (2022), 150

  45. [50]

    Eyad Elyan, Pattaramon Vuttipittayamongkol, Pamela Johnston, Kyle Martin, Kyle McPherson, Carlos Francisco Moreno-García, Chrisina Jayne, and Md Mostafa Kamal Sarker. 2022. Computer vision and machine learning for medical image analysis: recent advances, challenges, and way fo...

  46. [51]

    Samman Fatima, Sikandar Ali, and Hee-Cheol Kim. 2023. A Comprehensive Review on Multiple Instance Learning. Electronics 12, 20 (2023). https://doi.org/10.3390/electronics12204323

  47. [52]

    Mauricio Flores, Gustavo Glusman, Kristin Brogaard, Nathan D Price, and Leroy Hood. 2013. P4 medicine: how systems medicine will transform the healthcare sector and society. Personalized medicine 10, 6 (2013), 565–576

  48. [53]

    Stephanie Forrest and Melanie Mitchell. 1993. What makes a problem hard for a genetic algorithm? Some anomalous results and their explanation. Machine Learning 13 (1993), 285–319

  49. [54]

    M Ganeshkumar, Vinayakumar Ravi, V Sowmya, EA Gopalakrishnan, and KP Soman. 2021. Explainable deep learning-based approach for multilabel classification of electrocardiogram. IEEE Transactions on Engineering Management (2021)

  50. [55]

    Loveleen Gaur, Mohan Bhandari, Tanvi Razdan, Saurav Mallik, and Zhongming Zhao. 2022. Explanation-driven deep learning model for prediction of brain tumour status using MRI image data. Frontiers in genetics 13 (2022), 448

  51. [56]

    Felipe O Giuste, Ryan Sequeira, Vikranth Keerthipati, Peter Lais, Ali Mirzazadeh, Arshawn Mohseni, Yuanda Zhu, Wenqi Shi, Benoit Marteau, Yishan Zhong, et al. 2023. Explainable synthetic image generation to improve risk assessment of rare pediatric heart transplant rejection. ...

  52. [57]

    Kanika Goel, Renuka Sindhgatta, Sumit Kalra, Rohan Goel, and Preeti Mutreja. 2022. The effect of machine learning explanations on user trust for automated diagnosis of COVID-19. Computers in Biology and Medicine 146 (2022), 105587

  53. [58]

    Prashant Gohel, Priyanka Singh, and Manoranjan Mohanty. 2021. Explainable AI: current status and future directions. arXiv preprint arXiv:2107.07045 (2021)

  54. [59]

    Valerio Guarrasi and Paolo Soda. 2023. Multi-objective optimization determines when, which and how to fuse deep networks: An application to predict COVID-19 outcomes. Computers in Biology and Medicine 154 (2023), 106625

  55. [60]

    Pratiyush Guleria, Parvathaneni Naga Srinivasu, Shakeel Ahmed, Naif Almusallam, and Fawaz Khaled Alarfaj. 2022. XAI framework for cardiovascular disease prediction using classification techniques. Electronics 11, 24 (2022), 4086

  56. [61]

    David Gunning and David Aha. 2019. DARPA’s explainable artificial intelligence (XAI) program. AI magazine 40, 2 (2019), 44–58

  57. [62]

    David Gutman, Noel CF Codella, Emre Celebi, Brian Helba, Michael Marchetti, Nabin Mishra, and Allan Halpern. 2016. Skin lesion analysis toward melanoma detection: A challenge at the international symposium on biomedical imaging (ISBI) 2016, hosted by the international skin ima...

  58. [63]

    Maria Habib, Mohammad Faris, Raneem Qaddoura, Manal Alomari, Alaa Alomari, and Hossam Faris. 2021. Toward an automatic quality assessment of voice-based telemedicine consultations: a deep learning approach. Sensors 21, 9 (2021), 3279

  59. [64]

    Hani Hagras. 2018. Toward human-understandable, explainable AI. Computer 51, 9 (2018), 28–36

  60. [65]

    Fuchang Han, Shenghui Liao, Renzhong Wu, Shu Liu, Yuqian Zhao, and Yu Xie. 2021. Explainable Predictions of Renal Cell Carcinoma with Interpretable Tree Ensembles from Contrast-enhanced CT Images. In 2021 International Joint Conference on Neural Networks (IJCNN). IEEE, 1–8

  61. [66]

    Heather Hartley. 2023. Local Model Agnostic XAI Methodologies Applied to Breast Cancer Malignancy Predictions. (2023)

  62. [68]

    Jack Highton12, Quok Zong Chong, Richard Crawley, Julia A Schnabel234, and Kanwal K Bhatia. [n. d.]. Evaluation of Randomized Input Sampling for Explanation (RISE) for 3D XAI-Proof of Concept for Black-Box Brain-Hemorrhage Classification. ([n. d.])

  63. [69]

    Robert R Hoffman, Shane T Mueller, Gary Klein, and Jordan Litman. 2018. Metrics for explainable AI: Challenges and prospects. arXiv preprint arXiv:1812.04608 (2018). Proc. ACM Meas. Anal. Comput. Syst., Vol. 37, No. 4, Article 111. Publication date: August 2024. 111:26 • Q. Sun et al

  64. [70]

    Andreas Holzinger, Chris Biemann, Constantinos S Pattichis, and Douglas B Kell. 2017. What do we need to build explainable AI systems for the medical domain? arXiv preprint arXiv:1712.09923 (2017)

  65. [71]

    Sandro Hurtado, Hossein Nematzadeh, José García-Nieto, Miguel-Ángel Berciano-Guerrero, and Ismael Navas-Delgado. 2022. On the use of explainable artificial intelligence for the differential diagnosis of pigmented skin lesions. In International Work-Conference on Bioinformatics...

  66. [72]

    Shah Hussain, Iqra Mubeen, Niamat Ullah, Syed Shahab Ud Din Shah, Bakhtawar Abduljalil Khan, Muhammad Zahoor, Riaz Ullah, Farhat Ali Khan, and Mujeeb A Sultan. 2022. Modern diagnostic imaging technique applications and risk factors in the medical field: a review. BioMed resear...

  67. [73]

    Sardar Mehboob Hussain, Domenico Buongiorno, Nicola Altini, Francesco Berloco, Berardino Prencipe, Marco Moschetta, Vitoantonio Bevilacqua, and Antonio Brunetti. 2022. Shape-Based Breast Lesion Classification Using Digital Tomosynthesis Images: The Role of Explainable Artifici...

  68. [74]

    Md Khairul Islam, Md Mahbubur Rahman, Md Shahin Ali, SM Mahim, and Md Sipon Miah. 2023. Enhancing lung abnormalities detection and classification using a Deep Convolutional Neural Network and GRU with explainable AI: A promising approach for accurate diagnosis. Machine Learnin...

  69. [75]

    Emily Jia. 2020. Explaining explanations and perturbing perturbations . Ph. D. Dissertation

  70. [76]

    Dan Jin, Bo Zhou, Ying Han, Jiaji Ren, Tong Han, Bing Liu, Jie Lu, Chengyuan Song, Pan Wang, Dawei Wang, et al. 2020. Generalizable, reproducible, and neuroscientifically interpretable imaging biomarkers for Alzheimer’s disease. Advanced Science 7, 14 (2020), 2000675

  71. [77]

    Weina Jin, Xiaoxiao Li, Mostafa Fatehi, and Ghassan Hamarneh. 2023. Guidelines and evaluation of clinical explainable AI in medical image analysis. Medical Image Analysis 84 (2023), 102684

  72. [78]

    Muhammad Junaid, Sajid Ali, Fatma Eid, Shaker El-Sappagh, and Tamer Abuhmed. 2023. Explainable machine learning models based on multimodal time-series data for the early detection of Parkinson’s disease. Computer Methods and Programs in Biomedicine 234 (2023), 107495

  73. [79]

    Lamin Juwara, Alaa El-Hussuna, and Khaled El Emam. 2024. An evaluation of synthetic data augmentation for mitigating covariate bias in health data. Patterns 5, 4 (2024)

  74. [80]

    Alena Kalyakulina, Igor Yusipov, Maria Giulia Bacalini, Claudio Franceschi, Maria Vedunova, and Mikhail Ivanchenko. 2022. Disease classification for whole-blood DNA methylation: Meta-analysis, missing values imputation, and XAI. GigaScience 11 (2022), giac097

  75. [81]

    Peiqi Kang, Jinxuan Li, Shuo Jiang, and Peter B Shull. 2022. Reduce system redundancy and optimize sensor disposition for EMG–IMU multimodal fusion human–machine interfaces with XAI. IEEE Transactions on Instrumentation and Measurement 72 (2022), 1–9

  76. [82]

    Mark T Keane and Barry Smyth. 2020. Good counterfactuals and where to find them: A case-based technique for generating counterfactuals for explainable AI (XAI). In Case-Based Reasoning Research and Development: 28th International Conference, ICCBR 2020, Salamanca, Spain, June ...

  77. [83]

    Sascha M Keij, Nanny van Duijn-Bakker, Anne M Stiggelbout, and Arwen H Pieterse. 2021. What makes a patient ready for shared decision making? A qualitative study. Patient Education and Counseling 104, 3 (2021), 571–577

  78. [84]

    Sara Ketabi, Pranav Agnihotri, Hamed Zakeri, Khashayar Namdar, and Farzad Khalvati. 2023. Multimodal Learning for Improving Performance and Explainability of Chest X-Ray Classification. In International Conference on Medical Image Computing and Computer- Assisted Intervention....

  79. [85]

    Aaishwarya Khalane, Rikesh Makwana, Talal Shaikh, and Abrar Ullah. 2023. Evaluating significant features in context-aware multimodal emotion recognition with XAI methods. Expert Systems (2023), e13403

  80. [86]

    Tarek Khater, Sam Ansari, Soliman Mahmoud, Abir Hussain, and Hissam Tawfik. 2023. Skin cancer classification using explainable artificial intelligence on pre-extracted image features. Intelligent Systems with Applications 20 (2023), 200275

  81. [87]

    Adree Khondker, Jethro CC Kwong, Mandy Rickard, Marta Skreta, Daniel T Keefe, Armando J Lorenzo, and Lauren Erdman. 2022. A machine learning-based approach for quantitative grading of vesicoureteral reflux from voiding cystourethrograms: Methods and proof of concept. Journal o...

  82. [88]

    Been Kim, Martin Wattenberg, Justin Gilmer, Carrie Cai, James Wexler, Fernanda Viegas, et al. 2018. Interpretability beyond feature attribution: Quantitative testing with concept activation vectors (tcav). In International conference on machine learning . PMLR, 2668– 2677

  83. [89]

    Kevser Kübra Kırboğa. 2023. Bladder cancer gene expression prediction with explainable algorithms.Neural Computing and Applications (2023), 1–13

  84. [90]

    Marta Kłosok, Marcin Chlebus, et al. 2020. Towards better understanding of complex machine learning models using explainable artificial intelligence (XAI): Case of credit scoring modelling . University of Warsaw, Faculty of Economic Sciences Warsaw

  85. [91]

    Katarzyna Kobylińska, Tadeusz Orłowski, Mariusz Adamek, and Przemysław Biecek. 2022. Explainable machine learning for lung cancer screening models. Applied Sciences 12, 4 (2022), 1926

  86. [92]

    Michele La Ferla. 2023. An XAI Approach to Deep Learning Models in the Detection of DCIS. In IFIP International Conference on Artificial Intelligence Applications and Innovations. Springer, 409–420. Proc. ACM Meas. Anal. Comput. Syst., Vol. 37, No. 4, Article 111. Publication ...

  87. [93]

    H Chad Lane, Mark G Core, Michael Van Lent, Steve Solomon, and Dave Gomboc. 2005. Explainable Artificial Intelligence for Training and Tutoring.. In AIED. 762–764

  88. [94]

    Khiem H Le, Hieu H Pham, Thao BT Nguyen, Tu A Nguyen, Tien N Thanh, and Cuong D Do. 2023. Lightx3ecg: A lightweight and explainable deep learning system for 3-lead electrocardiogram classification.Biomedical Signal Processing and Control 85 (2023), 104963

  89. [95]

    Eunjin Lee, David Braines, Mitchell Stiffler, Adam Hudler, and Daniel Harborne. 2019. Developing the sensitivity of LIME for better machine learning explanation. In Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications , Vol. 11006. SPIE, 349–356

  90. [96]

    David Leslie. 2019. Understanding artificial intelligence ethics and safety. arXiv preprint arXiv:1906.05684 (2019)

  91. [97]

    Minglei Li, Xiang Li, Yuchen Jiang, Jiusi Zhang, Hao Luo, and Shen Yin. 2022. Explainable multi-instance and multi-task learning for COVID-19 diagnosis and lesion segmentation in CT images. Knowledge-Based Systems 252 (2022), 109278

  92. [98]

    Yi-Shan Lin, Wen-Chuan Lee, and Z Berkay Celik. 2021. What do you see? Evaluation of explainable artificial intelligence (XAI) interpretability through neural backdoors. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining . 1027–1035

  93. [99]

    Zachary C Lipton. 2018. The mythos of model interpretability: In machine learning, the concept of interpretability is both important and slippery. Queue 16, 3 (2018), 31–57

  94. [101]

    Renyuan Liu, Tong Wang, Xuejie Zhang, and Xiaobing Zhou. 2023. DA-Res2UNet: Explainable blood vessel segmentation from fundus images. Alexandria Engineering Journal 68 (2023), 539–549

  95. [102]

    Michele Lo Giudice, Nadia Mammone, Cosimo Ieracitano, Umberto Aguglia, Danilo Mandic, and Francesco Carlo Morabito. 2022. Explainable Deep Learning Classification of Respiratory Sound for Telemedicine Applications. In International Conference on Applied Intelligence and Inform...

  96. [103]

    Hui Wen Loh, Chui Ping Ooi, Silvia Seoni, Prabal Datta Barua, Filippo Molinari, and U Rajendra Acharya. 2022. Application of explainable artificial intelligence for healthcare: A systematic review of the last decade (2011–2022). Computer Methods and Programs in Biomedicine 226...

  97. [105]

    Adriano Lucieri, Muhammad Naseer Bajwa, Stephan Alexander Braun, Muhammad Imran Malik, Andreas Dengel, and Sheraz Ahmed

  98. [106]

    Scott M Lundberg, Gabriel Erion, Hugh Chen, Alex DeGrave, Jordan M Prutkin, Bala Nair, Ronit Katz, Jonathan Himmelfarb, Nisha Bansal, and Su-In Lee. 2020. From local explanations to global understanding with explainable AI for trees. Nature machine intelligence 2, 1 (2020), 56–67

  99. [107]

    Scott M Lundberg and Su-In Lee. 2017. A unified approach to interpreting model predictions. Advances in neural information processing systems 30 (2017)

  100. [108]

    J Ma, L Schneider, S Lapuschkin, R Achtibat, M Duchrau, J Krois, F Schwendicke, and W Samek. 2022. Towards trustworthy ai in dentistry. Journal of Dental Research 101, 11 (2022), 1263–1268

  101. [109]

    Computer Methods and Programs in Biomedicine 215 (2022), 106620

    ExAID: A multimodal explanation framework for computer-aided diagnosis of skin lesions. Computer Methods and Programs in Biomedicine 215 (2022), 106620

  102. [110]

    AL-Essa Malik, Giuseppina Andresini, Annalisa Appice, and Donato Malerba. 2022. An XAI-based adversarial training ap- proach for cyber-threat detection. In 2022 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Perva- sive Intelligence and Computing, I...

  103. [111]

    Markus, J

    A. Markus, J. Kors, and P. Rijnbeek. 2020. The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategies. Journal of biomedical informatics (2020), 103655. https:...

  104. [112]

    Joao Marques-Silva and Alexey Ignatiev. 2022. Delivering trustworthy AI through formal XAI. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 36. 12342–12350

  105. [113]

    Shipra Madan, Santanu Chaudhury, and Tapan Kumar Gandhi. 2023. Explainable few-shot learning with visual explanations on a low resource pneumonia dataset. Pattern Recognition Letters 176 (2023), 109–116

  106. [114]

    James Mayanja, Enoch Hall Asanda, Joshua Mwesigwa, Pius Tumwebaze, and Ggaliwango Marvin. 2023. Explainable Artificial Intelligence and Deep Transfer Learning for Skin Disease Diagnosis. In International Conference on Image Processing and Capsule Networks. Springer, 711–724. P...

  107. [115]

    Silvan Mertes, Tobias Huber, Katharina Weitz, Alexander Heimerl, and Elisabeth André. 2022. Ganterfactual—counterfactual explana- tions for medical non-experts using generative adversarial learning. Frontiers in artificial intelligence 5 (2022), 825565

  108. [116]

    Christian Meske and Enrico Bunde. 2020. Transparency and trust in human-AI-interaction: The role of model-agnostic explanations in computer vision-based decision support. In Artificial Intelligence in HCI: First International Conference, AI-HCI 2020, Held as Part of the 22nd H...

  109. [117]

    Edouard Mathieu, Hannah Ritchie, Lucas Rodés-Guirao, Cameron Appel, Charlie Giattino, Joe Hasell, Bobbie Macdonald, Saloni Dattani, Diana Beltekian, Esteban Ortiz-Ospina, et al. 2020. Coronavirus pandemic (COVID-19). Our world in data (2020)

  110. [119]

    Dang Minh, H Xiang Wang, Y Fen Li, and Tan N Nguyen. 2022. Explainable artificial intelligence: a comprehensive review. Artificial Intelligence Review (2022), 1–66

  111. [120]

    Riccardo Miotto, Fei Wang, Shuang Wang, Xiaoqian Jiang, and Joel T Dudley. 2018. Deep learning for healthcare: review, opportunities and challenges. Briefings in bioinformatics 19, 6 (2018), 1236–1246

  112. [121]

    Carlo Metta, Andrea Beretta, Riccardo Guidotti, Yuan Yin, Patrick Gallinari, Salvatore Rinzivillo, and Fosca Giannotti. 2023. Improving trust and confidence in medical skin lesion diagnosis through explainable deep learning. International Journal of Data Science and Analytics ...

  113. [122]

    Brent Mittelstadt. 2019. Principles alone cannot guarantee ethical AI. Nature machine intelligence 1, 11 (2019), 501–507

  114. [123]

    Xiaomin Mou. 2019. Artificial intelligence: Investment trends and selected industry uses. International Finance Corporation 8 (2019)

  115. [124]

    Ray Moynihan, Sharon Sanders, Zoe A Michaleff, Anna Mae Scott, Justin Clark, Emma J To, Mark Jones, Eliza Kitchener, Melissa Fox, Minna Johansson, et al. 2021. Impact of COVID-19 pandemic on utilisation of healthcare services: a systematic review. BMJ open 11, 3 (2021), e045343

  116. [125]

    Felicia Miranda, Vishakha Choudhari, Selene Barone, Luc Anchling, Nathan Hutin, Marcela Gurgel, Najla Al Turkestani, Marilia Yatabe, Jonas Bianchi, Aron Aliaga-Del Castillo, et al. 2023. Interpretable artificial intelligence for classification of alveolar bone defect in patien...

  117. [126]

    Krishna Mridha, Md Mezbah Uddin, Jungpil Shin, Susan Khadka, and MF Mridha. 2023. An Interpretable Skin Cancer Classification Using Optimized Convolutional Neural Network for a Smart Healthcare System. IEEE Access (2023)

  118. [127]

    Axel C Mühlbacher and Anika Kaczynski. 2016. Making good decisions in healthcare with multi-criteria decision analysis: the use, current research and future development of MCDA. Applied health economics and health policy 14 (2016), 29–40

  119. [128]

    Doniyorjon Mukhtorov, Madinakhon Rakhmonova, Shakhnoza Muksimova, and Young-Im Cho. 2023. Endoscopic image classification based on explainable deep learning. Sensors 23, 6 (2023), 3176

  120. [129]

    Krishna Mridha, Apu Chandra Barman, Shekhar Biswas, Shakil Sarkar, Sunanda Biswas, and Masrur Ahsan Priyok. 2023. Accuracy and Interpretability: Developing a Computer-Aided Diagnosis System for Pneumonia Detection in Chest X-Ray Images. In2023 International Conference on Distr...

  121. [130]

    Tushar Nayak, Krishnaraj Chadaga, Niranjana Sampathila, Hilda Mayrose, G Muralidhar Bairy, Srikanth Prabhu, Swathi S Katta, and Shashikiran Umakanth. 2023. Detection of Monkeypox from skin lesion images using deep learning networks and explainable artificial intelligence. Appl...

  122. [131]

    NHS England. 2023. GP Patient Survey 2023 Technical Annex. https://gp-patient.co.uk/downloads/2023/GPPS_2023_Technical_ Annex_PUBLIC.pdf Accessed: 2023-12-29

  123. [132]

    Robert Nimmo, Marios Constantinides, Ke Zhou, Daniele Quercia, and Simone Stumpf. 2024. User Characteristics in Explainable AI: The Rabbit Hole of Personalization?. In Proceedings of the CHI Conference on Human Factors in Computing Systems . 1–13

  124. [133]

    Meike Nauta, Jan Trienes, Shreyasi Pathak, Elisa Nguyen, Michelle Peters, Yasmin Schmitt, Jörg Schlötterer, Maurice Van Keulen, and Christin Seifert. 2023. From anecdotal evidence to quantitative evaluation methods: A systematic review on evaluating explainable ai. Comput. Sur...

  125. [134]

    Modupe Odusami, Rytis Maskeli¯unas, Robertas Damaševičius, and Sanjay Misra. 2023. Explainable Deep-Learning-Based Diagnosis of Alzheimer’s Disease Using Multimodal Input Fusion of PET and MRI Images. Journal of Medical and Biological Engineering (2023), 1–12

  126. [135]

    Daniel Omeiza, Skyler Speakman, Celia Cintas, and Komminist Weldermariam. 2019. Smooth grad-cam++: An enhanced inference level visualization technique for deep convolutional neural network models. arXiv preprint arXiv:1908.01224 (2019)

  127. [136]

    Matthew O’Shaughnessy, Gregory Canal, Marissa Connor, Christopher Rozell, and Mark Davenport. 2020. Generative causal explana- tions of black-box classifiers. Advances in neural information processing systems 33 (2020), 5453–5467

  128. [137]

    Muhammad Nouman Noor, Muhammad Nazir, Sajid Ali Khan, Imran Ashraf, and Oh-Young Song. 2023. Localization and classification of gastrointestinal tract disorders using explainable AI from endoscopic images. Applied Sciences 13, 15 (2023), 9031

  129. [138]

    Andrea Papenmeier, Dagmar Kern, Gwenn Englebienne, and Christin Seifert. 2022. It’s complicated: The relationship between user trust, model accuracy and explanations in ai. ACM Transactions on Computer-Human Interaction (TOCHI) 29, 4 (2022), 1–33. Proc. ACM Meas. Anal. Comput....

  130. [139]

    European Parliament, Directorate-General for Parliamentary Research Services, K Lekadir, G Quaglio, A Tselioudis Garmendia, and C Gallin. 2022. Artificial intelligence in healthcare – Applications, risks, and ethical and societal impacts . European Parliament. https://doi.org/...

  131. [140]

    Vitali Petsiuk, Abir Das, and Kate Saenko. 2018. Rise: Randomized input sampling for explanation of black-box models. arXiv preprint arXiv:1806.07421 (2018)

  132. [141]

    Jia Pan, Cong Liu, Zhiguo Wang, Yu Hu, and Hui Jiang. 2012. Investigation of deep neural networks (DNN) for large vocabulary continuous speech recognition: Why DNN surpasses GMMs in acoustic modeling. In 2012 8th International Symposium on Chinese Spoken Language Processing. I...

  133. [142]

    Nasir Rahim, Shaker El-Sappagh, Sajid Ali, Khan Muhammad, Javier Del Ser, and Tamer Abuhmed. 2023. Prediction of Alzheimer’s progression based on multimodal Deep-Learning-based fusion and visual Explainability of time-series data. Information Fusion 92 (2023), 363–388

  134. [143]

    MD Abdur Rahman, M Shamim Hossain, Nabil A Alrajeh, and BB Gupta. 2021. A multimodal, multimedia point-of-care deep learning framework for COVID-19 diagnosis. ACM Transactions on Multimidia Computing Communications and Applications 17, 1s (2021), 1–24

  135. [144]

    Arun Rai. 2020. Explainable AI: From black box to glass box. Journal of the Academy of Marketing Science 48 (2020), 137–141

  136. [145]

    Shiva prasad Koyyada and Thipendra P Singh. 2023. An explainable artificial intelligence model for identifying local indicators and detecting lung disease from chest X-ray images. Healthcare Analytics (2023), 100206

  137. [146]

    Harish Guruprasad Ramaswamy et al. 2020. Ablation-cam: Visual explanations for deep convolutional network via gradient-free localization. In proceedings of the IEEE/CVF winter conference on applications of computer vision . 983–991

  138. [147]

    Alberto Ramírez-Mena, Eduardo Andrés-León, Maria Jesus Alvarez-Cubero, Augusto Anguita-Ruiz, Luis Javier Martinez-Gonzalez, and Jesus Alcala-Fdez. 2023. Explainable artificial intelligence to predict and identify prostate cancer tissue by gene expression. Computer Methods and ...

  139. [148]

    P Kiran Rao, Subarna Chatterjee, M Janardhan, K Nagaraju, Surbhi Bhatia Khan, Ahlam Almusharraf, and Abdullah I Alharbe. 2023. Optimizing Inference Distribution for Efficient Kidney Tumor Segmentation Using a UNet-PWP Deep-Learning Model with XAI on CT Scan Images. Diagnostics...

  140. [149]

    Md Johir Raihan and Abdullah-Al Nahid. 2022. Malaria cell image classification by explainable artificial intelligence. Health and Technology 12, 1 (2022), 47–58

  141. [150]

    David Reinsel, John Gantz, and John Rydning. 2018. Data age 2025: the digitization of the world from edge to core. Seagate 16 (2018)

  142. [151]

    Zhao Ren, Kun Qian, Fengquan Dong, Zhenyu Dai, Wolfgang Nejdl, Yoshiharu Yamamoto, and Björn W Schuller. 2022. Deep attention-based neural networks for explainable heart sound classification. Machine Learning with Applications 9 (2022), 100322

  143. [152]

    Why should i trust you?

    Marco Tulio Ribeiro, Sameer Singh, and Carlos Guestrin. 2016. " Why should i trust you?" Explaining the predictions of any classifier. In Proceedings of the 22nd ACM SIGKDD international conference on knowledge discovery and data mining . 1135–1144

  144. [154]

    IETE Journal of Research (2022), 1–20

    Erythemato-Squamous Diseases Prediction and Interpretation Using Explainable AI. IETE Journal of Research (2022), 1–20

  145. [155]

    Raul Rojas and Raúl Rojas. 1996. The backpropagation algorithm. Neural networks: a systematic introduction (1996), 149–182

  146. [156]

    Cynthia Rudin. 2019. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nature machine intelligence 1, 5 (2019), 206–215

  147. [157]

    Mirka Saarela and Lilia Geogieva. 2022. Robustness, stability, and fidelity of explanations for a deep skin cancer classification model. Applied Sciences 12, 19 (2022), 9545

  148. [158]

    Fabien Ringeval, Björn Schuller, Michel Valstar, NIcholas Cummins, Roddy Cowie, Leili Tavabi, Maximilian Schmitt, Sina Alisamir, Shahin Amiriparian, Eva-Maria Messner, Siyang Song, Shuo Liu, Ziping Zhao, Adria Mallol-Ragolta, Zhao Ren, Mohammad Soleymani, and Maja Pantic. 2019...

  149. [159]

    Nikolaos Rodis, Christos Sardianos, Panagiotis Radoglou-Grammatikis, Panagiotis Sarigiannidis, Iraklis Varlamis, and Georgios Th Papadopoulos. 2024. Multimodal explainable artificial intelligence: A comprehensive review of methodological advances and future research directions...

  150. [161]

    Julian Savulescu and Hannah Maslen. 2015. Moral enhancement and artificial intelligence: moral AI? Beyond artificial intelligence: The disappearing human-machine divide (2015), 79–95

  151. [162]

    Björn W Schuller, Tuomas Virtanen, Maria Riveiro, Georgios Rizos, Jing Han, Annamaria Mesaros, and Konstantinos Drossos. 2021. Towards sonification in multimodal and user-friendlyexplainable artificial intelligence. InProceedings of the 2021 International Conference on Multimo...

  152. [163]

    AFM Saif, Tamjid Imtiaz, Shahriar Rifat, Celia Shahnaz, Wei-Ping Zhu, and M Omair Ahmad. 2021. CapsCovNet: A modified capsule network to diagnose Covid-19 from multimodal medical imaging. IEEE Transactions on Artificial Intelligence 2, 6 (2021), 608–617

  153. [164]

    2019.Explainable AI: interpreting, explaining and visualizing deep learning

    Wojciech Samek, Grégoire Montavon, Andrea Vedaldi, Lars Kai Hansen, and Klaus-Robert Müller. 2019.Explainable AI: interpreting, explaining and visualizing deep learning . Vol. 11700. Springer Nature

  154. [165]

    Ramprasaath R Selvaraju, Michael Cogswell, Abhishek Das, Ramakrishna Vedantam, Devi Parikh, and Dhruv Batra. 2017. Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE international conference on computer vision. 618–626

  155. [166]

    Sofia Serrano and Noah A Smith. 2019. Is attention interpretable? arXiv preprint arXiv:1906.03731 (2019)

  156. [167]

    Michalowski, and D

    Arash Shaban-Nejad, M. Michalowski, and D. Buckeridge. 2018. Health intelligence: how artificial intelligence transforms population and personalized health. NPJ Digital Medicine 1 (2018). https://doi.org/10.1038/s41746-018-0058-9

  157. [168]

    Gesina Schwalbe and Bettina Finzel. 2023. A comprehensive taxonomy for explainable artificial intelligence: a systematic survey of surveys on methods and concepts. Data Mining and Knowledge Discovery (2023), 1–59. Proc. ACM Meas. Anal. Comput. Syst., Vol. 37, No. 4, Article 11...

  158. [169]

    Nabeel Seedat, Vered Aharonson, and Yaniv Hamzany. 2020. Automated and interpretable m-health discrimination of vocal cord pathology enabled by machine learning. In 2020 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE) . IEEE, 1–6

  159. [170]

    Ruey-Kai Sheu, Mayuresh Sunil Pardeshi, Kai-Chih Pai, Lun-Chi Chen, Chieh-Liang Wu, and Wei-Cheng Chen. 2023. Interpretable Classification of Pneumonia Infection Using eXplainable AI (XAI-ICP). IEEE Access 11 (2023), 28896–28919

  160. [171]

    Ilija Šimić, Vedran Sabol, and Eduardo Veas. 2021. XAI Methods for Neural Time Series Classification: A Brief Review. arXiv preprint arXiv:2108.08009 (2021)

  161. [172]

    Karen Simonyan, Andrea Vedaldi, and Andrew Zisserman. 2013. Deep inside convolutional networks: Visualising image classification models and saliency maps. arXiv preprint arXiv:1312.6034 (2013)

  162. [173]

    Hamza Ahmed Shad, Quazi Ashikur Rahman, Nashita Binte Asad, Atif Zawad Bakshi, SM Faiaz Mursalin, Md Tanzim Reza, and Mohammad Zavid Parvez. 2021. Exploring Alzheimer’s disease prediction with XAI in various neural network models. In TENCON 2021-2021 IEEE Region 10 Conference ...

  163. [174]

    Thanveer Shaik, Xiaohui Tao, Haoran Xie, Lin Li, Juan D Velasquez, and Niall Higgins. 2023. QXAI: Explainable AI Framework for Quantitative Analysis in Patient Monitoring Systems. arXiv preprint arXiv:2309.10293 (2023)

  164. [175]

    MU Sreeja and MH Supriya. 2023. A Deep Convolutional Model for Heart Disease Prediction based on ECG Data with Explainable AI. WSEAS Transactions on Information Science and Applications 20 (2023), 254–264

  165. [176]

    Lukas Stappen, Jeremy Dillmann, Serena Striegel, Hans-Jörg Vögel, Nicolas Flores-Herr, and Björn W Schuller. 2023. Integrating Generative Artificial Intelligence in Intelligent Vehicle Systems. arXiv preprint arXiv:2305.17137 (2023)

  166. [177]

    K Muthamil Sudar, P Nagaraj, S Nithisaa, R Aishwarya, M Aakash, and S Ishwarya Lakshmi. 2022. Alzheimer’s Disease Analysis using Explainable Artificial Intelligence (XAI). In 2022 International Conference on Sustainable Computing and Data Communication Systems (ICSCDS). IEEE, 419–423

  167. [178]

    Amitojdeep Singh, Sourya Sengupta, and Vasudevan Lakshminarayanan. 2020. Explainable deep learning models in medical image analysis. Journal of imaging 6, 6 (2020), 52

  168. [179]

    Jost Tobias Springenberg, Alexey Dosovitskiy, Thomas Brox, and Martin Riedmiller. 2014. Striving for simplicity: The all convolutional net. arXiv preprint arXiv:1412.6806 (2014)

  169. [180]

    Mukund Sundararajan, Ankur Taly, and Qiqi Yan. 2016. Gradients of counterfactuals. arXiv preprint arXiv:1611.02639 (2016)

  170. [181]

    William Swartout, Cecile Paris, and Johanna Moore. 1991. Explanations in knowledge systems: Design for explainable expert systems. IEEE Expert 6, 3 (1991), 58–64

  171. [182]

    Lucas O Teixeira, Rodolfo M Pereira, Diego Bertolini, Luiz S Oliveira, Loris Nanni, George DC Cavalcanti, and Yandre MG Costa. 2021. Impact of lung segmentation on the diagnosis and explanation of COVID-19 in chest X-ray images. Sensors 21, 21 (2021), 7116

  172. [183]

    Hao Sun, Jiaqing Liu, Shurong Chai, Zhaolin Qiu, Lanfen Lin, Xinyin Huang, and Yenwei Chen. 2021. Multi-modal adaptive fusion transformer network for the estimation of depression level. Sensors 21, 14 (2021), 4764

  173. [184]

    Schuller

    Qiyang Sun, Alican Akman, Xin Jing, Manuel Milling, and Björn W. Schuller. 2024. Audio-based Kinship Verification Using Age Domain Conversion. arXiv:2410.11120 [cs.SD] https://arxiv.org/abs/2410.11120

  174. [185]

    Chiagoziem C Ukwuoma, Zhiguang Qin, Md Belal Bin Heyat, Faijan Akhtar, Olusola Bamisile, Abdullah Y Muaad, Daniel Addo, and Mugahed A Al-Antari. 2023. A hybrid explainable ensemble transformer encoder for pneumonia identification from chest X-ray images. Journal of Advanced Re...

  175. [186]

    Jeya Maria Jose Valanarasu, Poojan Oza, Ilker Hacihaliloglu, and Vishal M Patel. 2021. Medical transformer: Gated axial-attention for medical image segmentation. In Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbour...

  176. [187]

    Bas HM Van der Velden, Hugo J Kuijf, Kenneth GA Gilhuijs, and Max A Viergever. 2022. Explainable artificial intelligence (XAI) in deep learning-based medical image analysis. Medical Image Analysis 79 (2022), 102470

  177. [188]

    Erico Tjoa and Cuntai Guan. 2020. A survey on explainable artificial intelligence (xai): Toward medical xai. IEEE transactions on neural networks and learning systems 32, 11 (2020), 4793–4813

  178. [189]

    Philipp A Toussaint, Florian Leiser, Scott Thiebes, Matthias Schlesner, Benedikt Brors, and Ali Sunyaev. 2024. Explainable artificial intelligence for omics data: a systematic mapping study. Briefings in Bioinformatics 25, 1 (2024), bbad453

  179. [190]

    Giulia Vilone and Luca Longo. 2020. Explainable artificial intelligence: a systematic review. arXiv preprint arXiv:2006.00093 (2020)

  180. [191]

    Thinira Wanasinghe, Sakuni Bandara, Supun Madusanka, Dulani Meedeniya, Meelan Bandara, and Isabel de la Torre Díez. 2024. Lung Sound Classification with Multi-Feature Integration Utilizing Lightweight CNN Model. IEEE Access (2024)

  181. [192]

    Chao Wang and Pengcheng An. 2021. Explainability via Interactivity? Supporting Nonexperts’ Sensemaking of pre-trained CNN by Interacting with Their Daily Surroundings. In Extended Abstracts of the 2021 Annual Symposium on Computer-Human Interaction in Play. 274–279

  182. [193]

    Michael Van Lent, William Fisher, and Michael Mancuso. 2004. An explainable artificial intelligence system for small-unit tactical behavior. In Proceedings of the national conference on artificial intelligence . Citeseer, 900–907. Proc. ACM Meas. Anal. Comput. Syst., Vol. 37, ...

  183. [194]

    Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017)

  184. [195]

    Lidong Wang and Cheryl Ann Alexander. 2020. Big data analytics in medical engineering and healthcare: methods, advances and challenges. Journal of medical engineering & technology 44, 6 (2020), 267–283

  185. [196]

    Yongjie Wang, Tong Zhang, Xu Guo, and Zhiqi Shen. 2024. Gradient based Feature Attribution in Explainable AI: A Technical Review. arXiv preprint arXiv:2403.10415 (2024)

  186. [197]

    Hu, and Jianmin Jiang

    Zheng Wang, Ziqi Zhou, Huchuan Lu, Q. Hu, and Jianmin Jiang. 2020. Video Saliency Prediction via Joint Discrimination and Local Consistency. IEEE Transactions on Cybernetics 52 (2020), 1490–1501. https://doi.org/10.1109/tcyb.2020.2989158

  187. [198]

    Haofan Wang, Rakshit Naidu, Joy Michael, and Soumya Snigdha Kundu. 2020. SS-CAM: Smoothed Score-CAM for sharper visual feature localization. arXiv preprint arXiv:2006.14255 (2020)

  188. [199]

    Haofan Wang, Zifan Wang, Mengnan Du, Fan Yang, Zijian Zhang, Sirui Ding, Piotr Mardziel, and Xia Hu. 2020. Score-CAM: Score- weighted visual explanations for convolutional neural networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition wor...

  189. [200]

    Anne Wullenweber, Alican Akman, and Björn W Schuller. 2022. CoughLIME: Sonified explanations for the predictions of COVID-19 cough classifiers. In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) . IEEE, 1342–1345

  190. [201]

    Xiaozheng Xie, Jianwei Niu, Xuefeng Liu, Zhengsu Chen, Shaojie Tang, and Shui Yu. 2021. A survey on incorporating domain knowledge into deep learning for medical image analysis. Medical Image Analysis 69 (2021), 101985

  191. [202]

    Fan Xu, Li Jiang, Wenjing He, Guangyi Huang, Yiyi Hong, Fen Tang, Jian Lv, Yunru Lin, Yikun Qin, Rushi Lan, et al. 2021. The clinical value of explainable deep learning for diagnosing fungal keratitis using in vivo confocal microscopy images. Frontiers in Medicine 8 (2021), 797616

  192. [203]

    Niyaz Ahmad Wani, Ravinder Kumar, and Jatin Bedi. 2024. DeepXplainer: An interpretable deep learning based approach for lung cancer detection using explainable artificial intelligence. Computer Methods and Programs in Biomedicine 243 (2024), 107879

  193. [204]

    Panpan Wu, Xuanchao Sun, Ziping Zhao, Haishuai Wang, Shirui Pan, Björn Schuller, et al. 2020. Classification of lung nodules based on deep residual networks and migration learning. Computational intelligence and neuroscience 2020 (2020)

  194. [205]

    Wenjie Yang, Houjing Huang, Zhang Zhang, Xiaotang Chen, Kaiqi Huang, and Shu Zhang. 2019. Towards rich feature discovery with class activation maps augmentation for person re-identification. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. ...

  195. [206]

    Yuting Yang, Gang Mei, and Francesco Piccialli. 2022. A Deep Learning Approach Considering Image Background for Pneumonia Identification Using Explainable AI (XAI). IEEE/ACM Transactions on Computational Biology and Bioinformatics (2022)

  196. [207]

    Hyun Yoo, Soyoung Han, and Kyungyong Chung. 2021. Diagnosis support model of cardiomegaly based on CNN using ResNet and explainable feature map. IEEE Access 9 (2021), 55802–55813

  197. [208]

    Yongjun Xu, Xin Liu, Xin Cao, Changping Huang, Enke Liu, Sen Qian, Xingchen Liu, Yanjun Wu, Fengliang Dong, Cheng-Wei Qiu, et al. 2021. Artificial intelligence: A powerful paradigm for scientific research. The Innovation 2, 4 (2021)

  198. [209]

    Yiqi Yan, Jeremy Kawahara, and Ghassan Hamarneh. 2019. Melanoma Recognition via Visual Attention. In Information Processing in Medical Imaging, Albert C. S. Chung, James C. Gee, Paul A. Yushkevich, and Siqi Bao (Eds.). Springer International Publishing, Cham, 793–804

  199. [210]

    Matthew D Zeiler and Rob Fergus. 2014. Visualizing and understanding convolutional networks. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part I 13 . Springer, 818–833

  200. [211]

    Bolei Zhou, Aditya Khosla, Agata Lapedriza, Aude Oliva, and Antonio Torralba. 2016. Learning deep features for discriminative localization. In Proceedings of the IEEE conference on computer vision and pattern recognition . 2921–2929. Received 26 June 2024; revised ; accepted P...

  201. [213]

    Kyubaek Yoon, Jae-Young Kim, Sun-Jong Kim, Jong-Ki Huh, Jin-Woo Kim, and Jongeun Choi. 2023. Explainable deep learning-based clinical decision support engine for MRI-based automated diagnosis of temporomandibular joint anterior disk displacement. Computer Methods and Programs ...

  202. [214]

    Dong Yu and Jinyu Li. 2017. Recent progresses in deep learning based acoustic models. IEEE/CAA Journal of automatica sinica 4, 3 (2017), 396–409

  203. [2020]

    In 2020 international joint conference on neural networks (IJCNN)

    On interpretability of deep learning based skin lesion classifiers using concept activation vectors. In 2020 international joint conference on neural networks (IJCNN) . IEEE, 1–10

  204. [2022]

    where" to

    From" where" to" what": Towards human-understandable explanations through concept relevance propagation. arXiv preprint arXiv:2206.03208 (2022)

  205. [2023]

    Nature Machine Intelligence 5, 9 (2023), 1006–1019

    From attribution maps to human-understandable explanations through Concept Relevance Propagation. Nature Machine Intelligence 5, 9 (2023), 1006–1019

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.