[Basics of three dimensional image processing].

J. Toriwaki

DOI: https://doi.org/10.6009/JJRT.KJ00001364417

2002-05-01

Abstract:

What problem does this paper attempt to address?

Explainable artificial intelligence (XAI) in radiology and nuclear medicine: a literature review

Bart M. de Vries,Gerben J. C. Zwezerijnen,George L. Burchell,Floris H. P. van Velden,Catharina Willemien Menke-van der Houven van Oordt,Ronald Boellaard

DOI: https://doi.org/10.3389/fmed.2023.1180773

IF: 3.9

2023-05-12

Frontiers in Medicine

Abstract:Rational Deep learning (DL) has demonstrated a remarkable performance in diagnostic imaging for various diseases and modalities and therefore has a high potential to be used as a clinical tool. However, current practice shows low deployment of these algorithms in clinical practice, because DL algorithms lack transparency and trust due to their underlying black-box mechanism. For successful employment, explainable artificial intelligence (XAI) could be introduced to close the gap between the medical professionals and the DL algorithms. In this literature review, XAI methods available for magnetic resonance (MR), computed tomography (CT), and positron emission tomography (PET) imaging are discussed and future suggestions are made. Methods PubMed, Embase.com and Clarivate Analytics/Web of Science Core Collection were screened. Articles were considered eligible for inclusion if XAI was used (and well described) to describe the behavior of a DL model used in MR, CT and PET imaging. Results A total of 75 articles were included of which 54 and 17 articles described post and ad hoc XAI methods, respectively, and 4 articles described both XAI methods. Major variations in performance is seen between the methods. Overall, post hoc XAI lacks the ability to provide class-discriminative and target-specific explanation. Ad hoc XAI seems to tackle this because of its intrinsic ability to explain. However, quality control of the XAI methods is rarely applied and therefore systematic comparison between the methods is difficult. Conclusion There is currently no clear consensus on how XAI should be deployed in order to close the gap between medical professionals and DL algorithms for clinical implementation. We advocate for systematic technical and clinical quality assessment of XAI methods. Also, to ensure end-to-end unbiased and safe integration of XAI in clinical workflow, (anatomical) data minimization and quality control methods should be included.

medicine, general & internal
Evaluating the quality of visual explanations on chest X-ray images for thorax diseases classification

Shakiba Rahimiaghdam,Hande Alemdar

DOI: https://doi.org/10.1007/s00521-024-09587-0

2024-03-10

Neural Computing and Applications

Abstract:Abstract Deep learning models are extensively used but often lack transparency due to their complex internal mechanics. To bridge this gap, the field of explainable AI (XAI) strives to make these models more interpretable. However, a significant obstacle in XAI is the absence of quantifiable metrics for evaluating explanation quality. Existing techniques, reliant on manual assessment or inadequate metrics, face limitations in scalability, reproducibility, and trustworthiness. Recognizing these issues, the current study specifically addresses the quality assessment of visual explanations in medical imaging, where interpretability profoundly influences diagnostic accuracy and trust in AI-assisted decisions. Introducing novel criteria such as informativeness, localization, coverage, multi-target capturing, and proportionality, this work presents a comprehensive method for the objective assessment of various explainability algorithms. These newly introduced criteria aid in identifying optimal evaluation metrics. The study expands the domain’s analytical toolkit by examining existing metrics, which have been prevalent in recent works for similar applications, and proposing new ones. Rigorous analysis led to selecting Jensen–Shannon divergence (JS_DIV) as the most effective metric for visual explanation quality. Applied to the multi-label, multi-class diagnosis of thoracic diseases using a trained classifier on the CheXpert dataset, local interpretable model-agnostic explanations (LIME) with diverse segmentation strategies interpret the classifier’s decisions. A qualitative analysis on an unseen subset of the VinDr-CXR dataset evaluates these metrics, confirming JS_DIV’s superiority. The subsequent quantitative analysis optimizes LIME’s hyper-parameters and benchmarks its performance across various segmentation algorithms, underscoring the utility of an objective assessment metric in practical applications.

computer science, artificial intelligence
Explainable Artificial Intelligence (XAI) for Deep Learning Based Medical Imaging Classification

Rawan Ghnemat,Sawsan Alodibat,Qasem Abu Al-Haija

DOI: https://doi.org/10.3390/jimaging9090177

2023-08-30

Abstract:Recently, deep learning has gained significant attention as a noteworthy division of artificial intelligence (AI) due to its high accuracy and versatile applications. However, one of the major challenges of AI is the need for more interpretability, commonly referred to as the black-box problem. In this study, we introduce an explainable AI model for medical image classification to enhance the interpretability of the decision-making process. Our approach is based on segmenting the images to provide a better understanding of how the AI model arrives at its results. We evaluated our model on five datasets, including the COVID-19 and Pneumonia Chest X-ray dataset, Chest X-ray (COVID-19 and Pneumonia), COVID-19 Image Dataset (COVID-19, Viral Pneumonia, Normal), and COVID-19 Radiography Database. We achieved testing and validation accuracy of 90.6% on a relatively small dataset of 6432 images. Our proposed model improved accuracy and reduced time complexity, making it more practical for medical diagnosis. Our approach offers a more interpretable and transparent AI model that can enhance the accuracy and efficiency of medical diagnosis.
Transparent and Clinically Interpretable AI for Lung Cancer Detection in Chest X-Rays

Amy Rafferty,Rishi Ramaesh,Ajitha Rajan

2024-03-28

Abstract:The rapidly advancing field of Explainable Artificial Intelligence (XAI) aims to tackle the issue of trust regarding the use of complex black-box deep learning models in real-world applications. Existing post-hoc XAI techniques have recently been shown to have poor performance on medical data, producing unreliable explanations which are infeasible for clinical use. To address this, we propose an ante-hoc approach based on concept bottleneck models which introduces for the first time clinical concepts into the classification pipeline, allowing the user valuable insight into the decision-making process. On a large public dataset of chest X-rays and associated medical reports, we focus on the binary classification task of lung cancer detection. Our approach yields improved classification performance in lung cancer detection when compared to baseline deep learning models (F1 > 0.9), while also generating clinically relevant and more reliable explanations than existing techniques. We evaluate our approach against post-hoc image XAI techniques LIME and SHAP, as well as CXR-LLaVA, a recent textual XAI tool which operates in the context of question answering on chest X-rays.

Machine Learning,Computer Vision and Pattern Recognition
Amputations and replantations.

J. Schlenker,C. Koulis

IF: 2

Emergency Medicine Clinics of North America

Abstract:Essential aspects of emergency department assessment and initial treatment of patients with traumatic amputations are outlined. Pitfalls of early treatment and indications for replantation are discussed. The dogmatic approach is avoided.
Explainable AI And Visual Reasoning: Insights From Radiology

Robert Kaufman,David Kirsh

2023-04-07

Abstract:Why do explainable AI (XAI) explanations in radiology, despite their promise of transparency, still fail to gain human trust? Current XAI approaches provide justification for predictions, however, these do not meet practitioners' needs. These XAI explanations lack intuitive coverage of the evidentiary basis for a given classification, posing a significant barrier to adoption. We posit that XAI explanations that mirror human processes of reasoning and justification with evidence may be more useful and trustworthy than traditional visual explanations like heat maps. Using a radiology case study, we demonstrate how radiology practitioners get other practitioners to see a diagnostic conclusion's validity. Machine-learned classifications lack this evidentiary grounding and consequently fail to elicit trust and adoption by potential users. Insights from this study may generalize to guiding principles for human-centered explanation design based on human reasoning and justification of evidence.

Human-Computer Interaction,Artificial Intelligence
Application of Example-Based Explainable Artificial Intelligence (XAI) for Analysis and Interpretation of Medical Imaging: A Systematic Review

Miguel Fontes,João Dallyson Sousa De Almeida,António Cunha

DOI: https://doi.org/10.1109/access.2024.3367606

IF: 3.9

2024-02-28

IEEE Access

Abstract:Explainable Artificial Intelligence (XAI) is an area of growing interest, particularly in medical imaging, where example-based techniques show great potential. This paper is a systematic review of recent example-based XAI techniques, a promising approach that remains relatively unexplored in clinical practice and medical image analysis. A selection and analysis of recent studies using example-based XAI techniques for interpreting medical images was carried out. Several approaches were examined, highlighting how each contributes to increasing accuracy, transparency, and usability in medical applications. These techniques were compared and discussed in detail, considering their advantages and limitations in the context of medical imaging, with a focus on improving the integration of these technologies into clinical practice and medical decision-making. The review also pointed out gaps in current research, suggesting directions for future investigations. The need to develop XAI methods that are not only technically efficient but also ethically responsible and adaptable to the needs of healthcare professionals was emphasised. Thus, the paper sought to establish a solid foundation for understanding and advancing example-based XAI techniques in medical imaging, promoting a more integrated and patient-centred approach to medicine.

computer science, information systems,telecommunications,engineering, electrical & electronic
Explainable Artificial Intelligence and Cardiac Imaging: Toward More Interpretable Models.

A. Lee,P. Gkontra,Z. Raisi-Estabragh,Ahmed M. A. Salih,Ilaria Boscolo Galazzo,Steffen E. Petersen,K. Lekadir

DOI: https://doi.org/10.1161/CIRCIMAGING.122.014519

2023-04-12

Circulation Cardiovascular Imaging

Abstract:Artificial intelligence applications have shown success in different medical and health care domains, and cardiac imaging is no exception. However, some machine learning models, especially deep learning, are considered black box as they do not provide an explanation or rationale for model outcomes. Complexity and vagueness in these models necessitate a transition to explainable artificial intelligence (XAI) methods to ensure that model results are both transparent and understandable to end users. In cardiac imaging studies, there are a limited number of papers that use XAI methodologies. This article provides a comprehensive literature review of state-of-the-art works using XAI methods for cardiac imaging. Moreover, it provides simple and comprehensive guidelines on XAI. Finally, open issues and directions for XAI in cardiac imaging are discussed.

Medicine,Computer Science
Explainable machine learning for breast cancer diagnosis from mammography and ultrasound images: a systematic review

Daraje kaba Gurmessa,Worku Jimma

DOI: https://doi.org/10.1136/bmjhci-2023-100954

2024-02-01

Abstract:Background Breast cancer is the most common disease in women. Recently, explainable artificial intelligence (XAI) approaches have been dedicated to investigate breast cancer. An overwhelming study has been done on XAI for breast cancer. Therefore, this study aims to review an XAI for breast cancer diagnosis from mammography and ultrasound (US) images. We investigated how XAI methods for breast cancer diagnosis have been evaluated, the existing ethical challenges, research gaps, the XAI used and the relation between the accuracy and explainability of algorithms. Methods In this work, Preferred Reporting Items for Systematic Reviews and Meta-Analyses checklist and diagram were used. Peer-reviewed articles and conference proceedings from PubMed, IEEE Explore, ScienceDirect, Scopus and Google Scholar databases were searched. There is no stated date limit to filter the papers. The papers were searched on 19 September 2023, using various combinations of the search terms ‘breast cancer’, ‘explainable’, ‘interpretable’, ‘machine learning’, ‘artificial intelligence’ and ‘XAI’. Rayyan online platform detected duplicates, inclusion and exclusion of papers. Results This study identified 14 primary studies employing XAI for breast cancer diagnosis from mammography and US images. Out of the selected 14 studies, only 1 research evaluated humans’ confidence in using the XAI system—additionally, 92.86% of identified papers identified dataset and dataset-related issues as research gaps and future direction. The result showed that further research and evaluation are needed to determine the most effective XAI method for breast cancer. Conclusion XAI is not conceded to increase users’ and doctors’ trust in the system. For the real-world application, effective and systematic evaluation of its trustworthiness in this scenario is lacking. PROSPERO registration number CRD42023458665.
Enhancing the detection of airway disease by applying deep learning and explainable artificial intelligence

Apeksha Koul,Rajesh K. Bawa,Yogesh Kumar

DOI: https://doi.org/10.1007/s11042-024-18381-y

IF: 2.577

2024-02-22

Multimedia Tools and Applications

Abstract:Airway diseases cause significant challenges while diagnosing it accurately as well as timely. In current years, the combination of deep learning techniques with Explainable Artificial Intelligence (XAI), has emerged as a promising possibility to enhance the understanding as well as interpretability of complex medical data which are associated with these conditions. The study explores the usage of advanced convolutional neural networks (CNNs) on large-scale of Chest X-ray or CT scan image datasets and their application in the domain of medical imaging to detect as well as classify airway diseases such as pneumoconiosis, pulmonary embolism, Covid-19, tuberculosis, and Lung cancer. The visualization of the images have been enhanced by applying sharpening techniques and are later subsequently used to train various deep learning models which include InceptionResNetV2, MobileNet, Xception, ResNet152, EfficientNetV2M, and DenseNet169. Further, various parameters have been used for the evaluation of the performance of these models in determining the most optimal choice. During training the model, it has been found that the highest accuracy, precision, recall, and F1 score has been computed by InceptionResNetV2 with 99.15%, 98% and 99% (both) respectively on a loss of 0.0275. Besides this, a graphical user interface (GUI) has been also developed to improvise the interaction between the AI based model and end users. The GUI is based on the theory of XAI which after predicting the diseases provides in detail explanation of treatment as well as preventive measures of the disease. The motto of the research is to escalate the knowledge of deep learning techniques for various lung based issues as well as to enlighten with the significance of XAI in promoting interpretability as well as transparency. The findings of the research implies towards the advancement of decision support systems at various medical sectors to promote effective as well as personalized interventions in the realm of pulmonology.

computer science, information systems, theory & methods,engineering, electrical & electronic, software engineering
A Brief Review of Explainable Artificial Intelligence in Healthcare

Zahra Sadeghi,Roohallah Alizadehsani,Mehmet Akif Cifci,Samina Kausar,Rizwan Rehman,Priyakshi Mahanta,Pranjal Kumar Bora,Ammar Almasri,Rami S. Alkhawaldeh,Sadiq Hussain,Bilal Alatas,Afshin Shoeibi,Hossein Moosaei,Milan Hladik,Saeid Nahavandi,Panos M. Pardalos

2023-04-04

Abstract:XAI refers to the techniques and methods for building AI applications which assist end users to interpret output and predictions of AI models. Black box AI applications in high-stakes decision-making situations, such as medical domain have increased the demand for transparency and explainability since wrong predictions may have severe consequences. Model explainability and interpretability are vital successful deployment of AI models in healthcare practices. AI applications' underlying reasoning needs to be transparent to clinicians in order to gain their trust. This paper presents a systematic review of XAI aspects and challenges in the healthcare domain. The primary goals of this study are to review various XAI methods, their challenges, and related machine learning models in healthcare. The methods are discussed under six categories: Features-oriented methods, global methods, concept models, surrogate models, local pixel-based methods, and human-centric methods. Most importantly, the paper explores XAI role in healthcare problems to clarify its necessity in safety-critical applications. The paper intends to establish a comprehensive understanding of XAI-related applications in the healthcare field by reviewing the related experimental results. To facilitate future research for filling research gaps, the importance of XAI models from different viewpoints and their limitations are investigated.

Artificial Intelligence
Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks

Sajid Nazir,Diane M. Dickson,Muhammad Usman Akram

DOI: https://doi.org/10.1016/j.compbiomed.2023.106668

IF: 7.7

2023-03-02

Computers in Biology and Medicine

Abstract:Artificial Intelligence (AI) techniques of deep learning have revolutionized the disease diagnosis with their outstanding image classification performance. In spite of the outstanding results, the widespread adoption of these techniques in clinical practice is still taking place at a moderate pace. One of the major hindrance is that a trained Deep Neural Networks (DNN) model provides a prediction, but questions about why and how that prediction was made remain unanswered. This linkage is of utmost importance for the regulated healthcare domain to increase the trust in the automated diagnosis system by the practitioners, patients and other stakeholders. The application of deep learning for medical imaging has to be interpreted with caution due to the health and safety concerns similar to blame attribution in the case of an accident involving autonomous cars. The consequences of both a false positive and false negative cases are far reaching for patients' welfare and cannot be ignored. This is exacerbated by the fact that the state-of-the-art deep learning algorithms comprise of complex interconnected structures, millions of parameters, and a 'black box' nature, offering little understanding of their inner working unlike the traditional machine learning algorithms. Explainable AI (XAI) techniques help to understand model predictions which help develop trust in the system, accelerate the disease diagnosis, and meet adherence to regulatory requirements. This survey provides a comprehensive review of the promising field of XAI for biomedical imaging diagnostics. We also provide a categorization of the XAI techniques, discuss the open challenges, and provide future directions for XAI which would be of interest to clinicians, regulators and model developers.

engineering, biomedical,computer science, interdisciplinary applications,mathematical & computational biology,biology
Unveiling the black box: A systematic review of Explainable Artificial Intelligence in medical image analysis

Dost Muhammad,Malika Bendechache

DOI: https://doi.org/10.1016/j.csbj.2024.08.005

2024-08-12

Abstract:This systematic literature review examines state-of-the-art Explainable Artificial Intelligence (XAI) methods applied to medical image analysis, discussing current challenges and future research directions, and exploring evaluation metrics used to assess XAI approaches. With the growing efficiency of Machine Learning (ML) and Deep Learning (DL) in medical applications, there's a critical need for adoption in healthcare. However, their "black-box" nature, where decisions are made without clear explanations, hinders acceptance in clinical settings where decisions have significant medicolegal consequences. Our review highlights the advanced XAI methods, identifying how they address the need for transparency and trust in ML/DL decisions. We also outline the challenges faced by these methods and propose future research directions to improve XAI in healthcare. This paper aims to bridge the gap between cutting-edge computational techniques and their practical application in healthcare, nurturing a more transparent, trustworthy, and effective use of AI in medical settings. The insights guide both research and industry, promoting innovation and standardisation in XAI implementation in healthcare.
Explainable AI for Medical Data: Current Methods, Limitations, and Future Directions

Imran Hossain,Ghada Zamzmi,Peter R. Mouton,Sirajus Salekin,Yu Sun,Dmitry Goldgof,Md Imran Hossain,Md Sirajus Salekin

DOI: https://doi.org/10.1145/3637487

IF: 16.6

2023-12-13

ACM Computing Surveys

Abstract:With the power of parallel processing, large datasets,and fast computational resources, deep neural networks (DNNs) have outperformed highly trained and experienced human experts in medical applications. However, the large global community of healthcare professionals, many of whom routinely face potentially life-or-death outcomes with complex medicolegal consequences, have yet to embrace this powerful technology. The major problem is that most current AI solutions function as a metaphorical black-box positioned between input data and output decisions without a rigorous explanation for their internal processes. With the goal of enhancing trust and improving acceptance of AI-based technology in clinical medicine, there is a large and growing effort to address this challenge using eXplainable AI (XAI), a set of techniques, strategies, and algorithms with an explicit focus on explaining the “hows and whys” of DNNs. Here, we provide a comprehensive review of the state-of-the-art XAI techniques concerning healthcare applications and discuss current challenges and future directions. We emphasize the strengths and limitations of each category, including image, tabular, and textual explanations, and explore a range of evaluation metrics for assessing the effectiveness of XAI solutions. Finally, we highlight promising opportunities for XAI research to enhance the acceptance of DNNs by the healthcare community.

computer science, theory & methods
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI

Erico Tjoa,Cuntai Guan

DOI: https://doi.org/10.1109/TNNLS.2020.3027314

2020-08-11

Abstract:Recently, artificial intelligence and machine learning in general have demonstrated remarkable performances in many tasks, from image processing to natural language processing, especially with the advent of deep learning. Along with research progress, they have encroached upon many different fields and disciplines. Some of them require high level of accountability and thus transparency, for example the medical sector. Explanations for machine decisions and predictions are thus needed to justify their reliability. This requires greater interpretability, which often means we need to understand the mechanism underlying the algorithms. Unfortunately, the blackbox nature of the deep learning is still unresolved, and many machine decisions are still poorly understood. We provide a review on interpretabilities suggested by different research works and categorize them. The different categories show different dimensions in interpretability research, from approaches that provide "obviously" interpretable information to the studies of complex patterns. By applying the same categorization to interpretability in medical research, it is hoped that (1) clinicians and practitioners can subsequently approach these methods with caution, (2) insights into interpretability will be born with more considerations for medical practices, and (3) initiatives to push forward data-based, mathematically- and technically-grounded medical education are encouraged.

Machine Learning,Artificial Intelligence
A review of evaluation approaches for explainable AI with applications in cardiology

Ahmed M Salih,Ilaria Boscolo Galazzo,Polyxeni Gkontra,Elisa Rauseo,Aaron Mark Lee,Karim Lekadir,Petia Radeva,Steffen E Petersen,Gloria Menegaz

DOI: https://doi.org/10.1007/s10462-024-10852-w

Abstract:Explainable artificial intelligence (XAI) elucidates the decision-making process of complex AI models and is important in building trust in model predictions. XAI explanations themselves require evaluation as to accuracy and reasonableness and in the context of use of the underlying AI model. This review details the evaluation of XAI in cardiac AI applications and has found that, of the studies examined, 37% evaluated XAI quality using literature results, 11% used clinicians as domain-experts, 11% used proxies or statistical analysis, with the remaining 43% not assessing the XAI used at all. We aim to inspire additional studies within healthcare, urging researchers not only to apply XAI methods but to systematically assess the resulting explanations, as a step towards developing trustworthy and safe models. Supplementary information: The online version contains supplementary material available at 10.1007/s10462-024-10852-w.
A Comparative Approach to Explainable Artificial Intelligence Methods in Application to High-Dimensional Electronic Health Records: Examining the Usability of XAI

Jamie Andrew Duell

DOI: https://doi.org/10.48550/arXiv.2103.04951

2021-03-09

Abstract:Explainable Artificial Intelligence (XAI) is a rising field in AI. It aims to produce a demonstrative factor of trust, which for human subjects is achieved through communicative means, which Machine Learning (ML) algorithms cannot solely produce, illustrating the necessity of an extra layer producing support to the model output. When approaching the medical field, we can see challenges arise when dealing with the involvement of human-subjects, the ideology behind trusting a machine to tend towards the livelihood of a human poses an ethical conundrum - leaving trust as the basis of the human-expert in acceptance to the machines decision. The aim of this paper is to apply XAI methods to demonstrate the usability of explainable architectures as a tertiary layer for the medical domain supporting ML predictions and human-expert opinion, XAI methods produce visualization of the feature contribution towards a given models output on both a local and global level. The work in this paper uses XAI to determine feature importance towards high-dimensional data-driven questions to inform domain-experts of identifiable trends with a comparison of model-agnostic methods in application to ML algorithms. The performance metrics for a glass-box method is also provided as a comparison against black-box capability for tabular data. Future work will aim to produce a user-study using metrics to evaluate human-expert usability and opinion of the given models.

Machine Learning,Artificial Intelligence,Computers and Society
Explainable Deep Learning Methods in Medical Imaging Diagnosis: A Survey

Cristiano Patrício,João C. Neves,Luís F. Teixeira

DOI: https://doi.org/10.48550/arXiv.2205.04766

2022-05-10

Image and Video Processing

Abstract:The remarkable success of deep learning has prompted interest in its application to medical imaging diagnosis. Even though state-of-the-art deep learning models have achieved human-level accuracy on the classification of different types of medical data, these models are hardly adopted in clinical workflows, mainly due to their lack of interpretability. The black-box-ness of deep learning models has raised the need for devising strategies to explain the decision process of these models, leading to the creation of the topic of eXplainable Artificial Intelligence (XAI). In this context, we provide a thorough survey of XAI applied to medical imaging diagnosis, including visual, textual, example-based and concept-based explanation methods. Moreover, this work reviews the existing medical imaging datasets and the existing metrics for evaluating the quality of the explanations. In addition, we include a performance comparison among a set of report generation-based methods. Finally, the major challenges in applying XAI to medical imaging and the future research directions on the topic are also discussed.
Explainable Artificial Intelligence for Medical Applications: A Review

Qiyang Sun,Alican Akman,Björn W. Schuller

2024-11-15

Abstract:The continuous development of artificial intelligence (AI) theory has propelled this field to unprecedented heights, owing to the relentless efforts of scholars and researchers. In the medical realm, AI takes a pivotal role, leveraging robust machine learning (ML) algorithms. AI technology in medical imaging aids physicians in X-ray, computed tomography (CT) scans, and magnetic resonance imaging (MRI) diagnoses, conducts pattern recognition and disease prediction based on acoustic data, delivers prognoses on disease types and developmental trends for patients, and employs intelligent health management wearable devices with human-computer interaction technology to name but a few. While these well-established applications have significantly assisted in medical field diagnoses, clinical decision-making, and management, collaboration between the medical and AI sectors faces an urgent challenge: How to substantiate the reliability of decision-making? The underlying issue stems from the conflict between the demand for accountability and result transparency in medical scenarios and the black-box model traits of AI. This article reviews recent research grounded in explainable artificial intelligence (XAI), with an emphasis on medical practices within the visual, audio, and multimodal perspectives. We endeavour to categorise and synthesise these practices, aiming to provide support and guidance for future researchers and healthcare professionals.

Machine Learning,Computer Vision and Pattern Recognition
Explainable AI applications in the Medical Domain: a systematic review

Nicoletta Prentzas,Antonis Kakas,Constantinos S. Pattichis

DOI: https://doi.org/10.48550/arXiv.2308.05411

2023-08-10

Abstract:Artificial Intelligence in Medicine has made significant progress with emerging applications in medical imaging, patient care, and other areas. While these applications have proven successful in retrospective studies, very few of them were applied in practice.The field of Medical AI faces various challenges, in terms of building user trust, complying with regulations, using data ethically.Explainable AI (XAI) aims to enable humans understand AI and trust its results. This paper presents a literature review on the recent developments of XAI solutions for medical decision support, based on a representative sample of 198 articles published in recent years. The systematic synthesis of the relevant articles resulted in several findings. (1) model-agnostic XAI techniques were mostly employed in these solutions, (2) deep learning models are utilized more than other types of machine learning models, (3) explainability was applied to promote trust, but very few works reported the physicians participation in the loop, (4) visual and interactive user interface is more useful in understanding the explanation and the recommendation of the system. More research is needed in collaboration between medical and AI experts, that could guide the development of suitable frameworks for the design, implementation, and evaluation of XAI solutions in medicine.

Artificial Intelligence,Machine Learning

[Basics of three dimensional image processing].

Explainable artificial intelligence (XAI) in radiology and nuclear medicine: a literature review

Evaluating the quality of visual explanations on chest X-ray images for thorax diseases classification

Explainable Artificial Intelligence (XAI) for Deep Learning Based Medical Imaging Classification

Transparent and Clinically Interpretable AI for Lung Cancer Detection in Chest X-Rays

Amputations and replantations.

Explainable AI And Visual Reasoning: Insights From Radiology

Application of Example-Based Explainable Artificial Intelligence (XAI) for Analysis and Interpretation of Medical Imaging: A Systematic Review

Explainable Artificial Intelligence and Cardiac Imaging: Toward More Interpretable Models.

Explainable machine learning for breast cancer diagnosis from mammography and ultrasound images: a systematic review

Enhancing the detection of airway disease by applying deep learning and explainable artificial intelligence

A Brief Review of Explainable Artificial Intelligence in Healthcare

Survey of explainable artificial intelligence techniques for biomedical imaging with deep neural networks

Unveiling the black box: A systematic review of Explainable Artificial Intelligence in medical image analysis

Explainable AI for Medical Data: Current Methods, Limitations, and Future Directions

A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI

A review of evaluation approaches for explainable AI with applications in cardiology

A Comparative Approach to Explainable Artificial Intelligence Methods in Application to High-Dimensional Electronic Health Records: Examining the Usability of XAI

Explainable Deep Learning Methods in Medical Imaging Diagnosis: A Survey

Explainable Artificial Intelligence for Medical Applications: A Review

Explainable AI applications in the Medical Domain: a systematic review