Clinical applications of machine learning algorithms: beyond the black box

David S Watson,Jenny Krutzinna,Ian N Bruce,Christopher Em Griffiths,Iain B McInnes,Michael R Barnes,Luciano Floridi,Christopher EM Griffiths

DOI: https://doi.org/10.1136/bmj.l886

2019-03-12

BMJ

Abstract:To maximise the clinical benefits of machine learning algorithms, we need to rethink our approach to explanation, argue David Watson and colleagues

What problem does this paper attempt to address?

Clinical Applications of Machine Learning

Nadayca Mateussi,Michael P. Rogers,Emily A. Grimsley,Meagan Read,Rajavi Parikh,Ricardo Pietrobon,Paul C. Kuo

DOI: https://doi.org/10.1097/as9.0000000000000423

2024-04-18

Annals of Surgery Open

Abstract:Objective: This review introduces interpretable predictive machine learning approaches, natural language processing, image recognition, and reinforcement learning methodologies to familiarize end users. Background: As machine learning, artificial intelligence, and generative artificial intelligence become increasingly utilized in clinical medicine, it is imperative that end users understand the underlying methodologies. Methods: This review describes publicly available datasets that can be used with interpretable predictive approaches, natural language processing, image recognition, and reinforcement learning models, outlines result interpretation, and provides references for in-depth information about each analytical framework. Results: This review introduces interpretable predictive machine learning models, natural language processing, image recognition, and reinforcement learning methodologies. Conclusions: Interpretable predictive machine learning models, natural language processing, image recognition, and reinforcement learning are core machine learning methodologies that underlie many of the artificial intelligence methodologies that will drive the future of clinical medicine and surgery. End users must be well versed in the strengths and weaknesses of these tools as they are applied to patient care now and in the future.
Strategies for Implementing Machine Learning Algorithms in the Clinical Practice of Radiology

Allison Chae,Michael S Yao,Hersh Sagreiya,Ari D Goldberg,Neil Chatterjee,Matthew T MacLean,Jeffrey Duda,Ameena Elahi,Arijitt Borthakur,Marylyn D Ritchie,Daniel Rader,Charles E Kahn,Walter R Witschey,James C Gee,Michael S. Yao,Ari D. Goldberg,Matthew T. MacLean,Marylyn D. Ritchie,Charles E. Kahn,Walter R. Witschey,James C. Gee

DOI: https://doi.org/10.1148/radiol.223170

IF: 19.7

2024-01-25

Radiology

Abstract:Despite recent advancements in machine learning (ML) applications in health care, there have been few benefits and improvements to clinical medicine in the hospital setting. To facilitate clinical adaptation of methods in ML, this review proposes a standardized framework for the step-by-step implementation of artificial intelligence into the clinical practice of radiology that focuses on three key components: problem identification, stakeholder alignment, and pipeline integration. A review of...

radiology, nuclear medicine & medical imaging
Statistical Thinking, Machine Learning

Jiang Bian,Iain Buchan,Yi Guo,Mattia Prosperi

DOI: https://doi.org/10.1016/j.jclinepi.2019.08.003

IF: 7.407

2019-01-01

Journal of Clinical Epidemiology

Abstract:We read with interest “A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models” by Christodoulou et al. [ [1] Christodoulou E. Ma J. Collins G.S. Steyerberg E.W. Verbakel J.Y. Van Calster B. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J Clin Epidemiol. 2019; 110: 12-22 Abstract Full Text Full Text PDF PubMed Scopus (604) Google Scholar ] appreciating its rigor and importance. We question, however, the conceptual dichotomy of logistic regression (LR) vs. machine learning (ML). Statistics versus machine learning: definitions are interesting (but understanding, methodology, and reporting are more important)Journal of Clinical EpidemiologyVol. 116PreviewWe thank Bian et al for their interest in our study. Since the study was published, the distinction between logistic regression and machine learning has fueled a lot of discussion. We had addressed this issue already in the initial submission but corroborated on it based on the reviewers’ comments. We state in the article that we do not believe there is a clear dichotomy but rather that algorithms lie on a continuum regarding flexibility, and reliance on the data versus subject knowledge. Nevertheless, several publications and discussions explicitly make this distinction and often conclude that machine learning leads to better predictive performance compared with traditional statistical methods. Full-Text PDF
From patterns to patients: Advances in clinical machine learning for cancer diagnosis, prognosis, and treatment

Kyle Swanson,Eric Wu,Angela Zhang,James Zou,Ash A. Alizadeh

DOI: https://doi.org/10.1016/j.cell.2023.01.035

2023-03-12

Cell Journal

Abstract:Summary Machine learning (ML) is increasingly used in clinical oncology to diagnose cancers, predict patient outcomes, and inform treatment planning. Here, we review recent applications of ML across the clinical oncology workflow. We review how these techniques are applied to medical imaging and to molecular data obtained from liquid and solid tumor biopsies for cancer diagnosis, prognosis, and treatment design. We discuss key considerations in developing ML for the distinct challenges posed by imaging and molecular data. Finally, we examine ML models approved for cancer-related patient usage by regulatory agencies and discuss approaches to improve the clinical usefulness of ML.

cell biology
Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness

Sebastian Vollmer,Bilal A Mateen,Gergo Bohner,Franz J Király,Rayid Ghani,Pall Jonsson,Sarah Cumbers,Adrian Jonas,Katherine S L McAllister,Puja Myles,David Granger,Mark Birse,Richard Branson,Karel G M Moons,Gary S Collins,John P A Ioannidis,Chris Holmes,Harry Hemingway,David Grainger

DOI: https://doi.org/10.1136/bmj.l6927

2020-03-20

BMJ

Abstract:Machine learning (ML), artificial intelligence (AI), and other modern statistical methods are providing new opportunities to operationalise previously untapped and rapidly growing sources of data for patient benefit. The potential uses include improving diagnostic accuracy,1 more reliably predicting prognosis,2 targeting treatments,3 and increasing the operational efficiency of health systems.4 Examples of potentially disruptive technology with early promise include image based diagnostic applications of ML/AI, which have shown the most early clinical promise (eg, deep learning based algorithms improving accuracy in diagnosing retinal pathology compared with that of specialist physicians5), or natural language processing used as a tool to extract information from structured and unstructured (that is, free) text embedded in electronic health records.2 Although we are only just beginning to understand the wealth of opportunities afforded by these methods, there is growing concern in the academic community that because the products of these methods are not perceived in the same...
Opening the Black Box of Neural Networks: Methods for Interpreting Neural Network Models in Clinical Applications

Zhongheng Zhang,Marcus W. Beck,David A. Winkler,Bin Huang,Wilbert Sibanda,Hemant Goyal

DOI: https://doi.org/10.21037/atm.2018.05.32

IF: 3.616

2018-01-01

Annals of Translational Medicine

Abstract:Artificial neural networks (ANNs) are powerful tools for data analysis and are particularly suitable for modeling relationships between variables for best prediction of an outcome. While these models can be used to answer many important research questions, their utility has been critically limited because the interpretation of the "black box" model is difficult. Clinical investigators usually employ ANN models to predict the clinical outcomes or to make a diagnosis; the model however is difficult to interpret for clinicians. To address this important shortcoming of neural network modeling methods, we describe several methods to help subject-matter audiences (e.g., clinicians, medical policy makers) understand neural network models. Garson's algorithm describes the relative magnitude of the importance of a descriptor (predictor) in its connection with outcome variables by dissecting the model weights. The Lek's profile method explores the relationship of the outcome variable and a predictor of interest, while holding other predictors at constant values (e.g., minimum, 20th quartile, maximum). While Lek's profile was developed specifically for neural networks, partial dependence plot is a more generic version that visualize the relationship between an outcome and one or two predictors. Finally, the local interpretable model-agnostic explanations (LIME) method can show the predictions of any classification or regression, by approximating it locally with an interpretable model. R code for the implementations of these methods is shown by using example data fitted with a standard, feed-forward neural network model. We offer codes and step-by-step description on how to use these tools to facilitate better understanding of ANN.
The role of machine learning in clinical research: transforming the future of evidence generation

E Hope Weissler,Tristan Naumann,Tomas Andersson,Rajesh Ranganath,Olivier Elemento,Yuan Luo,Daniel F Freitag,James Benoit,Michael C Hughes,Faisal Khan,Paul Slater,Khader Shameer,Matthew Roe,Emmette Hutchison,Scott H Kollins,Uli Broedl,Zhaoling Meng,Jennifer L Wong,Lesley Curtis,Erich Huang,Marzyeh Ghassemi

DOI: https://doi.org/10.1186/s13063-021-05489-x

IF: 2.728

2021-08-16

Trials

Abstract:Background: Interest in the application of machine learning (ML) to the design, conduct, and analysis of clinical trials has grown, but the evidence base for such applications has not been surveyed. This manuscript reviews the proceedings of a multi-stakeholder conference to discuss the current and future state of ML for clinical research. Key areas of clinical trial methodology in which ML holds particular promise and priority areas for further investigation are presented alongside a narrative review of evidence supporting the use of ML across the clinical trial spectrum. Results: Conference attendees included stakeholders, such as biomedical and ML researchers, representatives from the US Food and Drug Administration (FDA), artificial intelligence technology and data analytics companies, non-profit organizations, patient advocacy groups, and pharmaceutical companies. ML contributions to clinical research were highlighted in the pre-trial phase, cohort selection and participant management, and data collection and analysis. A particular focus was paid to the operational and philosophical barriers to ML in clinical research. Peer-reviewed evidence was noted to be lacking in several areas. Conclusions: ML holds great promise for improving the efficiency and quality of clinical research, but substantial barriers remain, the surmounting of which will require addressing significant gaps in evidence.
Opening the black box of AI‐Medicine

Aaron I F Poon,Joseph J Y Sung

DOI: https://doi.org/10.1111/jgh.15384

2021-03-01

Journal of Gastroenterology and Hepatology

Abstract:One of the biggest challenges of utilizing artificial intelligence (AI) in medicine is that physicians are reluctant to trust and adopt something that they do not fully understand and regarded as a "black box." Machine Learning (ML) can assist in reading radiological, endoscopic and histological pictures, suggesting diagnosis and predict disease outcome, and even recommending therapy and surgical decisions. However, clinical adoption of these AI tools has been slow because of a lack of trust. Besides clinician's doubt, patients lacking confidence with AI-powered technologies also hamper development. While they may accept the reality that human errors can occur, little tolerance of machine error is anticipated. In order to implement AI medicine successfully, interpretability of ML algorithm needs to improve. Opening the black box in AI medicine needs to take a stepwise approach. Small steps of biological explanation and clinical experience in ML algorithm can help to build trust and acceptance. AI software developers will have to clearly demonstrate that when the ML technologies are integrated into the clinical decision-making process, they can actually help to improve clinical outcome. Enhancing interpretability of ML algorithm is a crucial step in adopting AI in medicine.

gastroenterology & hepatology
Machine Learning for Clinical Decision-Making: Challenges and Opportunities in Cardiovascular Imaging

Sergio Sanchez-Martinez,Oscar Camara,Gemma Piella,Maja Cikes,Miguel Ángel González-Ballester,Marius Miron,Alfredo Vellido,Emilia Gómez,Alan G. Fraser,Bart Bijnens

DOI: https://doi.org/10.3389/fcvm.2021.765693

IF: 3.6

2022-01-04

Frontiers in Cardiovascular Medicine

Abstract:The use of machine learning (ML) approaches to target clinical problems is called to revolutionize clinical decision-making in cardiology. The success of these tools is dependent on the understanding of the intrinsic processes being used during the conventional pathway by which clinicians make decisions. In a parallelism with this pathway, ML can have an impact at four levels: for data acquisition, predominantly by extracting standardized, high-quality information with the smallest possible learning curve; for feature extraction, by discharging healthcare practitioners from performing tedious measurements on raw data; for interpretation, by digesting complex, heterogeneous data in order to augment the understanding of the patient status; and for decision support, by leveraging the previous steps to predict clinical outcomes, response to treatment or to recommend a specific intervention. This paper discusses the state-of-the-art, as well as the current clinical status and challenges associated with the two later tasks of interpretation and decision support, together with the challenges related to the learning process, the auditability/traceability, the system infrastructure and the integration within clinical processes in cardiovascular imaging.

cardiac & cardiovascular systems
"The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learning

Mark Sendak,Madeleine Elish,Michael Gao,Joseph Futoma,William Ratliff,Marshall Nichols,Armando Bedoya,Suresh Balu,Cara O'Brien

DOI: https://doi.org/10.48550/arXiv.1911.08089

2019-11-19

Computers and Society

Abstract:Machine learning technologies are increasingly developed for use in healthcare. While research communities have focused on creating state-of-the-art models, there has been less focus on real world implementation and the associated challenges to accuracy, fairness, accountability, and transparency that come from actual, situated use. Serious questions remain under examined regarding how to ethically build models, interpret and explain model output, recognize and account for biases, and minimize disruptions to professional expertise and work cultures. We address this gap in the literature and provide a detailed case study covering the development, implementation, and evaluation of Sepsis Watch, a machine learning-driven tool that assists hospital clinicians in the early diagnosis and treatment of sepsis. We, the team that developed and evaluated the tool, discuss our conceptualization of the tool not as a model deployed in the world but instead as a socio-technical system requiring integration into existing social and professional contexts. Rather than focusing on model interpretability to ensure a fair and accountable machine learning, we point toward four key values and practices that should be considered when developing machine learning to support clinical decision-making: rigorously define the problem in context, build relationships with stakeholders, respect professional discretion, and create ongoing feedback loops with stakeholders. Our work has significant implications for future research regarding mechanisms of institutional accountability and considerations for designing machine learning systems. Our work underscores the limits of model interpretability as a solution to ensure transparency, accuracy, and accountability in practice. Instead, our work demonstrates other means and goals to achieve FATML values in design and in practice.
Machine learning in medicine: what clinicians should know

Jordan Zheng Ting Sim,Qi Wei Fong,Weimin Huang,Cher Heng Tan

DOI: https://doi.org/10.11622/smedj.2021054

Abstract:With the advent of artificial intelligence (AI), machines are increasingly being used to complete complicated tasks, yielding remarkable results. Machine learning (ML) is the most relevant subset of AI in medicine, which will soon become an integral part of our everyday practice. Therefore, physicians should acquaint themselves with ML and AI, and their role as an enabler rather than a competitor. Herein, we introduce basic concepts and terms used in AI and ML, and aim to demystify commonly used AI/ML algorithms such as learning methods including neural networks/deep learning, decision tree and application domain in computer vision and natural language processing through specific examples. We discuss how machines are already being used to augment the physician's decision-making process, and postulate the potential impact of ML on medical practice and medical research based on its current capabilities and known limitations. Moreover, we discuss the feasibility of full machine autonomy in medicine.
A primer on the use of machine learning to distil knowledge from data in biological psychiatry

Thomas P. Quinn,Jonathan L. Hess,Victoria S. Marshe,Michelle M. Barnett,Anne-Christin Hauschild,Malgorzata Maciukiewicz,Samar S. M. Elsheikh,Xiaoyu Men,Emanuel Schwarz,Yannis J. Trakadis,Michael S. Breen,Eric J. Barnett,Yanli Zhang-James,Mehmet Eren Ahsen,Han Cao,Junfang Chen,Jiahui Hou,Asif Salekin,Ping-I Lin,Kristin K. Nicodemus,Andreas Meyer-Lindenberg,Isabelle Bichindaritz,Stephen V. Faraone,Murray J. Cairns,Gaurav Pandey,Daniel J. Müller,Stephen J. Glatt,on behalf of the Machine Learning in Psychiatry (MLPsych) Consortium

DOI: https://doi.org/10.1038/s41380-023-02334-2

IF: 11

2024-01-05

Molecular Psychiatry

Abstract:Applications of machine learning in the biomedical sciences are growing rapidly. This growth has been spurred by diverse cross-institutional and interdisciplinary collaborations, public availability of large datasets, an increase in the accessibility of analytic routines, and the availability of powerful computing resources. With this increased access and exposure to machine learning comes a responsibility for education and a deeper understanding of its bases and bounds, borne equally by data scientists seeking to ply their analytic wares in medical research and by biomedical scientists seeking to harness such methods to glean knowledge from data. This article provides an accessible and critical review of machine learning for a biomedically informed audience, as well as its applications in psychiatry. The review covers definitions and expositions of commonly used machine learning methods, and historical trends of their use in psychiatry. We also provide a set of standards, namely G uidelines for RE porting M achine L earning I nvestigations in N europsychiatry ( GREMLIN ), for designing and reporting studies that use machine learning as a primary data-analysis approach. Lastly, we propose the establishment of the Machine Learning in Psychiatry ( MLPsych ) Consortium, enumerate its objectives, and identify areas of opportunity for future applications of machine learning in biological psychiatry. This review serves as a cautiously optimistic primer on machine learning for those on the precipice as they prepare to dive into the field, either as methodological practitioners or well-informed consumers.

biochemistry & molecular biology,neurosciences,psychiatry
Rethinking explainability: toward a postphenomenology of black-box artificial intelligence in medicine

Annie B. Friedrich,Jordan Mason,Jay R. Malone

DOI: https://doi.org/10.1007/s10676-022-09631-4

IF: 3.633

2022-01-24

Ethics and Information Technology

Abstract:In recent years, increasingly advanced artificial intelligence (AI), and in particular machine learning, has shown great promise as a tool in various healthcare contexts. Yet as machine learning in medicine has become more useful and more widely adopted, concerns have arisen about the "black-box" nature of some of these AI models, or the inability to understand—and explain—the inner workings of the technology. Some critics argue that AI algorithms must be explainable to be responsibly used in the clinical encounter, while supporters of AI dismiss the importance of explainability and instead highlight the many benefits the application of this technology could have for medicine. However, this dichotomy fails to consider the particular ways in which machine learning technologies mediate relations in the clinical encounter, and in doing so, makes explainability more of a problem than it actually is. We argue that postphenomenology is a highly useful theoretical lens through which to examine black-box AI, because it helps us better understand the particular mediating effects this type of technology brings to clinical encounters and moves beyond the explainability stalemate. Using a postphenomenological approach, we argue that explainability is more of a concern for physicians than it is for patients, and that a lack of explainability does not introduce a novel concern to the physician–patient encounter. Explainability is just one feature of technological mediation and need not be the central concern on which the use of black-box AI hinges.

information science & library science,ethics
Machine Learning for Mental Health: Applications, Challenges, and the Clinician's Role

Sorabh Singhal,Danielle L. Cooke,Ricardo I. Villareal,Joel J. Stoddard,Chen-Tan Lin,Allison G. Dempsey

DOI: https://doi.org/10.1007/s11920-024-01561-w

2024-11-13

Current Psychiatry Reports

Abstract:This review aims to evaluate the current psychiatric applications and limitations of machine learning (ML), defined as techniques used to train algorithms to improve performance at a task based on data. The review emphasizes the clinician's role in ensuring equitable and effective patient care and seeks to inform mental health providers about the importance of clinician involvement in these technologies.

psychiatry
Artificial intelligence and machine learning in clinical development: a translational perspective

Pratik Shah,Francis Kendall,Sean Khozin,Ryan Goosen,Jianying Hu,Jason Laramie,Michael Ringel,Nicholas Schork

DOI: https://doi.org/10.1038/s41746-019-0148-3

2019-07-26

Abstract:Future of clinical development is on the verge of a major transformation due to convergence of large new digital data sources, computing power to identify clinically meaningful patterns in the data using efficient artificial intelligence and machine-learning algorithms, and regulators embracing this change through new collaborations. This perspective summarizes insights, recent developments, and recommendations for infusing actionable computational evidence into clinical development and health care from academy, biotechnology industry, nonprofit foundations, regulators, and technology corporations. Analysis and learning from publically available biomedical and clinical trial data sets, real-world evidence from sensors, and health records by machine-learning architectures are discussed. Strategies for modernizing the clinical development process by integration of AI- and ML-based digital methods and secure computing technologies through recently announced regulatory pathways at the United States Food and Drug Administration are outlined. We conclude by discussing applications and impact of digital algorithmic evidence to improve medical care for patients.
A Research Ethics Framework for the Clinical Translation of Healthcare Machine Learning

Melissa D McCradden,James A Anderson,Elizabeth A Stephenson,Erik Drysdale,Lauren Erdman,Anna Goldenberg,Randi Zlotnik Shaul,Elizabeth A. Stephenson

DOI: https://doi.org/10.1080/15265161.2021.2013977

2022-01-20

The American Journal of Bioethics

Abstract:The application of artificial intelligence and machine learning (ML) technologies in healthcare have immense potential to improve the care of patients. While there are some emerging practices surrounding responsible ML as well as regulatory frameworks, the traditional role of research ethics oversight has been relatively unexplored regarding its relevance for clinical ML. In this paper, we provide a comprehensive research ethics framework that can apply to the systematic inquiry of ML research across its development cycle. The pathway consists of three stages: (1) exploratory, hypothesis-generating data access; (2) silent period evaluation; (3) prospective clinical evaluation. We connect each stage to its literature and ethical justification and suggest adaptations to traditional paradigms to suit ML while maintaining ethical rigor and the protection of individuals. This pathway can accommodate a multitude of research designs from observational to controlled trials, and the stages can apply individually to a variety of ML applications.
A comprehensive review of machine learning algorithms and their application in geriatric medicine: present and future

Richard J. Woodman,Arduino A. Mangoni

DOI: https://doi.org/10.1007/s40520-023-02552-2

2023-09-09

Aging Clinical and Experimental Research

Abstract:The increasing access to health data worldwide is driving a resurgence in machine learning research, including data-hungry deep learning algorithms. More computationally efficient algorithms now offer unique opportunities to enhance diagnosis, risk stratification, and individualised approaches to patient management. Such opportunities are particularly relevant for the management of older patients, a group that is characterised by complex multimorbidity patterns and significant interindividual variability in homeostatic capacity, organ function, and response to treatment. Clinical tools that utilise machine learning algorithms to determine the optimal choice of treatment are slowly gaining the necessary approval from governing bodies and being implemented into healthcare, with significant implications for virtually all medical disciplines during the next phase of digital medicine. Beyond obtaining regulatory approval, a crucial element in implementing these tools is the trust and support of the people that use them. In this context, an increased understanding by clinicians of artificial intelligence and machine learning algorithms provides an appreciation of the possible benefits, risks, and uncertainties, and improves the chances for successful adoption. This review provides a broad taxonomy of machine learning algorithms, followed by a more detailed description of each algorithm class, their purpose and capabilities, and examples of their applications, particularly in geriatric medicine. Additional focus is given on the clinical implications and challenges involved in relying on devices with reduced interpretability and the progress made in counteracting the latter via the development of explainable machine learning.

geriatrics & gerontology,gerontology
Unbox the black-box for the medical explainable AI via multi-modal and multi-centre data fusion: A mini-review, two showcases and beyond

Guang Yang,Qinghao Ye,Jun Xia

DOI: https://doi.org/10.1016/j.inffus.2021.07.016

IF: 18.6

2022-01-01

Information Fusion

Abstract:Explainable Artificial Intelligence (XAI) is an emerging research topic of machine learning aimed at unboxing how AI systems' black-box choices are made. This research field inspects the measures and models involved in decision-making and seeks solutions to explain them explicitly. Many of the machine learning algorithms can not manifest how and why a decision has been cast. This is particularly true of the most popular deep neural network approaches currently in use. Consequently, our confidence in AI systems can be hindered by the lack of explainability in these black-box models. The XAI becomes more and more crucial for deep learning powered applications, especially for medical and healthcare studies, although in general these deep neural networks can return an arresting dividend in performance. The insufficient explainability and transparency in most existing AI systems can be one of the major reasons that successful implementation and integration of AI tools into routine clinical practice are uncommon. In this study, we first surveyed the current progress of XAI and in particular its advances in healthcare applications. We then introduced our solutions for XAI leveraging multi-modal and multi-centre data fusion, and subsequently validated in two showcases following real clinical scenarios. Comprehensive quantitative and qualitative analyses can prove the efficacy of our proposed XAI solutions, from which we can envisage successful applications in a broader range of clinical questions.

computer science, artificial intelligence, theory & methods
Machine learning in medicine: Addressing ethical challenges

Effy Vayena,Alessandro Blasimme,I. Glenn Cohen

DOI: https://doi.org/10.1371/journal.pmed.1002689

2018-11-06

PLoS Medicine

Abstract:Effy Vayena and colleagues argue that machine learning in medicine must offer data protection, algorithmic transparency, and accountability to earn the trust of patients and clinicians.

medicine, general & internal
Unveiling the black box: A systematic review of Explainable Artificial Intelligence in medical image analysis

Dost Muhammad,Malika Bendechache

DOI: https://doi.org/10.1016/j.csbj.2024.08.005

2024-08-12

Abstract:This systematic literature review examines state-of-the-art Explainable Artificial Intelligence (XAI) methods applied to medical image analysis, discussing current challenges and future research directions, and exploring evaluation metrics used to assess XAI approaches. With the growing efficiency of Machine Learning (ML) and Deep Learning (DL) in medical applications, there's a critical need for adoption in healthcare. However, their "black-box" nature, where decisions are made without clear explanations, hinders acceptance in clinical settings where decisions have significant medicolegal consequences. Our review highlights the advanced XAI methods, identifying how they address the need for transparency and trust in ML/DL decisions. We also outline the challenges faced by these methods and propose future research directions to improve XAI in healthcare. This paper aims to bridge the gap between cutting-edge computational techniques and their practical application in healthcare, nurturing a more transparent, trustworthy, and effective use of AI in medical settings. The insights guide both research and industry, promoting innovation and standardisation in XAI implementation in healthcare.

Clinical applications of machine learning algorithms: beyond the black box

Clinical Applications of Machine Learning

Strategies for Implementing Machine Learning Algorithms in the Clinical Practice of Radiology

Statistical Thinking, Machine Learning

From patterns to patients: Advances in clinical machine learning for cancer diagnosis, prognosis, and treatment

Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness

Opening the Black Box of Neural Networks: Methods for Interpreting Neural Network Models in Clinical Applications

The role of machine learning in clinical research: transforming the future of evidence generation

Opening the black box of AI‐Medicine

Machine Learning for Clinical Decision-Making: Challenges and Opportunities in Cardiovascular Imaging

"The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learning

Machine learning in medicine: what clinicians should know

A primer on the use of machine learning to distil knowledge from data in biological psychiatry

Rethinking explainability: toward a postphenomenology of black-box artificial intelligence in medicine

Machine Learning for Mental Health: Applications, Challenges, and the Clinician's Role

Artificial intelligence and machine learning in clinical development: a translational perspective

A Research Ethics Framework for the Clinical Translation of Healthcare Machine Learning

A comprehensive review of machine learning algorithms and their application in geriatric medicine: present and future

Unbox the black-box for the medical explainable AI via multi-modal and multi-centre data fusion: A mini-review, two showcases and beyond

Machine learning in medicine: Addressing ethical challenges

Unveiling the black box: A systematic review of Explainable Artificial Intelligence in medical image analysis