Abstract:This review aims to explore the growing impact of machine learning and deep learning algorithms in the medical field, with a specific focus on the critical issues of explainability and interpretability associated with black-box algorithms. While machine learning algorithms are increasingly employed for medical analysis and diagnosis, their complexity underscores the importance of understanding how these algorithms explain and interpret data to take informed decisions. This review comprehensively analyzes challenges and solutions presented in the literature, offering an overview of the most recent techniques utilized in this field. It also provides precise definitions of interpretability and explainability, aiming to clarify the distinctions between these concepts and their implications for the decision-making process. Our analysis, based on 448 articles and addressing seven research questions, reveals an exponential growth in this field over the last decade. The psychological dimensions of public perception underscore the necessity for effective communication regarding the capabilities and limitations of artificial intelligence. Researchers are actively developing techniques to enhance interpretability, employing visualization methods and reducing model complexity. However, the persistent challenge lies in finding the delicate balance between achieving high performance and maintaining interpretability. Acknowledging the growing significance of artificial intelligence in aiding medical diagnosis and therapy, and the creation of interpretable artificial intelligence models is considered essential. In this dynamic context, an unwavering commitment to transparency, ethical considerations, and interdisciplinary collaboration is imperative to ensure the responsible use of artificial intelligence. This collective commitment is vital for establishing enduring trust between clinicians and patients, addressing emerging challenges, and facilitating the informed adoption of these advanced technologies in medicine.

Study of Interpretability in ML Algorithms for Disease Prognosis

Interpretability of machine learning‐based prediction models in healthcare

Explainable AI for Healthcare: A Study for Interpreting Diabetes Prediction

The importance of interpretability and visualization in machine learning for applications in medicine and health care

A survey on the interpretability of deep learning in medical diagnosis

When will the mist clear? On the Interpretability of Machine Learning for Medical Applications: a survey

Explainable and interpretable artificial intelligence in medicine: a systematic bibliometric review

A critical moment in machine learning in medicine: on reproducible and interpretable learning

Interpretable Machine Learning Enhances Disease Prognosis: Applications on COVID-19 and Onward

What is Interpretable? Using Machine Learning to Design Interpretable Decision-Support Systems

Predictive Analytics and Machine Learning in Disease Diagnosis: A Review of Recent Advances

Explorative study on potential of machine learning and artificial intelligence for improved healthcare diagnosis and treatment

Interpretable machine learning for dermatological disease detection: Bridging the gap between accuracy and explainability

Machine Learning Model Interpretability for Precision Medicine

Global and local interpretation of black-box machine learning models to determine prognostic factors from early COVID-19 data

Interpretable machine learning for dementia: A systematic review

Towards the Interpretability of Machine Learning Predictions for Medical Applications Targeting Personalised Therapies: A Cancer Case Survey

Interpretable and explainable machine learning: A methods‐centric overview with concrete examples

Machine learning in medicine: should the pursuit of enhanced interpretability be abandoned?

Interpretability and accessibility of machine learning in selected food processing, agriculture and health applications

Global and local interpretability techniques of supervised machine learning black box models for numerical medical data