Unlocking the Potential of Explainable Artificial Intelligence in Remote Sensing Big Data

Peng Liu,Lizhe Wang,Jun Li

DOI: https://doi.org/10.3390/rs15235448

IF: 5

2023-01-01

Remote Sensing

Abstract:In the ever-evolving landscape of artificial intelligence and big data, the concept of explainable artificial intelligence (XAI) [...]

What problem does this paper attempt to address?

Survey on Explainable AI: From Approaches, Limitations and Applications Aspects

Wenli Yang,Yuchen Wei,Hanyu Wei,Yanyu Chen,Guan Huang,Xiang Li,Renjie Li,Naimeng Yao,Xinyi Wang,Xiaotong Gu,Muhammad Bilal Amin,Byeong Kang

DOI: https://doi.org/10.1007/s44230-023-00038-y

2023-08-11

Human-Centric Intelligent Systems

Abstract:In recent years, artificial intelligence (AI) technology has been used in most if not all domains and has greatly benefited our lives. While AI can accurately extract critical features and valuable information from large amounts of data to help people complete tasks faster, there are growing concerns about the non-transparency of AI in the decision-making process. The emergence of explainable AI (XAI) has allowed humans to better understand and control AI systems, which is motivated to provide transparent explanations for the decisions made by AI. This article aims to present a comprehensive overview of recent research on XAI approaches from three well-defined taxonomies. We offer an in-depth analysis and summary of the status and prospects of XAI applications in several key areas where reliable explanations are urgently needed to avoid mistakes in decision-making. We conclude by discussing XAI's limitations and future research directions.
Applications of Explainable artificial intelligence in Earth system science

Feini Huang,Shijie Jiang,Lu Li,Yongkun Zhang,Ye Zhang,Ruqing Zhang,Qingliang Li,Danxi Li,Wei Shangguan,Yongjiu Dai

2024-06-12

Abstract:In recent years, artificial intelligence (AI) rapidly accelerated its influence and is expected to promote the development of Earth system science (ESS) if properly harnessed. In application of AI to ESS, a significant hurdle lies in the interpretability conundrum, an inherent problem of black-box nature arising from the complexity of AI algorithms. To address this, explainable AI (XAI) offers a set of powerful tools that make the models more transparent. The purpose of this review is twofold: First, to provide ESS scholars, especially newcomers, with a foundational understanding of XAI, serving as a primer to inspire future research advances; second, to encourage ESS professionals to embrace the benefits of AI, free from preconceived biases due to its lack of interpretability. We begin with elucidating the concept of XAI, along with typical methods. We then delve into a review of XAI applications in the ESS literature, highlighting the important role that XAI has played in facilitating communication with AI model decisions, improving model diagnosis, and uncovering scientific insights. We identify four significant challenges that XAI faces within the ESS, and propose solutions. Furthermore, we provide a comprehensive illustration of multifaceted perspectives. Given the unique challenges in ESS, an interpretable hybrid approach that seamlessly integrates AI with domain-specific knowledge appears to be a promising way to enhance the utility of AI in ESS. A visionary outlook for ESS envisions a harmonious blend where process-based models govern the known, AI models explore the unknown, and XAI bridges the gap by providing explanations.

Artificial Intelligence,Machine Learning
Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing

Ioannis Kakogeorgiou,Konstantinos Karantzalos

DOI: https://doi.org/10.1016/j.jag.2021.102520

2021-09-20

Abstract:Although deep neural networks hold the state-of-the-art in several remote sensing tasks, their black-box operation hinders the understanding of their decisions, concealing any bias and other shortcomings in datasets and model performance. To this end, we have applied explainable artificial intelligence (XAI) methods in remote sensing multi-label classification tasks towards producing human-interpretable explanations and improve transparency. In particular, we utilized and trained deep learning models with state-of-the-art performance in the benchmark BigEarthNet and SEN12MS datasets. Ten XAI methods were employed towards understanding and interpreting models' predictions, along with quantitative metrics to assess and compare their performance. Numerous experiments were performed to assess the overall performance of XAI methods for straightforward prediction cases, competing multiple labels, as well as misclassification cases. According to our findings, Occlusion, Grad-CAM and Lime were the most interpretable and reliable XAI methods. However, none delivers high-resolution outputs, while apart from Grad-CAM, both Lime and Occlusion are computationally expensive. We also highlight different aspects of XAI performance and elaborate with insights on black-box decisions in order to improve transparency, understand their behavior and reveal, as well, datasets' particularities.

Machine Learning,Computer Vision and Pattern Recognition
Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective

Haoyi Xiong,Xuhong Li,Xiaofei Zhang,Jiamin Chen,Xinhao Sun,Yuchen Li,Zeyi Sun,Mengnan Du

2024-01-13

Abstract:Given the complexity and lack of transparency in deep neural networks (DNNs), extensive efforts have been made to make these systems more interpretable or explain their behaviors in accessible terms. Unlike most reviews, which focus on algorithmic and model-centric perspectives, this work takes a "data-centric" view, examining how data collection, processing, and analysis contribute to explainable AI (XAI). We categorize existing work into three categories subject to their purposes: interpretations of deep models, referring to feature attributions and reasoning processes that correlate data points with model outputs; influences of training data, examining the impact of training data nuances, such as data valuation and sample anomalies, on decision-making processes; and insights of domain knowledge, discovering latent patterns and fostering new knowledge from data and models to advance social values and scientific discovery. Specifically, we distill XAI methodologies into data mining operations on training and testing data across modalities, such as images, text, and tabular data, as well as on training logs, checkpoints, models and other DNN behavior descriptors. In this way, our study offers a comprehensive, data-centric examination of XAI from a lens of data mining methods and applications.

Artificial Intelligence,Machine Learning
Opening the Black-Box: A Systematic Review on Explainable AI in Remote Sensing

Adrian Höhl,Ivica Obadic,Miguel Ángel Fernández Torres,Hiba Najjar,Dario Oliveira,Zeynep Akata,Andreas Dengel,Xiao Xiang Zhu

2024-02-21

Abstract:In recent years, black-box machine learning approaches have become a dominant modeling paradigm for knowledge extraction in Remote Sensing. Despite the potential benefits of uncovering the inner workings of these models with explainable AI, a comprehensive overview summarizing the used explainable AI methods and their objectives, findings, and challenges in Remote Sensing applications is still missing. In this paper, we address this issue by performing a systematic review to identify the key trends of how explainable AI is used in Remote Sensing and shed light on novel explainable AI approaches and emerging directions that tackle specific Remote Sensing challenges. We also reveal the common patterns of explanation interpretation, discuss the extracted scientific insights in Remote Sensing, and reflect on the approaches used for explainable AI methods evaluation. Our review provides a complete summary of the state-of-the-art in the field. Further, we give a detailed outlook on the challenges and promising research directions, representing a basis for novel methodological development and a useful starting point for new researchers in the field of explainable AI in Remote Sensing.

Machine Learning
Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Survey

Arun Das,Paul Rad

DOI: https://doi.org/10.48550/arXiv.2006.11371

2020-06-16

Computer Vision and Pattern Recognition

Abstract:Nowadays, deep neural networks are widely used in mission critical systems such as healthcare, self-driving vehicles, and military which have direct impact on human lives. However, the black-box nature of deep neural networks challenges its use in mission critical applications, raising ethical and judicial concerns inducing lack of trust. Explainable Artificial Intelligence (XAI) is a field of Artificial Intelligence (AI) that promotes a set of tools, techniques, and algorithms that can generate high-quality interpretable, intuitive, human-understandable explanations of AI decisions. In addition to providing a holistic view of the current XAI landscape in deep learning, this paper provides mathematical summaries of seminal work. We start by proposing a taxonomy and categorizing the XAI techniques based on their scope of explanations, methodology behind the algorithms, and explanation level or usage which helps build trustworthy, interpretable, and self-explanatory deep learning models. We then describe the main principles used in XAI research and present the historical timeline for landmark studies in XAI from 2007 to 2020. After explaining each category of algorithms and approaches in detail, we then evaluate the explanation maps generated by eight XAI algorithms on image data, discuss the limitations of this approach, and provide potential future directions to improve XAI evaluation.
Opening the Black Box: A systematic review on explainable artificial intelligence in remote sensing

Adrian Höhl,Ivica Obadic,Miguel-Ángel Fernández-Torres,Hiba Najjar,Dario Augusto Borges Oliveira,Zeynep Akata,Andreas Dengel,Xiao Xiang Zhu

DOI: https://doi.org/10.1109/mgrs.2024.3467001

IF: 14.6

2024-12-14

IEEE Geoscience and Remote Sensing Magazine

Abstract:In recent years, black-box machine learning approaches have become a dominant modeling paradigm for knowledge extraction in remote sensing. Despite the potential benefits of uncovering the inner workings of these models with explainable AI, a comprehensive overview summarizing the explainable AI methods used and their objectives, findings, and challenges in remote sensing applications is still missing. In this paper, we address this gap by performing a systematic review to identify the key trends in the field and shed light on novel explainable AI approaches and emerging directions that tackle specific remote sensing challenges. We also reveal the common patterns of explanation interpretation, discuss the extracted scientific insights, and reflect on the approaches used for the evaluation of explainable AI methods. As such, our review provides a complete summary of the state-of-the-art of explainable AI in remote sensing. Further, we give a detailed outlook on the challenges and promising research directions, representing a basis for novel methodological development and a useful starting point for new researchers in the field.

geochemistry & geophysics,remote sensing,imaging science & photographic technology
Explainable Artificial Intelligence: Concepts, Applications, Research Challenges and Visions

Luca Longo,Randy Goebel,Freddy Lecue,Peter Kieseberg,Andreas Holzinger

DOI: https://doi.org/10.1007/978-3-030-57321-8_1

2020-01-01

Abstract:The development of theory, frameworks and tools for Explainable AI (XAI) is a very active area of research these days, and articulating any kind of coherence on a vision and challenges is itself a challenge. At least two sometimes complementary and colliding threads have emerged. The first focuses on the development of pragmatic tools for increasing the transparency of automatically learned prediction models, as for instance by deep or reinforcement learning. The second is aimed at anticipating the negative impact of opaque models with the desire to regulate or control impactful consequences of incorrect predictions, especially in sensitive areas like medicine and law. The formulation of methods to augment the construction of predictive models with domain knowledge can provide support for producing human understandable explanations for predictions. This runs in parallel with AI regulatory concerns, like the European Union General Data Protection Regulation, which sets standards for the production of explanations from automated or semi-automated decision making. Despite the fact that all this research activity is the growing acknowledgement that the topic of explainability is essential, it is important to recall that it is also among the oldest fields of computer science. In fact, early AI was re-traceable, interpretable, thus understandable by and explainable to humans. The goal of this research is to articulate the big picture ideas and their role in advancing the development of XAI systems, to acknowledge their historical roots, and to emphasise the biggest challenges to moving forward.
Explaining Explanations: An Overview of Interpretability of Machine Learning

Leilani H. Gilpin,David Bau,Ben Z. Yuan,Ayesha Bajwa,Michael Specter,Lalana Kagal

DOI: https://doi.org/10.1109/dsaa.2018.00018

2018-10-01

Abstract:There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought processes. XAI allows users and parts of the internal system to be more transparent, providing explanations of their decisions in some level of detail. These explanations are important to ensure algorithmic fairness, identify potential bias/problems in the training data, and to ensure that the algorithms perform as expected. However, explanations produced by these systems is neither standardized nor systematically assessed. In an effort to create best practices and identify open challenges, we describe foundational concepts of explainability and show how they can be used to classify existing literature. We discuss why current approaches to explanatory methods especially for deep neural networks are insufficient. Finally, based on our survey, we conclude with suggested future research directions for explanatory artificial intelligence.
Quantitative Analysis of Primary Attribution Explainable Artificial Intelligence Methods for Remote Sensing Image Classification

Akshatha Mohan,Joshua Peeples

DOI: https://doi.org/10.1109/IGARSS52108.2023.10281981

2023-12-05

Abstract:We present a comprehensive analysis of quantitatively evaluating explainable artificial intelligence (XAI) techniques for remote sensing image classification. Our approach leverages state-of-the-art machine learning approaches to perform remote sensing image classification across multiple modalities. We investigate the results of the models qualitatively through XAI methods. Additionally, we compare the XAI methods quantitatively through various categories of desired properties. Through our analysis, we offer insights and recommendations for selecting the most appropriate XAI method(s) to gain a deeper understanding of the models' decision-making processes. The code for this work is publicly available.

Machine Learning,Artificial Intelligence,Computer Vision and Pattern Recognition
Beyond XAI:Obstacles Towards Responsible AI

Yulu Pi

2023-09-07

Abstract:The rapidly advancing domain of Explainable Artificial Intelligence (XAI) has sparked significant interests in developing techniques to make AI systems more transparent and understandable. Nevertheless, in real-world contexts, the methods of explainability and their evaluation strategies present numerous limitations.Moreover, the scope of responsible AI extends beyond just explainability. In this paper, we explore these limitations and discuss their implications in a boarder context of responsible AI when considering other important aspects, including privacy, fairness and contestability.

Artificial Intelligence
Explainable Analysis of Deep Learning Methods for SAR Image Classification

Shenghan Su,Ziteng Cui,Weiwei Guo,Zenghui Zhang,Wenxian Yu

DOI: https://doi.org/10.48550/arXiv.2204.06783

2022-04-14

Abstract:Deep learning methods exhibit outstanding performance in synthetic aperture radar (SAR) image interpretation tasks. However, these are black box models that limit the comprehension of their predictions. Therefore, to meet this challenge, we have utilized explainable artificial intelligence (XAI) methods for the SAR image classification task. Specifically, we trained state-of-the-art convolutional neural networks for each polarization format on OpenSARUrban dataset and then investigate eight explanation methods to analyze the predictions of the CNN classifiers of SAR images. These XAI methods are also evaluated qualitatively and quantitatively which shows that Occlusion achieves the most reliable interpretation performance in terms of Max-Sensitivity but with a low-resolution explanation heatmap. The explanation results provide some insights into the internal mechanism of black-box decisions for SAR image classification.

Computer Vision and Pattern Recognition
A Comprehensive Guide to Explainable AI: From Classical Models to LLMs

Weiche Hsieh,Ziqian Bi,Chuanqi Jiang,Junyu Liu,Benji Peng,Sen Zhang,Xuanhe Pan,Jiawei Xu,Jinlang Wang,Keyu Chen,Caitlyn Heqi Yin,Pohsun Feng,Yizhu Wen,Xinyuan Song,Tianyang Wang,Junjie Yang,Ming Li,Bowen Jing,Jintao Ren,Junhao Song,Han Xu,Hong-Ming Tseng,Yichao Zhang,Lawrence K.Q. Yan,Qian Niu,Silin Chen,Yunze Wang,Chia Xin Liang,Ming Liu

2024-12-01

Abstract:Explainable Artificial Intelligence (XAI) addresses the growing need for transparency and interpretability in AI systems, enabling trust and accountability in decision-making processes. This book offers a comprehensive guide to XAI, bridging foundational concepts with advanced methodologies. It explores interpretability in traditional models such as Decision Trees, Linear Regression, and Support Vector Machines, alongside the challenges of explaining deep learning architectures like CNNs, RNNs, and Large Language Models (LLMs), including BERT, GPT, and T5. The book presents practical techniques such as SHAP, LIME, Grad-CAM, counterfactual explanations, and causal inference, supported by Python code examples for real-world applications. Case studies illustrate XAI's role in healthcare, finance, and policymaking, demonstrating its impact on fairness and decision support. The book also covers evaluation metrics for explanation quality, an overview of cutting-edge XAI tools and frameworks, and emerging research directions, such as interpretability in federated learning and ethical AI considerations. Designed for a broad audience, this resource equips readers with the theoretical insights and practical skills needed to master XAI. Hands-on examples and additional resources are available at the companion GitHub repository: <a class="link-external link-https" href="https://github.com/Echoslayer/XAI_From_Classical_Models_to_LLMs" rel="external noopener nofollow">this https URL</a>.

Machine Learning,Artificial Intelligence
Bridging AI Developers and End Users: an End-User-Centred Explainable AI Taxonomy and Visual Vocabularies

Weina Jin,Sheelagh Carpendale,Simon Fraser,G. Hamarneh,D. Gromala

2019-01-01

Abstract:Researchers in the re-emerging field of explainable/interpretable artificial intelligence (XAI) have not paid enough attention to the end users of AI, who may be lay persons or domain experts such as doctors, drivers, and judges. We took an end-user-centric lens and conducted a literature review of 59 technique papers on XAI algorithms and/or visualizations. We grouped the existing explanatory forms in the literature into the end-user-friendly XAI taxonomy. It consists of three forms that explain AI’s decisions: feature attribute, instance, and decision rules/trees. We also analyzed the visual representations for each explanatory form, and summarized them as the XAI visual vocabularies. Our work is a synergy of XAI algorithm, visualization, and user-centred design. It provides a practical toolkit for AI developers to define the explanation problem from a user-centred perspective, and expand the visualization space of explanations to develop more end-user-friendly XAI systems.
Explainability of Artificial Intelligence Methods, Applications and Challenges: A Comprehensive Survey

Weiping Ding,Mohamed Abdel-Basset,Hossam Hawash,Ahmed M. Ali

DOI: https://doi.org/10.1016/j.ins.2022.10.013

IF: 8.1

2022-01-01

Information Sciences

Abstract:The continuous advancement of Artificial Intelligence (AI) has been revolutionizing the strategy of decision-making in different life domains. Regardless of this achievement, AI algorithms have been built as Black-Boxes , that is as they hide their internal rationality and learning methodology from the human leaving many unanswered questions about how and why the AI decisions are made. The absence of explanation results in a sensible and ethical challenge. Explainable Artificial Intelligence (XAI) is an evolving subfield of AI that emphasizes developing a plethora of tools and techniques for unboxing the Black-Box AI solutions by generating human-comprehensible, insightful, and transparent explanations of AI decisions. This study begins by discussing the primary principles of XAI research, Black-Box problems, the targeted audience, and the related notion of explainability over the historical timeline of the XAI studies and accordingly establishes an innovative definition of explainability that addresses the earlier theoretical proposals. According to an extensive analysis of the literature, this study contributes to the body of knowledge by driving a fine-grained, multi-level, and multi-dimension taxonomy for insightful categorization of XAI studies with the main aim to shed light on the variations and commonalities of existing algorithms paving the way for extra methodological developments. Then, an experimental comparative analysis is presented for the explanation generated by common XAI algorithms applied to different categories of data to highlight their properties, advantages, and flaws. Followingly, this study discusses and categorizes the evaluation metrics for the XAI-generated explanation and the findings show that there is no common consensus on how an explanation must be expressed, and how its quality and dependability should be evaluated. The findings show that XAI can contribute to realizing responsible and trustworthy AI, however, the advantages of interpretability should be technically demonstrated, and complementary procedures and regulations are required to give actionable information that can empower decision-making in real-world applications. Finally, the tutorial is crowned by discussing the open research questions, challenges, and future directions that serve as a roadmap for the AI community to advance the research in XAI and to inspire specialists and practitioners to take the advantage of XAI in different disciplines.
Explainable AI: The Quest for Transparency in Business and Beyond

Hanna DeSimone,Maikel Leon

DOI: https://doi.org/10.1109/ICICT62343.2024.00093

2024-03-15

Abstract:This paper provides an in-depth examination of Explainable Artificial Intelligence (XAI) and its significance in developing responsible AI. It covers the history of AI, the fundamental principles, the difference between explainability and interpretability, and the types of explanations. The paper highlights the role of transparency in explainable systems. Moreover, it discusses applications across high-stakes domains. Additionally, it touches on the current regulatory landscape and presents an outlook on the future of XAI research and regulation.

Business,Computer Science
LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks

Truong Thanh Hung Nguyen,Tobias Clement,Phuc Truong Loc Nguyen,Nils Kemmerzell,Van Binh Truong,Vo Thanh Khang Nguyen,Mohamed Abdelaal,Hung Cao

2024-02-20

Abstract:LangXAI is a framework that integrates Explainable Artificial Intelligence (XAI) with advanced vision models to generate textual explanations for visual recognition tasks. Despite XAI advancements, an understanding gap persists for end-users with limited domain knowledge in artificial intelligence and computer vision. LangXAI addresses this by furnishing text-based explanations for classification, object detection, and semantic segmentation model outputs to end-users. Preliminary results demonstrate LangXAI's enhanced plausibility, with high BERTScore across tasks, fostering a more transparent and reliable AI framework on vision tasks for end-users.

Artificial Intelligence,Computer Vision and Pattern Recognition
Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI

Alejandro Barredo Arrieta,Natalia Díaz-Rodríguez,Javier Del Ser,Adrien Bennetot,Siham Tabik,Alberto Barbado,Salvador García,Sergio Gil-López,Daniel Molina,Richard Benjamins,Raja Chatila,Francisco Herrera

2019-12-26

Abstract:In the last years, Artificial Intelligence (AI) has achieved a notable momentum that may deliver the best of expectations over many application sectors across the field. For this to occur, the entire community stands in front of the barrier of explainability, an inherent problem of AI techniques brought by sub-symbolism (e.g. ensembles or Deep Neural Networks) that were not present in the last hype of AI. Paradigms underlying this problem fall within the so-called eXplainable AI (XAI) field, which is acknowledged as a crucial feature for the practical deployment of AI models. This overview examines the existing literature in the field of XAI, including a prospect toward what is yet to be reached. We summarize previous efforts to define explainability in Machine Learning, establishing a novel definition that covers prior conceptual propositions with a major focus on the audience for which explainability is sought. We then propose and discuss about a taxonomy of recent contributions related to the explainability of different Machine Learning models, including those aimed at Deep Learning methods for which a second taxonomy is built. This literature analysis serves as the background for a series of challenges faced by XAI, such as the crossroads between data fusion and explainability. Our prospects lead toward the concept of Responsible Artificial Intelligence, namely, a methodology for the large-scale implementation of AI methods in real organizations with fairness, model explainability and accountability at its core. Our ultimate goal is to provide newcomers to XAI with a reference material in order to stimulate future research advances, but also to encourage experts and professionals from other disciplines to embrace the benefits of AI in their activity sectors, without any prior bias for its lack of interpretability.

Artificial Intelligence,Machine Learning,Neural and Evolutionary Computing
The challenges of integrating explainable artificial intelligence into GeoAI

Jin Xing,Renee Sieber

DOI: https://doi.org/10.1111/tgis.13045

IF: 2.568

2023-04-26

Transactions in GIS

Abstract:Although explainable artificial intelligence (XAI) promises considerable progress in glassboxing deep learning models, there are challenges in applying XAI to geospatial artificial intelligence (GeoAI), specifically geospatial deep neural networks (DNNs). We summarize these as three major challenges, related generally to XAI computation, to GeoAI and geographic data handling, and to geosocial issues. XAI computation includes the difficulty of selecting reference data/models and the shortcomings of attributing explanatory power to gradients, as well as the difficulty in accommodating geographic scale, geovisualization, and underlying geographic data structures. Geosocial challenges encompass the limitations of knowledge scope—semantics and ontologies—in the explanation of GeoAI as well as the lack of integrating non‐technical aspects in XAI, including processes that are not amenable to XAI. We illustrate these issues with a land use classification case study.

geography
EXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications

Evandro S. Ortigossa,Thales Gonçalves,Luis Gustavo Nonato

DOI: https://doi.org/10.1109/access.2024.3409843

IF: 3.9

2024-06-15

IEEE Access

Abstract:Intelligent applications supported by Machine Learning have achieved remarkable performance rates for a wide range of tasks in many domains. However, understanding why a trained algorithm makes a particular decision remains problematic. Given the growing interest in the application of learning-based models, some concerns arise in the dealing with sensible environments, which may impact users' lives. The complex nature of those models' decision mechanisms makes them the so-called "black boxes," in which the understanding of the logic behind automated decision-making processes by humans is not trivial. Furthermore, the reasoning that leads a model to provide a specific prediction can be more important than performance metrics, which introduces a trade-off between interpretability and model accuracy. Explaining intelligent computer decisions can be regarded as a way to justify their reliability and establish trust. In this sense, explanations are critical tools that verify predictions to discover errors and biases previously hidden within the models' complex structures, opening up vast possibilities for more responsible applications. In this review, we provide theoretical foundations of Explainable Artificial Intelligence (XAI), clarifying diffuse definitions and identifying research objectives, challenges, and future research lines related to turning opaque machine learning outputs into more transparent decisions. We also present a careful overview of the state-of-the-art explainability approaches, with a particular analysis of methods based on feature importance, such as the well-known LIME and SHAP. As a result, we highlight practical applications of the successful use of XAI.

computer science, information systems,telecommunications,engineering, electrical & electronic

Unlocking the Potential of Explainable Artificial Intelligence in Remote Sensing Big Data

Survey on Explainable AI: From Approaches, Limitations and Applications Aspects

Applications of Explainable artificial intelligence in Earth system science

Evaluating explainable artificial intelligence methods for multi-label deep learning classification tasks in remote sensing

Towards Explainable Artificial Intelligence (XAI): A Data Mining Perspective

Opening the Black-Box: A Systematic Review on Explainable AI in Remote Sensing

Opportunities and Challenges in Explainable Artificial Intelligence (XAI): A Survey

Opening the Black Box: A systematic review on explainable artificial intelligence in remote sensing

Explainable Artificial Intelligence: Concepts, Applications, Research Challenges and Visions

Explaining Explanations: An Overview of Interpretability of Machine Learning

Quantitative Analysis of Primary Attribution Explainable Artificial Intelligence Methods for Remote Sensing Image Classification

Beyond XAI:Obstacles Towards Responsible AI

Explainable Analysis of Deep Learning Methods for SAR Image Classification

A Comprehensive Guide to Explainable AI: From Classical Models to LLMs

Bridging AI Developers and End Users: an End-User-Centred Explainable AI Taxonomy and Visual Vocabularies

Explainability of Artificial Intelligence Methods, Applications and Challenges: A Comprehensive Survey

Explainable AI: The Quest for Transparency in Business and Beyond

LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks

Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI

The challenges of integrating explainable artificial intelligence into GeoAI

EXplainable Artificial Intelligence (XAI)—From Theory to Methods and Applications