Explainable AI: current status and future directions

Prashant Gohel,Priyanka Singh,Manoranjan Mohanty
DOI: https://doi.org/10.48550/arXiv.2107.07045
2021-07-12
Abstract:Explainable Artificial Intelligence (XAI) is an emerging area of research in the field of Artificial Intelligence (AI). XAI can explain how AI obtained a particular solution (e.g., classification or object detection) and can also answer other "wh" questions. This explainability is not possible in traditional AI. Explainability is essential for critical applications, such as defense, health care, law and order, and autonomous driving vehicles, etc, where the know-how is required for trust and transparency. A number of XAI techniques so far have been purposed for such applications. This paper provides an overview of these techniques from a multimedia (i.e., text, image, audio, and video) point of view. The advantages and shortcomings of these techniques have been discussed, and pointers to some future directions have also been provided.
Machine Learning,Artificial Intelligence
What problem does this paper attempt to address?
The core problem that this paper attempts to solve is the lack of transparency and interpretability brought about by the black - box nature of traditional artificial intelligence (AI) models. Specifically, traditional AI models lack the ability to explain their decision - making processes in many key areas (such as healthcare, national defense, law and order, etc.), which limits the trust and application of AI technology in these areas. ### Main problem description in the paper 1. **Limitations of traditional AI**: - Traditional AI models are usually black - box models and cannot explain their decision - making processes. For example, in medical diagnosis, doctors need to understand how AI arrives at the conclusion of whether a patient has a disease or not, rather than just getting a "yes" or "no" answer. - In other application scenarios (such as law and order), in addition to "what", questions such as "why", "when", and "where" also need to be answered, but traditional AI cannot provide these explanations. 2. **Importance of interpretability**: - **Trust and transparency**: In critical applications, such as healthcare and national defense, it is crucial to explain the decision - making process of AI, because errors in these areas can lead to serious consequences. For example, in medical diagnosis, wrong predictions may endanger lives. - **Legal and ethical requirements**: Some regulations (such as the "right to explanation" clause in the European Union) require AI systems to be able to explain their decision - making processes to ensure their legality and fairness. 3. **Insufficiencies of existing solutions**: - Although a variety of XAI (Explainable AI) techniques have been proposed, there are differences in the applicability and effectiveness of these techniques on different data types (text, image, audio, video). For example, an interpretation method suitable for images may not be suitable for text or audio. ### Goals of the paper This paper aims to review existing XAI techniques, explore their applications in multimedia data (text, image, audio, video), and point out the advantages and disadvantages of each technique. In addition, the paper also points out the directions for future XAI research, especially the potential in multimodal applications, such as AI solutions in the national defense field that need to process multiple data types such as images, text, and audio. ### Contributions of the paper - **Classification and summary**: The paper classifies existing XAI techniques into transparent methods and post - hoc explanation methods, and discusses in detail the characteristics and application scenarios of each method. - **Case analysis**: Through specific cases (such as industrial equipment failure prediction, video threat detection), it shows the importance and challenges of XAI in practical applications. - **Future directions**: It points out the key issues and potential application areas that need to be focused on in the future research and development of XAI. In short, this paper aims to promote the development of XAI technology through systematic review and analysis, so that it can be widely used in more key areas and improve the transparency and credibility of AI systems.