Abstract:User trust has been identified as a critical issue that is pivotal to the success of autonomous vehicle (AV) operations where artificial intelligence (AI) is widely adopted. For such integrated AI-based driving systems, one promising way of building user trust is through the concept of explainable artificial intelligence (XAI) which requires the AI system to provide the user with the explanations behind each decision it makes. Motivated by both the need to enhance user trust and the promise of novel XAI technology in addressing such need, this paper seeks to enhance trustworthiness in autonomous driving systems through the development of explainable Deep Learning (DL) models. First, the paper casts the decision-making process of the AV system not as a classification task (which is the traditional process) but rather as an image-based language generation (image captioning) task. As such, the proposed approach makes driving decisions by first generating textual descriptions of the driving scenarios, which serve as explanations that humans can understand. To this end, a novel multi-modal DL architecture is proposed to jointly model the correlation between an image (driving scenario) and language (descriptions). It adopts a fully Transformer-based structure and therefore has the potential to perform global attention and imitate effectively, the learning processes of human drivers. The results suggest that the proposed model can and does generate legal and meaningful sentences to describe a given driving scenario, and subsequently to correctly generate appropriate driving decisions in autonomous vehicles (AVs). It is also observed that the proposed model significantly outperforms multiple baseline models in terms of generating both explanations and driving actions. From the end user's perspective, the proposed model can be beneficial in enhancing user trust because it provides the rationale behind an AV's actions. From the AV developer's perspective, the explanations from this explainable system could serve as a "debugging" tool to detect potential weaknesses in the existing system and identify specific directions for improvement.

NLE-DM: Natural-Language Explanations for Decision Making of Autonomous Driving Based on Semantic Scene Understanding

Attention-Based Interrelation Modeling for Explainable Automated Driving

Reason induced visual attention for explainable autonomous driving

A Scene Understanding Network Based on Driving Scene

Vehicle-Related Scene Understanding Using Deep Learning

A system of vision sensor based deep neural networks for complex driving scene analysis in support of crash risk assessment and prevention

RAG-Driver: Generalisable Driving Explanations with Retrieval-Augmented In-Context Learning in Multi-Modal Large Language Model

Explainable deep learning improves human mental models of self-driving cars

Textual Explanations for Automated Commentary Driving

DME-Driver: Integrating Human Decision Logic and 3D Scene Perception in Autonomous Driving

Efficient textual explanations for complex road and traffic scenarios based on semantic segmentation

Why did the AI make that decision? Towards an explainable artificial intelligence (XAI) for autonomous driving systems

Multi-Modal Sensor Fusion-Based Deep Neural Network for End-to-End Autonomous Driving With Scene Understanding

Hint-AD: Holistically Aligned Interpretability in End-to-End Autonomous Driving

On the Road to Clarity: Exploring Explainable AI for World Models in a Driver Assistance System

Safety Implications of Explainable Artificial Intelligence in End-to-End Autonomous Driving

Leveraging Driver Attention for an End-to-End Explainable Decision-Making From Frontal Images

DRIVE: Dependable Robust Interpretable Visionary Ensemble Framework in Autonomous Driving

Visualizing Global Explanations of Point Cloud DNNs