Abstract:Automated driving desires better performance on tasks like motion planning and interacting with pedestrians in mixed-traffic environments. Deep learning algorithms can achieve high performance in these tasks with remarkable visual scene understanding and generalization abilities. However, when common scene-parsing methods are used to train end-to-end models, limitations of explainability in such algorithms inhibit their implementations in fully automated driving. The main challenges include algorithm performance deficiencies and inconsistencies, insufficient AI transparency, degraded user trust, and undermining human-AI interactions. This research aids the decision-making performance and transparency of automated driving systems by providing multi-modal explanations, especially when interacting with pedestrians. The proposed algorithm combines global visual features and interrelation features by parsing scene images as self-constructed graphs and using an attention-based module to capture the interrelationship among the ego-vehicle and other traffic-related objects. The output modules make decisions while simultaneously generating semantic text explanations. The results show that the fusion of the features from global frames and interrelational graphs improves decision-making and explanation predictions compared to two state-of-the-art benchmark algorithms. The interrelation module also enhances algorithm transparency by disclosing the visual attention used for decision-making. The importance of interrelation features on the two prediction tasks is further revealed along with the underlying mechanism of multitask learning on the datasets with hierarchical labels. The proposed model improves driving decision-making during pedestrian interactions with intelligible reasoning cues for building an appropriate mental model of automated driving performance for human users.

Expected Integral Discrete Gradient: Diagnosing Autonomous Driving Model

Integrated Decision Gradients: Compute Your Attributions Where the Model Makes Its Decision

IG2: Integrated Gradient on Iterative Gradient Path for Feature Attribution

IDGI: A Framework to Eliminate Explanation Noise from Integrated Gradients

Generalized Integrated Gradients: A practical method for explaining diverse ensembles

Maximum Entropy Baseline for Integrated Gradients

Gradient based Feature Attribution in Explainable AI: A Technical Review

Four Axiomatic Characterizations of the Integrated Gradients Attribution Method

Greedy PIG: Adaptive Integrated Gradients

Integrated Gradient Correlation: a Dataset-wise Attribution Method

DiCE: The Infinitely Differentiable Monte-Carlo Estimator

Attention-Based Interrelation Modeling for Explainable Automated Driving

On Gradient-like Explanation under a Black-box Setting: When Black-box Explanations Become as Good as White-box

XC: Exploring Quantitative Use Cases for Explanations in 3D Object Detection

Derivative-Free Diffusion Manifold-Constrained Gradient for Unified XAI

Interpret Gaussian Process Models by Using Integrated Gradients

Decompose the model: Mechanistic interpretability in image models with Generalized Integrated Gradients (GIG)

Towards Understanding Sensitive and Decisive Patterns in Explainable AI: A Case Study of Model Interpretation in Geometric Deep Learning

T-Explainer: A Model-Agnostic Explainability Framework Based on Gradients

Explaining a Machine-Learning Lane Change Model With Maximum Entropy Shapley Values