Abstract:The non-transparency of artificial intelligence (AI) systems, particularly in deep learning (DL), poses significant challenges to their comprehensibility and trustworthiness. This study aims to enhance the explainability of DL models through visual analytics (VA) and human-in-the-loop (HITL) principles, making these systems more transparent and understandable to end users. In this work, we propose a novel approach that utilizes a transition matrix to interpret results from DL models through more comprehensible machine learning (ML) models. The methodology involves constructing a transition matrix between the feature spaces of DL and ML models as formal and mental models, respectively, improving the explainability for classification tasks. We validated our approach with computational experiments on the MNIST, FNC-1, and Iris datasets using a qualitative and quantitative comparison criterion, that is, how different the results obtained by our approach are from the ground truth of the training and testing samples. The proposed approach significantly enhanced model clarity and understanding in the MNIST dataset, with SSIM and PSNR values of 0.697 and 17.94, respectively, showcasing high-fidelity reconstructions. Moreover, achieving an F1m score of 77.76% and a weighted accuracy of 89.38%, our approach proved its effectiveness in stance detection with the FNC-1 dataset, complemented by its ability to explain key textual nuances. For the Iris dataset, the separating hyperplane constructed based on the proposed approach allowed for enhancing classification accuracy. Overall, using VA, HITL principles, and a transition matrix, our approach significantly improves the explainability of DL models without compromising their performance, marking a step forward in developing more transparent and trustworthy AI systems.

Contrastive Explanations for a Deep Learning Model on Time-Series Data

XAI Methods for Neural Time Series Classification: A Brief Review

Interpretation of Time-Series Deep Models: A Survey

Explainable Artificial Intelligence (XAI) on TimeSeries Data: A Survey

Explainable Artificial Intelligence: Understanding, Visualizing and Interpreting Deep Learning Models

Encoding Time-Series Explanations through Self-Supervised Model Behavior Consistency

TimeX++: Learning Time-Series Explanations with Information Bottleneck

Towards Understanding Sensitive and Decisive Patterns in Explainable AI: A Case Study of Model Interpretation in Geometric Deep Learning

Explainable AI for Time Series Classification: A Review, Taxonomy and Research Directions

Behave-XAI: Deep Explainable Learning of Behavioral Representational Data

Explainable AI for time series via virtual inspection layers

Explanation Space: A New Perspective into Time Series Interpretability

Post-hoc Explanation Options for XAI in Deep Learning: The Insight Centre for Data Analytics Perspective

Deep Learning for Time-Series Analysis

DeLELSTM: Decomposition-based Linear Explainable LSTM to Capture Instantaneous and Long-term Effects in Time Series

Visual Explanations with Attributions and Counterfactuals on Time Series Classification

Investigating Explainability Methods in Recurrent Neural Network Architectures for Financial Time Series Data

Explaining deep multi-class time series classifiers

Explaining the Unexplained: Revealing Hidden Correlations for Better Interpretability

Interpretability of deep learning models in analysis of Spanish financial text

Explainable Deep Learning: A Visual Analytics Approach with Transition Matrices