Abstract:Despite the high accuracy offered by state-of-the-art deep natural-language models (e.g., LSTM, BERT), their application in real-life settings is still widely limited, as they behave like a black-box to the end-user. Hence, explainability is rapidly becoming a fundamental requirement of future-generation data-driven systems based on deep-learning approaches. Several attempts to fulfill the existing gap between accuracy and interpretability have been made. However, robust and specialized eXplainable Artificial Intelligence solutions, tailored to deep natural-language models, are still missing. We propose a new framework, named T-EBAnO , which provides innovative prediction-local and class-based model-global explanation strategies tailored to deep learning natural-language models. Given a deep NLP model and the textual input data, T-EBAnO provides an objective, human-readable, domain-specific assessment of the reasons behind the automatic decision-making process. Specifically, the framework extracts sets of interpretable features mining the inner knowledge of the model. Then, it quantifies the influence of each feature during the prediction process by exploiting the normalized Perturbation Influence Relation index at the local level and the novel Global Absolute Influence and Global Relative Influence indexes at the global level. The effectiveness and the quality of the local and global explanations obtained with T-EBAnO are proved on an extensive set of experiments addressing different tasks, such as a sentiment-analysis task performed by a fine-tuned BERT model and a toxic-comment classification task performed by an LSTM model. The quality of the explanations proposed by T-EBAnO , and, specifically, the correlation between the influence index and human judgment, has been evaluated by humans in a survey with more than 4000 judgments. To prove the generality of T-EBAnO and its model/task-independent methodology, experiments with other models (ALBERT, ULMFit) on popular public datasets (Ag News and Cola) are also discussed in detail.

MANE: Model-Agnostic Non-linear Explanations for Deep Learning Model

Which Neural Network Makes More Explainable Decisions? an Approach Towards Measuring Explainability

Locally Interpretable One-Class Anomaly Detection for Credit Card Fraud Detection

Accurate and Intuitive Contextual Explanations using Linear Model Trees

Generating Plausible Counterfactual Explanations for Deep Transformers in Financial Text Classification

Model Interpretation and Explainability: Towards Creating Transparency in Prediction Models

A user-centered explainable artificial intelligence approach for financial fraud detection

Modeling Users' Behavior Sequences with Hierarchical Explainable Network for Cross-domain Fraud Detection

Toward Learning Model-Agnostic Explanations for Deep Learning-Based Signal Modulation Classifiers

Explainable AI in Credit Card Fraud Detection: Interpretable Models and Transparent Decision-making for Enhanced Trust and Compliance in the USA

Model Agnostic Multilevel Explanations

Explaining Deep Convolutional Neural Networks for Image Classification by Evolving Local Interpretable Model-agnostic Explanations

Trusting deep learning natural-language models via local and global explanations

Solving the enigma: Deriving optimal explanations of deep networks

Explainable Enterprise Credit Rating via Deep Feature Crossing Network

FraudMemory: Explainable Memory-Enhanced Sequential Neural Networks for Financial Fraud Detection.

Can I trust you more? Model-Agnostic Hierarchical Explanations

Interpreting Deep Learning Model Using Rule-based Method

Explainable AI for Interpretable Credit Scoring

Explanations of Machine Learning predictions: a mandatory step for its application to Operational Processes