Abstract:Background: Explainable artificial intelligence (XAI) is a technology that can enhance trust in mental state classifications by providing explanations for the reasoning behind artificial intelligence (AI) models outputs, especially for high-dimensional and highly-correlated brain signals. Feature importance and counterfactual explanations are two common approaches to generate these explanations, but both have drawbacks. While feature importance methods, such as shapley additive explanations (SHAP), can be computationally expensive and sensitive to feature correlation, counterfactual explanations only explain a single outcome instead of the entire model. Methods: To overcome these limitations, we propose a new procedure for computing global feature importance that involves aggregating local counterfactual explanations. This approach is specifically tailored to fMRI signals and is based on the hypothesis that instances close to the decision boundary and their counterfactuals mainly differ in the features identified as most important for the downstream classification task. We refer to this proposed feature importance measure as Boundary Crossing Solo Ratio (BoCSoR), since it quantifies the frequency with which a change in each feature in isolation leads to a change in classification outcome, i.e., the crossing of the model's decision boundary. Results and conclusions: Experimental results on synthetic data and real publicly available fMRI data from the Human Connect project show that the proposed BoCSoR measure is more robust to feature correlation and less computationally expensive than state-of-the-art methods. Additionally, it is equally effective in providing an explanation for the behavior of any AI model for brain signals. These properties are crucial for medical decision support systems, where many different features are often extracted from the same physiological measures and a gold standard is absent. Consequently, computing feature importance may become computationally expensive, and there may be a high probability of mutual correlation among features, leading to unreliable results from state-of-the-art XAI methods.

Nontarget deposition and losses of chlorothalonil in irrigation runoff water from a commercial foliage plant nursery.

A Probabilistic Model of Functional Brain Connectivity Network for Discovering Novel Biomarkers.

A Novel Explainable Fuzzy Clustering Approach for fMRI Dynamic Functional Network Connectivity Analysis

BrainGNN: Interpretable Brain Graph Neural Network for fMRI Analysis

Large-scale Directional Connections among Multi Resting-State Neural Networks in Human Brain: A Functional MRI and Bayesian Network Modeling Study

Novel Machine Learning Approaches for Improving the Reproducibility and Reliability of Functional and Effective Connectivity from Functional MRI

Comparison of Brain Networks based on Predictive Models of Connectivity

Initial Validation for the Estimation of Resting-State fMRI Effective Connectivity by a Generalization of the Correlation Approach

Relative Attributing Propagation: Interpreting the Comparative Contributions of Individual Units in Deep Neural Networks

Effective and Interpretable fMRI Analysis via Functional Brain Network Generation

Sparse Deep Neural Network for Encoding and Decoding the Structural Connectome

Interpretable Graph Neural Networks for Connectome-Based Brain Disorder Analysis

Decoding autism: Uncovering patterns in brain connectivity through sparsity analysis with rs-fMRI data

Estimating effective connectivity in linear brain network models

Interpretable Deep Neural Networks for Single-Trial EEG Classification

From local counterfactuals to global feature importance: efficient, robust, and model-agnostic explanations for brain connectivity networks

Identifying Brain Network Structure for an fMRI Effective Connectivity Study Using the Least Absolute Shrinkage and Selection Operator (LASSO) Method

A novel method linking neural connectivity to behavioral fluctuations: Behavior-Regressed Connectivity

Estimating Functional Brain Networks by Low-Rank Representation With Local Constraint

A Mixed Model Approach for Estimating Regional Functional Connectivity from Voxel-level BOLD Signals

Nonlinear brain connectivity from neurons to networks: quantification, sources and localization.