Abstract:Deep neural networks (DNN) try to analyze given data, to come up with decisions regarding the inputs. The decision-making process of the DNN model is not entirely transparent. The confidence of the model predictions on new data fed into the network can vary. We address the question of certainty of decision making and adequacy of information capturing by DNN models during this process of decision-making. We introduce a measure called certainty index, which is based on the outputs in the most penultimate layer of DNN. In this approach, we employed iEEG (intracranial electroencephalogram) data to train and test DNN. When arriving at model predictions, the contribution of the entire information content of the input may be important. We explored the relationship between the certainty of DNN predictions and information content of the signal by estimating the sample entropy and using a heatmap of the signal. While it can be assumed that the entire sample must be utilized for arriving at the most appropriate decisions, an evaluation of DNNs from this standpoint has not been reported. We demonstrate that the robustness of the relationship between certainty index with the sample entropy, demonstrated through sample entropy-heatmap correlation, is higher than that with the original signal, indicating that the DNN focuses on information rich regions of the signal to arrive at decisions. Therefore, it can be concluded that the certainty of a decision is related to the DNN's ability to capture the information in the original signal. Our results indicate that, within its limitations, the certainty index can be used as useful tool in estimating the confidence of predictions. The certainty index appears to be related to how effectively DNN heatmaps captured the information content in the signal.

Data Separability for Neural Network Classifiers and the Development of a Separability Index

A Novel Intrinsic Measure of Data Separability

A Classification Performance Evaluation Measure Considering Data Separability

A Distance-based Separability Measure for Internal Cluster Validation

A note on the separability index

DCSI -- An improved measure of cluster separability based on separation and connectedness

Compressed Data Separation with Redundant Dictionaries

An Internal Cluster Validity Index Using a Distance-based Separability Measure

Feature Separability Based on the Distance Matrix

A Law of Data Separation in Deep Learning

A New Separation Measure for Improving the Effectiveness of Validity Indices

Understanding Deep Neural Networks via Linear Separability of Hidden Layers

An Information-Geometric Formulation of Pattern Separation and Evaluation of Existing Indices

Ipcm Separability Ratio for Supervised Feature Selection

Information Entropy Measures for Evaluation of Reliability of Deep Neural Network Results

Data dimensionality reduction with application to improving classification performance and explaining concepts of data sets.

A Novel Separating Hyperplane Classification Framework to Unify Nearest-Class-Model Methods for High-Dimensional Data

Separability-entanglement Classifier Via Machine Learning

Analysis of Generalizability of Deep Neural Networks Based on the Complexity of Decision Boundary

The Role of Subgroup Separability in Group-Fair Medical Image Classification