Abstract:Topological data analysis (TDA) is a branch of computational mathematics, bridging algebraic topology and data science, that provides compact, noise-robust representations of complex structures. Deep neural networks (DNNs) learn millions of parameters associated with a series of transformations defined by the model architecture, resulting in high-dimensional, difficult-to-interpret internal representations of input data. As DNNs become more ubiquitous across multiple sectors of our society, there is increasing recognition that mathematical methods are needed to aid analysts, researchers, and practitioners in understanding and interpreting how these models' internal representations relate to the final classification. In this paper, we apply cutting edge techniques from TDA with the goal of gaining insight into the interpretability of convolutional neural networks used for image classification. We use two common TDA approaches to explore several methods for modeling hidden-layer activations as high-dimensional point clouds, and provide experimental evidence that these point clouds capture valuable structural information about the model's process. First, we demonstrate that a distance metric based on persistent homology can be used to quantify meaningful differences between layers, and we discuss these distances in the broader context of existing representational similarity metrics for neural network interpretability. Second, we show that a mapper graph can provide semantic insight into how these models organize hierarchical class knowledge at each layer. These observations demonstrate that TDA is a useful tool to help deep learning practitioners unlock the hidden structures of their models.

Topological learning in multiclass data sets

Topological Learning in Multi-Class Data Sets

A Comprehensive Review of Deep Neural Network Interpretation Using Topological Data Analysis

Learning Connectivity of Neural Networks from a Topological Perspective

Experimental Observations of the Topology of Convolutional Neural Network Activations

Topological structure of complex predictions

Understanding Deep Neural Networks Using Topological Data Analysis

Topological data analysis and machine learning

Topological exploration of artificial neuronal network dynamics

The importance of the whole: Topological data analysis for the network neuroscientist

On Characterizing the Evolution of Embedding Space of Neural Networks using Algebraic Topology

Machine Learning Topological States

A Differential Topological View of Challenges in Learning with Feedforward Neural Networks.

Topological Learning for Brain Networks

Hypernetwork Science: From Multidimensional Networks to Computational Topology

Weisfeiler and Lehman Go Paths: Learning Topological Features via Path Complexes

Beyond Multilayer Perceptrons: Investigating Complex Topologies in Neural Networks

Image Classification using Combination of Topological Features and Neural Networks

A topological data analysis based classification method for multiple measurements

Topological data analysis of the firings of a network of stochastic spiking neurons

Topological Data Analysis of Neural Network Layer Representations