Abstract:Artificial Neural Networks (ANNs) require significant amounts of data and computational resources to achieve high effectiveness in performing the tasks for which they are trained. To reduce resource demands, various techniques, such as Neuron Pruning, are applied. Due to the complex structure of ANNs, interpreting the behavior of hidden layers and the features they recognize in the data is challenging. A lack of comprehensive understanding of which information is utilized during inference can lead to inefficient use of available data, thereby lowering the overall performance of the models. In this paper, we introduce a method for integrating Topological Data Analysis (TDA) with Convolutional Neural Networks (CNN) in the context of image recognition. This method significantly enhances the performance of neural networks by leveraging a broader range of information present in the data, enabling the model to make more informed and accurate predictions. Our approach, further referred to as Vector Stitching, involves combining raw image data with additional topological information derived through TDA methods. This approach enables the neural network to train on an enriched dataset, incorporating topological features that might otherwise remain unexploited or not captured by the network's inherent mechanisms. The results of our experiments highlight the potential of incorporating results of additional data analysis into the network's inference process, resulting in enhanced performance in pattern recognition tasks in digital images, particularly when using limited datasets. This work contributes to the development of methods for integrating TDA with deep learning and explores how concepts from Information Theory can explain the performance of such hybrid methods in practical implementation environments.

Activation Landscapes as a Topological Summary of Neural Network Performance

Experimental Observations of the Topology of Convolutional Neural Network Activations

Visualizing Deep Neural Networks with Topographic Activation Maps

Topological Data Analysis of Neural Network Layer Representations

Understanding Deep Neural Networks Using Topological Data Analysis

A Comprehensive Review of Deep Neural Network Interpretation Using Topological Data Analysis

Functional Loops: Monitoring Functional Organization of Deep Neural Networks Using Algebraic Topology

Evaluating Loss Landscapes from a Topology Perspective

Characterization of topological structures in different neural network architectures

Learning Persistent Homology of 3D Point Clouds

Topological Measurement of Deep Neural Networks Using Persistent Homology

Preserving Information: How does Topological Data Analysis improve Neural Network performance?

Exposition and Interpretation of the Topology of Neural Networks

Topological exploration of artificial neuronal network dynamics

Topological learning in multiclass data sets

Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks

Topo-Geometric Analysis of Variability in Point Clouds using Persistence Landscapes

Learning Connectivity of Neural Networks from a Topological Perspective

Attending to Topological Spaces: The Cellular Transformer

The Landscape of Complex Networks

The importance of the whole: Topological data analysis for the network neuroscientist