Abstract:Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by millions of parameters, but valuable because it increases our ability to understand current models and create improved versions of them. In this paper we investigate the extent to which neural networks exhibit what we call convergent learning, which is when the representations learned by multiple nets converge to a set of features which are either individually similar between networks or where subsets of features span similar low-dimensional spaces. We propose a specific method of probing representations: training multiple networks and then comparing and contrasting their individual, learned representations at the level of neurons or groups of neurons. We begin research into this question using three techniques to approximately align different neural networks on a feature level: a bipartite matching approach that makes one-to-one assignments between neurons, a sparse prediction approach that finds one-to-many mappings, and a spectral clustering approach that finds many-to-many mappings. This initial investigation reveals a few previously unknown properties of neural networks, and we argue that future research into the question of convergent learning will yield many more. The insights described here include (1) that some features are learned reliably in multiple networks, yet other features are not consistently learned; (2) that units learn to span low-dimensional subspaces and, while these subspaces are common to multiple networks, the specific basis vectors learned are not; (3) that the representation codes show evidence of being a mix between a local code and slightly, but not fully, distributed codes across multiple units.

Finite convergence of the learning algorithms for a modified multi-valued neuron

Convergence Analysis of General Neural Networks under Almost Periodic Stimuli

An On-Line Learning Approach with Support Vector Dormain Classifier

Convergence Theorems for the Kohonen Feature Mapping Algorithms with VLRPs

Convergence Analysis of Graph Regularized Non-Negative Matrix Factorization

Convergence analysis of discrete time recurrent neural networks for linear variational inequality problem

A L-BFGS Based Learning Algorithm for Complex-Valued Feedforward Neural Networks

Convergence Theorems for a Class of Learning Algorithms with VLRPs

Convergence Analysis of Novel Fractional-Order Backpropagation Neural Networks With Regularization Terms

Deterministic convergence analysis for regularized long short-term memory and its application to regression and multi-classification problems

Convergence Rates of Training Deep Neural Networks Via Alternating Minimization Methods.

Convergence and objective functions of noise-injected multilayer perceptrons with hidden multipliers

Convergence Analysis of Two-layer Neural Networks with ReLU Activation

Convergence of a modified gradient-based learning algorithm with penalty for single-hidden-layer feed-forward networks

Estimation of Convergence Rate for Multi-Regression Learning Algorithm

A Fast Hybrid Algorithm Of Global Optimization For Feedforward Neural Networks

On Convergence of Training Loss Without Reaching Stationary Points

FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Convergence Analysis

Convergent Learning: Do different neural networks learn the same representations?

A mixture varying-gain dynamic learning network for solving nonlinear and nonconvex constrained optimization problems

Geometric Insights into the Convergence of Nonlinear TD Learning