Abstract:There currently exist two extreme viewpoints for neural network feature learning -- (i) Neural networks simply implement a kernel method (a la NTK) and hence no features are learned (ii) Neural networks can represent (and hence learn) intricate hierarchical features suitable for the data. We argue in this paper neither interpretation is likely to be correct based on a novel viewpoint. Neural networks can be viewed as a mixture of experts, where each expert corresponds to a (number of layers length) path through a sequence of hidden units. We use this alternate interpretation to motivate a model, called the Deep Linearly Gated Network (DLGN), which sits midway between deep linear networks and ReLU networks. Unlike deep linear networks, the DLGN is capable of learning non-linear features (which are then linearly combined), and unlike ReLU networks these features are ultimately simple -- each feature is effectively an indicator function for a region compactly described as an intersection of (number of layers) half-spaces in the input space. This viewpoint allows for a comprehensive global visualization of features, unlike the local visualizations for neurons based on saliency/activation/gradient maps. Feature learning in DLGNs is shown to happen and the mechanism with which this happens is through learning half-spaces in the input space that contain smooth regions of the target function. Due to the structure of DLGNs, the neurons in later layers are fundamentally the same as those in earlier layers -- they all represent a half-space -- however, the dynamics of gradient descent impart a distinct clustering to the later layer neurons. We hypothesize that ReLU networks also have similar feature learning behaviour.

Piecewise-linear Division of Region by Neural Networks with Maximum Detectors.

Nearly-tight bounds on linear regions of piecewise linear neural networks

Empirical Studies on the Properties of Linear Regions in Deep Neural Networks

On the Number of Linear Regions of Convolutional Neural Networks with Piecewise Linear Activations.

Analysis on the Number of Linear Regions of Piecewise Linear Neural Networks

Dissecting Deep Neural Networks

Max-Mahalanobis Linear Discriminant Analysis Networks

How to Explain Neural Networks: A perspective of data space division

Fast and Exact Enumeration of Deep Networks Partitions Regions

A Novel Improvement of Neural Network Classification Using Further Division of Partition Space

The Evolution of the Interplay Between Input Distributions and Linear Regions in Networks

Continuous piecewise linear identification with moderate number of subregions

Exploring Linear Feature Disentanglement for Neural Networks

Spatial Division Networks for Weakly Supervised Detection

Training Dynamics of Deep Network Linear Regions

Half-Space Feature Learning in Neural Networks

Piecewise Linear Neural Networks and Deep Learning

A Novel Region Segmentation Algorithm with Neural Network for Segmented Image Coding

On the Number of Linear Regions of Deep Neural Networks

Divide and Slide: Layer-Wise Refinement for Output Range Analysis of Deep Neural Networks

An Industrial Micro-Defect Diagnosis System Via Intelligent Segmentation Region.