Abstract:A structure composed of local linear perceptrons for approximating global class discriminants is investigated. Such local linear models may be combined in a cooperative or competitive way. In the cooperative model, a weighted sum of the outputs of the local perceptrons is computed where the weight is a function of the distance between the input and the position of the local perceptron. In the competitive model, the cost function dictates a mixture model where only one of the local perceptrons give output. Learning of the local models' positions and the linear mappings they implement are coupled and both supervised. We show that this is preferable to the uncoupled case where the positions are trained in an unsupervised manner before the separate, supervised training of mappings. We use goodness criteria based on the cross-entropy and give learning equations for both the cooperative and competitive cases. The coupled and uncoupled versions of cooperative and competitive approaches are compared among themselves and with multilayer perceptrons of sigmoidal hidden units and radial basis functions (RBFs) of Gaussian units on the application of recognition of handwritten digits. The criteria of comparison are the generalization accuracy, learning time, and the number of free parameters. We conclude that even on such a high-dimensional problem, such local models are promising. They generalize much better than RBF's and use much less memory. When compared with multilayer perceptrons, we note that local models learn much faster and generalize as well and sometimes better with comparable number of parameters.

Local design for multi-layer perceptron

A Local Online Learning Approach for Non-linear Data.

Adaptive Deep Spiking Neural Network with Global-Local Learning Via Balanced Excitatory and Inhibitory Mechanism

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

A SYMMETRIC TERNARY LOGIC BASED MULTI-VALUED LEARNING NETWORK

Multi-Valued Logic Learning Control

LMKL-Net: A Fast Localized Multiple Kernel Learning Solver via Deep Neural Networks

Learning nonlinear manifolds based on mixtures of localized linear manifolds under a self-organizing framework

Novel neural controller for robot manipulator

A Global Algorithm for Training Multilayer Neural Networks

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Local linear perceptrons for classification

Multilayer In-Place Learning Networks for Modeling Functional Layers in the Laminar Cortex.

Brain-inspired Global-Local Learning Incorporated with Neuromorphic Computing

A Smooth Optimisation Perspective on Designing and Training Feedforward Multilayer Perceptrons

Multi-view Local Learning

Brain-inspired Multilayer Perceptron with Spiking Neurons

Multilayer In-Place Learning Networks with Adaptive Lateral Connections: Models and Simulations

In-situ learning in multilayer locally-connected memristive spiking neural network

Block-local learning with probabilistic latent representations

Multilayer In-Place Learning Networks: Multitask Invariance And Adaptive Lateral Connections