Abstract:The additive recurrent network structure of linear threshold neurons represents a class of biologically-motivated models, where nonsaturating transfer functions are necessary for representing neuronal activities, such as that of cortical neurons. This paper extends the existing results of dynamics analysis of such linear threshold networks by establishing new and milder conditions for boundedness and asymptotical stability, while allowing for multistability. As a condition for asymptotical stability, it is found that boundedness does not require a deterministic matrix to be symmetric or possess positive off-diagonal entries. The conditions put forward an explicit way to design and analyze such networks. Based on the established theory, an alternate approach to study such networks is through permitted and forbidden sets. An application of the linear threshold (LT) network is analog associative memory, for which a simple design method describing the associative memory is suggested in this paper. The proposed design method is similar to a generalized Hebbian approach, but with distinctions of additional network parameters for normalization, excitation and inhibition, both on a global and local scale. The computational abilities of the network are dependent on its nonlinear dynamics, which in turn is reliant upon the sparsity of the memory vectors.

Qualitative Analysis for Recurrent Neural Networks with Linear Threshold Transfer Functions

Analysis of Cyclic Dynamics for Networks of Linear Threshold Neurons.

Multiperiodicity of Periodically Oscillated Discrete-Time Neural Networks with Transient Excitatory Self-Connections and Sigmoidal Nonlinearities

Switching analysis of 2-D neural networks with nonsaturating linear threshold transfer functions

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Multistability Analysis for Recurrent Neural Networks with Unsaturating Piecewise Linear Transfer Functions

Analysis of Continuous Attractors for 2-D Linear Threshold Neural Networks

Nontrivial Global Attractors in 2-D Multistable Attractor Neural Networks

Qualitative analysis for neural networks with LT transfer functions

Multistability of discrete-time recurrent neural networks with unsaturating piecewise linear activation functions.

Multistability of Recurrent Neural Networks with Nonmonotonic Activation Functions and Mixed Time Delays

Qualitative Analysis of Discrete-time Recurrent Neural Networks

Analysis of Equilibria for a Class of Recurrent Neural Networks with Two Subnetworks

Multistability of Delayed Neural Networks with Monotonically Nondecreasing Linear Activation Function

Global Attractivity of Discrete-Time Recurrent Neural Networks with Lnsaturating Piecewise Linear Activation Functions

Some multistability properties of bidirectional associative memory recurrent neural networks with unsaturating piecewise linear transfer functions

Multistability and Instability Analysis of Recurrent Neural Networks with Time-Varying Delays

Quantitative Analysis of Exponential Stability of Nonlinear Continuous Neural Networks

Stability and Bifurcation Analysis in a Class of Two-Neuron Networks with Resonant Bilinear Terms

A Winner-Take-All Neural Networks of N Linear Threshold Neurons Without Self-Excitatory Connections

Stability Analysis of Continuous-Time and Discrete-Time Quaternion-Valued Neural Networks with Linear Threshold Neurons.