Abstract:We study the influence of a variable neuronal threshold on fixed points and convergence rates of an associative neural network in the presence of noise. We allow a random distribution in the activity levels of the patterns stored, and a modification to the standard Hebbian learning rule is proposed for this purpose. There is a threshold at which the retrieval ability, including the average final overlap and the convergence rate, is optimized for patterns with a particular activity level at a given noise level. This type of selective attention to one class of patterns with a certain activity level may be obtained at the cost of reducing the retrieval ability of the network for patterns with different activity levels. The effects of a constant threshold independent of noise, time, and pattern are discussed. For high-(low-) activity patterns, the average final overlap is shown to be increased at high noise levels and decreased at low noise levels by a negative (positive) constant threshold, whereas a positive (negative) threshold always reduces the final average overlap. When the magnitude of the constant threshold exceeds a critical value, there is no retrieval. Rates of convergence towards the stored pattern with negative (positive) thresholds are greater than those with positive (negative) thresholds. These results are related to (de)sensitization and anesthesia. For certain threshold values and patterns with certain activity levels, hysteresis appears in the plot of the average final overlap versus the noise level, even for first order interactions. We make the analogy between the pattern-dependent neuronal threshold proposed in the present paper and the “task-related” modulation in neuronal excitability determined by cognitive factors, such as the attentional state of a higher animal. A constant threshold is associated with overall changes in neuronal excitability caused, e.g., by various drugs and physical injuries. Neurophysiological evidence of a dynamically variable neuronal threshold, such as accommodation and potentiation, is presented.

Synchronous Neural Networks of Nonlinear Threshold Elements with Hysteresis.

STOCHASTIC RESONANCE IN A DOUBLE LAYER HODGKIN-HUXLEY NEURONAL NETWORK

Effect of noises on two-layer hodgkin-huxley neuronal network

The neural dynamics for hysteresis in visual perception

Stochastic Resonance Enhancing Detectability Of Weak Signal By Neuronal Networks Model For Receiver

Dynamics Analysis and Analog Associative Memory of Networks with LT Neurons.

Variable Threshold As a Model for Selective Attention, (de)sensitization, and Anesthesia in Associative Neural Networks

Synchronous clusters in a noisy inhibitory neural network

Suppressing Chaos with Hysteresis in a Higher Order Neural Network

Stochastic resonance in Hodgkin-Huxley neuron induced by unreliable synaptic transmission.

Latching dynamics in neural networks with synaptic depression

A neural computation model with short-term memory

Neural oscillators for magnetic hysteresis modeling

Modeling and Contractivity of Neural-Synaptic Networks with Hebbian Learning

Dynamic Analysis of a Class of Generalized Hopfield Neural Networks with Hysteresis

Memristor synapse-coupled piecewise-linear simplified Hopfield neural network: Dynamics analysis and circuit implementation

Nonlinear Dynamics of Three-Neurons-Based Hopfield Neural Networks (HNNs): Remerging Feigenbaum Trees, Coexisting Bifurcations and Multiple Attractors

The Nonresonant Double Hopf Bifurcation and the Generalized Synchronization in the Delayed Neural Network

Multistability of Delayed Hybrid Impulsive Neural Networks with Application to Associative Memories.

Memristor Synapse-Driven Simplified Hopfield Neural Network: Hidden Dynamics, Attractor Control, and Circuit Implementation

Bistability and Tunable Gating in a Recurrent Neuronal Network with Synaptic Failure and Hidden Neurons