Abstract:Nearly all models in neural networks start from the assumption that the input-output characteristic is a sigmoidal function. On parameter space, we present a systematic and feasible method for analyzing the whole spectrum of attractors—all-saturated, all-but-one-saturated, all-but-twosaturated, and so on—of a neurodynamical system with a saturated sigmoidal function as its input-output characteristic. We present an argument that claims, under a mild condition, that only all-saturated or all but-one-saturated attractors are observable for the neurodynamics. For any given all-saturated configuration [Formula: see text] (all-but-one-saturated configuration [Formula: see text]) the article shows how to construct an exact parameter region R([Formula: see text])([Formula: see text]([Formula: see text])) such that if and only if the parameters fall within R([Formula: see text])([Formula: see text]([Formula: see text])), then [Formula: see text]([Formula: see text]) is an attractor (a fixed point) of the dynamics. The parameter region for an all-saturated fixed-point attractor is independent of the specific choice of a saturated sigmoidal function, whereas for an all-but-one-saturated fixed point, it is sensitive to the input-output characteristic. Based on a similar idea, the role of weight normalization realized by a saturated sigmoidal function in competitive learning is discussed. A necessary and sufficient condition is provided to distinguish two kinds of competitive learning: stable competitive learning with the weight vectors representing extremes of input space and being fixed-point attractors, and unstable competitive learning. We apply our results to Linsker's model and (using extreme value theory in statistics) the Hopfield model and obtain some novel results on these two models.

Continuous attractors and attraction basins of a population decoding model with a parameter as a switch

Continuous Attractors and Population Decoding Multiple-Peaked Activity

Parameter As A Switch Between Dynamical States of A Network in Population Decoding

Dynamics Analysis of a Population Decoding Model

Dynamics and computation of continuous attractors.

Analysis of Continuous Attractors for 2-D Linear Threshold Neural Networks

Fixed-Point Attractor Analysis for a Class of Neurodynamics

Computing with Continuous Attractors: Stability and Online Aspects

Effect of Constant External Input on Continuous Attractors Shifting

Continuous Attractors of Discrete-Time Recurrent Neural Networks

Viewing A Class of Neurodynamics on Parameter Space

Coexisting hollow chaotic attractors within a steep parameter interval

Stability switches and Hopf bifurcations of an isolated population model with delay-dependent parameters

The Tracking Speed of Continuous Attractors

Upper semi-continuity of numerical attractors for deterministic and random lattice reversible Selkov systems

Offset Parameter Cancellation Produces Countless Coexisting Attractors

Existence And Global Attractivity Of Positive Periodic Solution For An Impulsive Delay Population Model

Spatial Patterns of a Predator-Prey Model with Beddington-DeAngelis Functional Response

Non-equilibrium statistical mechanics of continuous attractors

Continuous Wong–Zakai Approximations of Random Attractors for Quasi-linear Equations with Nonlinear Noise

Stability and Bifurcation Analysis of a Population Mo del with Piecewise Constant Arguments?