Abstract:Biological neural networks are able to store and retrieve patterns in the presence of different types of noise. Hopfield neural networks have been inspired by biological neural networks and provide a model for auto-associative memory patterns. An important parameter in these networks is the pattern bias, i.e. the mean activity level of the network, which is closely related to the degree of sparseness in the coding scheme. Here we studied the relation between robustness against different types of biologically-motivated noise and pattern bias. To do so, we developed performance and robustness measures, which are applicable to varying degrees of sparseness of the memory representations, using analytically-optimized thresholds and corruption tolerances adjusted by mutual information. We then applied these tools in numerical simulations and found that, for different types of noise, the pattern load, i.e. the number of patterns that the network has to store, determined which pattern bias is most robust. Across different types of noise, the higher the pattern load was, the more biased was the most robust performing pattern representation. Given the variation in the sparseness level in different brain regions, our findings suggest that memory pattern encoding schemes (i.e. degree of sparseness) in different brain regions might be adapted to the expected memory load in order to best mitigate the adverse effects of disruptions.

RETRIEVAL PROPERTIES OF HOPFIELD NEURAL NETWORK MODELS

STOCHASTIC RESONANCE IN A DOUBLE LAYER HODGKIN-HUXLEY NEURONAL NETWORK

Quantum Hopfield model with a random transverse field and a random neuronal threshold

Suppression of Retrieval States in Spin-Glass-Like Model of Neural Networks with Random Neuronal Threshold

Effect of noises on two-layer hodgkin-huxley neuronal network

Retrieval phase diagrams of non-monotonic Hopfield networks

Stochastic Resonance Enhancing Detectability Of Weak Signal By Neuronal Networks Model For Receiver

A generalized Hopfield model to store and retrieve mismatched memory patterns

Random Attractors of a Stochastic Hopfield Neural Network Model with Delays

Tricritical Points and Reentry in the Quantum Hopfield Neural-Network Model

Retrieval Phase Diagrams in the Asymmetric Sherrington-Kirkpatrick Model and in the Little-Hopfield Model.

THE STUDY ON RESEARCH OF CONVERGENCE ANDFEASIBILITY ANALYSIS OF THE DISCRETE HOPFIELD-TYPENEURAL NETWORK

Multistability in a class of stochastic delayed Hopfield neural networks

Storage and Learning phase transitions in the Random-Features Hopfield Model

Statistical Mechanics of a Hopfield Neural-Network Model in a Transverse Field

Storage Capacity of the Hopfield Network Associative Memory

Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories

A Feed-Forward Neural Network for Increasing the Hopfield-Network Storage Capacity

Input-Driven Dynamics for Robust Memory Retrieval in Hopfield Networks

PERIODIC SOLUTION AND GLOBAL EXPONENTIAL STABILITY OF HOPFIELD NEURAL NETWORKS WITH TIME-VARYING DELAYED

Robustness in Hopfield neural networks with biased memory patterns