Abstract:Several authors have recently highlighted the need for a new dynamical paradigm in the modelling of brain working and evolution. In particular, the models should include the possibility of non constant and non symmetric synaptic weights $T_{ij}$ in the neuron-neuron interaction matrix, radically overcoming the classical Hopfield setting. Krotov and Hopfield have proposed a non constant, still symmetric model, leading to a vector field describing a gradient type dynamics then including a Lyapunov-like energy function. In this note, we first will detail the general condition to produce a Hopfield like vector field of gradient type obtaining, as a particular case, the Krotov-Hopfield condition. Secondly, we abandon the symmetry because of two relevant physiological facts: (1) the actual neural connections have a marked directional character and (2) the gradient structure deriving from the symmetry forces the dynamics always towards stationary points, prescribing every pattern to be recognized. We propose a novel model including a set of limited but varying controls $|\xi_{ij}|\leq K$ used for correcting a starting constant interaction matrix, $T_{ij}=A_{ij}+\xi_{ij}$. Besides, we introduce a reasonable controlled variational functional to be optimized. This allows us to reproduce the following three possible outcomes when submitting a pattern to the learning system. If (1) the dynamics leads to an already existing stationary point without activating the controls, the system has \emph{recognized} an existing pattern. If (2) a new stationary point is reached by the activation of controls, then the system has \emph{learned} a new pattern. If (3) the dynamics is \emph{wandering} without reaching neither existing or new stationary points, then the system is unable to recognize or learn the pattern submitted. A further feature (4), appears to model \emph{forgetting and restoring} memory.

A Waddington landscape for prototype learning in generalized Hopfield networks

Prototype Analysis in Hopfield Networks with Hebbian Learning

Heteroclinic cycles in Hopfield networks

Simplicial Hopfield networks

Dense Hopfield Networks in the Teacher-Student Setting

Hierarchical Control of State Transitions in Dense Associative Memories

Memorizing morph patterns in small-world neuronal network

Storage and Learning phase transitions in the Random-Features Hopfield Model

Input-Driven Dynamics for Robust Memory Retrieval in Hopfield Networks

Dreaming neural networks: Forgetting spurious memories and reinforcing pure ones

Storing overlapping associative memories on latent manifolds in low-rank spiking networks

Large Associative Memory Problem in Neurobiology and Machine Learning

An Internal Mechanism for Detecting Parasite Attractors in a Hopfield Network

Geometry and dynamics of representations in a precisely balanced memory network related to olfactory cortex

Learning associative memories by error backpropagation.

Eigenvector Dreaming

Brain memory working. Optimal control behavior for improved Hopfield-like models

"What" x "When" working memory representations using Laplace Neural Manifolds

Not just a colourful metaphor: modelling the landscape of cellular development using Hopfield networks

A new mechanical approach to handle generalized Hopfield neural networks

Hopfield model with planted patterns: a teacher-student self-supervised learning model