Abstract:In the hippocampal dentate gyrus (DG), pattern separation mainly depends on the concepts of 'expansion recoding', meaning random mixing of different DG input channels. However, recent advances in neurophysiology have challenged the theory of pattern separation based on these concepts. In this study, we propose a novel feed-forward neural network, inspired by the structure of the DG and neural oscillatory analysis, to increase the Hopfield-network storage capacity. Unlike the previously published feed-forward neural networks, our bio-inspired neural network is designed to take advantage of both biological structure and functions of the DG. To better understand the computational principles of pattern separation in the DG, we have established a mouse model of environmental enrichment. We obtained a possible computational model of the DG, associated with better pattern separation ability, by using neural oscillatory analysis. Furthermore, we have developed a new algorithm based on Hebbian learning and coupling direction of neural oscillation to train the proposed neural network. The simulation results show that our proposed network significantly expands the storage capacity of Hopfield network, and more effective pattern separation is achieved. The storage capacity rises from 0.13 for the standard Hopfield network to 0.32 using our model when the overlap in patterns is 10%.

Storage capacity of the Hopfield neural network

Storage Capacity of the Hopfield Network Associative Memory

The capacity of the Hopfield associative memory

On the Critical Capacity of the Hopfield Model

Some Exact Results of Hopfield Neural Networks and Applications

Dynamic Capacity Estimation in Hopfield Networks

Statistical Mechanics of a Hopfield Neural-Network Model in a Transverse Field

High storage capacity in the Hopfield model with auto-interactions - stability analysis

Effects of Delays on the Basin Boundary of Attraction in A Hopfield Network of Two Delay-Connecting Neurons

Statistical Mechanics of a Multiconnected Hopfield Neural-Network Model in a Transverse Field

On Computational Limits of Modern Hopfield Models: A Fine-Grained Complexity Analysis

Universal Approximation Theorem and error bounds for quantum neural networks and quantum reservoirs

Comment on ``Capacity of the Hopfield model''

Function approximation ability of fuzzy neural networks

A generalized Hopfield model to store and retrieve mismatched memory patterns

Estimation of domain of attraction and exponential convergence rate of Hopfield's continuous-time associative memory and its applications

Effect of spatial correlations on Hopfield Neural Network and Dense Associative Memories

Almost Sure Exponential Stability of Uncertain Stochastic Hopfield Neural Networks Based on Subadditive Measures

The three-dimensional rotation neural network

Capacity of the Hebbian-Hopfield network associative memory

A Feed-Forward Neural Network for Increasing the Hopfield-Network Storage Capacity