Multistability and Associative Memory of Neural Networks with Morita-like Activation Functions.

Yuanchu Shen,Song Zhu,Xiaoyang Liu,Shiping Wen
DOI: https://doi.org/10.1016/j.neunet.2021.04.035
IF: 7.8
2021-01-01
Neural Networks
Abstract:This paper presents the multistability analysis and associative memory of neural networks (NNs) with Morita-like activation functions. In order to seek larger memory capacity, this paper proposes Morita-like activation functions. In a weakened condition, this paper shows that the NNs with n-neurons have ( 2 m + 1 ) n equilibrium points (Eps) and ( m + 1 ) n of them are locally exponentially stable, where the parameter m depends on the Morita-like activation functions, called Morita parameter. Also the attraction basins are estimated based on the state space partition. Moreover, this paper applies these NNs into associative memories (AMs). Compared with the previous related works, the number of Eps and AM’s memory capacity are extensively increased. The simulation results are illustrated and some reliable associative memories examples are shown at the end of this paper.
What problem does this paper attempt to address?