Superior Performance of Using Hyperbolic Sine Activation Functions in ZNN Illustrated Via Time-Varying Matrix Square Roots Finding.

Yunong Zhang,Long Jin,Zhende Ke
DOI: https://doi.org/10.2298/csis120121043z
2012-01-01
Computer Science and Information Systems
Abstract:A special class of recurrent neural network (RNN) termed Zhang neural network (ZNN) has recently been proposed for time-varying matrix square roots finding. Such a ZNN model can be constructed via monotonically-increasing odd activation functions to obtain the theoretical time-varying matrix square roots in an error-free manner. Different choices of activation functions lead to different performance of the ZNN model. In this paper, to pursue the superior convergence and robustness, a special type of activation functions (i.e., hyperbolic sine activation functions) is used in the ZNN model for online solution of time-varying matrix square roots. Theoretical analysis and simulation results further demonstrate the superior performance of the ZNN model using hyperbolic sine activation functions in the context of (very) large model-implementation errors, in comparison with that using linear activation functions.
What problem does this paper attempt to address?