Handwritten Digit Recognition Using Multilayer Feedforward Neural Networks with Periodic and Monotonic Activation Functions

KW Wong,CS Leung,SJ Chang
DOI: https://doi.org/10.1109/icpr.2002.1047806
2002-01-01
Abstract:The problem of handwritten digit recognition is tackled by multi-layer feedforward neural networks with different types of neuronal activation functions. Three types of activation functions are adopted in the network, namely, the traditional sigmoid function, the sinusoidal function and a periodic function that can be considered as a combination of the first two functions. To speed up the learning, as well as to reduce the network size, the Extended Kalman Filter (EKF) algorithm conjunct with a pruning method is used to train the network. Simulation results show that periodic activation functions perform better than monotonic ones in solving multi-cluster classification problems such as handwritten digit recognition.
What problem does this paper attempt to address?