An Improved Algorithm for Eleman Neural Network by Adding a Modified Error Function

Zhang Zhiqiang,Tang Zheng,Guofeng Tang,Catherine Vairappan,Xugang Wang,Runqun Xiong
DOI: https://doi.org/10.1007/978-3-540-72393-6_56
2007-01-01
Abstract:The Eleman Neural Network has been widely used in various fields ranging from temporal version of the Exclusive-OR function to the discovery of syntactic categories in natural language date. However, one of the problems often associated with this type of network is the local minima problem which usually occurs in the process of the learning. To solve this problem, we have proposed an error function which can harmonize the update weights connected to the hidden layer and those connected to the output layer by adding one term to the conventional error function. It can avoid the local minima problem caused by this disharmony. We applied this method to the Boolean Series Prediction Questions problems to demonstrate its validity. The result shows that the proposed method can avoid the local minima problem and largely accelerate the speed of the convergence and get good results for the prediction tasks.
What problem does this paper attempt to address?