Research on Back-Propagation Learning Algorithm Based on Weight Adjustment Parameters

SU Xiao-hong,WANG Ya-dong,MA Pei-jun
DOI: https://doi.org/10.3321/j.issn:0367-6234.2005.10.002
2005-01-01
Abstract:When the initial weights and thresholds of back-propagation network are optimized by genetic algorithm,the learning process is more likely trapped into flat spot which results in slow or even suppressed learning process and weight adjustment due to the large scope of weight-initializing in genetic algorithm.To solve this problem and inspired by the research fruits of neuroscience and physiological anatomy,an improved learning algorithm based on weight adjustment parameters is proposed.It avoids premature saturation problem that the weight adjustment reaching zero by introducing an excitation unit into the neuron model to excitation the back-propagated error signal.Simulation results show that the new method can avoid the learning process being trapped into the flat spot efficiently and improve the capability of fine-tuning to the result optimized by the genetic algorithm.The new algorithm also outperforms the other traditional methods in terms of the convergence rate,stability,and the capability of searching optimum in large space.
What problem does this paper attempt to address?