Relative Entropy of BP Network

康健,李一兵,林云
DOI: https://doi.org/10.3969/j.issn.1008-1402.2009.06.013
2009-01-01
Abstract:There are inherent shortcomings in BP neural network: slow convergence and easy to fall into local minimum and difficult to determine the network structure.In this paper,entropy function is used as error function to improve the convergence speed and stability.Compared with the standard BP network on the learning rate in different comparative examples of the convergence rate,relative entropy BP network is superior to any of the above.
What problem does this paper attempt to address?