A New Convergence Property of Online BP Learning

Rui Zhang,Le Yang,Wei Wang

DOI: https://doi.org/10.1109/icist.2011.5765243

2011-01-01

Abstract:The feedforward neural networks trained with the online backpropagation (BP) learning algorithm have been widely studied in various areas of scientific research and engineering applications. In this paper we further study the convergence property of the online BP learning algorithm. Unlike the existing convergence analysis mainly focusing on the convergence of the gradient sequence of the error functions, we prove a convergence theorem for the sequence of the error functions itself.