Fractional-Order Deep Backpropagation Neural Network

Chunhui Bao,Yifei Pu,Yi Zhang
DOI: https://doi.org/10.1155/2018/7361628
IF: 3.12
2018-01-01
Computational Intelligence and Neuroscience
Abstract:In recent years, the research of artificial neural networks based on fractional calculus has attracted much attention. In this paper, we proposed a fractional-order deep backpropagation (BP) neural network model with L2 regularization. The proposed network was optimized by the fractional gradient descent method with Caputo derivative. We also illustrated the necessary conditions for the convergence of the proposed network. The influence of L2 regularization on the convergence was analyzed with the fractional-order variational method. The experiments have been performed on the MNIST dataset to demonstrate that the proposed network was deterministically convergent and can effectively avoid overfitting.
What problem does this paper attempt to address?