Abstract:In this work, a bibliographic analysis on artificial neural networks (ANNs) using fractional calculus (FC) theory has been developed to summarize the main features and applications of the ANNs. ANN is a mathematical modeling tool used in several sciences and engineering fields. FC has been mainly applied on ANNs with three different objectives, such as systems stabilization, systems synchronization, and parameters training, using optimization algorithms. FC and some control strategies have been satisfactorily employed to attain the synchronization and stabilization of ANNs. To show this fact, in this manuscript are summarized, the architecture of the systems, the control strategies, and the fractional derivatives used in each research work, also, the achieved goals are presented. Regarding the parameters training using optimization algorithms issue, in this manuscript, the systems types, the fractional derivatives involved, and the optimization algorithm employed to train the ANN parameters are also presented. In most of the works found in the literature where ANNs and FC are involved, the authors focused on controlling the systems using synchronization and stabilization. Furthermore, recent applications of ANNs with FC in several fields such as medicine, cryptographic, image processing, robotic are reviewed in detail in this manuscript. Works with applications, such as chaos analysis, functions approximation, heat transfer process, periodicity, and dissipativity, also were included. Almost to the end of the paper, several future research topics arising on ANNs involved with FC are recommended to the researchers community. From the bibliographic review, we concluded that the Caputo derivative is the most utilized derivative for solving problems with ANNs because its initial values take the same form as the differential equations of integer-order.

Exploring the Effects of Caputo Fractional Derivative in Spiking Neural Network Training

Fractional-order gradient descent learning of BP neural networks with Caputo derivative.

Fractional-order spike-timing-dependent gradient descent for multi-layer spiking neural networks

Applications of fractional calculus in learned optimization

A Caputo-Type Fractional-Order Gradient Descent Learning of BP Neural Networks.

Convergence Analysis of Caputo-Type Fractional Order Complex-Valued Neural Networks

A smoothing interval neural networks-based Caputo fractional-order gradient learning algorithm

Study on fast speed fractional order gradient descent method and its application in neural networks

Convolutional Neural Networks with Fractional Order Gradient Method.

Dynamic Analysis of Fractional-Order Recurrent Neural Network with Caputo Derivative

Artificial neural networks: a practical review of applications involving fractional calculus

Fractional-Order Deep Backpropagation Neural Network

Differentiable Spike: Rethinking Gradient-Descent for Training Spiking Neural Networks.

Optimising the Order of the Fractional Derivative

On uniform stability and numerical simulations of complex valued neural networks involving generalized Caputo fractional order

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

An Integer-Fractional Gradient Algorithm for Back Propagation Neural Networks

Accelerating gradient descent and Adam via fractional gradients

Accelerating Fractional PINNs using Operational Matrices of Derivative

Fractional derivative of Hermite fractal splines on the fractional-order delayed neural networks synchronization

The Fractional Neural Grey System Model and Its Application