Abstract:Smoothing interval neural networks (SINNs) are widely recognized for their effectiveness in handling uncertain data across various domains. However, training SINNs using the integer-order gradient method usually leads to lower computational accuracy and instability during parameter updating, which adversely affects the convergence and accuracy of the model. Fractional-order derivatives, in contrast, offer superior non-local memory properties and broader data fitting capabilities, providing more accurate descriptions of complex system dynamics. Therefore, this paper introduces a fractional-order gradient descent (FGD) method that utilizes Caputo fractional-order derivatives to train SINNs. Theoretical validation of the FGD method is achieved by rigorously proving the monotonicity of the error function and the strong convergence theorem of the algorithm. Additionally, various simulations are conducted to assess the enhanced algorithm's performance on different approximation functions and classification datasets. The experimental results demonstrate that the FGD method significantly accelerates the convergence rate, enhances generalization ability, and improves the overall performance of SINNs.

A Novel Modified Fractional Order LMS Algorithm

An Innovative Fractional Order LMS Based on Variable Initial Value and Gradient Order

A Novel Fractional Order Normalized Lms Algorithm with Direction Optimization

A Universal Modified LMS Algorithm with Iteration Order Hybrid Switching.

The Novel Adaptive Fractional Order Gradient Decent Algorithms Design via Robust Control

Study on Fractional Order Gradient Methods

A Novel Fractional Order Speedest Gradient Descent Method and its application<sup>*</sup>

Numerical Analysis of a Fractional Nonlinear Oscillator with Coordinate-Dependent Mass

Study on a Convex Combination of Two Fractional Order Adaptive Filters

The Improved Stochastic Fractional Order Gradient Descent Algorithm

A novel fractional order gradient method for identifying a linear system

A novel perspective to gradient method: the fractional order approach

Generalization of the Gradient Method with Fractional Order Gradient Direction

Design of Generalized Fractional Order Gradient Descent Method

On line parameter estimation based on gradient algorithm for fractional order systems.

A smoothing interval neural networks-based Caputo fractional-order gradient learning algorithm

Convolutional Neural Networks with Fractional Order Gradient Method.

A hybrid fractional order LMS algorithm for power system harmonic estimation

An innovative fractional order LMS algorithm for power signal parameter estimation

A Gradient Tracking Protocol for Optimization Over Nabla Fractional Multi-Agent Systems

A Novel Gradient Descent Optimizer based on Fractional Order Scheduler and its Application in Deep Neural Networks