Abstract:Gradient-based algorithms are commonly used for training radial basis function neural network (RBFNN). However, it is still difficult to avoid vanishing gradient to improve the learning performance in the training process. For this reason, in this paper, an accelerated second-order learning (ASOL) algorithm is developed to train RBFNN. First, an adaptive expansion and pruning mechanism (AEPM) of gradient space, based on the integrity and orthogonality of hidden neurons, is designed. Then, the effective gradient information is constantly added to gradient space and the redundant gradient information is eliminated from gradient space. Second, with AEPM, the neurons are generated or pruned accordingly. In this way, a self-organizing RBFNN (SORBFNN) which reduces the structure complexity and improves the generalization ability is obtained. Then, the structure and parameters in the learning process can be optimized by the proposed ASOL-based SORBFNN (ASOL-SORBFNN). Third, some theoretical analyses including the efficiency of the proposed AEPM on avoiding the vanishing gradient and the stability of SORBFNN in the process of structural adjustment are given, then the successful application of the proposed ASOL-SORBFNN is guaranteed. Finally, to illustrate the advantages of the proposed ASOL-SORBFNN, several experimental studies are examined. By comparing with other existing approaches, the results show that ASOLSORBFNN performs well in terms of both learning speed and prediction accuracy. (c) 2021 Elsevier B.V. All rights reserved.

Self-organization of a Recurrent RBF Neural Network Using an Information-Oriented Algorithm.

Self-organization of a recurrent RBF neural network using an information-oriented algorithm

Nonlinear System Modeling Using a Self-Organizing Recurrent Radial Basis Function Neural Network

A Rbf Network Modeling Approach Combining Ga and Orthogonal Optimum Seeking Method

Structure design for recurrent RBF neural network based on recursive orthogonal least squares

Design of a Self-Organizing Recurrent RBF Neural Network Based on Spiking Mechanism

A Self-Organizing RBF Neural Network Based on Distance Concentration Immune Algorithm.

An Online Modeling Approach Based Upon Improved Self-Organizing Radial Basis Function Neural Network

A Growing Algorithm for RBF Neural Network

Identification and modeling of nonlinear dynamical systems using a novel self-organizing RBF-based approach

A Spiking-based mechanism for self-organizing RBF neural networks

Research on an Online Self-Organizing Radial Basis Function Neural Network

An Adaptive Growing and Pruning Algorithm for Designing Recurrent Neural Network.

Self-organizing Radial Basis Function Neural Network Using Accelerated Second-Order Learning Algorithm

Design of self-organizing RBF neural network based on relative contribution index

A new on-line modeling approach to nonlinear dynamic systems

An Integrated Hybrid Algorithm Based On Nature Inspired Evolutionary For Radial Basis Function Neural Network Learning

Self-Organizing RBF Neural Network Using an Adaptive Gradient Multiobjective Particle Swarm Optimization

On the Optimal Design of Radial Basis Function Neural Networks for the Analysis of Nonlinear Stochastic Systems

A Novel RBF Neural Network Design Based on Immune Algorithm System

An efficient self-organizing RBF neural network for water quality prediction.