Abstract:Based on researching into the classification mechanisms of feedforward single-layer radial basis function CRBF) and linear basis function (LBF) networks, the author presents the viewpoints that the RBF centers and widths should be determined through a self-learning procedure, that some new kernels naturally come into being according to which class the labeled patterns are misclassified to. Author holds that two or more kernels should be automatically merged or overlapped in part if they belong to the same original category and are neighboring each other and not divided by other classes. The reason is clarified why the classification threshold of feedforward single-layer perceptron networks with Sigmoid activation functions should be 0.5. And furthermore, a kind of cascade RBF-LBF networks consisting of a single-layer RBF network and perceptron are proposed. The learning algorithm for optimally determining the number, locations and widths of kernels in cascade RBF-LBF networks is gone into details. Generally speaking, the presented algorithm has much lower computational complexity than its backpropagation correspondent used in feedforward single-hidden-layer perceptron networks. The results for some classically tricky classification problems show that the proposed cascade RBF-LBF networks as well as their adaptively learning algorithm, have advantages over standard RBF networks and feedforward single-hidden-layer perceptrons. For examples, the cascade networks have fast convergence rate, high classification accuracy, large probability to get optimal structures, good capacity to reach global minimum points, etc. Therefore, the cascade networks are quite favorable for real-time analyses. The experiments still verify that single-layer perceptrons are very important for improving the classification correct rate of cascade RBF-LBF networks.

An Online Self-Adaption Learning Algorithm for Hyper Basis Function Neural Network

Estimation of catalyst activity using improved RBFN

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

A Nonlinear Adaptive Controller Based on RBF Networks

Hyperbolic Binary Neural Network

Hyperparameters Adaptation for Restricted Boltzmann Machines Based on Free Energy

Self-adaptiye RBF neural network and its application

Training Radial Basis Function Classifiers with Gaussian Kernel Clustering and Fuzzy Decision Technique

HCFNN: High-order Coverage Function Neural Network for Image Classification

A Novel Radial Basis Function Neural Network For Approximation

Incremental learning-based optimal design of BFN kernel for online spacecraft disturbance rejection control

An Adaptive Learning Algorithm Aimed at Improving RBF Network Generalization Ability

Anefficient Learning Algorithm For Binary Feedforward Neural Networks

An Integrated Hybrid Algorithm Based On Nature Inspired Evolutionary For Radial Basis Function Neural Network Learning

Adaptive Structure and Parameter Optimizations of Cascade RBF-LBF Neural Networks

Efficient Training of RBF Networks Via the BYY Automated Model Selection Learning Algorithms

A two-level learning hierarchy for the radial basis function networks

A Novel Two Stage Algorithm for Construction of RBF Neural Models Based on A-optimality Criterion

A Combined Offline–Online Algorithm for Hodgkin–Huxley Neural Networks

The Growing Radial Basis Function (RBF) Neural Network and Its Applications.

Sensitivity based Growing and Pruning method for RBF network in online learning environments.