Abstract:Developing an efficient embedded feature selection method for both binary and multiclass classification problems is a fundamental topic to be further studied. In this paper, the conventional radial basis function (RBF) network is modified for joint feature selection and classification. By utilizing the anisotropic Gaussian basis function, an individual weight parameter is assigned to each feature for feature weighting. The L1 1regularized loss function is designed by combining the softmax cross entropy loss with L1 1 regularization terms imposing on feature and output weights. A specialized active-set limited-memory projected Quasi-Newton (SAL-PQN) algorithm is proposed to minimize the L1 1-regularized loss function, which can optimize all the adjustable parameters and zero out the redundant feature and output weights simultaneously. Furthermore, a safe dynamic pruning strategy is integrated into the SAL-PQN algorithm for dynamic sparse training of the modified RBF network, which continuously excludes the dynamically zeroed-out feature weights from the training process. It is theoretically assured of yielding the same gradient updates as SAL-PQN, thus the relevant computation of the zeroed-out feature weights in the forward and backward propagations can be safely eliminated. The experimental results demonstrate the effectiveness and efficiency of the proposed methods for joint feature selection and classification, and illustrate the practical utility of the inherent feature weighting capability.

Fast Backward Elimination Algorithm for Radial Basis Function Networks Pruning

Pls Algorithm For Radial Basis Function Networks

Splicing System Based Genetic Algorithms for Developing Rbf Networks Models

A Novel Nonlinear Dynamic System Modeling Approach Using Radial Basis Function Neural Networks

Radial Basis Function Network for Elimination of Noise from Image

An improved conjugate gradient algorithm for radial basis function (RBF) networks modelling

Kernelized LARS–LASSO for Constructing Radial Basis Function Neural Networks

Radial Basis Function Networks Based on Adaptive Projective Learning Algorithm and Its Applications

Safe Dynamic Sparse Training of Modified RBF Networks for Joint Feature Selection and Classification

Orthogonal least squares learning algorithm for radial basis function networks

Training Radial Basis Function Classifiers with Gaussian Kernel Clustering and Fuzzy Decision Technique

Online identification using radial basis function neural network coupled with KPCA

Optimizing Radial Basis Function Neural Network Based on Rough Sets and Affinity Propagation Clustering Algorithm

An efficient multilayer RBF neural network and its application to regression problems

Gradient-Based Training and Pruning of Radial Basis Function Networks with an Application in Materials Physics

A Novel Radial Basis Function Neural Network For Approximation

A two-level learning hierarchy for the radial basis function networks

Pruning Networks with Cross-Layer Ranking K-Reciprocal Nearest Filters

Research of Neural Network Algorithm Based on FA and RBF

A Dual Structural Radial Basis Function Network For Recursive Function Estimation

A distributed cooperative learning algorithm based on Zero-Gradient-Sum strategy using Radial Basis Function Network