Abstract:Stochastic Configuration Network (SCN) has a powerful capability for regression and classification analysis. Traditionally, it is quite challenging to correctly determine an appropriate architecture for a neural network so that the trained model can achieve excellent performance for both learning and generalization. Compared with the known randomized learning algorithms for single hidden layer feed-forward neural networks, such as Randomized Radial Basis Function (RBF) Networks and Random Vector Functional-link (RVFL), the SCN randomly assigns the input weights and biases of the hidden nodes in a supervisory mechanism. Since the parameters in the hidden layers are randomly generated in uniform distribution, hypothetically, there is optimal randomness. Heavy-tailed distribution has shown optimal randomness in an unknown environment for finding some targets. Therefore, in this research, the authors used heavy-tailed distributions to randomly initialize weights and biases to see if the new SCN models can achieve better performance than the original SCN. Heavy-tailed distributions, such as Lévy distribution, Cauchy distribution, and Weibull distribution, have been used. Since some mixed distributions show heavy-tailed properties, the mixed Gaussian and Laplace distributions were also studied in this research work. Experimental results showed improved performance for SCN with heavy-tailed distributions. For the regression model, SCN-Lévy, SCN-Mixture, SCN-Cauchy, and SCN-Weibull used less hidden nodes to achieve similar performance with SCN. For the classification model, SCN-Mixture, SCN-Lévy, and SCN-Cauchy have higher test accuracy of 91.5%, 91.7% and 92.4%, respectively. Both are higher than the test accuracy of the original SCN.

Deep Stochastic Configuration Networks with Different Random Sampling Strategies

Deep Stochastic Configuration Networks with Optimised Model and Hyper-Parameters

Lightweight Stochastic Configuration Networks

Stochastic Configuration Networks: Fundamentals and Algorithms

Deep Stochastic Configuration Networks with Universal Approximation Property

Deeper Insights into Learning Performance of Stochastic Configuration Networks

Enhancing Deep Stochastic Configuration Networks: Efficient Training via Low-Rank Matrix Approximation

Distributed Stochastic Configuration Networks with Cooperative Learning Paradigm

Orthogonal Stochastic Configuration Networks with Adaptive Construction Parameter for Data Analytics

Optimal Randomness for Stochastic Configuration Network (SCN) with Heavy-Tailed Distributions

2-D Stochastic Configuration Networks for Image Data Analytics

Two Dimensional Stochastic Configuration Networks for Image Data Analytics

Broad Stochastic Configuration Network for Regression

Stochastic Configuration Networks for Imbalanced Data Classification

An AdaBoost Based - Deep Stochastic Configuration Network.

A Stochastic Configuration Network with Attenuation Regularization and Multi-kernel Learning and Its Application

Distributed Sparse Learning for Stochastic Configuration Networks Via Alternating Direction Method of Multipliers

Driving Amount Based Stochastic Configuration Network for Industrial Process Modeling.

Adaptive inertia weights: an effective way to improve parameter estimation of hidden layer in stochastic configuration networks

Stochastic Configuration Networks with Improved Supervisory Mechanism

Dense Deep Stochastic Configuration Network with Hybrid Training Mechanism.