Abstract:Studies have demonstrated that stochastic configuration networks (SCNs) have good potential for rapid data modeling because of their sufficient adequate learning power, which is theoretically guaranteed. Empirical studies have verified that the learner models produced by SCNs can usually achieve favorable test performance in practice but more in-depth theoretical analysis of their generalization power would be useful for constructing SCN-based ensemble models with enhanced generalization capacities. In particular, given a collection of independently developed SCN-based learner models, it is useful to select certain base learners that can potentially obtain preferable test results rather than considering all of the base models together, before simply taking their average in order to build an effective ensemble model. In this study, we propose a novel framework for building SCN ensembles by exploring key factors that might potentially affect the generalization performance of the base model. Under a mild assumption, we provide a comprehensive theoretical framework for examining a learner model's generalization error, as well as formulating a novel indicator that contains measurement information for the training errors, output weights, and a hidden layer output matrix, which can be used by our proposed algorithm to find a subset of appropriate base models from a pool of randomized learner models. A toy example of one-dimensional function approximation, a case study for developing a predictive model for forecasting student learning performance, and two large-scale data sets were used in our experiments. The experimental results indicate that our proposed method has some remarkable advantages for building ensemble models.

Ensemble Stochastic Configuration Networks for Estimating Prediction Intervals: A Simultaneous Robust Training Algorithm and Its Application

Mixed-Distribution-Based Robust Stochastic Configuration Networks for Prediction Interval Construction

Industrial Prediction Intervals With Data Uncertainty

Robust Stochastic Configuration Networks for Industrial Data Modelling with Student’s-t Mixture Distribution

Prediction Intervals for a Noisy Nonlinear Time Series Based on a Bootstrapping Reservoir Computing Network Ensemble.

Hierarchical-Bayesian-Based Sparse Stochastic Configuration Networks for Construction of Prediction Intervals

Hybrid Parallel Stochastic Configuration Networks for Industrial Data Analytics

Robust Stochastic Configuration Networks with Kernel Density Estimation for Uncertain Data Regression

Optimal Nonparametric Prediction Intervals of Electricity Load

Parallel stochastic configuration networks for large-scale data regression

Robust Multi-Target Regression with Improved Stochastic Configuration Networks and Its Applications

Data Driven Particle Size Estimation of Hematite Grinding Process Using Stochastic Configuration Network with Robust Technique

Probabilistic Wind Power Prediction Using Incremental Bayesian Stochastic Configuration Network under Concept Drift Environment

Stochastic configuration networks with block increments for data modeling in process industries

1 So ware E ort Interval Prediction via Bayesian Inference and Synthetic Bootstrap Resampling

Prediction intervals for industrial data with incomplete input using kernel-based dynamic Bayesian networks

An Ensemble of Single Multiplicative Neuron Models for Probabilistic Prediction

Stochastic Configuration Network Ensembles with Selective Base Models.

A Construction Approach to Prediction Intervals Based on Bootstrap and Deep Belief Network.

Robust Stochastic Configuration Networks with Maximum Correntropy Criterion for Uncertain Data Regression.

An Empirical Study on Prediction of Seismic Activity Using Stochastic Configuration Networks