Abstract:Studies have demonstrated that stochastic configuration networks (SCNs) have good potential for rapid data modeling because of their sufficient adequate learning power, which is theoretically guaranteed. Empirical studies have verified that the learner models produced by SCNs can usually achieve favorable test performance in practice but more in-depth theoretical analysis of their generalization power would be useful for constructing SCN-based ensemble models with enhanced generalization capacities. In particular, given a collection of independently developed SCN-based learner models, it is useful to select certain base learners that can potentially obtain preferable test results rather than considering all of the base models together, before simply taking their average in order to build an effective ensemble model. In this study, we propose a novel framework for building SCN ensembles by exploring key factors that might potentially affect the generalization performance of the base model. Under a mild assumption, we provide a comprehensive theoretical framework for examining a learner model's generalization error, as well as formulating a novel indicator that contains measurement information for the training errors, output weights, and a hidden layer output matrix, which can be used by our proposed algorithm to find a subset of appropriate base models from a pool of randomized learner models. A toy example of one-dimensional function approximation, a case study for developing a predictive model for forecasting student learning performance, and two large-scale data sets were used in our experiments. The experimental results indicate that our proposed method has some remarkable advantages for building ensemble models.

Compact Ensemble Model of Neural Networks

Optimizing Weights by Genetic Algorithm for Neural Network Ensemble

A Hybrid Algorithm for Compact Neural Network Ensemble

Ensembling Neural Networks: Many Could Be Better Than All

A Constructive Algorithm for Training Neural Network Ensemble

Dynamic Neural Network Ensemble Construction For Classification

Neural Subnetwork Ensembles

Hybrid Ensemble Construction with Selected Neural Networks.

The Diversified Ensemble Neural Network.

A New Algorithm for Training Cooperative Neural Network Ensembles

Ensemble Neural Networks (ENN): A gradient-free stochastic method

A Constructive Algorithm for Training Cooperative Neural Network Ensembles

Stochastic Configuration Network Ensembles with Selective Base Models.

Collegial Ensembles

Ensemble Algorithm Of Neural Networks And Its Application

A Minimal Neural Network Ensemble Construction Method: A Constructive Approach

Training of neural network ensemble through progressive interaction

Neural Network Ensembles: Theory, Training, and the Importance of Explicit Diversity

COMBINING REGRESSION ESTIMATORS: GA-BASED SELECTIVE NEURAL NETWORK ENSEMBLE

Hybrid neural network ensemble construction combining boosting and negative correlation learning

Coevolutionary Learning of Neural Network Ensemble for Complex Classification Tasks