Abstract:Studies have demonstrated that stochastic configuration networks (SCNs) have good potential for rapid data modeling because of their sufficient adequate learning power, which is theoretically guaranteed. Empirical studies have verified that the learner models produced by SCNs can usually achieve favorable test performance in practice but more in-depth theoretical analysis of their generalization power would be useful for constructing SCN-based ensemble models with enhanced generalization capacities. In particular, given a collection of independently developed SCN-based learner models, it is useful to select certain base learners that can potentially obtain preferable test results rather than considering all of the base models together, before simply taking their average in order to build an effective ensemble model. In this study, we propose a novel framework for building SCN ensembles by exploring key factors that might potentially affect the generalization performance of the base model. Under a mild assumption, we provide a comprehensive theoretical framework for examining a learner model's generalization error, as well as formulating a novel indicator that contains measurement information for the training errors, output weights, and a hidden layer output matrix, which can be used by our proposed algorithm to find a subset of appropriate base models from a pool of randomized learner models. A toy example of one-dimensional function approximation, a case study for developing a predictive model for forecasting student learning performance, and two large-scale data sets were used in our experiments. The experimental results indicate that our proposed method has some remarkable advantages for building ensemble models.

A Fast Selective Approach to Neural Network Ensemble

Genetic Algorithm based Selective Neural Network Ensemble.

Optimizing Weights by Genetic Algorithm for Neural Network Ensemble

A Neural Network Selection Approach of Constructing Ensemble Based on CS Algorithm

Ensemble of GA Based Selective Neural Network Ensembles

COMBINING REGRESSION ESTIMATORS: GA-BASED SELECTIVE NEURAL NETWORK ENSEMBLE

Ensembling Neural Networks: Many Could Be Better Than All

Clustering Algorithm Based Selective Ensemble

A DNN-Ensemble Method for Error Reduction and Training Data Selection in DNN Based Modeling

Selective Ensemble Of Decision Trees

Selective Approach for Neural Network Ensemble Based on Network Clustering Technology and Its Application

Selectively ensembling neural classifiers

A Survey of Selective Ensemble Learning Algorithms

Stochastic Configuration Network Ensembles with Selective Base Models.

SAE: Single Architecture Ensemble Neural Networks

Selective Ensemble under Regularization Framework

Selective Neural Network Ensemble Approach Based on Cultural Algorithm

Neural Subnetwork Ensembles

Selective Ensemble Learning with Parallel Optimization and Hierarchical Selection

Dynamic Post-Hoc Neural Ensemblers

Concurrent Optimization of Multiple Base Learners in Neural Network Ensembles: an Adaptive Niching Differential Evolution Approach