Abstract:According to the thought “divide and conquer” that human perceives complicated things from multi-side and multi-view and balances the final decision, this paper puts forward the multi-sided multi-granular neural network ensemble optimization method based on feature selection, which divides attribute granularity of dataset from multi-side, and structures multi-granular individual neural networks using different attribute granularity and the corresponding subsets. In this way, we can gain multi-granular individual neural networks with greater diversity, and get better performance of neural network ensemble(NNE). Firstly, use feature selection method to calculate the importance of each attribute, according to the average weight to choose some attributes whose average weight is greater than a certain threshold, to form an attribute granularity and the corresponding sample subset, thus to construct an individual neural network. If samples are not properly identified, this attribute granularity is weak for the generalization ability of the sample. Secondly, again calculate the importance of the attributes of samples not properly identified, choose the attributes that can generalize the corresponding samples better, and add to the last attribute granularity to form a new attribute granularity, and at the same time random choose two-thirds of sample subset to construct an individual neural network. In turn, one can get a series of attribute granularities and the corresponding sample subsets and a series of multi-granular individual neural networks. These attribute granularities and the corresponding sample subsets constructed from multi-side and multi-view with greater diversity can construct multi-granular individual neural networks with greater diversity. This method not only reduces the dimension of the dataset, but also makes the attribute granularity to identify the corresponding sample as large as possible. Finally, by calculating the diversity of each of the two individual neural networks, optimal selects some individual neural networks with greater diversity to ensemble. The simulation experiments show that our proposed method here, multi-side multi-granular neural network ensemble optimization method, can gain better performance.

Selective Neural Network Ensemble Approach Based on Cultural Algorithm

A Novel Selection Operator of Cultural Algorithm

Genetic Algorithm based Selective Neural Network Ensemble.

A Neural Network Selection Approach of Constructing Ensemble Based on CS Algorithm

A Cultural Algorithm based on multilayer belief spaces and its application in neural network fault classifier

Neural Network Based on Cultural Algorithms and Its Application on Modeling

Ensemble of GA Based Selective Neural Network Ensembles

A Selective GMDH Network Ensemble Algorithm

Diversity Creation in Local Search for the Evolution of Neural Network Ensembles.

A Constructive Algorithm for Training Neural Network Ensemble

The Diversified Ensemble Neural Network.

Neural Network Ensembles: Theory, Training, and the Importance of Explicit Diversity

A Constructive Algorithm for Training Cooperative Neural Network Ensembles

Clustering Algorithm Based Selective Ensemble

Research of Multi-Sided Multi-Granular Neural Network Ensemble Optimization Method

Nature-Inspired Neural Network Ensemble Learning

Ensemble Algorithm Of Neural Networks And Its Application

Cultural Genetic Algorithm For Constrained Optimization Problem

A Study on a Probabilistic Method for Designing Artificial Neural Networks for the Formation of Intelligent Technology Assemblies with High Variability

New Cultural Algorithm with Differential Evolution

COMBINING REGRESSION ESTIMATORS: GA-BASED SELECTIVE NEURAL NETWORK ENSEMBLE