Abstract:<p>Support vector machine (SVM) provides a good classification and regression ability, especially, for small sample learning. However, in practice, the learning ability of implemented SVM is occasionally far from the expected level. Group method of data handling neural network (GMDH-NN) has been applied in various fields for pattern recognition and data mining. It makes it possible to automatically find interrelations in data, to select an optimal structure of network or model and to improve the accuracy of existing algorithms. In this work we propose to take the advantages of GMDH-NN for further increasing the classification performance of SVM. One weakness of the symmetric regularity criterion of GMDH-NN is that if one of the input attributes has a relatively big range, then it may overcome the other attributes. Thus, we first define a standardized symmetric regularity criterion (SSRC) to evaluate and select the candidate models, and optimize a classifier ensemble selection approach. Secondly, we define a novel structure of initial model of GMDH-NN which is from the posterior probability outputs of SVMs. These probabilistic outputs are generated from the improved Platt's probabilistic outputs. Thirdly, in real classification tasks, different classifiers usually have different classification advantages. So we use probabilistic SVM as base learner and integrate the probabilistic SVMs with GMDH-NN, and then propose a special classifier ensemble selection approach for probabilistic SVM classifiers based on GMDH-NN called GMDH-PSVM. Moreover, we use the Borda sorting and Random weighted Borda sorting to discuss the results of our experiments. Experiments on standard UCI datasets demonstrate the effectiveness of our method.</p>

Genetic Algorithm Based Selective Ensemble with Multiset Representation

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Optimizing Weights by Genetic Algorithm for Neural Network Ensemble

Genetic Ensemble of Extreme Learning Machine

Genetic Algorithm based Selective Neural Network Ensemble.

A Selective GMDH Network Ensemble Algorithm

Support Vector Machine Ensemble Based on Genetic Algorithm

A New Ensemble Feature Selection Approach Based on Genetic Algorithm.

A Novel Genetic Algorithm for Subspace Based Subclasssifier Selection

Novel Selective Support Vector Machine Ensemble Learning Algorithm

Selectively ensembling neural classifiers

Using ensemble method to improve the performance of genetic algorithm

Probabilistic SVM classifier ensemble selection based on GMDH-type neural network

Ensemble of GA Based Selective Neural Network Ensembles

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A Survey of Selective Ensemble Learning Algorithms

COMBINING REGRESSION ESTIMATORS: GA-BASED SELECTIVE NEURAL NETWORK ENSEMBLE

A Hybrid Ensemble Algorithm Combining AdaBoost and Genetic Algorithm for Cancer Classification with Gene Expression Data.

Classifiers selection in ensembles using genetic algorithms for bankruptcy prediction

Clustering Algorithm Based Selective Ensemble

Bagging-Based Selective Clusterer Ensemble