Abstract:<p>Support vector machine (SVM) provides a good classification and regression ability, especially, for small sample learning. However, in practice, the learning ability of implemented SVM is occasionally far from the expected level. Group method of data handling neural network (GMDH-NN) has been applied in various fields for pattern recognition and data mining. It makes it possible to automatically find interrelations in data, to select an optimal structure of network or model and to improve the accuracy of existing algorithms. In this work we propose to take the advantages of GMDH-NN for further increasing the classification performance of SVM. One weakness of the symmetric regularity criterion of GMDH-NN is that if one of the input attributes has a relatively big range, then it may overcome the other attributes. Thus, we first define a standardized symmetric regularity criterion (SSRC) to evaluate and select the candidate models, and optimize a classifier ensemble selection approach. Secondly, we define a novel structure of initial model of GMDH-NN which is from the posterior probability outputs of SVMs. These probabilistic outputs are generated from the improved Platt's probabilistic outputs. Thirdly, in real classification tasks, different classifiers usually have different classification advantages. So we use probabilistic SVM as base learner and integrate the probabilistic SVMs with GMDH-NN, and then propose a special classifier ensemble selection approach for probabilistic SVM classifiers based on GMDH-NN called GMDH-PSVM. Moreover, we use the Borda sorting and Random weighted Borda sorting to discuss the results of our experiments. Experiments on standard UCI datasets demonstrate the effectiveness of our method.</p>

Support Vector Machine Selective Ensemble Learning on Feature Clustering and Genetic Algorithm

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Subspace Selective Ensemble Algorithm Based on Feature Clustering

An Ensemble of Classifiers with Genetic Algorithm Based Feature Selection

Support Vector Machine Ensemble Based on Genetic Algorithm

Novel Selective Support Vector Machine Ensemble Learning Algorithm

Genetic Algorithm Based Selective Ensemble with Multiset Representation

Clustering analysis application in SVM ensemble#

A Feature Selection Method Based on Feature Grouping and Genetic Algorithm

A Novel Genetic Algorithm for Subspace Based Subclasssifier Selection

Selective SVMs ensemble driven by immune clonal algorithm

Bagging-Based Selective Clusterer Ensemble

Heuristic Parallel Selective Ensemble Algorithm Based on Clustering and Improved Simulated Annealing

Feature selection for SVMs ensemble

A Novel SVM Ensemble Approach Using Clustering Analysis

Classifier Ensemble Selection Based on Affinity Propagation Clustering.

Probabilistic SVM classifier ensemble selection based on GMDH-type neural network

Improvement Classification Performance by the Support Vector Machine Ensemble

Unsupervised feature selection using clustering ensembles and population based incremental learning algorithm

Support vector machine based ensemble classifier