Abstract:Feature selection plays an important role in pattern classification. Its purpose is to remove redundant features from data set as many as possible. The presence of useless features may not only deteriorate the performance of learning algorithms, but also obscure important information (e.g., intrinsic structure) behind data. Along with new and emerging techniques, data sets in many domains are becoming larger and larger and many irrelevant features are often prevailing in these data sets. This, however, poses great challenges to traditional learning algorithms, such as low efficiency and over-fitting. Thus, it becomes apparent that an efficient technique is needed to eliminate redundant or irrelevant features from the data sets. Currently, many endeavors to cope with this problem have been attempted and various outstanding feature selection methods have been proposed. Unlike other selection methods, in this paper we propose a general scheme of boosting feature selection method using information metric. The primary characteristic of our method is that it exploits weight of data to select salient features. Furthermore, the weight of data will be dynamically changed after each candidate feature has been selected. Thus, the information criteria used in feature selector can exactly represent the relevant degree between features and the class labels. As a result, the selected feature subset has maximal relevance to the class labels. Simulation studies carried out on UCI data sets show that the classification performance achieved by our proposed method is better than those of other selection methods in most cases.

Feature combination using boosting

Multiple Classifiers Combination Based on Specialists' FIelds

Evaluating Feature Combination in Object Classification.

Combination of Multiple Classifier Using Feature Space Partitioning

Feature Combination Via Clustering

Two-Stage Multi-Class Adaboost for Facial Expression Recognition

Higher-level Feature Combination Via Multiple Kernel Learning for Image Classification

Discriminative feature combination selection for enhancing multiclass classification

Combining Classifiers and Learning Mixture-of-Experts

Evaluating Classifier Combination in Object Classification

A Method to Boost Support Vector Machines

Sentiment Classification Through Combining Classifiers with Multiple Feature Sets

A New Multi-classifier Combination Scheme and Its Application in Handwriting Chinese Character Recognition

A method of combining multiple probabilistic classifiers through soft competition on different feature sets

Boosting feature selection using information metric for classification

Improving Classification Performance By Combining Multiple Tan Classifiers

Bhattacharyya boosting

Support Vector Machine for Multiple Feature Classifcation

A New Multiple Classifiers Combination Algorithm

Combining Multiple Classifiers Based on Statistical Method for Handwritten Chinese Character Recognition

A Method to Boost Naïve Bayesian Classifiers