Abstract:Abstract Feature selection is usually a separate procedure which can not beneﬁt from result of the data exploration. In this paper,we propose a unsupervised feature selection method which could reuse a speciﬁc data exploration result. Furthermore, ouralgorithm follows the idea of clustering attributes and combines two state-of-the-art data analyzing methods, that’s maximalinformation coeﬃcient and aﬃnity propagation. Classiﬁcation problems with diﬀerent classiﬁers were tested to validation ourmethod and others. Data experiments result exhibits our unsupervised algorithm is comparable with classical feature selectionmethods and even outperforms some supervised learning algorithms. Data simulation with one credit dataset of our own froma bank of China shows the capability of our method for real world application. Keywords: feature selection, feature clustering, maximal information coeﬃcient, aﬃnity propagation 1. IntroductionData mining shows powerful capability for automatically identifying valuable and potential information fromdata,solotsofareahavebeenproﬁtfromit,suchasexpertsystem,decisionsupportandﬁnancialforecast[1]. Dueto the widespread use of the Internet and the emergence of bioinformatics, the dimensionality of dataset becomelarger and larger. Datasets with hundreds and thousands of attributes may cause the “curse of dimensionality”problem. Furthermore, some of traditional classiﬁcation and clustering algorithms can not work properly. Oneof the most feasible technique to cope with this problem is feature reduction. Feature reduction refers to theresearch of methods which have the reduced dimensions present the original data[2]. In general point of view,there are two categories of feature reduction, namely feature selection(or variable selection), feature extraction(orfeature transform). The former one tries to construct a new feature space by transforming the original featurespace into lower dimensional ones such as PCA and LLE which have been given broad appeal[3]. However, thetransformation result from feature extraction is quite diﬃcult to interpret and explain. This drawback limits theuse of this kind of means in some area. The latter type, by contrast, does not make any transformation, but ﬁltersout some meaningless attributes from original data. In other words, this category of processes chooses a subsetfrom the original feature space.

Optimal feature subset deduction based on possibilistic feature quality classification and feature complementarity

Assessing Data Quality Within Available Context

Feature Selection with Conditional Mutual Information Considering Feature Interaction

A Possibilistic Information Fusion-Based Unsupervised Feature Selection Method Using Information Quality Measures

A novel method of constrained feature selection by the measurement of pairwise constraints uncertainty

Key quality characteristics selection for imbalanced production data using a two-phase bi-objective feature selection method

Information Technology and Quantitative Management , ITQM 2013

A Constrained Feature Selection Approach Based on Feature Clustering and Hypothesis Margin Maximization

On the Effect of Suboptimal Estimation of Mutual Information in Feature Selection and Classification

Quality of Information-Based Source Assessment and Selection.

Conditional mutual information-based feature selection analyzing for synergy and redundancy

Feature Selection On Boolean Symbolic Objects

An improvement direction for filter selection techniques using information theory measures and quadratic optimization

Intuitionistic Fuzzy Quantifier and Its Application in Feature Selection

A Multi-objective Feature Selection Method Considering the Interaction Between Features

Methods for Detecting and Correcting Contextual Data Quality Problems.

Implications and Modelling of Data Quality on Confidence of Clinical Decision Support: A Conceptual Framework

Quality and Diversity Optimization: A Unifying Modular Framework

Input Feature Selection Method Based on Feature Set Equivalence and Mutual Information Gain Maximization

A metaheuristic multi-objective interaction-aware feature selection method

Automatically Assessing Quality of Online Health Articles