Abstract:Feature selection, as a data preprocessing strategy, has been proven to be effective and efficient in preparing data (especially high-dimensional data) for various data mining and machine learning problems. The objectives of feature selection include: building simpler and more comprehensible models, improving data mining performance, and preparing clean, understandable data. The recent proliferation of big data has presented some substantial challenges and opportunities to feature selection. In this survey, we provide a comprehensive and structured overview of recent advances in feature selection research. Motivated by current challenges and opportunities in the era of big data, we revisit feature selection research from a data perspective and review representative feature selection algorithms for conventional data, structured data, heterogeneous data and streaming data. Methodologically, to emphasize the differences and similarities of most existing feature selection algorithms for conventional data, we categorize them into four main groups: similarity based, information theoretical based, sparse learning based and statistical based methods. To facilitate and promote the research in this community, we also present an open-source feature selection repository that consists of most of the popular feature selection algorithms (\url{http://featureselection.asu.edu/}). Also, we use it as an example to show how to evaluate feature selection algorithms. At the end of the survey, we present a discussion about some open problems and challenges that require more attention in future research.

The six blinds and the elephant or an interdisciplinary selection of measurement features

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Six Statistical Senses

Measurement of Similarity in Academic Contexts

The quest for psychological symmetry through figural goodness, randomness, and complexity: A selective review

Six Measurement Problems of Quantum Mechanics

A New Measurement of Systematic Similarity

Measurement-induced asymmetry in bipartite networks

Measuring Interdisciplinary Interactions Using Citation Analysis and Semantic Analysis

Entropy based measure and its algorithms for scalable feature selection

The Perfect Marriage and Much More: Combining Dimension Reduction, Distance Measures and Covariance

Analysis and comparison of feature selection methods towards performance and stability

Unveiling the Link between Complexity and Symmetry: Statistical Asymmetry

Feature Selection with Neighborhood Entropy-Based Cooperative Game Theory

An operational approach to classifying measurement incompatibility

A mathematical model of performance-relevant feature interactions

Measuring Similarity: Computationally Reproducing the Scholar's Interests

Feature Selection: A Data Perspective

Ontology-based Feature Selection: A Survey

Three Perspectives on Complexity $-$ Entropy, Compression, Subsymmetry

Symplectic Entropy As a Novel Measure for Complex Systems.