Abstract:Feature selection is a critical step in machine learning that selects the most important features for a subsequent prediction task. Effective feature selection can help to reduce dimensionality, improve prediction accuracy, and increase result comprehensibility. It is traditionally challenging to find the optimal feature subset from the feature subset space as the space could be very large. While much effort has been made on feature selection, reinforcement learning can provide a new perspective towards a more globally-optimal searching strategy. In the preliminary work, we propose a multi-agent reinforcement learning framework for the feature selection problem. Specifically, we first reformulate feature selection with a reinforcement learning framework by regarding each feature as an agent. Besides, we obtain the state of the environment in three ways, i.e., statistic description, autoencoder, and graph convolutional network (GCN), in order to derive a fixed-length state representation as the input of reinforcement learning. In addition, we study how the coordination among feature agents can be improved by a more effective reward scheme. Also, we provide a GMM-based generative rectified sampling strategy to accelerate the convergence of multi-agent reinforcement learning. Our method searches the feature subset space more globally and can be easily adapted to real-time scenarios due to the nature of reinforcement learning. In the extended version, we further accelerate the framework from two aspects. From the sampling aspect, we show the indirect acceleration by proposing a rank-based softmax sampling strategy. From the exploration aspect, we show the direct acceleration by proposing an interactive reinforcement learning (IRL)-based exploration strategy. Extensive experimental results show the significant improvement of the proposed method over conventional approaches.

Active Sample Learning and Feature Selection: A Unified Approach

Joint Active Learning with Feature Selection via CUR Matrix Decomposition

U^2F^2S^2 : Uncovering Feature-level Similarities for Unsupervised Feature Selection

Uncertainty Sampling Based Active Learning with Diversity Constraint by Sparse Selection.

A Serial Sample Selection Framework for Active Learning.

Effective Learning with Joint Discriminative and Representative Feature Selection

Automated Feature Selection: A Reinforcement Learning Perspective

Joint Sample and Feature Selection Via Sparse Primal and Dual LSSVM

A unified feature and instance selection framework using optimum experimental design.

Unlabeled data selection for active learning in image classification

Adaptive dictionary and structure learning for unsupervised feature selection

An Improved Active Learning Method Based on Feature Selection

Joint Adaptive Graph Learning and Discriminative Analysis for Unsupervised Feature Selection

Feature and Instance Joint Selection: A Reinforcement Learning Perspective

Joint Embedding Learning and Sparse Regression: A Framework for Unsupervised Feature Selection

Two-Dimensional Unsupervised Feature Selection via Sparse Feature Filter

Self-Tuned Discrimination-Aware Method for Unsupervised Feature Selection

Unsupervised Feature Selection via Nonnegative Orthogonal Constrained Regularized Minimization

Exploring Representativeness and Informativeness for Active Learning.

A novel framework for online supervised learning with feature selection

Simultaneous Spectral-Spatial Feature Selection and Extraction for Hyperspectral Images