Abstract:Feature selection is a critical step in machine learning that selects the most important features for a subsequent prediction task. Effective feature selection can help to reduce dimensionality, improve prediction accuracy, and increase result comprehensibility. It is traditionally challenging to find the optimal feature subset from the feature subset space as the space could be very large. While much effort has been made on feature selection, reinforcement learning can provide a new perspective towards a more globally-optimal searching strategy. In the preliminary work, we propose a multi-agent reinforcement learning framework for the feature selection problem. Specifically, we first reformulate feature selection with a reinforcement learning framework by regarding each feature as an agent. Besides, we obtain the state of the environment in three ways, i.e., statistic description, autoencoder, and graph convolutional network (GCN), in order to derive a fixed-length state representation as the input of reinforcement learning. In addition, we study how the coordination among feature agents can be improved by a more effective reward scheme. Also, we provide a GMM-based generative rectified sampling strategy to accelerate the convergence of multi-agent reinforcement learning. Our method searches the feature subset space more globally and can be easily adapted to real-time scenarios due to the nature of reinforcement learning. In the extended version, we further accelerate the framework from two aspects. From the sampling aspect, we show the indirect acceleration by proposing a rank-based softmax sampling strategy. From the exploration aspect, we show the direct acceleration by proposing an interactive reinforcement learning (IRL)-based exploration strategy. Extensive experimental results show the significant improvement of the proposed method over conventional approaches.

A reinforcement learning guided adaptive cost-sensitive feature acquisition method

A Cost-Sensitive Feature Selection Method for High-Dimensional Data

Automated Feature Selection: A Reinforcement Learning Perspective

Automating Feature Subspace Exploration via Multi-Agent Reinforcement Learning

Cost-Sensitive Portfolio Selection via Deep Reinforcement Learning

Efficient Reinforced Feature Selection Via Early Stopping Traverse Strategy

Cost-sensitive feature selection using random forest: Selecting low-cost subsets of informative features

Disease Diagnosis with Cost-Sensitive Grouped Features Based on Deep Reinforcement Learning

Reinforced Feature Selection Using Q-learning Based on Collaborative Agents

Feature and Instance Joint Selection: A Reinforcement Learning Perspective

Dynamic feature selection in medical predictive monitoring by reinforcement learning

Cost-sensitive Regression Learning on Small Dataset Through Intra-Cluster Product Favoured Feature Selection

Learning a Cost-Effective Strategy on Incomplete Medical Data

AFS: An Attention-based mechanism for Supervised Feature Selection

Feature Selection Of Time Series Based On Reinforcement Learning

Recurrent Neural Network Based Feature Selection for High Dimensional and Low Sample Size Micro-array Data.

Evaluation of Active Feature Acquisition Methods for Time-varying Feature Settings

Towards Cost Sensitive Decision Making

Feature selection integrating Shapley values and mutual information in reinforcement learning: An application in the prediction of post-operative outcomes in patients with end-stage renal disease

Supervised Feature Selection via Collaborative Neurodynamic Optimization

Controlling Costs: Feature Selection on a Budget