Abstract:We study the problem of balancing effectiveness and efficiency in automated feature selection. Feature selection is to find an optimal feature subset from large feature space. After exploring many feature selection methods, we observe a computational dilemma: 1) traditional feature selection (e.g., mRMR) is mostly efficient, but difficult to identify the best subset; 2) the emerging reinforced feature selection automatically navigates feature space to search the best subset, but is usually inefficient. Are automation and efficiency always apart from each other? Can we bridge the gap between effectiveness and efficiency under automation? Motivated by this dilemma, we aim to develop a novel feature space navigation method. In our preliminary work, we leveraged interactive reinforcement learning to accelerate feature selection by external trainer-agent interaction. Our preliminary work can be significantly improved by modeling the structured knowledge of its downstream task (e.g., decision tree) as learning feedback. In this journal version, we propose a novel interactive and closed-loop architecture to simultaneously model interactive reinforcement learning (IRL) and decision tree feedback (DTF). Specifically, IRL is to create an interactive feature selection loop and DTF is to feed structured feature knowledge back to the loop. The DTF improves IRL from two aspects. First, the tree-structured feature hierarchy generated by decision tree is leveraged to improve state representation. In particular, we represent the selected feature subset as an undirected graph of feature-feature correlations and a directed tree of decision features. We propose a new embedding method capable of empowering Graph Convolutional Network (GCN) to jointly learn state representation from both the graph and the tree. Second, the tree-structured feature hierarchy is exploited to develop a new reward scheme. In particular, we personalize reward assignment of agents based on decision tree feature importance. In addition, observing agents’ actions can also be a feedback, we devise another new reward scheme, to weigh and assign reward based on the selected frequency ratio of each agent in historical action records. Finally, we present extensive experiments with real-world datasets to demonstrate the improved performances of our method.

Feature and Instance Joint Selection: A Reinforcement Learning Perspective

Automated Feature Selection: A Reinforcement Learning Perspective

Automating Feature Subspace Exploration via Multi-Agent Reinforcement Learning

Interactive Reinforcement Learning for Feature Selection with Decision Tree in the Loop

Joint Domain Alignment and Discriminative Feature Learning for Unsupervised Deep Domain Adaptation

Effective Learning with Joint Discriminative and Representative Feature Selection

A reinforcement learning guided adaptive cost-sensitive feature acquisition method

A unified feature and instance selection framework using optimum experimental design.

Visible-hidden Hybrid Automatic Feature Engineering Via Multi-Agent Reinforcement Learning

Joint Active Learning with Feature Selection via CUR Matrix Decomposition

Feature selection and feature learning for high-dimensional batch reinforcement learning: A survey

Unsupervised Feature Selection Via Joint Local Learning and Group Sparse Regression

Joint learning of graph and latent representation for unsupervised feature selection

Supervised Feature Selection via Collaborative Neurodynamic Optimization

Learning to Discover Task-Relevant Features for Interpretable Reinforcement Learning

Anti-drifting Feature Selection Via Deep Reinforcement Learning (student Abstract).

Joint Attention for Multi-Agent Coordination and Social Learning

Jointly-Learned State-Action Embedding for Efficient Reinforcement Learning

Joint Semi-Supervised Feature Selection and Classification Through Bayesian Approach

Feature Selection as Deep Sequential Generative Learning

On-the-Fly Joint Feature Selection and Classification