Abstract:We study the problem of balancing effectiveness and efficiency in automated feature selection. Feature selection is to find an optimal feature subset from large feature space. After exploring many feature selection methods, we observe a computational dilemma: 1) traditional feature selection (e.g., mRMR) is mostly efficient, but difficult to identify the best subset; 2) the emerging reinforced feature selection automatically navigates feature space to search the best subset, but is usually inefficient. Are automation and efficiency always apart from each other? Can we bridge the gap between effectiveness and efficiency under automation? Motivated by this dilemma, we aim to develop a novel feature space navigation method. In our preliminary work, we leveraged interactive reinforcement learning to accelerate feature selection by external trainer-agent interaction. Our preliminary work can be significantly improved by modeling the structured knowledge of its downstream task (e.g., decision tree) as learning feedback. In this journal version, we propose a novel interactive and closed-loop architecture to simultaneously model interactive reinforcement learning (IRL) and decision tree feedback (DTF). Specifically, IRL is to create an interactive feature selection loop and DTF is to feed structured feature knowledge back to the loop. The DTF improves IRL from two aspects. First, the tree-structured feature hierarchy generated by decision tree is leveraged to improve state representation. In particular, we represent the selected feature subset as an undirected graph of feature-feature correlations and a directed tree of decision features. We propose a new embedding method capable of empowering Graph Convolutional Network (GCN) to jointly learn state representation from both the graph and the tree. Second, the tree-structured feature hierarchy is exploited to develop a new reward scheme. In particular, we personalize reward assignment of agents based on decision tree feature importance. In addition, observing agents’ actions can also be a feedback, we devise another new reward scheme, to weigh and assign reward based on the selected frequency ratio of each agent in historical action records. Finally, we present extensive experiments with real-world datasets to demonstrate the improved performances of our method.

A spatial dependency based reinforcement learning model for selecting features in spatial classification

Spatial Likelihood Voting with Self-Knowledge Distillation for Weakly Supervised Object Detection.

Automated Feature Selection: A Reinforcement Learning Perspective

Automating Feature Subspace Exploration via Multi-Agent Reinforcement Learning

Interactive Reinforcement Learning for Feature Selection with Decision Tree in the Loop

SEA: A Spatially Explicit Architecture for Multi-Agent Reinforcement Learning

A Survey on Applications of Reinforcement Learning in Spatial Resource Allocation

Feature Selection for Reliable Data Association in Visual SLAM.

ReinforceNet: A reinforcement learning embedded object detection framework with region selection network

Spatial-Aware Learning in Feature Embedding and Classification for One-Stage 3-D Object Detection

Feature selection considering feature relevance, redundancy and interactivity for neighborhood decision systems

Group-wise Reinforcement Feature Generation for Optimal and Explainable Representation Space Reconstruction

An Ensemble Framework for Explainable Geospatial Machine Learning Models

ASK: Adaptively Selecting Key Local Features for RGB-D Scene Recognition

Adaptive Selection of Informative Path Planning Strategies via Reinforcement Learning

Feature and Instance Joint Selection: A Reinforcement Learning Perspective

Self-consistent Deep Geometric Learning for Heterogeneous Multi-source Spatial Point Data Prediction

Enhancing mineral prospectivity mapping with geospatial artificial intelligence: A geographically neural network-weighted logistic regression approach

Weakly Supervised Learning of Part Selection Model with Spatial Constraints for Fine-Grained Image Classification

Intra- and Intersource Interactive Representation Learning Network for Remote Sensing Images Classification

Neuro-Inspired Reinforcement Learning to Improve Trajectory Prediction in Reward-Guided Behavior