Abstract:We study the problem of balancing effectiveness and efficiency in automated feature selection. Feature selection is to find an optimal feature subset from large feature space. After exploring many feature selection methods, we observe a computational dilemma: 1) traditional feature selection (e.g., mRMR) is mostly efficient, but difficult to identify the best subset; 2) the emerging reinforced feature selection automatically navigates feature space to search the best subset, but is usually inefficient. Are automation and efficiency always apart from each other? Can we bridge the gap between effectiveness and efficiency under automation? Motivated by this dilemma, we aim to develop a novel feature space navigation method. In our preliminary work, we leveraged interactive reinforcement learning to accelerate feature selection by external trainer-agent interaction. Our preliminary work can be significantly improved by modeling the structured knowledge of its downstream task (e.g., decision tree) as learning feedback. In this journal version, we propose a novel interactive and closed-loop architecture to simultaneously model interactive reinforcement learning (IRL) and decision tree feedback (DTF). Specifically, IRL is to create an interactive feature selection loop and DTF is to feed structured feature knowledge back to the loop. The DTF improves IRL from two aspects. First, the tree-structured feature hierarchy generated by decision tree is leveraged to improve state representation. In particular, we represent the selected feature subset as an undirected graph of feature-feature correlations and a directed tree of decision features. We propose a new embedding method capable of empowering Graph Convolutional Network (GCN) to jointly learn state representation from both the graph and the tree. Second, the tree-structured feature hierarchy is exploited to develop a new reward scheme. In particular, we personalize reward assignment of agents based on decision tree feature importance. In addition, observing agents’ actions can also be a feedback, we devise another new reward scheme, to weigh and assign reward based on the selected frequency ratio of each agent in historical action records. Finally, we present extensive experiments with real-world datasets to demonstrate the improved performances of our method.

Traceable Group-Wise Self-Optimizing Feature Transformation Learning: A Dual Optimization Perspective

Traceable Automatic Feature Transformation via Cascading Actor-Critic Agents

Reinforcement-Enhanced Autoregressive Feature Transformation: Gradient-steered Search in Continuous Space for Postfix Expressions

A Transformation-Aggregation Framework for State Representation of Autonomous Driving Systems

Visible-hidden Hybrid Automatic Feature Engineering Via Multi-Agent Reinforcement Learning

The Self-Optimal-Transport Feature Transform

Automated Feature Selection: A Reinforcement Learning Perspective

A Post-training Framework for Improving the Performance of Deep Learning Models Via Model Transformation

Group-wise Reinforcement Feature Generation for Optimal and Explainable Representation Space Reconstruction

Improving Contrastive Learning by Visualizing Feature Transformation

A deep reinforcement learning algorithm framework for solving multi-objective traveling salesman problem based on feature transformation

A Framework to Co-Optimize Robot Exploration and Task Planning in Unknown Environments

Dual-Tuning: Joint Prototype Transfer and Structure Regularization for Compatible Feature Learning

Understanding Via Exploration: Discovery of Interpretable Features with Deep Reinforcement Learning.

Interactive Reinforcement Learning for Feature Selection with Decision Tree in the Loop

A Multi-Transformation Evolutionary Framework for Influence Maximization in Social Networks

Self-optimizing Feature Generation via Categorical Hashing Representation and Hierarchical Reinforcement Crossing

Evolutionary Large Language Model for Automated Feature Transformation

Automating Feature Subspace Exploration via Multi-Agent Reinforcement Learning

A Multi-objective Optimization Method for Joint Feature Selection and Classifier Parameter Tuning.

Online Feature Transformation Learning for Cross-Domain Object Category Recognition