Abstract:Sufficient good features are indispensable to train well-performed machine learning models. However, it is common that good features are not always enough, where feature augmentation is necessary to enrich high-quality features by joining with other tables. There are two main challenges for the problem. Given a set of tables where we can augment features from, the first challenge is that there are a lot of ways of joining multiple tables and deciding which features (or attributes) to use - selecting the best set of features to augment is hard. Moreover, we may need to materialize the join results for different join options, doing full materialization might be time consuming efficient but approximate methods are needed. In this paper, we first introduce the design space of the feature augmentation problem. Then, to address the above challenges, we propose a reinforcement learning based framework, namely AutoFeature, to augment the features following an exploration-exploitation strategy. AutoFeature keeps exploring the features in tables that have led to performance improvement. At the same time, AutoFeature also exploits the tables (features) that are rarely selected. In this way, the search space of tables (features) to be augmented can be well explored and a subset of good features can be selected. AutoFeature utilizes sampling techniques to achieve high efficiency. We implement two algorithms, one with multi-arm bandit and the other with branch Deep Q Networks (branch DQN), to realize the framework of AutoFeature. We conducted experiments on three real-world datasets School/XuetangE/Air using 16/23/34 candidate tables with 695/204/338 candidate features. Extensive results show that AutoFeature outperforms other methods by 12.4% and 9.8% on AUC values on two classification datasets (School and XuetangE) and by 0.113 on the MSE value on Air in terms of the model performance.

Catch: Collaborative Feature Set Search for Automated Feature Engineering

Cross-data Automatic Feature Engineering via Meta-learning and Reinforcement Learning.

Learning a Data-Driven Policy Network for Pre-Training Automated Feature Engineering

Visible-hidden Hybrid Automatic Feature Engineering Via Multi-Agent Reinforcement Learning

Toward Efficient Automated Feature Engineering

Automated Feature Selection: A Reinforcement Learning Perspective

SAFE: Scalable Automatic Feature Engineering Framework for Industrial Tasks.

DAFEE: A Scalable Distributed Automatic Feature Engineering Algorithm for Relational Datasets

Automatic Feature Engineering by Deep Reinforcement Learning

OpenFE: Automated Feature Generation with Expert-level Performance

Automating Feature Subspace Exploration via Multi-Agent Reinforcement Learning

SMARTFEAT: Efficient Feature Construction through Feature-Level Foundation Model Interactions

AEFE: Automatic Embedded Feature Engineering for Categorical Features

Evolutionary Automated Feature Engineering

Neural Feature Search: A Neural Architecture for Automated Feature Engineering

FeatureEnVi: Visual Analytics for Feature Engineering Using Stepwise Selection and Semi-Automatic Extraction Approaches

Feature Augmentation with Reinforcement Learning

Efficient Reinforced Feature Selection Via Early Stopping Traverse Strategy

Feature Engineering: The Method of Detecting Learner Behavior Patterns in Learning Analytics Field

FeatNavigator: Automatic Feature Augmentation on Tabular Data

MetaFS: An Effective Wrapper Feature Selection via Meta Learning