Abstract:Sufficient good features are indispensable to train well-performed machine learning models. However, it is common that good features are not always enough, where feature augmentation is necessary to enrich high-quality features by joining with other tables. There are two main challenges for the problem. Given a set of tables where we can augment features from, the first challenge is that there are a lot of ways of joining multiple tables and deciding which features (or attributes) to use - selecting the best set of features to augment is hard. Moreover, we may need to materialize the join results for different join options, doing full materialization might be time consuming efficient but approximate methods are needed. In this paper, we first introduce the design space of the feature augmentation problem. Then, to address the above challenges, we propose a reinforcement learning based framework, namely AutoFeature, to augment the features following an exploration-exploitation strategy. AutoFeature keeps exploring the features in tables that have led to performance improvement. At the same time, AutoFeature also exploits the tables (features) that are rarely selected. In this way, the search space of tables (features) to be augmented can be well explored and a subset of good features can be selected. AutoFeature utilizes sampling techniques to achieve high efficiency. We implement two algorithms, one with multi-arm bandit and the other with branch Deep Q Networks (branch DQN), to realize the framework of AutoFeature. We conducted experiments on three real-world datasets School/XuetangE/Air using 16/23/34 candidate tables with 695/204/338 candidate features. Extensive results show that AutoFeature outperforms other methods by 12.4% and 9.8% on AUC values on two classification datasets (School and XuetangE) and by 0.113 on the MSE value on Air in terms of the model performance.

Visible-hidden Hybrid Automatic Feature Engineering Via Multi-Agent Reinforcement Learning

Toward Efficient Automated Feature Engineering

Long-short Memory with Feature Representation by Latent-variable Model for Industrial Soft Sensor

SAFE: Scalable Automatic Feature Engineering Framework for Industrial Tasks.

Evolutionary Automated Feature Engineering

Catch: Collaborative Feature Set Search for Automated Feature Engineering

Automated Feature Selection: A Reinforcement Learning Perspective

Automating Feature Subspace Exploration via Multi-Agent Reinforcement Learning

Feature Augmentation with Reinforcement Learning

FeatureEnVi: Visual Analytics for Feature Engineering Using Stepwise Selection and Semi-Automatic Extraction Approaches

Dynamic Feature Extractor for Industrial Key Variable Prediction Based on Enhanced Gating Mechanism

DAFEE: A Scalable Distributed Automatic Feature Engineering Algorithm for Relational Datasets

Learning a Data-Driven Policy Network for Pre-Training Automated Feature Engineering

Features Masked Auto-Encoder-Based Anomaly Detection in Process Industry

Aero-Engine Remaining Useful Life Prediction Via Physics-Informed Self-Attention Encoder

AEFE: Automatic Embedded Feature Engineering for Categorical Features

Data-driven adaptive and stable feature selection method for large-scale industrial systems

An adaptive multi-scale feature fusion and adaptive mixture-of-experts multi-task model for industrial equipment health status assessment and remaining useful life prediction

Federated Automated Feature Engineering

Remaining Useful Life Prediction Using a Novel Feature-Attention-Based End-to-End Approach

Traceable Automatic Feature Transformation via Cascading Actor-Critic Agents