Abstract:Automated machine learning (AutoML) has achieved remarkable progress on various tasks, which is attributed to its minimal involvement of manual feature and model designs. However, most of existing AutoML pipelines only touch parts of the full machine learning pipeline, e.g., neural architecture search or optimizer selection. This leaves potentially important components such as data cleaning and model ensemble out of the optimization, and still results in considerable human involvement and suboptimal performance. The main challenges lie in the huge search space assembling all possibilities over all components, as well as the generalization ability over different tasks like image, text, and tabular etc. In this paper, we present a first-of-its-kind fully AutoML pipeline, to comprehensively automate data preprocessing, feature engineering, model generation/selection/training and ensemble for an arbitrary dataset and evaluation metric. Our innovation lies in the comprehensive scope of a learning pipeline, with a novel "life-long" knowledge anchor design to fundamentally accelerate the search over the full search space. Such knowledge anchors record detailed information of pipelines and integrates them with an evolutionary algorithm for joint optimization across components. Experiments demonstrate that the result pipeline achieves state-of-the-art performance on multiple datasets and modalities. Specifically, the proposed framework was extensively evaluated in the NeurIPS 2019 AutoDL challenge, and won the only champion with a significant gap against other approaches, on all the image, video, speech, text and tabular tracks.

Techniques for Automated Machine Learning

Automated Machine Learning: From Principles to Practices

AutoML: From Methodology to Application

Taking Human out of Learning Applications: A Survey on Automated Machine Learning.

A General Recipe for Automated Machine Learning in Practice

AutoML: A Perspective where Industry Meets Academy

AutoML: A survey of the state-of-the-art

AutoML from Software Engineering Perspective: Landscapes and Challenges

Whither AutoML? Understanding the Role of Automation in Machine Learning Workflows

AutoML: state of the art with a focus on anomaly detection, challenges, and research directions

AutoML in The Wild: Obstacles, Workarounds, and Expectations

How far are we with automated machine learning? characterization and challenges of AutoML toolkits

Benchmarking Automatic Machine Learning Frameworks

CO-AutoML: an Optimizable Automated Machine Learning System

Multi-Objective Automatic Machine Learning with AutoxgboostMC

Benchmark and Survey of Automated Machine Learning Frameworks

Towards Automated Semi-Supervised Learning

Evolving Fully Automated Machine Learning Via Life-Long Knowledge Anchors.

Automated machine learning: AI-driven decision making in business analytics

A Neophyte With AutoML: Evaluating the Promises of Automatic Machine Learning Tools

Automated Imbalanced Learning