Abstract:Machine learning models have liberated manpower greatly in many real-world tasks, but their predictions are still worse than humans on some specific instances. To improve the performance, it is natural to optimize machine learning models to take decisions for most instances while delivering a few tricky instances to humans, resulting in the problem of Human Assisted Learning (HAL). Previous works mainly formulated HAL as a constrained optimization problem that tries to find a limited subset of instances for human decision such that the sum of model and human errors can be minimized; and employed the greedy algorithms, whose performance, however, may be limited due to the greedy nature. In this paper, we propose a new framework HAL-EMO based on Evolutionary Multi-objective Optimization, which reformulates HAL as a bi-objective optimization problem that minimizes the number of selected instances for human decision and the total errors simultaneously, and employs a Multi-Objective Evolutionary Algorithm (MOEA) to solve it. We implement HALEMO using two MOEAs, the popular NSGA-II as well as the theoretically grounded GSEMO. We also propose a specific MOEA, called BSEMO, with biased selection and balanced mutation for HAL-EMO, and prove that for human assisted regression and classification, HAL-EMO using BSEMO can achieve better and same theoretical guarantees than previous greedy algorithms, respectively. Experiments on the tasks of medical diagnosis and content moderation show the superiority of HAL-EMO (with either NSGA-II, GSEMO or BSEMO) over previous algorithms, and that using BSEMO leads to the best performance of HAL-EMO.

Medical machine learning based on multiobjective evolutionary algorithm using learning decomposition

Multimodal Multiobjective Differential Evolution Algorithm Based on Enhanced Decision Space Search

An efficient hybrid extreme learning machine and evolutionary framework with applications for medical diagnosis

Two-stage Hybrid Learning-Based Multi-Objective Evolutionary Algorithm Based on Objective Space Decomposition

Human Assisted Learning by Evolutionary Multi-Objective Optimization.

Deep multi-layer perceptron-based evolutionary algorithm for dynamic multiobjective optimization

MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition

A Stable-State Multi-Objective Evolutionary Algorithm Based on Decomposition

A new learning-based adaptive multi-objective evolutionary algorithm.

Machine Learning Assisted Multiobjective Evolutionary Algorithm for Routing and Packing

A Decomposition based Multiobjective Evolutionary Algorithm with Semi-Supervised Classification

Feature optimization using Hybrid Metaheuristic Red Deer and Dragonfly Algorithms for Multi-disease prediction

Double Space Based Multiobjective Evolutionary Algorithm.

Learning from a Stream of Non-Stationary and Dependent Data in Multiobjective Evolutionary Optimization

Multi-Objective Performance Optimization of Machine Learning Models in Healthcare

A Multi-Objective Heuristic Algorithm for Gene Expression Microarray Data Classification

Multi-objective Evolutionary Algorithm Based on Decomposition Using Dynamic Neighbor

A Multi-Task Decomposition-Based Evolutionary Algorithm for Tackling High-Dimensional Bi-Objective Feature Selection

A localized decomposition evolutionary algorithm for imbalanced multi-objective optimization

Multi‐Objective Evolutionary Algorithm Based on Decomposition With Orthogonal Experimental Design

A Multiobjective Evolutionary Algorithm Based On Decomposition And Probability Model