Abstract:In binary classification problems, receiver operating characteristic (ROC) graphs are commonly used for visualizing, organizing and selecting classifiers based on their performances. An important issue in the ROC literature is to obtain the ROC convex hull (ROCCH) that covers potentially optima for a given set of classifiers [1]. Maximizing the ROCCH means to maximize the true positive rate (tpr) and minimize the false positive rate (fpr) for every classifier in ROC space, while tpr and fpr are conflicting with each other. In this paper, we propose multiobjective genetic programming (MOGP) to obtain a group of nondominated classifiers, with which the maximum ROCCH can be achieved. Four different multiobjective frameworks, including Nondominated Sorting Genetic Algorithm II (NSGA-II), Multiobjective Evolutionary Algorithms Based on Decomposition (MOEA/D), Multiobjective selection based on dominated hypervolume (SMS-EMOA), and Approximation-Guided Evolutionary Multi-Objective (AG-EMOA) are adopted into GP, because all of them are successfully applied into many problems and have their own characters. To improve the performance of each individual in GP, we further propose a memetic approach into GP by defining two local search strategies specifically designed for classification problems. Experimental results based on 27 well-known UCI data sets show that MOGP performs significantly better than single objective algorithms such as FGP, GGP, EGP, and MGP, and other traditional machine learning algorithms such as C4.5, Naive Bayes, and PRIE. The experiments also demonstrate the efficacy of the local search operator in the MOGP framework.

Partial Sampling Operator and Structural Distance Ranking for Multi-Objective GP

A Geometric Structure-Based Particle Swarm Optimization Algorithm for Multiobjective Problems

A probabilistic framework with the gradient-based method for multi-objective land use optimization

Soft Sensor Modeling Based on Multi-Objective Genetic Programming

Surrogate-Assisted Evolutionary Multi-Objective Optimization of Medium-Scale Problems by Random Grouping and Sparse Gaussian Modeling

Bi-objective memetic GP with dispersion-keeping Pareto evaluation for real-world regression

Highlights of Semantics in Multi-objective Genetic Programming

Improving the Performance of Multiobjective Genetic Algorithms: An Elitism-Based Approach

A Multicriteria Genetic Algorithm For Solving Multiobjective Optimization

Multi-Representation Genetic Programming: A Case Study on Tree-based and Linear Representations

Exploratory Study of Sorting Particle Swarm Optimizer for Multiobjective Design Optimization

Novel hybrid evolutionary algorithm for multi-objective optimization problem

Multi-Population Genetic Algorithms with Space Partition for Multi-Objective Optimization Problems

Surrogate-guided multi-objective optimization (SGMOO) using an efficient online sampling strategy

Multiobjective Genetic Programming for Maximizing ROC Performance

Multi-objective optimization scheme using Pareto Genetic Algorithm

SGOP: Surrogate-assisted global optimization using a Pareto-based sampling strategy

A Novel Multiobjective Genetic Programming Approach to High-Dimensional Data Classification

Reference point based evolutionary multi-objective optimization algorithms with convergence properties using KKTPM and ASF metrics

Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms