Abstract:The receiver operating characteristic (ROC) and detection error tradeoff (DET) curves are frequently used in the machine learning community to analyze the performance of binary classifiers. Recently, the convex-hull-based multiobjective genetic programming algorithm was proposed and successfully applied to maximize the convex hull area for binary classification problems by minimizing false positive rate and maximizing true positive rate at the same time using indicator-based evolutionary algorithms. The area under the ROC curve was used for the performance assessment and to guide the search. Here we extend this research and propose two major advancements: Firstly we formulate the algorithm in detection error tradeoff space, minimizing false positives and false negatives, with the advantage that misclassification cost tradeoff can be assessed directly. Secondly, we add complexity as an objective function, which gives rise to a 3D objective space (as opposed to a 2D previous ROC space). A domain specific performance indicator for 3D Pareto front approximations, the volume above DET surface, is introduced, and used to guide the indicator-based evolutionary algorithm to find optimal approximation sets. We assess the performance of the new algorithm on designed theoretical problems with different geometries of Pareto fronts and DET surfaces, and two application-oriented benchmarks: (1) Designing spam filters with low numbers of false rejects, false accepts, and low computational cost using rule ensembles, and (2) finding sparse neural networks for binary classification of test data from the UCI machine learning benchmark. The results show a high performance of the new algorithm as compared to conventional methods for multicriteria optimization.

Application of Compromising Evolution in Multi-objective Image Error Concealment

An New Evolutionary Multi-Objective Optimization Algorithm

Adaptive Memetic Computing for Evolutionary Multiobjective Optimization

A Review of Evolutionary Multi-modal Multi-objective Optimization

Balancing Objective Optimization and Constraint Satisfaction in Constrained Evolutionary Multiobjective Optimization

Novel hybrid evolutionary algorithm for multi-objective optimization problem

A coevolutionary algorithm assisted by two archives for constrained multi-objective optimization problems

A Framework to Handle Multi-modal Multi-objective Optimization in Decomposition-based Evolutionary Algorithms

Evolutionary Alternating Direction Method of Multipliers for Constrained Multi-Objective Optimization with Unknown Constraints

Trade-off Between Performance and Robustness: an Evolutionary Multiobjective Approach

MULTIOBJECTIVE DESIGN OPTIMIZATION BY AN EVOLUTIONARY ALGORITHM

A Multiobjective Evolutionary Algorithm Based On Decomposition And Probability Model

Multi-Objective Collaborative Optimization Based on Evolutionary Algorithms

Utilizing Dependence among Variables in Evolutionary Algorithms for Mixed-Integer Programming: A Case Study on Multi-Objective Constrained Portfolio Optimization

Adversarial Example Generation using Evolutionary Multi-objective Optimization

Evolutionary Multi-Objective Optimisation with a Hybrid Representation

Dynamic Detection of Relevant Objectives and Adaptation to Preference Drifts in Interactive Evolutionary Multi-Objective Optimization

A Coevolutionary Framework for Constrained Multiobjective Optimization Problems

3D Fast Convex-Hull-based Evolutionary Multiobjective Optimization Algorithm

Solving Multi-Objective Optimization Problems By A Bi-Objective Evolutionary Algorithm

Guest Editorial Evolutionary Many-Objective Optimization