Abstract:Gathering sufficient instance data to either train algorithm-selection models or understand algorithm footprints within an instance space can be challenging. We propose an approach to generating synthetic instances that are tailored to perform well with respect to a target algorithm belonging to a predefined portfolio but are also diverse with respect to their features. Our approach uses a novelty search algorithm with a linearly weighted fitness function that balances novelty and performance to generate a large set of diverse and discriminatory instances in a single run of the algorithm. We consider two definitions of novelty: (1) with respect to discriminatory performance within a portfolio of solvers; (2) with respect to the features of the evolved instances. We evaluate the proposed method with respect to its ability to generate diverse and discriminatory instances in two domains (knapsack and bin-packing), comparing to another well-known quality diversity method, Multi-dimensional Archive of Phenotypic Elites (MAP-Elites) and an evolutionary algorithm that only evolves for discriminatory behaviour. The results demonstrate that the novelty search method outperforms its competitors in terms of coverage of the space and its ability to generate instances that are diverse regarding the relative size of the "performance gap" between the target solver and the remaining solvers in the portfolio. Moreover, for the Knapsack domain, we also show that we are able to generate novel instances in regions of an instance space not covered by existing benchmarks using a portfolio of state-of-the-art solvers. Finally, we demonstrate that the method is robust to different portfolios of solvers (stochastic approaches, deterministic heuristics and state-of-the-art methods), thereby providing further evidence of its generality.

Feature-Based Diversity Optimization for Problem Instance Classification

Illuminating the Diversity-Fitness Trade-Off in Black-Box Optimization

A Novel Feature-Based Approach to Characterize Algorithm Performance for the Traveling Salesman Problem

Evolutionary Multi-Objective Diversity Optimization

Synthesising Diverse and Discriminatory Sets of Instances using Novelty Search in Combinatorial Domains

Niching-based Evolutionary Diversity Optimization for the Traveling Salesperson Problem

Differential Evolution Based Feature Selection: A Niching-based Multi-objective Approach

An Analysis of Phenotypic Diversity in Multi-Solution Optimization

Maintaining Diversity Provably Helps in Evolutionary Multimodal Optimization

Evolutionary Diversity Optimization Using Multi-Objective Indicators

Obtaining Approximately Optimal and Diverse Solutions via Dispersion

Achieving Diversity in Objective Space for Sample-efficient Search of Multiobjective Optimization Problems

A Probabilistic Niching Evolutionary Computation Framework Based on Binary Space Partitioning

A Biogeography-Based Optimization with a Greedy Randomized Adaptive Search Procedure and the 2-Opt Algorithm for the Traveling Salesman Problem

An evolutionary multiobjective method based on dominance and decomposition for feature selection in classification

A dual local search framework for combinatorial optimization problems with TSP application

Feature Selection Using Diversity-Based Multi-objective Binary Differential Evolution

Niching Diversity Estimation for Multi-modal Multi-objective Optimization

Finding Optimal Diverse Feature Sets with Alternative Feature Selection

Evolving Diverse Sets of Tours for the Travelling Salesperson Problem

Multimodal and multi-objective optimization algorithm based on two-stage search framework