Abstract:Given a ground set of items, the result diversification problem aims to select a subset with high “quality” and “diversity” while satisfying some constraints. It arises in various real-world artificial intelligence applications, such as web-based search, document summarization and feature selection, and also has applications in other areas, e.g., computational geometry, databases, finance and operations research. Previous algorithms are mainly based on greedy or local search. In this paper, we propose to reformulate the result diversification problem as a bi-objective maximization problem, and solve it by a multi-objective evolutionary algorithm (EA), i.e., the GSEMO. We theoretically prove that the GSEMO can achieve the (asymptotically) optimal theoretical guarantees under both static and dynamic environments. For cardinality constraints, the GSEMO can achieve the optimal polynomial-time approximation ratio, 1/2. For more general matroid constraints, the GSEMO can achieve an asymptotically optimal polynomial-time approximation ratio, 1 / 2 − ϵ / ( 4 n ), where ϵ > 0 and n is the size of the ground set of items. Furthermore, when the objective function (i.e., a linear combination of quality and diversity) changes dynamically, the GSEMO can maintain this approximation ratio in polynomial running time, addressing the open question proposed by Borodin et al. [7] . This also theoretically shows the superiority of EAs over local search for solving dynamic optimization problems for the first time, and discloses the robustness of the mutation operator of EAs against dynamic changes. Experiments on the applications of web-based search, multi-label feature selection and document summarization show the superior performance of the GSEMO over the state-of-the-art algorithms (i.e., the greedy algorithm and local search) under both static and dynamic environments.

Multi-objective Ensemble Construction , Learning and Evolution

Multi-objective Ensemble Generation

Trade-Off Between Diversity and Accuracy in Ensemble Generation

Evolutionary Multiobjective Ensemble Learning Based on Bayesian Feature Selection.

Generating Diverse and Accurate Classifier Ensembles Using Multi-Objective Optimization

Learning from Non-Stationary Stream Data in Multiobjective Evolutionary Algorithm.

Ensemble Learning through Diversity Management: Theory, Algorithms, and Applications

Pareto-Based Multiobjective Machine Learning: an Overview and Case Studies

New Multi-Objectivization Evolutionary Algorithm Based on Individual Diversity

Machine Learning Assisted Evolutionary Multi-Objective Optimization [Guest Editorial]

Learning from a Stream of Non-Stationary and Dependent Data in Multiobjective Evolutionary Optimization

Multiobjective Sparse Ensemble Learning by Means of Evolutionary Algorithms

Evolutionary extreme learning machine ensembles with size control

Evolutionary Multi-Objective Generation of Recurrent Neural Network Ensembles for Time Series Prediction

An ensemble learning-based multi-population evolutionary framework for multi-scenario multi-objective optimization problems

Interactive Evolutionary Multi-Objective Optimization via Learning-to-Rank

An Ensemble Surrogate-based Framework for Expensive Multiobjective Evolutionary Optimization

Evolutionary Classifier Ensembles For Semi-Supervised Learning

Result Diversification by Multi-objective Evolutionary Algorithms with Theoretical Guarantees

Neural Network Regularization and Ensembling Using Multi-Objective Evolutionary Algorithms

Two-stage Hybrid Learning-Based Multi-Objective Evolutionary Algorithm Based on Objective Space Decomposition