Abstract:Many machine learning tasks involve solving complex optimization problems, such as working on non-differentiable, non-continuous, and non-unique objective functions; in some cases it can prove difficult to even define an explicit objective function. Evolutionary learning applies evolutionary algorithms to address optimization problems in machine learning, and has yielded encouraging outcomes in many applications. However, due to the heuristic nature of evolutionary optimization, most outcomes to date have been empirical and lack theoretical support. This shortcoming has kept evolutionary learning from being well received in the machine learning community, which favors solid theoretical approaches. Recently there have been considerable efforts to address this issue. This book presents a range of those efforts, divided into four parts. Part I briefly introduces readers to evolutionary learning and provides some preliminaries, while Part II presents general theoretical tools for the analysis of running time and approximation performance in evolutionary algorithms. Based on these general tools, Part III presents a number of theoretical findings on major factors in evolutionary optimization, such as recombination, representation, inaccurate fitness evaluation, and population. In closing, Part IV addresses the development of evolutionary learning algorithms with provable theoretical guarantees for several representative tasks, in which evolutionary learning offers excellent performance.

Evolution Strategies for Continuous Optimization: A Survey of the State-of-the-art

A Survey of Evolutionary Continuous Dynamic Optimization over Two Decades-Part A

A Comparative Study on Evolutionary Algorithms and Mathematical Programming Methods for Continuous Optimization

Continuous selection and self-adaptive evolution strategies

Evolution Strategies in Optimization Problems

A Survey on Recent Progress in the Theory of Evolutionary Algorithms for Discrete Optimization

Journal of Computer Science and Technology: Preface

An Adaptive Real Coded Population-Based Incremental Learning Algorithm for Design Optimizations in Continuous Space

An Experimental Method to Estimate Running Time of Evolutionary Algorithms for Continuous Optimization

A Novel Evolutionary Algorithm for Global Numerical Optimization with Continuous Variables

Distributed Evolution Strategies for Black-Box Stochastic Optimization

An improved differential evolution to continuous domains and its convergence

Evolutionary Learning: Advances in Theories and Algorithms

Introduction to Evolutionary Algorithms

Analyses and Comparisons of Different Update Strategies for Differential Evolution

Benchmarking Continuous Dynamic Optimization: Survey and Generalized Test Suite.

Data-Driven Evolutionary Optimization: An Overview and Case Studies

Differential Evolution: A Survey of the State-of-the-Art

Efficacy of Modern Neuro-Evolutionary Strategies for Continuous Control Optimization

Survey of Multi-objective Evolutionary Algorithms

Adaptive Evolution Strategies for Stochastic Zeroth-Order Optimization