Abstract:Abstract We investigate the optimisation capabilities of an algorithm inspired by the Evolutionary Transitions in Individuality. In these transitions, the natural evolutionary process is repeatedly rescaled through successive levels of biological organisation. Each transition creates new higher-level evolutionary units that combine multiple units from the level below. We call the algorithm Deep Optimisation (DO) to recognise both its use of deep learning methods and the multi-level rescaling of biological evolutionary processes. The evolutionary model used in DO is a simple hill-climber, but, as higher-level representations are learned, the hill-climbing process is repeatedly rescaled to operate in successively higher-level representations. The transition process is based on a deep learning neural network (NN), specifically a deep auto-encoder. Our experiments with DO start with a study using the NP-hard problem, multiple knapsack (MKP). Comparing with state-of-the-art model-building optimisation algorithms (MBOAs), we show that DO finds better solutions to MKP instances and does so without using a problem-specific repair operator. A second, much more in-depth investigation uses a class of configurable problems to understand more precisely the distinct problem characteristics that DO can solve that other MBOAs cannot. Specifically, we observe a polynomial vs exponential scaling distinction where DO is the only algorithm to show polynomial scaling for all problems. We also demonstrate that some problem characteristics need a deep network in DO. In sum, our findings suggest that the use of deep learning principles have significant untapped potential in combinatorial optimisation. Moreover, we argue that natural evolution could be implementing something like DO, and the evolutionary transitions in individuality are the observable result.

Don't Play Games, Optimize [President's Message]

Don't Play Games, Optimize

Effects of Different Optimization Formulations in Evolutionary Reinforcement Learning on Diverse Behavior Generation

Evolutionary Optimization： Pitfalls and Booby Traps

Balance of exploration and exploitation: Non-cooperative game-driven evolutionary reinforcement learning

Evolutionary Learning: Advances in Theories and Algorithms

Deep Optimisation: Transitioning the Scale of Evolutionary Search by Inducing and Searching in Deep Representations

Towards Theoretically Grounded Evolutionary Learning.

Evolving the Behavior of Machines: From Micro to Macroevolution

Deep Reinforcement Learning Based Adaptive Operator Selection for Evolutionary Multi-Objective Optimization

Optimizing Hearthstone Agents using an Evolutionary Algorithm

Learning to Learn Evolutionary Algorithm: A Learnable Differential Evolution

Neuroevolution of Recurrent Architectures on Control Tasks

Analyzing Evolutionary Optimization in Noisy Environments

Optimizing human-interpretable dialog management policy using Genetic Algorithm

Auto-configuring Exploration-Exploitation Tradeoff in Evolutionary Computation via Deep Reinforcement Learning

Evolutionary Dynamic Optimization and Machine Learning

Efficacy of Modern Neuro-Evolutionary Strategies for Continuous Control Optimization

The Exploration-Exploitation Dilemma Revisited: An Entropy Perspective

Deep Reinforcement Learning for Dynamic Algorithm Selection: A Proof-of-Principle Study on Differential Evolution

Pareto Analysis of Evolutionary and Learning Systems

Don&#x0027;t Play Games, Optimize [President&#x0027;s Message]