Abstract:Novelty search is a recent artificial evolution technique that challenges traditional evolutionary approaches. In novelty search, solutions are rewarded based on their novelty, rather than their quality with respect to a predefined objective. The lack of a predefined objective precludes premature convergence caused by a deceptive fitness function. In this paper, we apply novelty search combined with NEAT to the evolution of neural controllers for homogeneous swarms of robots. Our empirical study is conducted in simulation, and we use a common swarm robotics task - aggregation, and a more challenging task - sharing of an energy recharging station. Our results show that novelty search is unaffected by deception, is notably effective in bootstrapping the evolution, can find solutions with lower complexity than fitness-based evolution, and can find a broad diversity of solutions for the same task. Even in non-deceptive setups, novelty search achieves solution qualities similar to those obtained in traditional fitness-based evolution. Our study also encompasses variants of novelty search that work in concert with fitness-based evolution to combine the exploratory character of novelty search with the exploitatory character of objective-based evolution. We show that these variants can further improve the performance of novelty search. Overall, our study shows that novelty search is a promising alternative for the evolution of controllers for robotic swarms.

An Examination of Different Fitness and Novelty Based Selection Methods for the Evolution of Neural Networks

Bisexual Evolution: A Novel Bisexual Evolutionary Framework Based on the Fisher's Runaway Process

Evolving plastic neural networks with novelty search

Efficient Novelty Search Through Deep Reinforcement Learning

Evolution of Swarm Robotics Systems with Novelty Search

Efficient Evolutionary Optimization Using Individual-Based Evolution Control and Neural Networks: A Comparative Study.

On Evolvability and Behavior Landscapes in Neuroevolutionary Divergent Search

Selecting for Selection: Learning To Balance Adaptive and Diversifying Pressures in Evolutionary Search

Efficiently evolving programs through the search for novelty

Combining Neuroevolution with the Search for Novelty to Improve the Generation of Test Inputs for Games

Novelty Driven Evolutionary Neural Architecture Search

Dynamics-aware Novelty Search with Behavior Repulsion

Assessing Quality-Diversity Neuro-Evolution Algorithms Performance in Hard Exploration Problems

NFDDE: A Novelty-Hybrid-fitness Driving Differential Evolution Algorithm

Fitness Uniform Optimization

A Novel Evolutionary Algorithm Ensemble for Global Numerical Optimization.

Comparing and Combining Lexicase Selection and Novelty Search

Surrogate Models for Enhancing the Efficiency of Neuroevolution in Reinforcement Learning

Discovering Evolutionary Stepping Stones through Behavior Domination

An Evolutionary Many-Objective Algorithm Based on a Novel Tournament Selection Strategy

Fitness Uniform Selection to Preserve Genetic Diversity