Abstract:For robot swarms to operate outside of the laboratory in complex real-world environments, they require the kind of error tolerance, flexibility, and scalability seen in living systems. While robot swarms are often designed to mimic some aspect of the behavior of social insects or other organisms, no systems have yet addressed all of these capabilities in a single framework. We describe a swarm robotics system that emulates ant behaviors, which govern memory, communication, and movement, as well as an evolutionary process that tailors those behaviors into foraging strategies that maximize performance under varied and complex conditions. The system evolves appropriate solutions to different environmental challenges. Solutions include the following: (1) increased communication when sensed information is reliable and resources to be collected are highly clustered, (2) less communication and more individual memory when cluster sizes are variable, and (3) greater dispersal with increasing swarm size. Analysis of the evolved behaviors reveals the importance of interactions among behaviors, and of the interdependencies between behaviors and environments. The effectiveness of interacting behaviors depends on the uncertainty of sensed information, the resource distribution, and the swarm size. Such interactions could not be manually specified, but are effectively evolved in simulation and transferred to physical robots. This work is the first to demonstrate high-level robot swarm behaviors that can be automatically tuned to produce efficient collective foraging strategies in varied and complex environments.

Evolution of Swarm Robotics Systems with Novelty Search

Efficient Novelty Search Through Deep Reinforcement Learning

Evolving plastic neural networks with novelty search

Dynamics-aware Novelty Search with Behavior Repulsion

Swarm Behaviour Evolution via Rule Sharing and Novelty Search

Innate Motivation for Robot Swarms by Minimizing Surprise: From Simple Simulations to Real-World Experiments

An Examination of Different Fitness and Novelty Based Selection Methods for the Evolution of Neural Networks

Efficiently evolving programs through the search for novelty

Onboard Evolution of Understandable Swarm Behaviors

Particle Swarm Optimization based on Novelty Search

Novelty Driven Evolutionary Neural Architecture Search

Learning NEAT Emergent Behaviors in Robot Swarms

A novelty-search-based evolutionary reinforcement learning algorithm for continuous optimization problems

Empirical assessment and comparison of neuro-evolutionary methods for the automatic off-line design of robot swarms

Beyond pheromones: evolving error-tolerant, flexible, and scalable ant-inspired robot swarms

Evolving Multi-Objective Neural Network Controllers for Robot Swarms

Improving Exploration in Evolution Strategies for Deep Reinforcement Learning via a Population of Novelty-Seeking Agents

Evolution of a Functionally Diverse Swarm via a Novel Decentralised Quality-Diversity Algorithm

On Evolvability and Behavior Landscapes in Neuroevolutionary Divergent Search

Recent trends in robot learning and evolution for swarm robotics

Combining Neuroevolution with the Search for Novelty to Improve the Generation of Test Inputs for Games