Learning Dynamics and the Co-Evolution of Competing Sexual Species

Georgios Piliouras,Leonard J. Schulman

DOI: https://doi.org/10.48550/arXiv.1711.06879

2017-11-18

Abstract:We analyze a stylized model of co-evolution between any two purely competing species (e.g., host and parasite), both sexually reproducing. Similarly to a recent model of Livnat \etal~\cite{evolfocs14} the fitness of an individual depends on whether the truth assignments on $n$ variables that reproduce through recombination satisfy a particular Boolean function. Whereas in the original model a satisfying assignment always confers a small evolutionary advantage, in our model the two species are in an evolutionary race with the parasite enjoying the advantage if the value of its Boolean function matches its host, and the host wishing to mismatch its parasite. Surprisingly, this model makes a simple and robust behavioral prediction. The typical system behavior is \textit{periodic}. These cycles stay bounded away from the boundary and thus, \textit{learning-dynamics competition between sexual species can provide an explanation for genetic diversity.} This explanation is due solely to the natural selection process. No mutations, environmental changes, etc., need be invoked. The game played at the gene level may have many Nash equilibria with widely diverse fitness levels. Nevertheless, sexual evolution leads to gene coordination that implements an optimal strategy, i.e., an optimal population mixture, at the species level. Namely, the play of the many "selfish genes" implements a time-averaged correlated equilibrium where the average fitness of each species is exactly equal to its value in the two species zero-sum competition. Our analysis combines tools from game theory, dynamical systems and Boolean functions to establish a novel class of conservative dynamical systems.

Computer Science and Game Theory

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how genetic diversity generated by sexual reproduction is maintained during the co - evolution process between two purely competitive species (such as hosts and parasites). Specifically, the authors constructed a model in which an individual's fitness depends on whether its genotype satisfies a specific Boolean function. Different from previous models, the two species here are in an evolutionary race. One species (such as parasites) has an advantage if its Boolean function value matches that of its host, while the host hopes not to match the Boolean function value of its parasite.

The key finding of the paper is that this model can predict a simple and robust behavioral pattern - the system behavior is usually periodic. These cycles are far from the boundaries, which means that the learning - dynamics competition between sexually reproducing species can provide an explanation for genetic diversity, an explanation based entirely on the process of natural selection without the need to introduce factors such as mutation and environmental change.

In addition, the authors also proved that games played at the gene level may have many Nash equilibrium points, and the fitness levels of these equilibrium points vary greatly. However, sexual evolution leads to gene coordination and realizes the optimal strategy at the species level, that is, the optimal population mixing. In other words, many "selfish - gene" games implement a time - averaged correlated equilibrium, in which the average fitness of each species is exactly equal to their value in the two - species zero - sum competition.

Overall, this research combines the tools of game theory, dynamic systems, and Boolean functions to establish a new class of conservative dynamic systems, thus providing a new perspective for understanding how sexually reproducing species maintain genetic diversity in highly competitive environments.