Abstract:Learning from past experience is an important adaptation and theoretical models may help to understand its evolution. Many of the existing models study simple phenotypes and do not consider the mechanisms underlying learning while the more complex neural network models often make biologically unrealistic assumptions and rarely consider evolutionary questions. Here, we present a novel way of modelling learning using small neural networks and a simple, biology-inspired learning algorithm. Learning affects only part of the network, and it is governed by the difference between expectations and reality. We use this model to study the evolution of learning under various environmental conditions and different scenarios for the trade-off between exploration (learning) and exploitation (foraging). Efficient learning readily evolves in our individual-based simulations. However, in line with previous studies, the evolution of learning is less likely in relatively constant environments, where genetic adaptation alone can lead to efficient foraging, or in short-lived organisms that cannot afford to spend much of their lifetime on exploration. Once learning does evolve, the characteristics of the learning strategy (i.e. the duration of the learning period and the learning rate) and the average performance after learning are surprisingly little affected by the frequency and/or magnitude of environmental change. In contrast, an organism's lifespan and the distribution of resources in the environment have a strong effect on the evolved learning strategy: a shorter lifespan and a narrow resource distribution reduce the likelihood of learning to evolve. Interestingly, a longer learning period does not always lead to better performance, indicating that the evolved neural networks differ in the effectiveness of learning. Overall, however, we show that a biologically inspired, yet relatively simple, learning mechanism can evolve to lead to an efficient adaptation in a changing environment. The ability to learn from experience is an important adaptation. However, it is still unclear how learning is shaped by natural selection. Here, we present a novel way of modelling the evolution of learning using small neural networks and a simple, biology-inspired learning mechanism. Computer simulations reveal that efficient learning readily evolves in this model. However, the evolution of learning is less likely in relatively constant environments (where evolved inborn preferences can guide animal behaviour) and in short-lived organisms (that cannot afford to spend much of their lifetime on learning). If learning does evolve, the evolved learning strategy is strongly affected by the lifespan and environmental richness but surprisingly little by the rate and degree of environmental change. In summary, we show that a simple and biologically plausible mechanism can help understand the evolution of learning and the structure of the evolved learning strategies.

An evolutionary process without variation and selection

Cumulative, Adaptive, Open-ended Change through Self-Other Reorganization: Reply to comment on 'An evolutionary process without variation and selection'

An Evolutionary Framework for Culture: Selectionism versus Communal Exchange

The Cultural Evolution of Socially Situated Cognition

Five clarifications about cultural evolution

Why Cognitive Science is Needed for a Viable Theoretical Framework for Cultural Evolution

Evolutionary Abilities of Minimalistic Physicochemical Models of Life Processes

A Darwinian model of cultural replication over the continuum of Weismannian and Lamarckian inheritance

Trait specialization, innovation, and the evolution of culture in fluctuating environments

Distilling the Essence of an Evolutionary Process and Implications for a Formal Description of Culture

The Evolution of Imitation Without Cultural Transmission

The Second Law of Thermodynamics Is the First Law of Psychology: Evolutionary Developmental Psychology and the Theory Of Tandem, Coordinated Inheritances: Comment on Lickliter and Honeycutt (2003).

A cultural evolutionary theory that explains both gradual and punctuated change

Competency of the Developmental Layer Alters Evolutionary Dynamics in an Artificial Embryogeny Model of Morphogenesis

Cultural Evolution as a Non-Stationary Stochastic Process

A neural network model for the evolution of learning in changing environments

Gene network architecture, mutation and selection collectively drive developmental pattern evolvability and predictability

Embodied Computational Evolution: A Model for Investigating Randomness and the Evolution of Morphological Complexity

Evolution is Driven by Natural Autoencoding: Reframing Species, Interaction Codes, Cooperation, and Sexual Reproduction

An energy-based natural selection model

Enhancing the diversity of self-replicating structures using active self-adapting mechanisms