Abstract:Advanced biological intelligence learns efficiently from an information-rich stream of stimulus information, even when feedback on behaviour quality is sparse or absent. Such learning exploits implicit assumptions about task domains. We refer to such learning as Domain-Adapted Learning (DAL). In contrast, AI learning algorithms rely on explicit externally provided measures of behaviour quality to acquire fit behaviour. This imposes an information bottleneck that precludes learning from diverse non-reward stimulus information, limiting learning efficiency. We consider the question of how biological evolution circumvents this bottleneck to produce DAL. We propose that species first evolve the ability to learn from reward signals, providing inefficient (bottlenecked) but broad adaptivity. From there, integration of non-reward information into the learning process can proceed via gradual accumulation of biases induced by such information on specific task domains. This scenario provides a biologically plausible pathway towards bottleneck-free, domain-adapted learning. Focusing on the second phase of this scenario, we set up a population of NNs with reward-driven learning modelled as Reinforcement Learning (A2C), and allow evolution to improve learning efficiency by integrating non-reward information into the learning process using a neuromodulatory update mechanism. On a navigation task in continuous 2D space, evolved DAL agents show a 300-fold increase in learning speed compared to pure RL agents. Evolution is found to eliminate reliance on reward information altogether, allowing DAL agents to learn from non-reward information exclusively, using local neuromodulation-based connection weight updates only. Code available at <a class="link-external link-http" href="http://github.com/aislab/dal" rel="external noopener nofollow">this http URL</a>.

Towards the Neuroevolution of Low-level artificial general intelligence

Neuroevolution of Recurrent Architectures on Control Tasks

Explaining the Neuroevolution of Fighting Creatures Through Virtual fMRI

A Neuroevolution Approach to General Atari Game Playing

Breaching the Bottleneck: Evolutionary Transition from Reward-Driven Learning to Reward-Agnostic Domain-Adapted Learning in Neuromodulated Neural Nets

Design of the Artificial: lessons from the biological roots of general intelligence

Generative Adversarial Neuroevolution for Control Behaviour Imitation

Born to Learn: the Inspiration, Progress, and Future of Evolved Plastic Artificial Neural Networks

A Theory of Natural Intelligence

Catalyzing next-generation Artificial Intelligence through NeuroAI

Building artificial neural circuits for domain-general cognition: a primer on brain-inspired systems-level architecture

Evolving plastic neural networks with novelty search

Neuromorphic Cognitive Learning Systems: The Future of Artificial Intelligence?

Growing Artificial Neural Networks for Control: the Role of Neuronal Diversity

Learning to acquire novel cognitive tasks with evolution, plasticity and meta-meta-learning

First Steps Towards a Runtime Analysis of Neuroevolution

Evolutionary emergence of biological intelligence

Adaptability of Improved NEAT in Variable Environments

Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learning

Minimally Naturalistic Artificial Intelligence

On the design of neural networks in the brain by genetic evolution.