Abstract:Ants are capable of learning long visually guided foraging routes with limited neural resources. The visual scene memory needed for this behaviour is mediated by the mushroom bodies; an insect brain region important for learning and memory. In a visual navigation context, the mushroom bodies are theorised to act as familiarity detectors, guiding ants to views that are similar to those previously learned when first travelling along a foraging route. Evidence from behavioural experiments, computational studies and brain lesions all support this idea. Here we further investigate the role of mushroom bodies in visual navigation with a spiking neural network model learning complex natural scenes. By implementing these networks in GeNN–a library for building GPU accelerated spiking neural networks–we were able to test these models offline on an image database representing navigation through a complex outdoor natural environment, and also online embodied on a robot. The mushroom body model successfully learnt a large series of visual scenes (400 scenes corresponding to a 27 m route) and used these memories to choose accurate heading directions during route recapitulation in both complex environments. Through analysing our model's Kenyon cell (KC) activity, we were able to demonstrate that KC activity is directly related to the respective novelty of input images. Through conducting a parameter search we found that there is a non-linear dependence between optimal KC to visual projection neuron (VPN) connection sparsity and the length of time the model is presented with an image stimulus. The parameter search also showed training the model on lower proportions of a route generally produced better accuracy when testing on the entire route. We embodied the mushroom body model and comparator visual navigation algorithms on a Quanser Q-car robot with all processing running on an Nvidia Jetson TX2. On a 6.5 m route, the mushroom body model had a mean distance to training route (error) of 0.144 ± 0.088 m over 5 trials, which was performance comparable to standard visual-only navigation algorithms. Thus, we have demonstrated that a biologically plausible model of the ant mushroom body can navigate complex environments both in simulation and the real world. Understanding the neural basis of this behaviour will provide insight into how neural circuits are tuned to rapidly learn behaviourally relevant information from complex environments and provide inspiration for creating bio-mimetic computer/robotic systems that can learn rapidly with low energy requirements.

A Simplified Computational Model of Mushroom Body for Tethered Bees' Abdominal Swing Behavior Induced by Optic Flow

Modeling the undulatory locomotion of C. elegans based on the proprioceptive mechanism

Representation and Computation Method for Bumblebee’s Abdomen Movements

A dynamical model exploring sensory integration in the insect central complex substructures

A Bio-inspired Model for Bee Simulations

Representation of Drosophila Larval Behaviors by Muscle Activity Patterns

A computational neural model that incorporates both intrinsic dynamics and sensory feedback in the Aplysia feeding network

Path Guided Motion Synthesis for Drosophila Larvae

A machine learning based method for tracking of simultaneously imaged neural activity and body posture of freely moving maggot

Automatic analysis of segmentwise locomotion details of Drosophila larva

A Connectome-Based Digital Twin Caenorhabditis elegans Capable of Intelligent Sensorimotor Behavior

Investigating visual navigation using spiking neural network models of the insect mushroom bodies

A neural algorithm for Drosophila linear and nonlinear decision-making

Abdominal-Waving Control of Tethered Bumblebees Based on Sarsa with Transformed Reward

Biological Mechanisms for Learning: A Computational Model of Olfactory Learning in the Manduca sexta Moth, with Applications to Neural Nets

Cortical Motion Perception Emerges from Dimensionality Reduction with Evolved Spike-Timing-Dependent Plasticity Rules

Motor-Skill Learning in an Insect Inspired Neuro-Computational Control System

Mathematical Analysis and Simulations of the Neural Circuit for Locomotion in Lampreys

A neural network model for familiarity and context learning during honeybee foraging flights

Modeling Small-Target Motion Detector Neurons as Switched Systems with Dwell Time Constraints

The Effect of Proprioceptive Feedback on the Distribution of Sensory Information in a Model of an Undulatory Organism.