Abstract:Ants are capable of learning long visually guided foraging routes with limited neural resources. The visual scene memory needed for this behaviour is mediated by the mushroom bodies; an insect brain region important for learning and memory. In a visual navigation context, the mushroom bodies are theorised to act as familiarity detectors, guiding ants to views that are similar to those previously learned when first travelling along a foraging route. Evidence from behavioural experiments, computational studies and brain lesions all support this idea. Here we further investigate the role of mushroom bodies in visual navigation with a spiking neural network model learning complex natural scenes. By implementing these networks in GeNN–a library for building GPU accelerated spiking neural networks–we were able to test these models offline on an image database representing navigation through a complex outdoor natural environment, and also online embodied on a robot. The mushroom body model successfully learnt a large series of visual scenes (400 scenes corresponding to a 27 m route) and used these memories to choose accurate heading directions during route recapitulation in both complex environments. Through analysing our model's Kenyon cell (KC) activity, we were able to demonstrate that KC activity is directly related to the respective novelty of input images. Through conducting a parameter search we found that there is a non-linear dependence between optimal KC to visual projection neuron (VPN) connection sparsity and the length of time the model is presented with an image stimulus. The parameter search also showed training the model on lower proportions of a route generally produced better accuracy when testing on the entire route. We embodied the mushroom body model and comparator visual navigation algorithms on a Quanser Q-car robot with all processing running on an Nvidia Jetson TX2. On a 6.5 m route, the mushroom body model had a mean distance to training route (error) of 0.144 ± 0.088 m over 5 trials, which was performance comparable to standard visual-only navigation algorithms. Thus, we have demonstrated that a biologically plausible model of the ant mushroom body can navigate complex environments both in simulation and the real world. Understanding the neural basis of this behaviour will provide insight into how neural circuits are tuned to rapidly learn behaviourally relevant information from complex environments and provide inspiration for creating bio-mimetic computer/robotic systems that can learn rapidly with low energy requirements.

Vision is not olfaction: impact on the insect Mushroom Bodies connectivity

Investigating visual navigation using spiking neural network models of the insect mushroom bodies

What do the mushroom bodies do for the insect brain? Twenty-five years of progress

Lateralised memory networks explain the use of higher-order visual features in navigating insects

Research on the Mushroom Body of Insects

Mushroom bodies modulate salience-based selective fixation behavior in Drosophila.

Sensory encoding and memory in the mushroom body: signals, noise, and variability

Mushroom Bodies Are Required for Learned Visual Navigation, but Not for Innate Visual Behavior, in Ants

Ground plan of the insect mushroom body: functional and evolutionary implications

Neural circuit mechanisms for transforming learned olfactory valences into wind-oriented movement

Beyond prediction error: 25 years of modeling the associations formed in the insect mushroom body

Vision Enhanced Neuro-Cognitive Structure for Robotic Spatial Cognition

A Simplified Computational Model of Mushroom Body for Tethered Bees' Abdominal Swing Behavior Induced by Optic Flow

Skewing information flow through pre- and postsynaptic plasticity in the mushroom bodies of Drosophila

Insect Behavior: Visual Cognition in Fruit Fly

Evolution of connectivity architecture in the Drosophila mushroom body

Gap junction networks in mushroom bodies participate in visual learning and memory in Drosophila

Spatial learning in feature-impoverished environments in Drosophila

Future avenues in Drosophila mushroom body research

Modality specific memory enhancement in butterflies

Functional architecture of reward learning in mushroom body extrinsic neurons of larval Drosophila