Abstract:Ants are capable of learning long visually guided foraging routes with limited neural resources. The visual scene memory needed for this behaviour is mediated by the mushroom bodies; an insect brain region important for learning and memory. In a visual navigation context, the mushroom bodies are theorised to act as familiarity detectors, guiding ants to views that are similar to those previously learned when first travelling along a foraging route. Evidence from behavioural experiments, computational studies and brain lesions all support this idea. Here we further investigate the role of mushroom bodies in visual navigation with a spiking neural network model learning complex natural scenes. By implementing these networks in GeNN–a library for building GPU accelerated spiking neural networks–we were able to test these models offline on an image database representing navigation through a complex outdoor natural environment, and also online embodied on a robot. The mushroom body model successfully learnt a large series of visual scenes (400 scenes corresponding to a 27 m route) and used these memories to choose accurate heading directions during route recapitulation in both complex environments. Through analysing our model's Kenyon cell (KC) activity, we were able to demonstrate that KC activity is directly related to the respective novelty of input images. Through conducting a parameter search we found that there is a non-linear dependence between optimal KC to visual projection neuron (VPN) connection sparsity and the length of time the model is presented with an image stimulus. The parameter search also showed training the model on lower proportions of a route generally produced better accuracy when testing on the entire route. We embodied the mushroom body model and comparator visual navigation algorithms on a Quanser Q-car robot with all processing running on an Nvidia Jetson TX2. On a 6.5 m route, the mushroom body model had a mean distance to training route (error) of 0.144 ± 0.088 m over 5 trials, which was performance comparable to standard visual-only navigation algorithms. Thus, we have demonstrated that a biologically plausible model of the ant mushroom body can navigate complex environments both in simulation and the real world. Understanding the neural basis of this behaviour will provide insight into how neural circuits are tuned to rapidly learn behaviourally relevant information from complex environments and provide inspiration for creating bio-mimetic computer/robotic systems that can learn rapidly with low energy requirements.

A Method for Visual Psychophysics based on the Navigational Behaviour of Desert Ants (Melophorus bagoti)

Is this scenery worth exploring? Insight into the visual encoding of navigating ants.

The role of learning-walk related multisensory experience in rewiring visual circuits in the desert ant brain

A comparative study of navigation behaviours in ants

Transcriptomic Signature of Spatial Navigation in Brains of Desert Ants

The Use of Edges in Visual Navigation by the Ant Leptothorax albipennis

Route Following Without Scanning

Neophobic response of bull ants (Myrmecia midas) to odours introduced on their foraging route

Route following by one-eyed ants suggests a revised model of normal route following

Ontogeny of learning walks and the acquisition of landmark information in desert ants, Cataglyphis fortis

Nest excavators' learning walks in the Australian desert ant Melophorus bagoti

Route Learning and Transport of Resources during Colony Relocation in Australian Desert Ants

Intricacies of running a route without success in night-active bull ants (Myrmecia midas)

Experience improves navigational knowledge of dumpers in desert ants (Melophorus bagoti)

Species-specific differences in the fine structure of learning walk elements in Cataglyphis ants

Varieties of visual navigation in insects

Lateralised memory networks explain the use of higher-order visual features in navigating insects

VidereX: A Navigational Application inspired by ants

Investigating visual navigation using spiking neural network models of the insect mushroom bodies

Importance of magnetic information for neuronal plasticity in desert ants

Mushroom Bodies Are Required for Learned Visual Navigation, but Not for Innate Visual Behavior, in Ants