Abstract:Fruit flies are established model systems for studying olfactory learning as they will readily learn to associate odors with both electric shock or sugar rewards. The mechanisms of the insect brain apparently responsible for odor learning form a relatively shallow neuronal architecture. Olfactory inputs are received by the antennal lobe (AL) of the brain, which produces an encoding of each odor mixture across ~50 sub-units known as glomeruli. Each of these glomeruli then project its component of this feature vector to several of ~2000 so-called Kenyon Cells (KCs) in a region of the brain known as the mushroom body (MB). Fly responses to odors are generated by small downstream neuropils that decode the higher-order representation from the MB. Research has shown that there is no recognizable pattern in the glomeruli--KC connections (and thus the particular higher-order representations); they are akin to fingerprints~-- even isogenic flies have different projections. Leveraging insights from this architecture, we propose KCNet, a single-hidden-layer neural network that contains sparse, randomized, binary weights between the input layer and the hidden layer and analytically learned weights between the hidden layer and the output layer. Furthermore, we also propose a dynamic optimization algorithm that enables the KCNet to increase performance beyond its structural limits by searching a more efficient set of inputs. For odorant-perception tasks that predict perceptual properties of an odorant, we show that KCNet outperforms existing data-driven approaches, such as XGBoost. For image-classification tasks, KCNet achieves reasonable performance on benchmark datasets (MNIST, Fashion-MNIST, and EMNIST) without any data-augmentation methods or convolutional layers and shows particularly fast running time. Thus, neural networks inspired by the insect brain can be both economical and perform well.

Can a Fruit Fly Learn Word Embeddings?

Algorithmic insights on continual learning from fruit flies

Insect Behavior: Visual Cognition in Fruit Fly

Learning Sparse Representations for Fruit-Fly Gene Expression Pattern Image Annotation and Retrieval

Learning sparsity in reservoir computing through a novel bio-inspired algorithm

Future avenues in Drosophila mushroom body research

An Insect-Inspired Randomly, Weighted Neural Network with Random Fourier Features For Neuro-Symbolic Relational Learning

KCNet: An Insect-Inspired Single-Hidden-Layer Neural Network with Randomized Binary Weights for Prediction and Classification Tasks

Mushroom bodies modulate salience-based selective fixation behavior in Drosophila.

A computational model of conditioning inspired by Drosophila olfactory system

The fly connectome reveals a path to the effectome

Functional architecture of reward learning in mushroom body extrinsic neurons of larval Drosophila

Inferring community architectures of multisensory pathways in Drosophila via unsupervised network embedding

A neural network model for familiarity and context learning during honeybee foraging flights

Reducing Catastrophic Forgetting With Associative Learning: A Lesson From Fruit Flies

Whole-body simulation of realistic fruit fly locomotion with deep reinforcement learning

A series of methods incorporating deep learning and computer vision techniques in the study of fruit fly (Diptera: Tephritidae) regurgitation

A Drosophila computational brain model reveals sensorimotor processing

Imposing Connectome-Derived Topology on an Echo State Network

Gap junction networks in mushroom bodies participate in visual learning and memory in Drosophila

Semantic projection: recovering human knowledge of multiple, distinct object features from word embeddings