Abstract:Fruit flies are established model systems for studying olfactory learning as they will readily learn to associate odors with both electric shock or sugar rewards. The mechanisms of the insect brain apparently responsible for odor learning form a relatively shallow neuronal architecture. Olfactory inputs are received by the antennal lobe (AL) of the brain, which produces an encoding of each odor mixture across ~50 sub-units known as glomeruli. Each of these glomeruli then project its component of this feature vector to several of ~2000 so-called Kenyon Cells (KCs) in a region of the brain known as the mushroom body (MB). Fly responses to odors are generated by small downstream neuropils that decode the higher-order representation from the MB. Research has shown that there is no recognizable pattern in the glomeruli--KC connections (and thus the particular higher-order representations); they are akin to fingerprints~-- even isogenic flies have different projections. Leveraging insights from this architecture, we propose KCNet, a single-hidden-layer neural network that contains sparse, randomized, binary weights between the input layer and the hidden layer and analytically learned weights between the hidden layer and the output layer. Furthermore, we also propose a dynamic optimization algorithm that enables the KCNet to increase performance beyond its structural limits by searching a more efficient set of inputs. For odorant-perception tasks that predict perceptual properties of an odorant, we show that KCNet outperforms existing data-driven approaches, such as XGBoost. For image-classification tasks, KCNet achieves reasonable performance on benchmark datasets (MNIST, Fashion-MNIST, and EMNIST) without any data-augmentation methods or convolutional layers and shows particularly fast running time. Thus, neural networks inspired by the insect brain can be both economical and perform well.

KCNet: An Insect-Inspired Single-Hidden-Layer Neural Network with Randomized Binary Weights for Prediction and Classification Tasks

Odor Recognition with a Spiking Neural Network for Bioelectronic Nose

Putting a bug in ML: The moth olfactory network learns to read MNIST

Multilayer Perceptron Classification of Unknown Volatile Chemicals from the Firing Rates of Insect Olfactory Sensory Neurons and Its Application to Biosensor Design

Biological Mechanisms for Learning: A Computational Model of Olfactory Learning in the Manduca sexta Moth, with Applications to Neural Nets

Design Principles of the Sparse Coding Network and the Role of "sister Cells" in the Olfactory System of Drosophila.

An Insect-Inspired Randomly, Weighted Neural Network with Random Fourier Features For Neuro-Symbolic Relational Learning

Effective Insect Recognition Using a Stacked Autoencoder with Maximum Correntropy Criterion

Insect cyborgs: Bio-mimetic feature generators improve machine learning accuracy on limited data

A descriptive analysis of olfactory sensation and memory in Drosophila and its relation to artificial neural networks

An Artificial Neural Network for Image Classification Inspired by the Aversive Olfactory Learning Neural Circuit in Caenorhabditis elegans

A computational model of conditioning inspired by Drosophila olfactory system

An Artificial Neural Network for Image Classification Inspired by Aversive Olfactory Learning Circuits in Caenorhabditis Elegans

Effect of Circuit Structure on Odor Representation in the Insect Olfactory System

Exploring a Mathematical Model of Gain Control via Lateral Inhibition in the Antennal Lobe

Algorithmic insights on continual learning from fruit flies

Application of a Brain-Inspired Spiking Neural Network Architecture to Odor Data Classification

Beetle Antennae Search: Using Biomimetic Foraging Behaviour of Beetles to Fool a Well-Trained Neuro-Intelligent System

Odor Pattern Recognition of a Novel Bio-Inspired Olfactory Neural Network Based on Kernel Clustering

Normative and mechanistic model of an adaptive circuit for efficient encoding and feature extraction

A Novel Neural Network Classifier Using Beetle Antennae Search Algorithm for Pattern Classification