Abstract:Understanding the computational principles of the brain and replicating them on neuromorphic hardware and modern deep learning architectures is crucial for advancing neuro-inspired AI (NeuroAI). Here, we develop an experimentally-constrained biophysical network model of neocortical circuit motifs, focusing on layers 2-3 of the primary visual cortex (V1). We investigate the role of four major cortical interneuron classes in a competitive-cooperative computational primitive and validate these circuit motifs implemented soft winner-take-all (sWTA) computation for gain modulation, signal restoration, and context-dependent multistability. Using a novel parameter mapping technique, we configured IBM's TrueNorth (TN) chip to implement sWTA computations, mirroring biological neural dynamics. Retrospectively, we observed a strong correspondence between the biophysical model and the TN hardware parameters, particularly in the roles of four key inhibitory neuron classes: Parvalbumin (feedforward inhibition), Somatostatin (feedback inhibition), VIP (disinhibition), and LAMP5 (gain normalization). Moreover, the sparse coupling of this sWTA motif was also able to simulate a two-state neural state machine on the TN chip, replicating working memory dynamics essential for cognitive tasks. Additionally, integrating the sWTA computation as a pre-processing layer in the Vision Transformer (ViT) enhanced its performance on the MNIST digit classification task, demonstrating improved generalization to previously unseen data and suggesting a mechanism akin to zero-shot learning. Our approach provides a framework for translating brain-inspired computations to neuromorphic hardware, with potential applications on platforms like Intel's Loihi2 and IBM's Northpole. By integrating biophysically accurate models with neuromorphic hardware and advanced machine learning techniques, we offer a comprehensive roadmap for embedding neural computation into NeuroAI systems.

Design and development of opto-neural processors for simulation of neural networks trained in image detection for potential implementation in hybrid robotics

Key Technologies and Progress of Precision Optogenetics

Optical Implementation of Neural Learning Algorithms Based on Cross-gain Modulation in a Semiconductor Optical Amplifier

A Spiking Neural Network Mimics the Oculomotor System to Control a Biomimetic Robotic Head without Learning on a Neuromorphic Hardware

Optoelectronic implementations of neural networks

The Neural Engine: A Reprogrammable Low Power Platform for Closed-Loop Optogenetics

Spatially Varying Nanophotonic Neural Networks

Electrophysiology-based Closed Loop Optogenetic Brain Stimulation Devices: Recent Developments and Future Prospects

Closed-Loop Optogenetic Brain Interface

Integrated optoelectronics for neural stimulation and recording in freely moving animals

Digital-analog hybrid matrix multiplication processor for optical neural networks

Real-Time Neural Signals Decoding onto Off-the-Shelf DSP Processors for Neuroprosthetic Applications

Wireless Optogenetic Nanonetworks: Device Model and Charging Protocols

Biologically Realistic Computational Primitives of Neocortex Implemented on Neuromorphic Hardware Improve Vision Transformer Performance

Active learning of neural population dynamics using two-photon holographic optogenetics

Experimentally realized in situ backpropagation for deep learning in photonic neural networks

Hybrid training of optical neural networks

Optical backpropagation training method and its applications

Efficient digital design of ganglion cells in the retinal pathway

Design and Control of a Photonic Neural Network Applied to High-Bandwidth Classification

A Closed-Loop Optogenetic Platform