Abstract:Understanding the computational principles of the brain and replicating them on neuromorphic hardware and modern deep learning architectures is crucial for advancing neuro-inspired AI (NeuroAI). Here, we develop an experimentally-constrained biophysical network model of neocortical circuit motifs, focusing on layers 2-3 of the primary visual cortex (V1). We investigate the role of four major cortical interneuron classes in a competitive-cooperative computational primitive and validate these circuit motifs implemented soft winner-take-all (sWTA) computation for gain modulation, signal restoration, and context-dependent multistability. Using a novel parameter mapping technique, we configured IBM's TrueNorth (TN) chip to implement sWTA computations, mirroring biological neural dynamics. Retrospectively, we observed a strong correspondence between the biophysical model and the TN hardware parameters, particularly in the roles of four key inhibitory neuron classes: Parvalbumin (feedforward inhibition), Somatostatin (feedback inhibition), VIP (disinhibition), and LAMP5 (gain normalization). Moreover, the sparse coupling of this sWTA motif was also able to simulate a two-state neural state machine on the TN chip, replicating working memory dynamics essential for cognitive tasks. Additionally, integrating the sWTA computation as a pre-processing layer in the Vision Transformer (ViT) enhanced its performance on the MNIST digit classification task, demonstrating improved generalization to previously unseen data and suggesting a mechanism akin to zero-shot learning. Our approach provides a framework for translating brain-inspired computations to neuromorphic hardware, with potential applications on platforms like Intel's Loihi2 and IBM's Northpole. By integrating biophysically accurate models with neuromorphic hardware and advanced machine learning techniques, we offer a comprehensive roadmap for embedding neural computation into NeuroAI systems.

A VLSI Implementation of Novel Neural Computing Unit

Darwin:a Neuromorphic Hardware Co-Processor Based on Spiking Neural Networks

A Brain-Inspired In-Memory Computing System for Neuronal Communication Via Memristive Circuits.

Hardware Implementation of an Approximate Simplified Piecewise Linear Spiking Neuron

VLSI implementation of a neural network model

A New Hybrid Neural System Interfacing Neurons and Silicon Hardware for Fast Signal Recognition

Advances in Neuromorphic Computing: Expanding Horizons for AI Development through Novel Artificial Neurons and In-Sensor Computing

Low-Power Neuromorphic Hardware for Signal Processing Applications

Special Topic on Nonvolatile Memory for Efficient Implementation of Neural/Neuromorphic Computing

Design Proposal For A Chip Jointing Vlsi And Rat Spinal Cord Neurons On A Single Silicon Wafer

Modular Building Blocks for Mapping Spiking Neural Networks Onto a Programmable Neuromorphic Processor

Biologically Realistic Computational Primitives of Neocortex Implemented on Neuromorphic Hardware Improve Vision Transformer Performance

A Novel Solid Neuron-Network Chip Based on Both Biological and Artificial Neural Network Theories

UIC: A Unified and Scalable Chip Integrating Neuromorphic Computation and General Purpose Processor

A General Neural Computer Architecture and Its Ann-Based Task Assignment Method for Parallel Distributed Processing

A Versatile Neuromorphic System Based on Simple Neuron Model

A Survey on Neuromorphic Architectures for Running Artificial Intelligence Algorithms

A Power Efficient Hardware Implementation of the IF Neuron Model.

Sparsely-Connected Neural Networks: Towards Efficient VLSI Implementation of Deep Neural Networks

Towards Efficient Neural Networks On-a-chip: Joint Hardware-Algorithm Approaches

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware