Abstract:Understanding the computational principles of the brain and replicating them on neuromorphic hardware and modern deep learning architectures is crucial for advancing neuro-inspired AI (NeuroAI). Here, we develop an experimentally-constrained biophysical network model of neocortical circuit motifs, focusing on layers 2-3 of the primary visual cortex (V1). We investigate the role of four major cortical interneuron classes in a competitive-cooperative computational primitive and validate these circuit motifs implemented soft winner-take-all (sWTA) computation for gain modulation, signal restoration, and context-dependent multistability. Using a novel parameter mapping technique, we configured IBM's TrueNorth (TN) chip to implement sWTA computations, mirroring biological neural dynamics. Retrospectively, we observed a strong correspondence between the biophysical model and the TN hardware parameters, particularly in the roles of four key inhibitory neuron classes: Parvalbumin (feedforward inhibition), Somatostatin (feedback inhibition), VIP (disinhibition), and LAMP5 (gain normalization). Moreover, the sparse coupling of this sWTA motif was also able to simulate a two-state neural state machine on the TN chip, replicating working memory dynamics essential for cognitive tasks. Additionally, integrating the sWTA computation as a pre-processing layer in the Vision Transformer (ViT) enhanced its performance on the MNIST digit classification task, demonstrating improved generalization to previously unseen data and suggesting a mechanism akin to zero-shot learning. Our approach provides a framework for translating brain-inspired computations to neuromorphic hardware, with potential applications on platforms like Intel's Loihi2 and IBM's Northpole. By integrating biophysically accurate models with neuromorphic hardware and advanced machine learning techniques, we offer a comprehensive roadmap for embedding neural computation into NeuroAI systems.

Artificial vision by multi-layered neural networks: neocognitron and its advances

Neocognitron: a self organizing neural network model for a mechanism of pattern recognition unaffected by shift in position

Neocognitron Incorporated with Evolutionary Computation

Add-if-Silent Rule for Training Multi-layered Convolutional Network Neocognitron

Vision Enhanced Neuro-Cognitive Structure for Robotic Spatial Cognition

A Neocognitron Based on Multi-objective Optimization for Few-Shot Learning

Seeing eye-to-eye? A comparison of object recognition performance in humans and deep convolutional neural networks under image manipulation

Deep neural networks: a new framework for modelling biological vision and brain information processing

Neuromorphic Artificial Vision Systems Based on Reconfigurable Ion‐Modulated Memtransistors

GA-based Supervised Learning of Neocognitron

Convolutional neural networks for vision neuroscience: significance, developments, and outstanding issues

Visualizing and Understanding Vision System

Human Eyes Inspired Recurrent Neural Networks are More Robust Against Adversarial Noises

A neural network model for selective attention in visual pattern recognition

Human Eyes-Inspired Recurrent Neural Networks Are More Robust Against Adversarial Noises

Multilayer Optoelectronic Hybrid Convolutional Neural Network with an Optical 4F-System Recurrent Structure

Biologically Realistic Computational Primitives of Neocortex Implemented on Neuromorphic Hardware Improve Vision Transformer Performance

Connectivity-Inspired Network for Context-Aware Recognition

Recurrent issues with deep neural networks of visual recognition

A Model of Invariant Object Recognition in the Visual System: Learning Rules, Activation Functions, Lateral Inhibition, and Information-Based Performance Measures

Broadband Visual Adaption and Image Recognition in a Monolithic Neuromorphic Machine Vision System