Abstract:Spiking neural networks (SNNs) have shown great potential in achieving high energy efficiency and low power consumption compared to artificial neural networks (ANNs). However, there remains a significant accuracy gap between SNNs and ANNs. To address this issue, we present an in-memory neuromorphic computing (IMNC) chip that supports hybrid spiking/artificial neural networks (S/ANNs) and sparsity-aware data flows. With the IMNC chip, we aim to improve inference accuracy while simultaneously achieving high energy efficiency through optimization at the algorithm, architecture, and circuit levels. First, at the algorithm level, we note that SNNs extract temporal features from input spikes using time-domain convolution operations. Based on this insight, we efficiently utilize leaky integrate (LI) neurons to hybridize SNNs and ANNs, thereby improving accuracy while maintaining highly sparse operations. Second, at the architecture level, we design a sparsity-aware architecture that supports a hybrid S/ANN topology with varying sparsity. Finally, at the circuit level, we propose a ring-based in-memory computing (IMC) macro, whose energy consumption is inversely proportional to the input sparsity, making it ideal for performing energy-efficient multiplication and accumulation (MAC) operations in both SNNs and ANNs. We evaluate the proposed hybrid S/ANNs on various classification tasks and demonstrate their stronger classification and generalization ability compared with pure SNNs. Notably, our IMNC chip, fabricated using 22 nm CMOS technology, achieves impressive measured accuracy rates of over 95% for voice activity detection (VAD) and ECG anomaly detection. Additionally, our IMNC chip demonstrates superior dynamic energy efficiency of 0.43 pJ per synaptic operation, outperforming related works.

Cases for Analog Mixed Signal Computing Integrated Circuits for Deep Neural Networks

Prospects for Analog Circuits in Deep Networks

Exploiting Inherent Error-Resiliency of Neuromorphic Computing to achieve Extreme Energy-Efficiency through Mixed-Signal Neurons

Analog circuits for mixed-signal neuromorphic computing architectures in 28 nm FD-SOI technology

A Hybrid Precision Low Power Computing-in-memory Architecture for Neural Networks

Containing Analog Data Deluge at Edge through Frequency-Domain Compression in Collaborative Compute-in-Memory Networks

Analog Deep Neural Network Based On Nor Flash Computing Array For High Speed/Energy Efficiency Computation

Processing Near Sensor Architecture in Mixed-Signal Domain with CMOS Image Sensor of Convolutional-Kernel-Readout Method

Special Topic on Nonvolatile Memory for Efficient Implementation of Neural/Neuromorphic Computing

An analog-AI chip for energy-efficient speech recognition and transcription

AnalogNAS: A Neural Network Design Framework for Accurate Inference with Analog In-Memory Computing

An Energy-Efficient Mixed-Signal Neuron for Inherently Error-Resilient Neuromorphic Systems

A Case for 3D Integrated System Design for Neuromorphic Computing & AI Applications

Sparsity-Aware In-Memory Neuromorphic Computing Unit With Configurable Topology of Hybrid Spiking and Artificial Neural Network

Advancing Neuromorphic Computing: Mixed-Signal Design Techniques Leveraging Brain Code Units and Fundamental Code Units

On the Accuracy of Analog Neural Network Inference Accelerators

Circuit and System Technologies for Energy-Efficient Edge Robotics

Dynamic Electro-Optic Analog Memory for Neuromorphic Photonic Computing

The Promise of Analog Deep Learning: Recent Advances, Challenges and Opportunities

An Analog-Memoryless Near Sensor Computing Architecture for Always-On Intelligent Perception Applications

Improving the accuracy of neural networks in analog computing-in-memory systems by analog weight.