Abstract:Event-driven spiking neural networks (SNNs) have demonstrated significant potential for achieving high energy and area efficiency. However, existing SNN accelerators suffer from issues such as high latency and energy consumption due to serial accumulation-comparison operations. This is mainly because SNN neurons integrate spikes, accumulate membrane potential, and generate output spikes when the potential exceeds a threshold. To address this, one approach is to leverage the sparsity of SNN spikes to reduce the number of time steps. However, this method can result in imbalanced workloads among neurons and limit the utilization of processing elements (PEs). In this paper, we present SATO, a temporal-parallel SNN accelerator that enables parallel accumulation of membrane potential for all time steps. SATO adopts a two-stage pipeline methodology, effectively decoupling neuron computations. This not only maintains accuracy but also unveils opportunities for fine-grained parallelism. By dividing the neuron computation into distinct stages, SATO enables the concurrent execution of spike accumulation for each time step, leveraging the parallel processing capabilities of modern hardware architectures. This not only enhances the overall efficiency of the accelerator but also reduces latency by exploiting parallelism at a granular level. The architecture of SATO includes a novel binary adder-search tree for generating the output spike train, effectively decoupling the chronological dependence in the accumulation-comparison operation. Furthermore, SATO employs a bucket-sort-based method to evenly distribute compressed workloads to all PEs, maximizing data locality of input spike trains. Experimental results on various SNN models demonstrate that SATO outperforms the well-known accelerator, the 8-bit version of "Eyeriss" by 20.7× in terms of speedup and 6.0× energy-saving, on average. Compared to the state-of-the-art SNN accelerator "SpinalFlow", SATO can also achieve 4.6× performance gain and 3.1× energy reduction on average, which is quite impressive for inference.

Accurate and Energy-Efficient Implementation of Non-Linear Adder in Parallel Stochastic Computing Using Sorting Network

Efficient Non-Linear Adder for Stochastic Computing with Approximate Spatial-Temporal Sorting Network

When Sorting Network Meets Parallel Bitstreams: A Fault-Tolerant Parallel Ternary Neural Network Accelerator Based on Stochastic Computing.

Parallel Hybrid Stochastic-Binary-Based Neural Network Accelerators

Not Your Father’s Stochastic Computing (SC)! Efficient Yet Accurate End-to-End SC Accelerator Design

Efficient yet Accurate End-to-End SC Accelerator Design

Parallel Convolutional Neural Network (CNN) Accelerators Based on Stochastic Computing

A 28-Nm 198.9-TOPS/W Fault-Tolerant Stochastic Computing Neural Network Processor

Optimizing Stochastic Computing for Low Latency Inference of Convolutional Neural Networks

Accurate yet Efficient Stochastic Computing Neural Acceleration with High Precision Residual Fusion

An Energy-Efficient Mixed-Signal Parallel Multiply-Accumulate (MAC) Engine Based on Stochastic Computing

SC-DCNN: Highly-Scalable Deep Convolutional Neural Network using Stochastic Computing

Exploiting Temporal-Unrolled Parallelism for Energy-Efficient SNN Acceleration

Reconfigurable Spatial-Parallel Stochastic Computing for Accelerating Sparse Convolutional Neural Networks

Efficient Parallel Stochastic Computing Multiply-Accumulate (MAC) Technique Using Pseudo-Sobol Bit-Streams

Stochastic Computing Hardware Design and Optimization for Convolutional Neutral Networks

A Parallel Bitstream Generator for Stochastic Computing

Stochastic-Binary Hybrid Spatial Coding Multiplier for Convolutional Neural Network Accelerator

Hybrid Stochastic-Binary Computing for Low-Latency and High-Precision Inference of CNNs

A Survey of Stochastic Computing Neural Networks for Machine Learning Applications

An Energy-Efficient and Noise-Tolerant Recurrent Neural Network Using Stochastic Computing