Abstract:Organizations managing high-performance computing systems face a multitude of challenges, including overarching concerns such as overall energy consumption, microprocessor clock frequency limitations, and the escalating costs associated with chip production. Evidently, processor speeds have plateaued over the last decade, persisting within the range of 2 GHz to 5 GHz. Scholars assert that brain-inspired computing holds substantial promise for mitigating these challenges. The spiking neural network (SNN) particularly stands out for its commendable power efficiency when juxtaposed with conventional design paradigms. Nevertheless, our scrutiny has brought to light several pivotal challenges impeding the seamless implementation of large-scale neural networks (NNs) on silicon. These challenges encompass the absence of automated tools, the need for multifaceted domain expertise, and the inadequacy of existing algorithms to efficiently partition and place extensive SNN computations onto hardware infrastructure. In this paper, we posit the development of an automated tool flow capable of transmuting any NN into an SNN. This undertaking involves the creation of a novel graph-partitioning algorithm designed to strategically place SNNs on a network-on-chip (NoC), thereby paving the way for future energy-efficient and high-performance computing paradigms. The presented methodology showcases its effectiveness by successfully transforming ANN architectures into SNNs with a marginal average error penalty of merely 2.65%. The proposed graph-partitioning algorithm enables a 14.22% decrease in inter-synaptic communication and an 87.58% reduction in intra-synaptic communication, on average, underscoring the effectiveness of the proposed algorithm in optimizing NN communication pathways. Compared to a baseline graph-partitioning algorithm, the proposed approach exhibits an average decrease of 79.74% in latency and a 14.67% reduction in energy consumption. Using existing NoC tools, the energy-latency product of SNN architectures is, on average, 82.71% lower than that of the baseline architectures.

Design of router for spiking neural networks

Mapping Very Large Scale Spiking Neuron Network to Neuromorphic Hardware.

Darwin:a Neuromorphic Hardware Co-Processor Based on Spiking Neural Networks

A Survey of Neuromorphic Computing Based on Spiking Neural Networks

An Efficient Software-Hardware Design Framework for Spiking Neural Network Systems

A Digital Neuromorphic Hardware for Spiking Neural Network

Low Cost Interconnected Architecture for the Hardware Spiking Neural Networks

Modelling Spiking Neural Network from the Architecture Evaluation Perspective

Spike Trains Encoding Optimization for Spiking Neural Networks Implementation in FPGA

Benchmarking Artificial Neural Network Architectures for High-Performance Spiking Neural Networks

A Mapping Model of SNNs to Neuromorphic Hardware

Modular Building Blocks for Mapping Spiking Neural Networks Onto a Programmable Neuromorphic Processor

A Hybrid-Mode On-Chip Router for the Large-Scale FPGA-Based Neuromorphic Platform

30.2 A 22nm 0.26nW/Synapse Spike-Driven Spiking Neural Network Processing Unit Using Time-Step-First Dataflow and Sparsity-Adaptive In-Memory Computing

A Spiking Neural Network Accelerator based on Ping-Pong Architecture with Sparse Spike and Weight

Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligence

NEXUS: A 28nm 3.3pJ/SOP 16-Core Spiking Neural Network with a Diamond Topology for Real-Time Data Processing

PT-Spike: A Precise-Time-Dependent Single Spike Neuromorphic Architecture with Efficient Supervised Learning

A 28-Nm 0.34-Pj/sop Spike-Based Neuromorphic Processor for Efficient Artificial Neural Network Implementations

A 5.3 pJ/Spike CMOS Neural Array Employing Time-Modulated Axon-Sharing and Background Mismatch Calibration Techniques

Mosaic: in-memory computing and routing for small-world spike-based neuromorphic systems