Abstract:<p>Machine learning is yielding unprecedented interest in research and industry, due to recent success in many applied contexts such as image classification and object recognition. However, the deployment of these systems requires huge computing capabilities, thus making them unsuitable for embedded systems. To deal with this limitation, many researchers are investigating brain-inspired computing, which would be a perfect alternative to the conventional Von Neumann architecture based computers (CPU/GPU) that meet the requirements for computing performance, but not for energy-efficiency. Therefore, neuromorphic hardware circuits that are adaptable for both parallel and distributed computations need to be designed. In this paper, we focus on Spiking Neural Networks (SNNs) with a comprehensive study of information coding methods and hardware exploration. In this context, we propose a framework for neuromorphic hardware design space exploration, which allows to define a suitable architecture based on application-specific constraints and starting from a wide variety of possible architectural choices. For this framework, we have developed a behavioral level simulator for neuromorphic hardware architectural exploration named NAXT. Moreover, we propose modified versions of the standard Rate Coding technique to make trade-offs with the Time Coding paradigm, which is characterized by the low number of spikes propagating in the network. Thus, we are able to reduce the number of spikes while keeping the same neuron's model, which results in an SNN with fewer events to process. By doing so, we seek to reduce the amount of power consumed by the hardware. Furthermore, we present three neuromorphic hardware architectures in order to quantitatively study the implementation of SNNs. One of these architectures integrates a novel hybrid structure: a highly-parallel computation core for most solicited layers, and time-multiplexed computation units for deeper layers. These architectures are derived from a novel funnel-like Design Space Exploration framework for neuromorphic hardware.</p>

Sparsity-Aware Hardware-Software Co-Design of Spiking Neural Networks: An Overview

Darwin:a Neuromorphic Hardware Co-Processor Based on Spiking Neural Networks

Design Space Exploration of Sparsity-Aware Application-Specific Spiking Neural Network Accelerators

Recent Advances in Scalable Energy-Efficient and Trustworthy Spiking Neural networks: from Algorithms to Technology

A Sparsity-Adapted Hardware Implementation of SNN for Cortical Spike Trains Decoding

An Efficient Software-Hardware Design Framework for Spiking Neural Network Systems

Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligence

30.2 A 22nm 0.26nW/Synapse Spike-Driven Spiking Neural Network Processing Unit Using Time-Step-First Dataflow and Sparsity-Adaptive In-Memory Computing

To Spike or Not To Spike: A Digital Hardware Perspective on Deep Learning Acceleration

Exploring Neuromorphic Computing Based on Spiking Neural Networks: Algorithms to Hardware

Compiling Spiking Neural Networks to Neuromorphic Hardware

Advancements in Algorithms and Neuromorphic Hardware for Spiking Neural Networks

An Efficient Spiking Neural Network Accelerator with Sparse Weight.

PULSE: Parametric Hardware Units for Low-power Sparsity-Aware Convolution Engine

Hardware implementation of spiking neural networks on FPGA

ESSA: Design of a Programmable Efficient Sparse Spiking Neural Network Accelerator

Hardware-Software Co-optimised Fast and Accurate Deep Reconfigurable Spiking Inference Accelerator Architecture Design Methodology

A A 22nm 0.43pJ/SOP Sparsity-Aware In-Memory Neuromorphic Computing System with Hybrid Spiking and Artificial Neural Network and Configurable Topology

An Event-driven Spiking Neural Network Accelerator with On-chip Sparse Weight

Cerebron: A Reconfigurable Architecture for Spatiotemporal Sparse Spiking Neural Networks

Hardware Spiking Neural Networks with Pair-Based STDP Using Stochastic Computing