Abstract:<p>Machine learning is yielding unprecedented interest in research and industry, due to recent success in many applied contexts such as image classification and object recognition. However, the deployment of these systems requires huge computing capabilities, thus making them unsuitable for embedded systems. To deal with this limitation, many researchers are investigating brain-inspired computing, which would be a perfect alternative to the conventional Von Neumann architecture based computers (CPU/GPU) that meet the requirements for computing performance, but not for energy-efficiency. Therefore, neuromorphic hardware circuits that are adaptable for both parallel and distributed computations need to be designed. In this paper, we focus on Spiking Neural Networks (SNNs) with a comprehensive study of information coding methods and hardware exploration. In this context, we propose a framework for neuromorphic hardware design space exploration, which allows to define a suitable architecture based on application-specific constraints and starting from a wide variety of possible architectural choices. For this framework, we have developed a behavioral level simulator for neuromorphic hardware architectural exploration named NAXT. Moreover, we propose modified versions of the standard Rate Coding technique to make trade-offs with the Time Coding paradigm, which is characterized by the low number of spikes propagating in the network. Thus, we are able to reduce the number of spikes while keeping the same neuron's model, which results in an SNN with fewer events to process. By doing so, we seek to reduce the amount of power consumed by the hardware. Furthermore, we present three neuromorphic hardware architectures in order to quantitatively study the implementation of SNNs. One of these architectures integrates a novel hybrid structure: a highly-parallel computation core for most solicited layers, and time-multiplexed computation units for deeper layers. These architectures are derived from a novel funnel-like Design Space Exploration framework for neuromorphic hardware.</p>

jaxsnn: Event-driven Gradient Estimation for Analog Neuromorphic Hardware

SNNAX -- Spiking Neural Networks in JAX

Differentiable simulation enables large-scale training of detailed biophysical models of neural dynamics

Adaptive Smoothing Gradient Learning for Spiking Neural Networks.

DYNAP-SE2: a scalable multi-core dynamic neuromorphic asynchronous spiking neural network processor

DelGrad: Exact event-based gradients in spiking networks for training delays and weights

Scalable Event-by-event Processing of Neuromorphic Sensory Signals With Deep State-Space Models

Event-based backpropagation on the neuromorphic platform SpiNNaker2

Event-Driven Learning for Spiking Neural Networks

Design Space Exploration of Hardware Spiking Neurons for Embedded Artificial Intelligence

Spyx: A Library for Just-In-Time Compiled Optimization of Spiking Neural Networks

Scalable Event-Driven Native Parallel Processing

An Asynchronous Reconfigurable SNN Accelerator with Event-Driven Time Step Update

Compiling Spiking Neural Networks to Neuromorphic Hardware

Efficient Spike-Driven Learning With Dendritic Event-Based Processing

Gradient-descent hardware-aware training and deployment for mixed-signal Neuromorphic processors

Advancing Spatio-Temporal Processing in Spiking Neural Networks through Adaptation

NDOT: Neuronal Dynamics-based Online Training for Spiking Neural Networks

Direct Training of Hardware-Friendly Weight Binarized Spiking Neural Network with Surrogate Gradient Learning Towards Spatio-Temporal Event-Based Dynamic Data Recognition

The BrainScaleS-2 Accelerated Neuromorphic System With Hybrid Plasticity

Ultra-low Latency Spiking Neural Networks with Spatio-Temporal Compression and Synaptic Convolutional Block