Abstract:In recent times, the usage of modern neuromorphic hardware for brain-inspired SNNs has grown exponentially. In the context of sparse input data, they are undertaking low power consumption for event-based neuromorphic hardware, specifically in the deeper layers. However, using deep ANNs for training spiking models is still considered as a tedious task. Until recently, various ANN to SNN conversion methods in the literature have been proposed to train deep SNN models. Nevertheless, these methods require hundreds to thousands of time-steps for training and still cannot attain good SNN performance. This work proposes a customized model (VGG, ResNet) architecture to train deep convolutional spiking neural networks. In this current study, the training is carried out using deep convolutional spiking neural networks with surrogate gradient descent backpropagation in a customized layer architecture similar to deep artificial neural networks. Moreover, this work also proposes fewer time-steps for training SNNs with surrogate gradient descent. During the training with surrogate gradient descent backpropagation, overfitting problems have been encountered. To overcome these problems, this work refines the SNN based dropout technique with surrogate gradient descent. The proposed customized SNN models achieve good classification results on both private and public datasets. In this work, several experiments have been carried out on an embedded platform (NVIDIA JETSON TX2 board), where the deployment of customized SNN models has been extensively conducted. Performance validations have been carried out in terms of processing time and inference accuracy between PC and embedded platforms, showing that the proposed customized models and training techniques are feasible for achieving a better performance on various datasets such as CIFAR-10, MNIST, SVHN, and private KITTI and Korean License plate dataset.

Convolutional Spiking Neural Networks for Spatio-Temporal Feature Extraction

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Spiking Deep Residual Networks.

An Event-based Feature Representation Method for Event Stream Classification Using Deep Spiking Neural Networks

An Event-based Categorization Model Using Spatio-temporal Features in a Spiking Neural Network.

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

STSC-SNN: Spatio-Temporal Synaptic Connection with temporal convolution and attention for spiking neural networks

Spatial-Temporal Search for Spiking Neural Networks

Spiking Neural Network Recognition Method Based on Dynamic Visual Motion Features

Ultra-low Latency Spiking Neural Networks with Spatio-Temporal Compression and Synaptic Convolutional Block

A Hybrid Learning Framework for Deep Spiking Neural Networks with One-Spike Temporal Coding

CompSNN: A lightweight spiking neural network based on spatiotemporally compressive spike features

A frugal Spiking Neural Network for unsupervised classification of continuous multivariate temporal data

Spiking Neural Networks for event-based action recognition: A new task to understand their advantage

VTSNN: a virtual temporal spiking neural network

Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition

Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms