Abstract:In recent times, the usage of modern neuromorphic hardware for brain-inspired SNNs has grown exponentially. In the context of sparse input data, they are undertaking low power consumption for event-based neuromorphic hardware, specifically in the deeper layers. However, using deep ANNs for training spiking models is still considered as a tedious task. Until recently, various ANN to SNN conversion methods in the literature have been proposed to train deep SNN models. Nevertheless, these methods require hundreds to thousands of time-steps for training and still cannot attain good SNN performance. This work proposes a customized model (VGG, ResNet) architecture to train deep convolutional spiking neural networks. In this current study, the training is carried out using deep convolutional spiking neural networks with surrogate gradient descent backpropagation in a customized layer architecture similar to deep artificial neural networks. Moreover, this work also proposes fewer time-steps for training SNNs with surrogate gradient descent. During the training with surrogate gradient descent backpropagation, overfitting problems have been encountered. To overcome these problems, this work refines the SNN based dropout technique with surrogate gradient descent. The proposed customized SNN models achieve good classification results on both private and public datasets. In this work, several experiments have been carried out on an embedded platform (NVIDIA JETSON TX2 board), where the deployment of customized SNN models has been extensively conducted. Performance validations have been carried out in terms of processing time and inference accuracy between PC and embedded platforms, showing that the proposed customized models and training techniques are feasible for achieving a better performance on various datasets such as CIFAR-10, MNIST, SVHN, and private KITTI and Korean License plate dataset.

Deep Convolutional Spiking Neural Networks for Image Classification

Bio-Inspired Deep Spiking Neural Network For Image Classification

Spiking Deep Residual Networks.

STDP and Competition Learning in Spiking Neural Networks and Its Application to Image Classification

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

High-performance deep spiking neural networks with 0.3 spikes per neuron

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Deep Spiking Neural Networks with Binary Weights for Object Recognition

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

Spiking VGG7: Deep Convolutional Spiking Neural Network with Direct Training for Object Recognition

RRAM-Based Spiking Neural Network with Target-Modulated Spike-Timing-Dependent Plasticity

Convolutional Spike Timing Dependent Plasticity based Feature Learning in Spiking Neural Networks

Unsupervised Multi-layer Spiking Convolutional Neural Network Using Layer-Wise Sparse Coding.

Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms

A Novel Multi-Type Image Coding Method Acting on Supervised Hierarchical Deep Spiking Convolutional Neural Networks for Image Classification

STDP-based Unsupervised Feature Learning using Convolution-over-time in Spiking Neural Networks for Energy-Efficient Neuromorphic Computing

Deep Spiking Neural Networks Based on STDP Rules for Image Recognition