Abstract:In recent times, the usage of modern neuromorphic hardware for brain-inspired SNNs has grown exponentially. In the context of sparse input data, they are undertaking low power consumption for event-based neuromorphic hardware, specifically in the deeper layers. However, using deep ANNs for training spiking models is still considered as a tedious task. Until recently, various ANN to SNN conversion methods in the literature have been proposed to train deep SNN models. Nevertheless, these methods require hundreds to thousands of time-steps for training and still cannot attain good SNN performance. This work proposes a customized model (VGG, ResNet) architecture to train deep convolutional spiking neural networks. In this current study, the training is carried out using deep convolutional spiking neural networks with surrogate gradient descent backpropagation in a customized layer architecture similar to deep artificial neural networks. Moreover, this work also proposes fewer time-steps for training SNNs with surrogate gradient descent. During the training with surrogate gradient descent backpropagation, overfitting problems have been encountered. To overcome these problems, this work refines the SNN based dropout technique with surrogate gradient descent. The proposed customized SNN models achieve good classification results on both private and public datasets. In this work, several experiments have been carried out on an embedded platform (NVIDIA JETSON TX2 board), where the deployment of customized SNN models has been extensively conducted. Performance validations have been carried out in terms of processing time and inference accuracy between PC and embedded platforms, showing that the proposed customized models and training techniques are feasible for achieving a better performance on various datasets such as CIFAR-10, MNIST, SVHN, and private KITTI and Korean License plate dataset.

Research on Binary NeuraI Network CIassification ModeIs Based on the PYNQ D eveIopment Board

Binary Neural Networks in FPGAs: Architectures, Tool Flows and Hardware Comparisons

Binary Neural Network with 16 Mb Rram Macro Chip for Classification and Online Training

A Fully Onchip Binarized Convolutional Neural Network FPGA Impelmentation with Accurate Inference.

Deep Spiking Convolutional Neural Networks for Programmable Neuro-synaptic System

A comprehensive review of Binary Neural Network

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

ALBSNN: ultra-low latency adaptive local binary spiking neural network with accuracy loss estimator

A New Hybrid Neural System Interfacing Neurons and Silicon Hardware for Fast Signal Recognition

Performance comparison of CNN, QNN and BNN deep neural networks for real-time object detection using ZYNQ FPGA node

Towards Accurate Binary Neural Networks via Modeling Contextual Dependencies.

An FPGA Implementation of Deep Spiking Neural Networks for Low-Power and Fast Classification

Rram-Based Binary Neural Networks Using Back-Propagation Learning

Improving energy efficiency and classification accuracy of neuromorphic chips by learning binary synaptic crossbars

Binary Convolutional Neural Network for Brain Computer Interfaces

NAS-BNN: Neural Architecture Search for Binary Neural Networks

A Power-Efficient and Re-Configurable Analog Artificial Neural Network Classifier

ANN vs SNN: A case study for Neural Decoding in Implantable Brain-Machine Interfaces

Deep Spiking Binary Neural Network for Digital Neuromorphic Hardware

NBSSN: A Neuromorphic Binary Single-Spike Neural Network for Efficient Edge Intelligence.

Exploring Optimized Spiking Neural Network Architectures for Classification Tasks on Embedded Platforms