Abstract:It is now known that the spiking neuron is a basic unit of spiking neural networks (SNNs). Spiking neurons modulate the nervous cells via receiving external incentives, generation of action potential and firing spikes. The SNNs usually used for pattern recognition tasks or complex computation depending on the brain-like characteristic. Although the SNNs have no advantages comparing with the deep neural networks in terms of classification accuracy, the SNNs have more characteristics of biological neurons. In this paper, a hierarchical SNN, comprising convolutional and pooling layers, is designed. The proposed SNN consists of excitatory and inhibitory neurons based on the mechanism of the primate brain. A temporal coding (rank order) manner is used to encode the input patterns. It depends on the rank of the spike arrival on post synapses to establish the priority of input spikes for a particular pattern. The spike-timing-dependent plasticity (STDP) learning rule is used in convolutional layers to extract visual features in an unsupervised learning manner. During the classification stage, a lateral inhibition mechanism is used to prevent the non-firing neurons and produce distinguishable results. In order to improve the performance of our SNN, an ensemble SNN architecture using the voting method is proposed, and transfer learning is used to avoid re-training the SNN when solving the different tasks. The hand-written digits classification task on MNIST, CIFAR-10, and BreaKHis databases are used to verify the performance of the proposed SNN. Experimental results show that by using the ensemble architecture and transfer learning, the classification accuracy of 99.27% for the MNIST database, overall accuracy is 93% for the CIFAR-10 database, and overall accuracy is 96.97% for BreaKHis database. In the meantime, this work achieves a better performance than the benchmarking approaches. Taken together, the results of our work suggest that the ensemble SNN architecture with transfer learning is key to improving the performance of the SNN.

Unsupervised Multi-layer Spiking Convolutional Neural Network Using Layer-Wise Sparse Coding.

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Spiking Deep Residual Networks.

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Spiking Inception Module For Multi-Layer Unsupervised Spiking Neural Networks

A Supervised Multi-Spike Learning Algorithm for Spiking Neural Networks

Effective Active Learning Method for Spiking Neural Networks.

Bio-Inspired Deep Spiking Neural Network For Image Classification

Training Deep Spiking Convolutional Neural Networks With STDP-Based Unsupervised Pre-training Followed by Supervised Fine-Tuning

Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition

An Ensemble Unsupervised Spiking Neural Network for Objective Recognition

Fast-Learning and High-Robustness Unsupervised Spiking Neural Networks with a Highly Parallel Inception-like Architecture

Efficient Deep Spiking Multilayer Perceptrons With Multiplication-Free Inference

High-parallelism Inception-like Spiking Neural Networks for Unsupervised Feature Learning

A Novel Multi-Type Image Coding Method Acting on Supervised Hierarchical Deep Spiking Convolutional Neural Networks for Image Classification

Convolutional Spiking Neural Networks for Spatio-Temporal Feature Extraction

Unsupervised Spiking Neural Network with Dynamic Learning of Inhibitory Neurons

An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections

Unsupervised Learning Based on Temporal Coding Using STDP in Spiking Neural Networks.