Abstract:It is now known that the spiking neuron is a basic unit of spiking neural networks (SNNs). Spiking neurons modulate the nervous cells via receiving external incentives, generation of action potential and firing spikes. The SNNs usually used for pattern recognition tasks or complex computation depending on the brain-like characteristic. Although the SNNs have no advantages comparing with the deep neural networks in terms of classification accuracy, the SNNs have more characteristics of biological neurons. In this paper, a hierarchical SNN, comprising convolutional and pooling layers, is designed. The proposed SNN consists of excitatory and inhibitory neurons based on the mechanism of the primate brain. A temporal coding (rank order) manner is used to encode the input patterns. It depends on the rank of the spike arrival on post synapses to establish the priority of input spikes for a particular pattern. The spike-timing-dependent plasticity (STDP) learning rule is used in convolutional layers to extract visual features in an unsupervised learning manner. During the classification stage, a lateral inhibition mechanism is used to prevent the non-firing neurons and produce distinguishable results. In order to improve the performance of our SNN, an ensemble SNN architecture using the voting method is proposed, and transfer learning is used to avoid re-training the SNN when solving the different tasks. The hand-written digits classification task on MNIST, CIFAR-10, and BreaKHis databases are used to verify the performance of the proposed SNN. Experimental results show that by using the ensemble architecture and transfer learning, the classification accuracy of 99.27% for the MNIST database, overall accuracy is 93% for the CIFAR-10 database, and overall accuracy is 96.97% for BreaKHis database. In the meantime, this work achieves a better performance than the benchmarking approaches. Taken together, the results of our work suggest that the ensemble SNN architecture with transfer learning is key to improving the performance of the SNN.

Brain-inspired Hierarchical Spiking Neural Network Using Unsupervised STDP Rule for Image Classification

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections

Bio-Inspired Deep Spiking Neural Network For Image Classification

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Pattern Recognition of Spiking Neural Networks Based on Visual Mechanism and Supervised Synaptic Learning

An STDP-Based Supervised Learning Algorithm for Spiking Neural Networks

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Bio-inspired Model Based on Global-Local Hybrid Learning in Spiking Neural Network.

STDP and Competition Learning in Spiking Neural Networks and Its Application to Image Classification

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

An Ensemble Unsupervised Spiking Neural Network for Objective Recognition

High-parallelism Inception-like Spiking Neural Networks for Unsupervised Feature Learning

Pattern Recognition of a Spiking Neural Network Based on Visual Motion Model

Biologically Inspired Structure Learning with Reverse Knowledge Distillation for Spiking Neural Networks

An Unsupervised Spiking Deep Neural Network For Object Recognition

Image Recognition Based on Sparse Spike Neural Network

Fast Unsupervised Learning for Visual Pattern Recognition Using Spike Timing Dependent Plasticity.

Unsupervised Learning Based on Temporal Coding Using STDP in Spiking Neural Networks.

Training Deep Spiking Convolutional Neural Networks With STDP-Based Unsupervised Pre-training Followed by Supervised Fine-Tuning

Deep Spiking Neural Networks Based on STDP Rules for Image Recognition