Abstract:The backpropagation algorithm has promoted the rapid development of deep learning, but it relies on a large amount of labeled data and still has a large gap with how humans learn. The human brain can quickly learn various conceptual knowledge in a self-organized and unsupervised manner, accomplished through coordinating various learning rules and structures in the human brain. Spike-timing-dependent plasticity (STDP) is a general learning rule in the brain, but spiking neural networks (SNNs) trained with STDP alone is inefficient and perform poorly. In this paper, taking inspiration from short-term synaptic plasticity, we design an adaptive synaptic filter and introduce the adaptive spiking threshold as the neuron plasticity to enrich the representation ability of SNNs. We also introduce an adaptive lateral inhibitory connection to adjust the spikes balance dynamically to help the network learn richer features. To speed up and stabilize the training of unsupervised spiking neural networks, we design a samples temporal batch STDP (STB-STDP), which updates weights based on multiple samples and moments. By integrating the above three adaptive mechanisms and STB-STDP, our model greatly accelerates the training of unsupervised spiking neural networks and improves the performance of unsupervised SNNs on complex tasks. Our model achieves the current state-of-the-art performance of unsupervised STDP-based SNNs in the MNIST and FashionMNIST datasets. Further, we tested on the more complex CIFAR10 dataset, and the results fully illustrate the superiority of our algorithm. Our model is also the first work to apply unsupervised STDP-based SNNs to CIFAR10. At the same time, in the small-sample learning scenario, it will far exceed the supervised ANN using the same structure.

Topological Representations of Heterogeneous Learning Dynamics of Recurrent Spiking Neural Networks

Heterogeneous Neuronal and Synaptic Dynamics for Spike-Efficient Unsupervised Learning: Theory and Design Principles

RSNN: Recurrent Spiking Neural Networks for Dynamic Spatial-Temporal Information Processing

Representation Learning using Event-based STDP

Characterization of Generalizability of Spike Timing Dependent Plasticity trained Spiking Neural Networks

Topological exploration of artificial neuronal network dynamics

Biologically Inspired Structure Learning with Reverse Knowledge Distillation for Spiking Neural Networks

Heterogeneous recurrent spiking neural network for spatio-temporal classification

An unsupervised STDP-based spiking neural network inspired by biologically plausible learning rules and connections

Spiking representation learning for associative memories

Exploiting Heterogeneity in Timescales for Sparse Recurrent Spiking Neural Networks for Energy-Efficient Edge Computing

Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

An STDP-Based Supervised Learning Algorithm for Spiking Neural Networks

Incorporating structural plasticity into self-organization recurrent networks for sequence learning

Unsupervised Learning Based on Temporal Coding Using STDP in Spiking Neural Networks.

Unveiling the Potential of Spiking Dynamics in Graph Representation Learning through Spatial-Temporal Normalization and Coding Strategies

Learning recurrent dynamics in spiking networks

Uncovering the Representation of Spiking Neural Networks Trained with Surrogate Gradient

Deep Unsupervised Learning Using Spike-Timing-Dependent Plasticity

MSTDP: A More Biologically Plausible Learning