Abstract:Synaptic plasticity plays a critical role in the expression power of brain neural networks. Among diverse plasticity rules, synaptic scaling presents indispensable effects on homeostasis maintenance and synaptic strength regulation. In the current modeling of brain-inspired spiking neural networks (SNN), backpropagation through time is widely adopted because it can achieve high performance using a small number of time steps. Nevertheless, the synaptic scaling mechanism has not yet been well touched. In this work, we propose an experience-dependent adaptive synaptic scaling mechanism (AS-SNN) for spiking neural networks. The learning process has two stages: First, in the forward path, adaptive short-term potentiation or depression is triggered for each synapse according to afferent stimuli intensity accumulated by presynaptic historical neural activities. Second, in the backward path, long-term consolidation is executed through gradient signals regulated by the corresponding scaling factor. This mechanism shapes the pattern selectivity of synapses and the information transfer they mediate. We theoretically prove that the proposed adaptive synaptic scaling function follows a contraction map and finally converges to an expected fixed point, in accordance with state-of-the-art results in three tasks on perturbation resistance, continual learning, and graph learning. Specifically, for the perturbation resistance and continual learning tasks, our approach improves the accuracy on the N-MNIST benchmark over the baseline by 44% and 25%, respectively. An expected firing rate callback and sparse coding can be observed in graph learning. Extensive experiments on ablation study and cost evaluation evidence the effectiveness and efficiency of our nonparametric adaptive scaling method, which demonstrates the great potential of SNN in continual learning and robust learning.

Simulation, visualization and analysis tools for pattern recognition assessment with spiking neuronal networks

Pattern Recognition Computation in a Spiking Neural Network with Temporal Encoding and Learning

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

A Spike-Timing Based Integrated Model for Pattern Recognition

Spiking-timing based pattern recognition with real-world visual stimuli

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Learning Real-World Stimuli By Single-Spike Coding And Tempotron Rule

Oscillation-Driven Spike-Timing Dependent Plasticity Allows Multiple Overlapping Pattern Recognition in Inhibitory Interneuron Networks

Two-compartment neuronal spiking model expressing brain-state specific apical-amplification, -isolation and -drive regimes

Beyond spiking networks: The computational advantages of dendritic amplification and input segregation

Automated customization of large-scale spiking network models to neuronal population activity

Advanced Computing and Related Applications Leveraging Brain-inspired Spiking Neural Networks

A Simulation Software Tool for Cell-like Spiking Neural P Systems

Simulation of networks of spiking neurons: A review of tools and strategies

Dynamic Spatiotemporal Pattern Recognition with Recurrent Spiking Neural Network

Spatiotemporal Patterns in Neurobiology: An Overview for Future Artificial Intelligence

Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness

A framework for studying synaptic plasticity with neural spike train data

Pattern Recognition of a Spiking Neural Network Based on Visual Motion Model