Abstract:Plastic changes with intrinsic dynamics in synaptic efficacy underlie the cellular level of expression of brain functions regarding multimodal information processing. Among diverse plasticity mechanisms, synaptic scaling exerts indispensable effects on the homeostatic state maintenance and synaptic strength regulation in biological neural networks. Despite recent tremendous progress in developing spiking neural networks (SNNs) for multiple complex scenarios, most of the work remains in the pure backpropagation-based framework where the synaptic scaling mechanism is rarely effectively incorporated. In this work, we present a biologically inspired neuronal model with an activity-dependent adaptive synaptic scaling mechanism that endows each synapse with both short-term enhancement and depression properties. The learning process is completed in two phases. Firstly, in the forward conduction circuits, adaptive short-term enhancement or depression response is triggered in the light of afferent stimuli intensity; Then long-term consolidation is executed by back-propagated error signals. These processes dramatically shape the pattern selectivity of synapses and the diverse information transfer they mediate. Experiments reveal remarkable advantages in three tasks regarding bimodal learning. Specifically, On the continual learning and perturbation-resistant task for Dynamic Vision Sensor (DVS) modal information, our method improves the mean accuracy on the benchmark of N-MNIST dataset than the baseline by and , respectively. On sequence learning task for Active Pixel Sensor (APS) model information, our method improve the generalization capability and training stability by a large margin. These results demonstrate favourable effectiveness of such non-parametric adaptive strategy on bimodal information inference for APS and DVS, facilitating intelligence understanding and bio-inspired modelling.

Toward a Brain-Inspired Developmental Neural Network Based on Dendritic Spine Dynamics

Efficient Structure Slimming for Spiking Neural Networks

Biologically Inspired Structure Learning with Reverse Knowledge Distillation for Spiking Neural Networks

Developmental Plasticity-inspired Adaptive Pruning for Deep Spiking and Artificial Neural Networks

Flexible and Scalable Deep Dendritic Spiking Neural Networks with Multiple Nonlinear Branching

State Transition of Dendritic Spines Improves Learning of Sparse Spiking Neural Networks.

IM-LIF: Improved Neuronal Dynamics with Attention Mechanism for Direct Training Deep Spiking Neural Network

Neurogenesis Dynamics-inspired Spiking Neural Network Training Acceleration

Endowing Spiking Neural Networks with Homeostatic Adaptivity for APS-DVS Bimodal Scenarios

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness

Dynamic Sparse Graph for Efficient Deep Learning.

SRS-DNN: a Deep Neural Network with Strengthening Response Sparsity

Deep Network Regularization via Bayesian Inference of Synaptic Connectivity

Backpropagation with Sparsity Regularization for Spiking Neural Network Learning.

Learning Improvement of Spiking Neural Networks with Dynamic Adaptive Hyperparameter Neurons

Detection of Dendritic Spines Using Wavelet-Based Conditional Symmetric Analysis and Regularized Morphological Shared-Weight Neural Networks

Training Stronger Spiking Neural Networks with Biomimetic Adaptive Internal Association Neurons

Dendrites endow artificial neural networks with accurate, robust and parameter-efficient learning

Deep belief networks with self-adaptive sparsity

Biologically Inspired Dynamic Thresholds for Spiking Neural Networks