Abstract:Since digital spiking signals can carry rich information and propagate with low computational consumption, spiking neural networks (SNNs) have received great attention from neuroscientists and are regarded as the future development object of neural networks. However, generating the appropriate spiking signals remains challenging, which is related to the dynamics property of neurons. Most existing studies imitate the biological neurons based on the correlation of synaptic input and output, but these models have only one time constant, thus ignoring the structural differentiation and versatility in biological neurons. In this article, we propose the reconstruction of adaptive leaky integrate-and-fire (R-ALIF) neuron to perform complex behaviors similar to real neurons. First, a synaptic cleft time constant is introduced into the membrane voltage charging equation to distinguish the leakage degree between the neuron membrane and the synaptic cleft, which can expand the representation space of spiking neurons to facilitate SNNs to obtain better information expression way. Second, R-ALIF constructs a voltage threshold adjustment equation to balance the firing rate of output signals. Third, three time constants are transformed into learnable parameters, enabling the adaptive adjustment of dynamics equation and enhancing the information expression ability of SNNs. Fourth, the computational graph of R-ALIF is optimized to improve the performance of SNNs. Moreover, we adopt a temporal dropout (TemDrop) method to solve the overfitting problem in SNNs and propose a data augmentation method for neuromorphic datasets. Finally, we evaluate our method on CIFAR10-DVS, ASL-DVS, and CIFAR-100, and achieve top1 accuracy of 81.0% , 99.8% , and 67.83% , respectively, with few time steps. We believe that our method will further promote the development of SNNs trained by spatiotemporal backpropagation (STBP).

A regenerating spiking neural network

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

Adaptive Smoothing Gradient Learning for Spiking Neural Networks.

Active Dendrites Enable Efficient Continual Learning in Time-To-First-Spike Neural Networks

ReSpawn: Energy-Efficient Fault-Tolerance for Spiking Neural Networks considering Unreliable Memories

Exploring Self-Repair in a Coupled Spiking Astrocyte Neural Network

Fault-Tolerant Neural Networks from Biological Error Correction Codes

Damage explains function in spiking neural networks representing central pattern generator

Evolving Self-Assembling Neural Networks: From Spontaneous Activity to Experience-Dependent Learning

Spiking recurrent neural networks for neuromorphic computing in nonlinear structural mechanics

Geometric algorithms for predicting resilience and recovering damage in neural networks

SpikingJET: Enhancing Fault Injection for Fully and Convolutional Spiking Neural Networks

Adaptive Reorganization of Neural Pathways for Continual Learning with Spiking Neural Networks

Advancing Spatio-Temporal Processing in Spiking Neural Networks through Adaptation

Vitality of Neural Networks under Reoccurring Catastrophic Failures

Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness

Reconstruction of Adaptive Leaky Integrate-and-Fire Neuron to Enhance the Spiking Neural Networks Performance by Establishing Complex Dynamics

Fault Tolerance Based on Neural Networks for the Intelligent Distributed Framework

Inherent Redundancy in Spiking Neural Networks

Artificial VO2 Spiking Neurons with Protective Mechanism for Enhancing Resilience of Spiking Neural Network Against Adversarial Attacks

Advancing Deep Residual Learning by Solving the Crux of Degradation in Spiking Neural Networks