Abstract:The brain-inspired Spiking neural networks (SNN) claim to present advantages for visual classification tasks in terms of energy efficiency and inherent robustness. In this work, we explore the impact on network inter-layer sparsity through neural coding schemes and the intrinsic structural parameters of Leaky Integrate-and-Fire (LIF) neurons, which can be a candidate metric for performance evaluation. Towards this, we perform a comparative study of four critical neural coding schemes: rate coding (poisson coding), latency coding, phase coding, and direct coding, as well as 6 LIF neuron intrinsic parameter options for a total of 24 combined parameter schemes. Specifically, the models were trained using a supervised training algorithm with a surrogate gradient, and two adversarial attacks, Fast Gradient Sign Method (FGSM) and Projected Gradient Descent (PGD) were applied on a CIFAR10 dataset. We identified the sources of interlayer sparsity in SNN, and quantitatively analyzed the differences in sparsity caused by coding schemes, neuron leakage factors and thresholds. Various aspects of network performance were thoroughly considered in this paper, including inference accuracy, adversarial robustness, and energy efficiency. Our results show that latency coding is the optimum choice in achieving the highest adversarial robustness and energy efficient against low intensity attacks, while rate coding offers the best adversarial robustness against medium and high intensity attacks. The maximum deviations of robustness and efficiency between different coding schemes are 9.35% in VGG5 and 13.59% in VGG9. Increasing the sparsity of spike activity by improving the threshold can bring a short-lived adversarial robustness sweet spot, while excessive sparsity due to changes in threshold and leakage can instead reduce the adversarial robustness. The study reveals the advantages and disadvantages, and design space of SNN in various dimensions, allowing researchers to frame their neuromorphic systems in terms of the coding methods, neuron inherent structure, and model learning capabilities.

Research on Validation of Visual Neural Encoding Methods Based on Biological Spike Signals

Research on Neural Encoding Models for Biological Vision: Progress and Challenges

Robust Transcoding Sensory Information with Neural Spikes

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Robust Decoding of Rich Dynamical Visual Scenes With Retinal Spikes

A Temporal Encoding Method Based on Expansion Representation

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Temporal Spiking Generative Adversarial Networks for Heading Direction Decoding

Spike Trains Encoding and Threshold Rescaling Method for Deep Spiking Neural Networks

A visual encoding model based on deep neural networks and transfer learning

A Visual Encoding Model Based on Deep Neural Networks and Transfer Learning for Brain Activity Measured by Functional Magnetic Resonance Imaging

Neural Decoding of Visual Information Across Different Neural Recording Modalities and Approaches

A Spike-Timing Based Integrated Model for Pattern Recognition

Reconstruction of natural visual scenes from neural spikes with deep neural networks

Towards the Next Generation of Retinal Neuroprosthesis: Visual Computation with Spikes

The brain-inspired decoder for natural visual image reconstruction

Decoding dynamic visual scenes across the brain hierarchy

GaborNet Visual Encoding: A Lightweight Region-Based Visual Encoding Model With Good Expressiveness and Biological Interpretability

Neural Encoding for Human Visual Cortex With Deep Neural Networks Learning “What” and “Where”

A Comparative Study on the Performance and Security Evaluation of Spiking Neural Networks

Reconstruction of Visual Image from Functional Magnetic Resonance Imaging Using Spiking Neuron Model