Abstract:Spiking neural network (SNN) is a brain-inspired model with more spatio-temporal information processing capacity and computational energy efficiency. However, with the increasing depth of SNNs, the memory problem caused by the weights of SNNs has gradually attracted attention. In this study, we propose an ultra-low latency adaptive local binary spiking neural network (ALBSNN) with accuracy loss estimators, which dynamically selects the network layers to be binarized to ensure a balance between quantization degree and classification accuracy by evaluating the error caused by the binarized weights during the network learning process. At the same time, to accelerate the training speed of the network, the global average pooling (GAP) layer is introduced to replace the fully connected layers by combining convolution and pooling. Finally, to further reduce the error caused by the binary weight, we propose binary weight optimization (BWO), which updates the overall weight by directly adjusting the binary weight. This method further reduces the loss of the network that reaches the training bottleneck. The combination of the above methods balances the network's quantization and recognition ability, enabling the network to maintain the recognition capability equivalent to the full precision network and reduce the storage space by more than 20%. So, SNNs can use a small number of time steps to obtain better recognition accuracy. In the extreme case of using only a one-time step, we still can achieve 93.39, 92.12, and 69.55% testing accuracy on three traditional static datasets, Fashion- MNIST, CIFAR-10, and CIFAR-100, respectively. At the same time, we evaluate our method on neuromorphic N-MNIST, CIFAR10-DVS, and IBM DVS128 Gesture datasets and achieve advanced accuracy in SNN with binary weights. Our network has greater advantages in terms of storage resources and training time.

Low-complex and Highly-performed Binary Residual Neural Network for Small-footprint Keyword Spotting

LWRN: Light-Weight Residual Network for Edge Detection

Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting

Small-footprint Keyword Spotting with Graph Convolutional Network

FPGA Implementation of Keyword Spotting System Using Depthwise Separable Binarized and Ternarized Neural Networks

Sparse Binarization for Fast Keyword Spotting

Hello Edge: Keyword Spotting on Microcontrollers

Broadcasted Residual Learning for Efficient Keyword Spotting

NS-KWS: joint optimization of near-sensor processing architecture and low-precision GRU for always-on keyword spotting

Depthwise Separable Convolutional ResNet with Squeeze-and-Excitation Blocks for Small-footprint Keyword Spotting

Hierarchical Neural Network Architecture In Keyword Spotting

Compact Feedforward Sequential Memory Networks For Small-Footprint Keyword Spotting

Sub-mW Keyword Spotting on an MCU: Analog Binary Feature Extraction and Binary Neural Networks

Frequency & Channel Attention Network for Small Footprint Noisy Spoken Keyword Spotting

Deep Spiking Neural Networks with Binary Weights for Object Recognition

Sub-bit Neural Networks: Learning to Compress and Accelerate Binary Neural Networks

Residual Quantization for Low Bit-Width Neural Networks.

Hardware Aware Training for Efficient Keyword Spotting on General Purpose and Specialized Hardware

DeltaKWS: A 65nm 36nJ/Decision Bio-inspired Temporal-Sparsity-Aware Digital Keyword Spotting IC with 0.6V Near-Threshold SRAM

ALBSNN: ultra-low latency adaptive local binary spiking neural network with accuracy loss estimator

Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting