Abstract:U-Net, known for its simple yet efficient architecture, is widely utilized for image processing tasks and is particularly suitable for deployment on neuromorphic chips. This paper introduces the novel concept of Spiking-UNet for image processing, which combines the power of Spiking Neural Networks (SNNs) with the U-Net architecture. To achieve an efficient Spiking-UNet, we face two primary challenges: ensuring high-fidelity information propagation through the network via spikes and formulating an effective training strategy. To address the issue of information loss, we introduce multi-threshold spiking neurons, which improve the efficiency of information transmission within the Spiking-UNet. For the training strategy, we adopt a conversion and fine-tuning pipeline that leverage pre-trained U-Net models. During the conversion process, significant variability in data distribution across different parts is observed when utilizing skip connections. Therefore, we propose a connection-wise normalization method to prevent inaccurate firing rates. Furthermore, we adopt a flow-based training method to fine-tune the converted models, reducing time steps while preserving performance. Experimental results show that, on image segmentation and denoising, our Spiking-UNet achieves comparable performance to its non-spiking counterpart, surpassing existing SNN methods. Compared with the converted Spiking-UNet without fine-tuning, our Spiking-UNet reduces inference time by approximately 90\%. This research broadens the application scope of SNNs in image processing and is expected to inspire further exploration in the field of neuromorphic engineering. The code for our Spiking-UNet implementation is available at <a class="link-external link-https" href="https://github.com/SNNresearch/Spiking-UNet" rel="external noopener nofollow">this https URL</a>.

A Rapid and Precise Spiking Neural Network for Image Recognition

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

An Efficient Learning Algorithm for Direct Training Deep Spiking Neural Networks

Direct training high-performance spiking neural networks for object recognition and detection

Spiking Deep Residual Networks.

A Neurally Inspired Pattern Recognition Approach with Latency-Phase Encoding and Precise-Spike-driven Rule in Spiking Neural Network.

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Adaptive Multi-Level Firing for Direct Training Deep Spiking Neural Networks

Spiking Deep Convolutional Neural Networks for Energy-Efficient Object Recognition

Direct Training for Spiking Neural Networks: Faster, Larger, Better

Bio-Inspired Deep Spiking Neural Network For Image Classification

Advancing Spiking Neural Networks Toward Deep Residual Learning

A Novel Spiking Neural Network of Receptive Field Encoding with Groups of Neurons Decision

A Parallel Spiking Neural Network Based on Adaptive Lateral Inhibition Mechanism for Objective Recognition

A Scatter-and-Gather Spiking Convolutional Neural Network on a Reconfigurable Neuromorphic Hardware

Keys to Accurate Feature Extraction Using Residual Spiking Neural Networks

Deep Multi-Threshold Spiking-UNet for Image Processing

ACE-SNN: Algorithm-Hardware Co-design of Energy-Efficient & Low-Latency Deep Spiking Neural Networks for 3D Image Recognition

Enabling Deep Spiking Neural Networks with Hybrid Conversion and Spike Timing Dependent Backpropagation

Toward Scalable, Efficient, and Accurate Deep Spiking Neural Networks With Backward Residual Connections, Stochastic Softmax, and Hybridization

SpikeAtConv: An Integrated Spiking-Convolutional Attention Architecture for Energy-Efficient Neuromorphic Vision Processing