Abstract:U-Net, known for its simple yet efficient architecture, is widely utilized for image processing tasks and is particularly suitable for deployment on neuromorphic chips. This paper introduces the novel concept of Spiking-UNet for image processing, which combines the power of Spiking Neural Networks (SNNs) with the U-Net architecture. To achieve an efficient Spiking-UNet, we face two primary challenges: ensuring high-fidelity information propagation through the network via spikes and formulating an effective training strategy. To address the issue of information loss, we introduce multi-threshold spiking neurons, which improve the efficiency of information transmission within the Spiking-UNet. For the training strategy, we adopt a conversion and fine-tuning pipeline that leverage pre-trained U-Net models. During the conversion process, significant variability in data distribution across different parts is observed when utilizing skip connections. Therefore, we propose a connection-wise normalization method to prevent inaccurate firing rates. Furthermore, we adopt a flow-based training method to fine-tune the converted models, reducing time steps while preserving performance. Experimental results show that, on image segmentation and denoising, our Spiking-UNet achieves comparable performance to its non-spiking counterpart, surpassing existing SNN methods. Compared with the converted Spiking-UNet without fine-tuning, our Spiking-UNet reduces inference time by approximately 90\%. This research broadens the application scope of SNNs in image processing and is expected to inspire further exploration in the field of neuromorphic engineering. The code for our Spiking-UNet implementation is available at <a class="link-external link-https" href="https://github.com/SNNresearch/Spiking-UNet" rel="external noopener nofollow">this https URL</a>.

U-Nets as Belief Propagation: Efficient Classification, Denoising, and Diffusion in Generative Hierarchical Models

Rethinking Performance Gains in Image Dehazing Networks

U-Net-Based Multispectral Image Generation from an RGB Image

FreeU: Free Lunch in Diffusion U-Net

A Unified Framework for U-Net Design and Analysis

A Mathematical Explanation of UNet

Hierarchical Gate Network for Fine-Grained Visual Recognition.

3D U$$^$$-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation

Deep Multi-Threshold Spiking-UNet for Image Processing

Spatial-Frequency U-Net for Denoising Diffusion Probabilistic Models

A U-Net Based Discriminator for Generative Adversarial Networks

A Closer Look at U-net for Road Detection

U-Net and its variants for medical image segmentation: theory and applications

Factorized Diffusion Architectures for Unsupervised Image Generation and Segmentation

A Fast Learning Algorithm for Deep Belief Nets

Deep Networks as Denoising Algorithms: Sample-Efficient Learning of Diffusion Models in High-Dimensional Graphical Models

The Missing U for Efficient Diffusion Models

MAgNET: A Graph U-Net Architecture for Mesh-Based Simulations

U2Net: A General Framework with Spatial-Spectral-Integrated Double U-Net for Image Fusion

I2U-Net: A dual-path U-Net with rich information interaction for medical image segmentation

UniNet: Unified Architecture Search with Convolution, Transformer, and MLP