Abstract:Denoising is one of the most significant procedures in the image processing pipeline. Nowadays, deep-learning-based algorithms have achieved superior denoising quality than traditional algorithms. However, the noise becomes severe in the dark environment, where even the SOTA algorithms fail to achieve satisfactory performance. Besides, the high computational complexity of deep-learning-based denoising algorithms makes them hardware unfriendly and difficult to process high-resolution images in real-time. To address these issues, a novel low-light RAW denoising algorithm Two-Stage-Denoising (TSDN), is proposed in this paper. In TSDN, denoising consists of two procedures: noise removal and image restoration. Firstly, in the noise-removal stage, most noise is removed from the image, and an intermediate image that is easier for the network to recover the clean image is obtained. Then, in the restoration stage, the clean image is restored from the intermediate image. The TSDN is designed to be light-weight for real-time and hardware friendly. However, the tiny network will be insufficient for satisfactory performance if directly trained from scratch. Therefore, we present an Expand-Shrink-Learning (ESL) method to train the TSDN. In the ESL method, firstly, the tiny network is expanded to a larger one with similar architecture but more channels and layers, which enhances the learning ability of the network because of more parameters. Secondly, the larger network is shrunk and restored to the original small network in fine-grained learning procedures, including Channel-Shrink-Learning (CSL) and Layer-Shrink-Learning (LSL). Experimental results demonstrate that the proposed TSDN achieves better performance (PSNR and SSIM) than other SOTA algorithms in the dark environment. Besides, the model size of TSDN is one-eighth of that of the U-Net for denoising (a classical denoising network).

Knowledge Distillation for U-Net Based Image Denoising

Dilated kernel prediction network for

DCCD: Reducing Neural Network Redundancy Via Distillation

Research on Knowledge Distillation Algorithm of Object Detection

QCGFNet: A Lightweight Color Image Denoising Network

Efficient Deep Image Denoising Via Class Specific Convolution

A Neural Network Based Low-Light Image Denoising Method

Dilated Residual Encode-Decode Networks for Image Denoising

A Model Compression Method Using Significant Data and Knowledge Distillation

Feature-Align Network with Knowledge Distillation for Efficient Denoising

On Compressing U-net Using Knowledge Distillation

Designing and training of a dual CNN for image denoising

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition

Joint Progressive Knowledge Distillation and Unsupervised Domain Adaptation

Analysis of Model Compression Using Knowledge Distillation

Knowledge Distillation: A Survey

Image denoising using deep CNN with batch renormalization

TSDN: Two-Stage Raw Denoising in the Dark.

Squeezing nnU-Nets with Knowledge Distillation for On-Board Cloud Detection

Pixel Distillation: Cost-flexible Distillation Across Image Sizes and Heterogeneous Networks

Attention-guided CNN for image denoising