Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Review

Dan Zhang,Fangfang Zhou,Felix Albu,Yuanzhou Wei,Xiao Yang,Yuan Gu,Qiang Li
2024-03-25
Abstract:The advent of deep learning has brought a revolutionary transformation to image denoising techniques. However, the persistent challenge of acquiring noise-clean pairs for supervised methods in real-world scenarios remains formidable, necessitating the exploration of more practical self-supervised image denoising. This paper focuses on self-supervised image denoising methods that offer effective solutions to address this challenge. Our comprehensive review thoroughly analyzes the latest advancements in self-supervised image denoising approaches, categorizing them into three distinct classes: General methods, Blind Spot Network (BSN)-based methods, and Transformer-based methods. For each class, we provide a concise theoretical analysis along with their practical applications. To assess the effectiveness of these methods, we present both quantitative and qualitative experimental results on various datasets, utilizing classical algorithms as benchmarks. Additionally, we critically discuss the current limitations of these methods and propose promising directions for future research. By offering a detailed overview of recent developments in self-supervised image denoising, this review serves as an invaluable resource for researchers and practitioners in the field, facilitating a deeper understanding of this emerging domain and inspiring further advancements.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
### Problems the paper attempts to solve The paper aims to solve a persistent challenge in image denoising techniques: the difficulty of obtaining noisy - clean image pairs for training supervised methods in real - world scenarios. Since obtaining absolutely clean images is often impractical in real - world applications, self - supervised image denoising algorithms that do not require clean images are particularly important. This paper provides a valuable resource for researchers and practitioners by comprehensively reviewing self - supervised image denoising methods, classifying and analyzing the latest progress, and proposing possible directions for future research. Specifically, the paper mainly focuses on the following problems: 1. **Difficulty in obtaining noisy - clean image pairs**: - In practical applications, it is very difficult to obtain paired noisy images and their corresponding clean images because clean images are usually not easily accessible. This limits the scope of application of supervised learning methods. 2. **Classification and analysis of existing self - supervised image denoising methods**: - The paper divides self - supervised image denoising methods into three categories: general methods, blind - spot network (BSN) methods, and Transformer - based methods. Each method has its own unique theoretical basis and application scenarios. 3. **Evaluating the effectiveness of different methods**: - Through quantitative and qualitative experimental results, evaluate the performance of various self - supervised image denoising methods on different datasets, thereby providing references for practical applications. 4. **Discussing the limitations of current methods**: - Analyze in - depth the shortcomings of existing methods, such as dependence on noise models, requirements for computational resources, etc., and propose improvement suggestions. 5. **Future research directions**: - Based on the current research results, propose possible future research directions to promote the further development of the self - supervised image denoising field. Through the exploration of these problems, the paper not only provides researchers with an in - depth understanding of this field but also points out the direction for future innovation and development.