Content-Noise Complementary Learning for Medical Image Denoising

Mufeng Geng,Xiangxi Meng,Jiangyuan Yu,Lei Zhu,Lujia Jin,Zhe Jiang,Bin Qiu,Hui Li,Hanjing Kong,Jianmin Yuan,Kun Yang,Hongming Shan,Hongbin Han,Zhi Yang,Qiushi Ren,Yanye Lu
DOI: https://doi.org/10.1109/tmi.2021.3113365
IF: 10.6
2022-02-01
IEEE Transactions on Medical Imaging
Abstract:Medical imaging denoising faces great challenges, yet is in great demand. With its distinctive characteristics, medical imaging denoising in the image domain requires innovative deep learning strategies. In this study, we propose a simple yet effective strategy, the content-noise complementary learning (CNCL) strategy, in which two deep learning predictors are used to learn the respective content and noise of the image dataset complementarily. A medical image denoising pipeline based on the CNCL strategy is presented, and is implemented as a generative adversarial network, where various representative networks (including U-Net, DnCNN, and SRDenseNet) are investigated as the predictors. The performance of these implemented models has been validated on medical imaging datasets including CT, MR, and PET. The results show that this strategy outperforms state-of-the-art denoising algorithms in terms of visual quality and quantitative metrics, and the strategy demonstrates a robust generalization capability. These findings validate that this simple yet effective strategy demonstrates promising potential for medical image denoising tasks, which could exert a clinical impact in the future. Code is available at: https://github.com/gengmufeng/CNCL-denoising.
engineering, biomedical,imaging science & photographic technology, electrical & electronic,computer science, interdisciplinary applications,radiology, nuclear medicine & medical imaging
What problem does this paper attempt to address?
### Problems the paper attempts to solve This paper attempts to solve the problem of medical image denoising. Noise in medical imaging can interfere with disease diagnosis and affect subsequent clinical decisions. Therefore, it is very important to remove this noise to restore high - quality medical images. Specifically, the paper proposes a simple and effective strategy - Content - Noise Complementary Learning (CNCL) strategy for medical image denoising. ### Background and motivation 1. **Importance of medical imaging**: - Computed tomography (CT), magnetic resonance imaging (MR) and positron emission tomography (PET) are three commonly used medical imaging modalities in clinical diagnosis. - These imaging techniques provide high - resolution structural information (CT and MR) and metabolic and functional information (PET). 2. **Noise problems**: - Low - dose CT examinations reduce ionizing radiation exposure by reducing the tube current or shortening the exposure time of the X - ray tube, but this will lead to a decline in image quality. - MR examinations may cause anxiety in patients due to the narrow space and long - term acquisition process, especially for patients with claustrophobia. - PET scans hope to reconstruct perfect images with a small number of coincidence events, but this also introduces noise problems. 3. **Limitations of existing methods**: - Traditional image processing algorithms (such as non - local means method, block - matching 3D method and diffusion filter) can reduce noise, but will lead to over - smoothing of the image and residual errors. - Deep learning methods show superior capabilities in medical image denoising tasks, but most methods either directly learn the content image or the noise image, and both have their own advantages and disadvantages. ### Proposed method 1. **Content - Noise Complementary Learning (CNCL) strategy**: - This strategy uses two deep - learning predictors to learn the content and noise of the image respectively, and performs denoising in a complementary manner. - By combining the advantages of content learning and noise learning, the CNCL strategy can better preserve the structure and contrast details of the image while stably removing noise. 2. **Implementation framework**: - Implement the CNCL strategy based on the generative adversarial network (GAN) framework, and regard medical image denoising as an end - to - end task. - Select three classic convolutional neural networks (U - Net, DnCNN and SRDenseNet) as predictors in the generator part, and comprehensively evaluate their denoising performance. ### Experimental verification 1. **Data set**: - Verify the effectiveness of the CNCL strategy on three medical image data sets (CT, PET and MR). - Also verify it on a natural image data set (smartphone image denoising data set, SIDD). 2. **Experimental results**: - The results show that the CNCL strategy is superior to existing denoising algorithms in both visual quality and quantitative indicators. - This strategy shows strong generalization ability in dealing with different types of noise. ### Summary This paper proposes a new Content - Noise Complementary Learning (CNCL) strategy. By combining the advantages of content learning and noise learning, it effectively solves the problem of medical image denoising. The experimental results verify the superior performance of this strategy on multiple medical image data sets, showing its potential in clinical applications.