Instant Image Denoising Plugin for ImageJ using Convolutional Neural Networks

Varun Mannam,Yide Zhang,Yinhao Zhu,Scott Howard
DOI: https://doi.org/10.1364/MICROSCOPY.2020.MW2A.3
2020-06-24
Abstract:We present a new convolutional neural network (CNN) based ImageJ plugin for fluorescence microscopy image denoising with an average improvement of 7.5 dB in peak signal-to-noise ratio (PSNR) and denoising instantly within 80 msec.
Image and Video Processing
What problem does this paper attempt to address?
This paper aims to solve the noise problem in fluorescence microscope imaging. Fluorescence microscopy technology has played an important role in modern biological research, but its imaging speed is limited by the signal - to - noise ratio (SNR). Traditional methods for improving the imaging SNR usually involve increasing the excitation light power or prolonging the pixel dwell time, exposure time, or reducing noise by averaging multiple images. However, these methods may not only cause sample damage but also are not suitable for real - time dynamic imaging. To overcome these limitations, the authors proposed a new algorithm based on convolutional neural network (CNN) for instant noise removal in fluorescence microscopic images. This algorithm not only improves the peak signal - to - noise ratio (PSNR) of the image but also significantly reduces the computation time. Specifically, the authors used a data set containing 12,000 fluorescence microscopic images with different noise levels to train a deep neural network (using the U - Net architecture). In this way, they developed an ImageJ plugin that can process the denoising task of any microscopic image almost in real - time, with an average PSNR improvement of 7.5 dB and extremely fast processing speed, only taking 80 milliseconds. In addition, the paper also compared the performance of this new method with traditional denoising methods (such as PURE - LET, VST + BM3D, VST + NLM, etc.). The results show that the new CNN denoising plugin performs better in terms of PSNR. This not only means that the image quality has been significantly improved, but also, due to its efficient computing power, enables effective denoising processing of images obtained at low laser power and high - speed acquisition rates, thus achieving a significant increase in the fluorescence microscopic imaging speed.