Three-dimensional Residual Channel Attention Networks Denoise and Sharpen Fluorescence Microscopy Image Volumes

Jiji Chen,Hideki Sasaki,Hoyin Lai,Yijun Su,Jiamin Liu,Yicong Wu,Alexander Zhovmer,Christian A. Combs,Ivan Rey-Suarez,Hung-Yu Chang,Chi Chou Huang,Xuesong Li,Min Guo,Srineil Nizambad,Arpita Upadhyaya,Shih-Jong J. Lee,Luciano A. G. Lucas,Hari Shroff
DOI: https://doi.org/10.1038/s41592-021-01155-x
IF: 48
2021-01-01
Nature Methods
Abstract:We demonstrate residual channel attention networks (RCAN) for the restoration and enhancement of volumetric time-lapse (four-dimensional) fluorescence microscopy data. First we modify RCAN to handle image volumes, showing that our network enables denoising competitive with three other state-of-the-art neural networks. We use RCAN to restore noisy four-dimensional super-resolution data, enabling image capture of over tens of thousands of images (thousands of volumes) without apparent photobleaching. Second, using simulations we show that RCAN enables resolution enhancement equivalent to, or better than, other networks. Third, we exploit RCAN for denoising and resolution improvement in confocal microscopy, enabling ~2.5-fold lateral resolution enhancement using stimulated emission depletion microscopy ground truth. Fourth, we develop methods to improve spatial resolution in structured illumination microscopy using expansion microscopy data as ground truth, achieving improvements of ~1.9-fold laterally and ~3.6-fold axially. Finally, we characterize the limits of denoising and resolution enhancement, suggesting practical benchmarks for evaluation and further enhancement of network performance.
What problem does this paper attempt to address?