Incorporating the Image Formation Process into Deep Learning Improves Network Performance
Yue Li,Yijun Su,Min Guo,Xiaofei Han,Jiamin Liu,Harshad D. Vishwasrao,Xuesong Li,Ryan Christensen,Titas Sengupta,Mark W. Moyle,Ivan Rey-Suarez,Jiji Chen,Arpita Upadhyaya,Ted B. Usdin,Daniel Alfonso Colón-Ramos,Huafeng Liu,Yicong Wu,Hari Shroff
DOI: https://doi.org/10.1038/s41592-022-01652-7
IF: 48
2022-01-01
Nature Methods
Abstract:We present Richardson-Lucy network (RLN), a fast and lightweight deep learning method for three-dimensional fluorescence microscopy deconvolution. RLN combines the traditional Richardson-Lucy iteration with a fully convolutional network structure, establishing a connection to the image formation process and thereby improving network performance. Containing only roughly 16,000 parameters, RLN enables four- to 50-fold faster processing than purely data-driven networks with many more parameters. By visual and quantitative analysis, we show that RLN provides better deconvolution, better generalizability and fewer artifacts than other networks, especially along the axial dimension. RLN outperforms classic Richardson-Lucy deconvolution on volumes contaminated with severe out of focus fluorescence or noise and provides four- to sixfold faster reconstructions of large, cleared-tissue datasets than classic multi-view pipelines. We demonstrate RLN's performance on cells, tissues and embryos imaged with widefield-, light-sheet-, confocal- and super-resolution microscopy.