Abstract:Confocal microscopy is one of the most widely used tools for high-resolution cellular, tissue imaging and industrial inspection. Micrograph reconstruction based on deep learning has become an effective tool for modern microscopy imaging techniques. While most deep learning methods neglect the imaging process mechanism, which requires a lot of work to solve the multi-scale image pairs aliasing problem. We show that these limitations can be mitigated via an image degradation model based on Richards-Wolf vectorial diffraction integral and confocal imaging theory. The low-resolution images required for network training are generated by model degradation from their high-resolution counterparts, thereby eliminating the need for accurate image alignment. The image degradation model ensures the generalization and fidelity of the confocal images. By combining the residual neural network with a lightweight feature attention module with degradation model of confocal microscopy ensures high fidelity and generalization. Experiments on different measured data report that compared with the two deconvolution algorithms, non-negative least squares algorithm and Richardson-Lucy algorithm, the structural similarity index between the network output image and the real image reaches a high level above 0.82, and the peak signal-to-noise ratio can be improved by more than 0.6 dB. It also shows good applicability in different deep learning networks.

Deep Learning Facilitated Whole Live Cell Fast Super-Resolution Imaging

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Dynamic live-cell super-resolution imaging with parallelized fluorescence emission difference microscopy

In Vivo Light-Field Encoded Nano-Imaging in a Narrow Space

Single-frame Structured Illumination Microscopy for Fast Live-Cell Imaging

Real-Time Super-Resolution Imaging By High-Speed Fluorescence Emission Difference Microscopy

Three-dimensional super-resolution imaging of live whole cells using galvanometer-based structured illumination microscopy.

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Field-dependent deep learning enables high-throughput whole-cell 3D super-resolution imaging

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Fast imaging of 15 intracellular compartments and interactions by deep learning segmentation of super-resolution data

Evaluation and development of deep neural networks for image super-resolution in optical microscopy

Deep‐MSIM: Fast Image Reconstruction with Deep Learning in Multifocal Structured Illumination Microscopy

Alternative deep learning method for fast spatial-frequency shift imaging microscopy.

Deep-learning accelerated super-resolution radial fluctuations (SRRF) enables real-time live cell imaging

Deep Learning for Super-Resolution in a Field Emission Scanning Electron Microscope

Video-rate 3D imaging of living cells using Fourier view-channel-depth light field microscopy

Real-Time Resolution Enhancement of Confocal Laser Scanning Microscopy via Deep Learning

Deep Learning Enables Large Depth-of-Field Images for Sub-Diffraction-Limit Scanning Superlens Microscopy

Deep learning-enhanced fluorescence microscopy via confocal physical imaging model.

Faster super-resolution imaging with auto-correlation two-step deconvolution