Abstract:The application of machine learning in wavefront reconstruction has brought great benefits to real-time, non-invasive, deep tissue imaging in biomedical research. However, due to the diversity and heterogeneity of biological tissues, it is difficult to train the dataset with a unified model. In general, the utilization of some unified models will result in the specific sample falling outside the training set, leading to low accuracy of the machine learning model in some real applications. This paper proposes a sensorless wavefront reconstruction method based on transfer learning to overcome the domain shift introduced by the difference between the training set and the target test set. We build a weights-sharing two-stream convolutional neural network (CNN) framework for the prediction of Zernike coefficient, in which a large number of labeled randomly generated samples serve as the source-domain data and the unlabeled specific samples serve as the target-domain data at the same time. By training on massive labeled simulated data with domain adaptation to unlabeled target-domain data, the network shows better performance on the target tissue samples. Experimental results show that the accuracy of the proposed method is 18.5% higher than that of conventional CNN-based method and the peak intensities of the point spread function (PSF) are more than 20% higher with almost the same training time and processing time. The better compensation performance on target sample could have more advantages when handling complex aberrations, especially the aberrations caused by various histological characteristics, such as refractive index inhomogeneity and biological motion in biological tissues.

Cross-modality deep learning brings bright-field microscopy contrast to holography

Bright-field holography: cross-modality deep learning enables snapshot 3D imaging with bright-field contrast using a single hologram

Deep Learning Colorful Ptychographic Iterative Engine Lens-Less Diffraction Microscopy

Single-shot Autofocusing in Light Sheet Fluorescence Microscopy with Multiplexed Structured Illumination and Deep Learning

Deep Learning Virtual Colorization Overcoming Chromatic Aberrations in Singlet Lens Microscopy

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Deep learning-based color holographic microscopy

Deep learning enables cross-modality super-resolution in fluorescence microscopy

Multicolor localization microscopy by deep learning

Enhancing fluorescence microscopy performance with Richardson-Lucy based deep learning

Auto-focusing and extended depth-of-field holographic reconstruction using deep learning (Conference Presentation)

Extended Depth-of-field in Holographic Imaging Using Deep-Learning-based Autofocusing and Phase Recovery

Deep learning-based holographic polarization microscopy

Deep Learning Microscopy

Deep learning-assisted light sheet holography

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Deep learning-based aberration compensation improves contrast and resolution in fluorescence microscopy

Deep-learning-enhanced light-field microscopy

OAH-Net: A Deep Neural Network for Hologram Reconstruction of Off-axis Digital Holographic Microscope

Deep learning-enhanced fluorescence microscopy via confocal physical imaging model.

Illumination Pattern Design with Deep Learning for Single-Shot Fourier Ptychographic Microscopy