Abstract:The application of machine learning in wavefront reconstruction has brought great benefits to real-time, non-invasive, deep tissue imaging in biomedical research. However, due to the diversity and heterogeneity of biological tissues, it is difficult to train the dataset with a unified model. In general, the utilization of some unified models will result in the specific sample falling outside the training set, leading to low accuracy of the machine learning model in some real applications. This paper proposes a sensorless wavefront reconstruction method based on transfer learning to overcome the domain shift introduced by the difference between the training set and the target test set. We build a weights-sharing two-stream convolutional neural network (CNN) framework for the prediction of Zernike coefficient, in which a large number of labeled randomly generated samples serve as the source-domain data and the unlabeled specific samples serve as the target-domain data at the same time. By training on massive labeled simulated data with domain adaptation to unlabeled target-domain data, the network shows better performance on the target tissue samples. Experimental results show that the accuracy of the proposed method is 18.5% higher than that of conventional CNN-based method and the peak intensities of the point spread function (PSF) are more than 20% higher with almost the same training time and processing time. The better compensation performance on target sample could have more advantages when handling complex aberrations, especially the aberrations caused by various histological characteristics, such as refractive index inhomogeneity and biological motion in biological tissues.

Exit Wavefunction Reconstruction from Single Transmission Electron Micrographs with Deep Learning

Exit-wave Phase Retrieval from a Single High-Resolution Transmission Electron Microscopy Image of a Weak-Phase Object

Optimal Phase Mask Design for Coherent Modulation Imaging by Deep Learning

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Disentangling multiple scattering with deep learning: application to strain mapping from electron diffraction patterns

Exit Wave Function Reconstruction from Two Defocus Images Using Neural Network.

Deep Learning Segmentation of Complex Features in Atomic-Resolution Phase Contrast Transmission Electron Microscopy Images

Deep-learning real-time phase retrieval of imperfect diffraction patterns from X-ray free-electron lasers

Partial Scanning Transmission Electron Microscopy with Deep Learning

Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations

An Improved Iterative Wave Function Reconstruction Algorithm in High-Resolution Transmission Electron Microscopy.

Reconstruction of 3-D Atomic Distortions from Electron Microscopy with Deep Learning.

Phase division and recognition of crystal HRTEM images based on machine learning and deep learning

Deep Learning for Atomically Resolved Imaging

Deep convolutional neural networks to restore single-shot electron microscopy images

Deep Learning-Based Subdivision Approach for Large Scale Macromolecules Structure Recovery from Electron Cryo Tomograms

Exit wave reconstruction of a focal series of images with structural changes in high‐resolution transmission electron microscopy

Deep Learning Analysis of Defect and Phase Evolution During Electron Beam Induced Transformations in WS2

Phase Identification in Synchrotron X-ray Diffraction Patterns of Ti–6Al–4V Using Computer Vision and Deep Learning

Real-time 3D Nanoscale Coherent Imaging via Physics-aware Deep Learning