Abstract:SignificanceLensless digital inline holographic microscopy (LDIHM) is an emerging quantitative phase imaging modality that uses advanced computational methods for phase retrieval from the interference pattern. The existing end-to-end deep networks require a large training dataset with sufficient diversity to achieve high-fidelity hologram reconstruction. To mitigate this data requirement problem, physics-aware deep networks integrate the physics of holography in the loss function to reconstruct complex objects without needing prior training. However, the data fidelity term measures the data consistency with a single low-resolution hologram without any external regularization, which results in a low performance on complex biological data.AimWe aim to mitigate the challenges with trained and physics-aware untrained deep networks separately and combine the benefits of both methods for high-resolution phase recovery from a single low-resolution hologram in LDIHM.ApproachWe propose a hybrid deep framework (HDPhysNet) using a plug-and-play method that blends the benefits of trained and untrained deep models for phase recovery in LDIHM. The high-resolution phase is generated by a pre-trained high-definition generative adversarial network (HDGAN) from a single low-resolution hologram. The generated phase is then plugged into the loss function of a physics-aware untrained deep network to regulate the complex object reconstruction process.ResultsSimulation results show that the SSIM of the proposed method is increased by 0.07 over the trained and 0.04 over the untrained deep networks. The average phase-SNR is elevated by 8.2 dB over trained deep models and 9.8 dB over untrained deep networks on the experimental biological cells (cervical cells and red blood cells).ConclusionsWe showed improved performance of the HDPhysNet against the unknown perturbation in the imaging parameters such as the propagation distance, the wavelength of the illuminating source, and the imaging sample compared with the trained network (HDGAN). LDIHM, combined with HDPhysNet, is a portable and technology-driven microscopy best suited for point-of-care cytology applications.

Deep learning for lensless imaging

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Generative deep learning-enabled ultra-large field-of-view lens-free imaging

High-resolution lensless holographic microscopy using a physics-aware deep network

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

DeepLeMiN: Deep-learning-empowered Physics-aware Lensless Miniscope

Deep learning in biomedical optics

Lensless cameras using a mask based on almost perfect sequence through deep learning

Unsupervised Deep Learning Enables 3D Imaging for Single‐Shot Incoherent Holography

Lensless Phase Retrieval Based on Deep Learning Used in Holographic Data Storage

Automated phase reconstruction and super-resolution with deep learning in digital holography

Deep-Learning Computational Holography: A Review (Invited)

Deep DIH : Statistically Inferred Reconstruction of Digital In-Line Holography by Deep Learning

Deep learning-based image processing in optical microscopy

Deep learning in macroscopic diffuse optical imaging

Extended Depth-of-field in Holographic Imaging Using Deep-Learning-based Autofocusing and Phase Recovery

Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural network

Computational Imaging Of Label-Free Cells Using Lens-Less Digital Holography

Let There Be Light: Robust Lensless Imaging Under External Illumination With Deep Learning

Light Field Reconstruction via Deep Adaptive Fusion of Hybrid Lenses

Deep Camera Obscura: An Image Restoration Pipeline for Lensless Pinhole Photography