Abstract:SignificanceLensless digital inline holographic microscopy (LDIHM) is an emerging quantitative phase imaging modality that uses advanced computational methods for phase retrieval from the interference pattern. The existing end-to-end deep networks require a large training dataset with sufficient diversity to achieve high-fidelity hologram reconstruction. To mitigate this data requirement problem, physics-aware deep networks integrate the physics of holography in the loss function to reconstruct complex objects without needing prior training. However, the data fidelity term measures the data consistency with a single low-resolution hologram without any external regularization, which results in a low performance on complex biological data.AimWe aim to mitigate the challenges with trained and physics-aware untrained deep networks separately and combine the benefits of both methods for high-resolution phase recovery from a single low-resolution hologram in LDIHM.ApproachWe propose a hybrid deep framework (HDPhysNet) using a plug-and-play method that blends the benefits of trained and untrained deep models for phase recovery in LDIHM. The high-resolution phase is generated by a pre-trained high-definition generative adversarial network (HDGAN) from a single low-resolution hologram. The generated phase is then plugged into the loss function of a physics-aware untrained deep network to regulate the complex object reconstruction process.ResultsSimulation results show that the SSIM of the proposed method is increased by 0.07 over the trained and 0.04 over the untrained deep networks. The average phase-SNR is elevated by 8.2 dB over trained deep models and 9.8 dB over untrained deep networks on the experimental biological cells (cervical cells and red blood cells).ConclusionsWe showed improved performance of the HDPhysNet against the unknown perturbation in the imaging parameters such as the propagation distance, the wavelength of the illuminating source, and the imaging sample compared with the trained network (HDGAN). LDIHM, combined with HDPhysNet, is a portable and technology-driven microscopy best suited for point-of-care cytology applications.

Automated phase reconstruction and super-resolution with deep learning in digital holography

Super-resolution digital holography by beam scanning

Single-exposure cepstrum phase-shifting in-line digital holography based on dual-CCD

Pixel Super-Resolution Phase Retrieval Algorithms for Digital Holography

Auto-focusing and extended depth-of-field holographic reconstruction using deep learning (Conference Presentation)

Holographic image reconstruction with phase recovery and autofocusing using recurrent neural networks

Phase-aberration compensation via deep learning in digital holographic microscopy

Phase Retrieval with Holography and Untrained Priors: Tackling the Challenges of Low-Photon Nanoscale Imaging

Deep DIH : Statistically Inferred Reconstruction of Digital In-Line Holography by Deep Learning

Extended Depth-of-field in Holographic Imaging Using Deep-Learning-based Autofocusing and Phase Recovery

Deep Neural Network-Based Phase-Recovery and Auto-Focusing Extend the Depth-of-Field in Digital Holography

OAH-Net: A Deep Neural Network for Hologram Reconstruction of Off-axis Digital Holographic Microscope

Fast phase retrieval in off-axis digital holographic microscopy through deep learning.

Single-shot reconstruction of three-dimensional morphology of biological cells in digital holographic microscopy using a physics-driven neural network

Plug-and-play pixel super-resolution phase retrieval for digital holography.

High-resolution lensless holographic microscopy using a physics-aware deep network

Deep Phase Shifter for Quantitative Phase Imaging

Deep learning-based quantitative phase microscopy

Amplitude/Phase Retrieval for Terahertz Holography With Supervised and Unsupervised Physics-Informed Deep Learning

Deep learning for lensless imaging

Unsupervised Deep Learning Enables 3D Imaging for Single‐Shot Incoherent Holography