Abstract:SignificanceLensless digital inline holographic microscopy (LDIHM) is an emerging quantitative phase imaging modality that uses advanced computational methods for phase retrieval from the interference pattern. The existing end-to-end deep networks require a large training dataset with sufficient diversity to achieve high-fidelity hologram reconstruction. To mitigate this data requirement problem, physics-aware deep networks integrate the physics of holography in the loss function to reconstruct complex objects without needing prior training. However, the data fidelity term measures the data consistency with a single low-resolution hologram without any external regularization, which results in a low performance on complex biological data.AimWe aim to mitigate the challenges with trained and physics-aware untrained deep networks separately and combine the benefits of both methods for high-resolution phase recovery from a single low-resolution hologram in LDIHM.ApproachWe propose a hybrid deep framework (HDPhysNet) using a plug-and-play method that blends the benefits of trained and untrained deep models for phase recovery in LDIHM. The high-resolution phase is generated by a pre-trained high-definition generative adversarial network (HDGAN) from a single low-resolution hologram. The generated phase is then plugged into the loss function of a physics-aware untrained deep network to regulate the complex object reconstruction process.ResultsSimulation results show that the SSIM of the proposed method is increased by 0.07 over the trained and 0.04 over the untrained deep networks. The average phase-SNR is elevated by 8.2 dB over trained deep models and 9.8 dB over untrained deep networks on the experimental biological cells (cervical cells and red blood cells).ConclusionsWe showed improved performance of the HDPhysNet against the unknown perturbation in the imaging parameters such as the propagation distance, the wavelength of the illuminating source, and the imaging sample compared with the trained network (HDGAN). LDIHM, combined with HDPhysNet, is a portable and technology-driven microscopy best suited for point-of-care cytology applications.

Image Enhancement in Lensless Inline Holographic Microscope by Inter-Modality Learning with Denoising Convolutional Neural Network

Learning a Model-Based Deep Hyperspectral Denoiser from a Single Noisy Hyperspectral Image.

High-resolution lensless holographic microscopy using a physics-aware deep network

OAH-Net: A Deep Neural Network for Hologram Reconstruction of Off-axis Digital Holographic Microscope

Single Infrared Image Enhancement Using a Deep Convolutional Neural Network

Self-Supervised Joint Learning for pCLE Image Denoising

Digital Inline Holographic Reconstruction with Learned Sparsifying Transform

Lensless Computational Imaging with a Hybrid Framework of Holographic Propagation and Deep Learning.

Deep Denoiser Prior Based Deep Analytic Network for Lensless Image Restoration.

Diffraction-Net: a Robust Single-Shot Holography for Multi-Distance Lensless Imaging.

Joint Contrast Enhancement and Noise Suppression of Low-light Images Via Deep Learning

Deep Learning-Based Denoising of Spatial Heterodyne Spectroscopy Interferograms Without Clear Images

Deep Learning Microscopy

DL-SI-DHM: a Deep Network Generating the High-Resolution Phase and Amplitude Images from Wide-Field Images.

Resolution and Contrast Enhancement for Lensless Digital Holographic Microscopy and Its Application in Biomedicine

Deep-Learning-Based Image Reconstruction and Enhancement in Optical Microscopy

Speckles-Training-Based Denoising Convolutional Neural Network Ghost Imaging

Fusion-Based Low-Light Image Enhancement

Lens-Free Imaging Method Based on Generative Adversarial Networks

Deep Multi-path Low-light Image Enhancement

High Bandwidth-Utilization Digital Holographic Reconstruction Using an Untrained Neural Network