Abstract:The past decade has witnessed transformative applications of deep learning in various computational imaging, sensing and microscopy tasks. Due to the supervised learning schemes employed, these methods mostly depend on large-scale, diverse, and labeled training data. The acquisition and preparation of such training image datasets are often laborious and costly, also leading to biased estimation and limited generalization to new sample types. Here, we report a self-supervised learning model, termed GedankenNet, that eliminates the need for labeled or experimental training data, and demonstrate its effectiveness and superior generalization on hologram reconstruction tasks. Without prior knowledge about the sample types to be imaged, the self-supervised learning model was trained using a physics-consistency loss and artificial random images that are synthetically generated without any experiments or resemblance to real-world samples. After its self-supervised training, GedankenNet successfully generalized to experimental holograms of various unseen biological samples, reconstructing the phase and amplitude images of different types of objects using experimentally acquired test holograms. Without access to experimental data or knowledge of real samples of interest or their spatial features, GedankenNet's self-supervised learning achieved complex-valued image reconstructions that are consistent with the Maxwell's equations, and its output inference and object solutions accurately represent the wave propagation in free-space. GedankenNet framework also exhibits resilience to random, unknown perturbations in the physical forward model, including changes in the hologram distances, pixel size and illumination wavelength. This self-supervised learning of image reconstruction tasks creates new opportunities for various inverse problems in holography, microscopy and computational imaging fields.

Unpaired Learning for Digital Holographic Reconstruction and Generation

Digital Holographic Reconstruction Based on Deep Learning Framework with Unpaired Data

Deep DIH : Statistically Inferred Reconstruction of Digital In-Line Holography by Deep Learning

Deep Learning-Based Holographic Reconstruction in Digital Holography

Unsupervised deep neural network for fast computer-generated holography with continuous depth control

Unsupervised Deep Learning Enables 3D Imaging for Single‐Shot Incoherent Holography

Phase Imaging for Digital Holography with Deep Learning

Deep-learning in Digital Holography with Imperfect Data

Robust Holographic Reconstruction by Deep Learning with One Frame

OAH-Net: A Deep Neural Network for Hologram Reconstruction of Off-axis Digital Holographic Microscope

Self-supervised learning of hologram reconstruction using physics consistency

High-speed Computer-Generated Holography Using an Autoencoder-Based Deep Neural Network

Application of Deep Learning in Digital Holographic Microscopy

High Bandwidth-Utilization Digital Holographic Reconstruction Using an Untrained Neural Network

High-fidelity, Model-Driven Deep Learning Network for Phase-Only Computer-Generated Holography (conference Presentation)

Enhancing Digital Hologram Reconstruction Using Reverse-Attention Loss for Untrained Physics-Driven Deep Learning Models with Uncertain Distance

Computer Holography Using Deep Neural Network with Fourier Basis.

Progress of the Computer-Generated Holography Based on Deep Learning

Generative adversarial neural network for 3D-hologram reconstruction

Generating high-quality phase-only holograms of binary images using global loss and stochastic homogenization training strategy

End-to-end learning of 3D phase-only holograms for holographic display