Abstract:Imaging through scattering media is a challenging problem owing to speckle decorrelations from perturbations in the media itself. For in-line imaging modalities, which are appealing because they are compact, require no moving parts, and are robust, negating the effects of such scattering becomes particularly challenging. Here we explore the effect of stationary scattering media on light scattering in in-line geometries, including digital holographic microscopy. We consider various object-scatterer scenarios where the object is distorted or obscured by additional stationary scatterers, and use an advanced deep learning (DL) generative methodology, generative adversarial networks (GANs), to mitigate the effects of the additional scatterers. Using light scattering simulations and experiments on objects of interest with and without additional scatterers, we find that conditional GANs can be quickly trained with minuscule datasets and can also efficiently learn the one-to-one statistical mapping between the cross-domain input-output image pairs. Training such a network yields a standalone model, that can be used later to inverse or negate the effect of scattering, yielding clear object reconstructions for object retrieval and downstream processing. Moreover, it is well-known that the coherent point spread function (c-PSF) of a stationary scattering optical system is a speckle pattern which is spatially shift variant. We show that with rapid training using only 20 image pairs, it is possible to negate this undesired scattering to accurately localize diffraction-limited impulses with high spatial accuracy, therefore transforming the earlier shift variant system to a linear shift invariant (LSI) system.

Deep learning-based scattering removal of light field imaging

A Method Of 3d Light Field Imaging Through Single Layer Of Weak Scattering Media Based On Deep Learning

Enhanced Deep Learning Approach Based on the Deep Convolutional Encoder–Decoder Architecture for Electromagnetic Inverse Scattering Problems

3D Localization of Point Source Based on Light Field Imaging and Deep Learning

DeepLFM: Deep Learning-based 3D Reconstruction for Light Field Microscopy

Robust single-shot 3D fluorescence imaging in scattering media with a simulator-trained neural network

Deep learning for light scattering computation: Reconstructing light scattering fields from 1-D randomly rough surfaces as an example

Improved Scattering Autocorrelation Imaging Method Based on Deep Learning Denoising

Light Field Imaging: Models, Calibrations, Reconstructions, and Applications

Deep learning-assisted imaging through stationary scattering media

Dynamic Light Field Reconstruction Based on Gradient Descent Deep Equilibrium Model(Invited)

Light Field Reconstruction With A Hybrid Sparse Regularization-Pseudo 4dcnn Framework

Depth of Field Extended Scattering Imaging by Light Field Estimation

Non-Invasive Imaging Through Scattering Media Based on Deep Learning

A Diffuse Light Field Imaging Model for Forward-Scattering Photon-Coded Signal Retrieval

Imaging Through Dynamic Thick Scattering Media Based on Deep Learning

Three-Dimensional Measurement Method of Light Field Imaging Based on Deep Learning

Imaging through unknown scattering media based on physics-informed learning

Light Field Reconstruction Using Deep Convolutional Network On Epi

Image Reconstruction Through Dynamic Scattering Media Based on Deep Learning

Revisiting Light Field Rendering with Deep Anti-Aliasing Neural Network