Abstract:Recently deep neural networks (DNNs) have been successfully introduced to the field of lensless imaging through scattering media. By solving an inverse problem in computational imaging, DNNs can overcome several shortcomings in the conventional lensless imaging through scattering media methods, namely, high cost, poor quality, complex control, and poor anti-interference. However, for training, a large number of training samples on various datasets have to be collected, with a DNN trained on one dataset generally performing poorly for recovering images from another dataset. The underlying reason is that lensless imaging through scattering media is a high dimensional regression problem and it is difficult to obtain an analytical solution. In this work, transfer learning is proposed to address this issue. Our main idea is to train a DNN on a relatively complex dataset using a large number of training samples and fine-tune the last few layers using very few samples from other datasets. Instead of the thousands of samples required to train from scratch, transfer learning alleviates the problem of costly data acquisition. Specifically, considering the difference in sample sizes and similarity among datasets, we propose two DNN architectures, namely LISMU-FCN and LISMU-OCN, and a balance loss function designed for balancing smoothness and sharpness. LISMU-FCN, with much fewer parameters, can achieve imaging across similar datasets while LISMU-OCN can achieve imaging across significantly different datasets. What's more, we establish a set of simulation algorithms that are close to the real experiments, and it is of great significance and practical value in the research on lensless scattering imaging. In summary, this work provides a new solution for lensless imaging through scattering media using transfer learning in DNNs.

Imaging through opaque scattering layers via transmission matrix assisted learning

Enhanced Deep Learning Approach Based on the Deep Convolutional Encoder–Decoder Architecture for Electromagnetic Inverse Scattering Problems

Adaptive imaging through dense dynamic scattering media using transfer learning

Roles of scattered and ballistic photons in imaging through scattering media: a deep learning-based study

Learning-based real-time imaging through dynamic scattering media

Extendible Ghost Imaging with High Reconstruction Quality in Strong Scattering Medium

Single Image Detecting Enhancement Through Scattering Media Based on Transmission Matrix with a Deep Learning Network

Computational Ghost Imaging in Scattering Media Using Simulation-Based Deep Learning

Deep Learning: A Powerful Framework for the Real-Time Solution of Inverse Scattering Problems

Scattering-Assisted Computational Imaging

Image reconstruction through a nonlinear scattering medium via deep learning

Passive imaging through dense scattering media

Transfer Learning in General Lensless Imaging Through Scattering Media.

Imaging through scattering media under strong ambient light interference via the lock-in process

Deep Hybrid Scattering Image Learning

Computational Ghost Imaging in Smoke Media

Imaging Through Scattering Media Based on Epipolar Constraints

Single picture single photon single pixel 3D imaging through unknown thick scattering medium

Robust single-shot 3D fluorescence imaging in scattering media with a simulator-trained neural network

Deep learning in macroscopic diffuse optical imaging

Imaging through scattering media with dimensional measuring and 3D positioning