Abstract:Recently deep neural networks (DNNs) have been successfully introduced to the field of lensless imaging through scattering media. By solving an inverse problem in computational imaging, DNNs can overcome several shortcomings in the conventional lensless imaging through scattering media methods, namely, high cost, poor quality, complex control, and poor anti-interference. However, for training, a large number of training samples on various datasets have to be collected, with a DNN trained on one dataset generally performing poorly for recovering images from another dataset. The underlying reason is that lensless imaging through scattering media is a high dimensional regression problem and it is difficult to obtain an analytical solution. In this work, transfer learning is proposed to address this issue. Our main idea is to train a DNN on a relatively complex dataset using a large number of training samples and fine-tune the last few layers using very few samples from other datasets. Instead of the thousands of samples required to train from scratch, transfer learning alleviates the problem of costly data acquisition. Specifically, considering the difference in sample sizes and similarity among datasets, we propose two DNN architectures, namely LISMU-FCN and LISMU-OCN, and a balance loss function designed for balancing smoothness and sharpness. LISMU-FCN, with much fewer parameters, can achieve imaging across similar datasets while LISMU-OCN can achieve imaging across significantly different datasets. What's more, we establish a set of simulation algorithms that are close to the real experiments, and it is of great significance and practical value in the research on lensless scattering imaging. In summary, this work provides a new solution for lensless imaging through scattering media using transfer learning in DNNs.

Deep Hybrid Scattering Image Learning

Enhanced Deep Learning Approach Based on the Deep Convolutional Encoder–Decoder Architecture for Electromagnetic Inverse Scattering Problems

Image Reconstruction of Multimode Fiber Scattering Media Based on Deep Learning

Image Reconstruction Through Dynamic Scattering Media Based on Deep Learning

Deep Learning Image Transmission Through a Multimode Fiber Based on a Small Training Dataset.

Non-Invasive Imaging Through Scattering Media Based on Deep Learning

Mutual Transfer Learning of Reconstructing Images Through a Multimode Fiber or a Scattering Medium.

Imaging through a Scattering Medium under Different Intensities of Ambient Light Interference

Imaging reconstruction through long-range scattering media by using deep learning

Synchronous Image Reconstruction and Depth Information Prediction Through Scattering Media Via Multi-Task Network

Single Image Detecting Enhancement Through Scattering Media Based on Transmission Matrix with a Deep Learning Network

A Symmetric Forward-Inverse Reinforcement Framework for Image Reconstruction Through Scattering Media

Imaging Through Dynamic Thick Scattering Media Based on Deep Learning

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

Synchronous image reconstruction and depth information prediction through scattering media via multi-task network

Transfer Learning in General Lensless Imaging Through Scattering Media.

Improved Scattering Autocorrelation Imaging Method Based on Deep Learning Denoising

Adaptive 3D Descattering with a Dynamic Synthesis Network

Computational Ghost Imaging in Scattering Media Using Simulation-Based Deep Learning

Scattering Networks for Hybrid Representation Learning

Extendible Ghost Imaging with High Reconstruction Quality in Strong Scattering Medium