Abstract:In recent years, deep learning has been effectively used to reconstruct speckled images created by the scattering media. However, when a network with previous data training is used to test new data, it usually exhibits poor performance due to significant differences in new data that differ in scattered media and data types. Retraining the network and collecting a large amount of new data are usually required to enhance performance, but this comes with a high cost and time expense. This article proposes a transfer learning approach to address this issue. We constructed an experimental setup for capturing infrared speckled images, which includes a laser module with a 4f resonant cavity structure capable of adjusting the aperture size of spatial filters. Speckled images are collected and preprocessed at different aperture sizes, then input into a convolutional neural network for training. Transfer learning is employed to study the reconstruction of speckled images between different aperture sizes. Subsequently, to recreate speckle patterns, a speckle reconstruction network named TCGAN (Transformer_CNN_GAN) is proposed. This network is based on pre-training TCGAN with an enormous quantity of data and fine-tuning its model with new data so that it can be adapted quickly with a small sample size. The experimental findings show that TCGAN may achieve good reconstruction without too much new data by means of transfer learning. Moreover, pretraining the network with more complex datasets helps enhance the network's transfer learning capability. Therefore, conducting research on optical field imaging and restoration methods based on transfer learning holds significant theoretical and practical significance.

Deep-learned speckle pattern and its application to ghost imaging

Spectral Imaging with Deep Learning.

Ghost Imaging with N-order Speckle Light

Foveated Ghost Imaging Based on Deep Learning

Sm-Net OCT: a Deep-Learning-based Speckle-Modulating Optical Coherence Tomography.

Ghost imaging based on Y-net: a dynamic coding and conjugate-decoding approach

Speckles-Training-Based Denoising Convolutional Neural Network Ghost Imaging

Ghost Imaging Based on Y-net: a Dynamic Coding and Decoding Approach.

Speckle Noise Reduction in Coherent Imaging Based on Deep Learning Without Clean Data

Improved Scattering Autocorrelation Imaging Method Based on Deep Learning Denoising

Fully-Connected-Based Adaptive Speckles Optimization Method for Ghost Imaging

Imaging reconstruction through long-range scattering media by using deep learning

Seeing the Invisible through Speckle Images

Optimizing Ghost Imaging via Analysis and Design of Speckle Patterns

Non-Invasive Imaging Through Scattering Media Based on Deep Learning

Transfer Learning of Reconstructing Imaging From Speckles Generated by Different Spatial Coherence Light

Laser Speckle Denoising with Deep Convolutional Network

Deep Gradient-Guidance Networks for Speckle Noise Reduction

Image reconstruction from speckle patterns on double diffusers condition by deep learning

DeSpecNet: a CNN-based Method for Speckle Reduction in Retinal Optical Coherence Tomography Images.

Differential Ghost Imaging with Learned Modulation Patterns