Abstract:In recent years, deep learning has been effectively used to reconstruct speckled images created by the scattering media. However, when a network with previous data training is used to test new data, it usually exhibits poor performance due to significant differences in new data that differ in scattered media and data types. Retraining the network and collecting a large amount of new data are usually required to enhance performance, but this comes with a high cost and time expense. This article proposes a transfer learning approach to address this issue. We constructed an experimental setup for capturing infrared speckled images, which includes a laser module with a 4f resonant cavity structure capable of adjusting the aperture size of spatial filters. Speckled images are collected and preprocessed at different aperture sizes, then input into a convolutional neural network for training. Transfer learning is employed to study the reconstruction of speckled images between different aperture sizes. Subsequently, to recreate speckle patterns, a speckle reconstruction network named TCGAN (Transformer_CNN_GAN) is proposed. This network is based on pre-training TCGAN with an enormous quantity of data and fine-tuning its model with new data so that it can be adapted quickly with a small sample size. The experimental findings show that TCGAN may achieve good reconstruction without too much new data by means of transfer learning. Moreover, pretraining the network with more complex datasets helps enhance the network's transfer learning capability. Therefore, conducting research on optical field imaging and restoration methods based on transfer learning holds significant theoretical and practical significance.

Research on Image Reconstruction of Multimode Fiber Based on Transfer Learning

Image Transmission Through a Multimode Fiber Based on Transfer Learning

Mutual Transfer Learning of Reconstructing Images Through a Multimode Fiber or a Scattering Medium.

Image Reconstruction of Multimode Fiber Scattering Media Based on Deep Learning

Reconstructing Images Through Multimode Fibers From the Up-Conversion Speckle Patterns via Deep Learning

Transfer Learning of Reconstructing Imaging From Speckles Generated by Different Spatial Coherence Light

Wavefront Reconstruction Based on Deep Transfer Learning for Microscopy.

Deep Learning Image Transmission Through a Multimode Fiber Based on a Small Training Dataset.

Image Reconstruction Using Pre-Trained Autoencoder on Multimode Fiber Imaging System

High Accuracy Transmission and Recognition of Complex Images Through Multimode Fibers Using Deep Learning

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

Learning to See High-Density Random Images Long-Term Transmitted in Multimode Fiber

Study on Transfer Learning-based Cross-Spectral Speckle Image Reconstruction Method

Multimode optical fiber transmission with a deep learning network

Learning to transmit images through optical speckle of a multimode fiber with high fidelity

Speckle Classification of a Multimode Fiber Based on Inception V3

Seeing Through Multimode Fibers with Physics-Assisted Deep Learning

Research on Image Transmission Mechanism Through a Multimode Fiber Based on Principal Component Analysis

Realization Of Recognition For Multi-Mode Optical Fiber Transmission Speckle Using Neural Network

High Definition Images Transmission Through Single Multimode Fiber Using Deep Learning and Simulation Speckles

Multimode fiber image reconstruction based on parallel neural network with small training set under wide temperature variations