Abstract:High-fidelity image transmission through multimode fiber is critical for the biomedical imaging and telecommunications industries. However, mode coupling and modal dispersion usually disrupt the distribution of the incident light field and form a speckle pattern at the distal end of the multimode fiber, which makes it challenging to reconstruct the target image. Data-driven deep learning models have been proposed to reconstruct target images from distorted output fields, but the data dependence of the models hinder their practical application. Here, we report a physics-assisted learning-based fiber imaging scheme that overcomes the shortcomings of traditional methods by combining the advantages of the physical model and the learning model. The role of the physical model is to simplify the mapping relationship between the speckle pattern and the target image, thereby reducing the computational complexity. The learning model is applied to learn on an optimized smallscale dataset and achieve high-fidelity image reconstruction according to the optimized direction provided by the physical model. The feasibility of the proposed scheme is verified by imaging experiments, and the results demonstrate that the physics-assisted learning model outperforms the solely data-driven learning model in terms of time cost, experimental effort, and fidelity. The proposed scheme in this work provides an enlightening reference for the combination of model-driven and data-driven methods, and it has the potential to advance the practical application of deep learning in imaging.

Multimode optical fiber transmission with a deep learning network

Learning to transmit images through optical speckle of a multimode fiber with high fidelity

Deep learning-based multimode fiber imaging in multispectral and multipolarimetric channels

High Accuracy Transmission and Recognition of Complex Images Through Multimode Fibers Using Deep Learning

Image transmission through a flexible multimode fiber by deep learning

Learning Enabled Continuous Transmission of Spatially Distributed Information Through Multimode Fibers

Seeing Through Multimode Fibers with Physics-Assisted Deep Learning

Learning to see through multimode fibers

Experimental Demonstration of Multimode Fiber Active Illuminated Imaging Via Deep Learning

Image Transmission Through a Multimode Fiber Based on Transfer Learning

High-definition Image Transmission Through Dynamically Perturbed Multimode Fiber by a Self-Attention Based Neural Network.

Deep Learning Image Transmission Through a Multimode Fiber Based on a Small Training Dataset.

Learning-enabled recovering scattered data from twisted light transmitted through a long standard multimode fiber

Characterization of Multimode Optical Fiber Transmission Matrix with Different Neural Networks

High Definition Images Transmission Through Single Multimode Fiber Using Deep Learning and Simulation Speckles

Learning Enabled Dense Space-division Multiplexing through a Single Multimode Fibre

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

Learning-based multiplexed transmission of scattered twisted light through a kilometer-scale standard multimode fiber

Versatile multimode fiber network with high capacity enabled by deep learning

Neural Network-Based Multimode Fiber Imaging and Characterization Under Thermal Perturbations

Intensity-only Mode Decomposition on Multimode Fibers using a Densely Connected Convolutional Network