Abstract:High-fidelity image transmission through multimode fiber is critical for the biomedical imaging and telecommunications industries. However, mode coupling and modal dispersion usually disrupt the distribution of the incident light field and form a speckle pattern at the distal end of the multimode fiber, which makes it challenging to reconstruct the target image. Data-driven deep learning models have been proposed to reconstruct target images from distorted output fields, but the data dependence of the models hinder their practical application. Here, we report a physics-assisted learning-based fiber imaging scheme that overcomes the shortcomings of traditional methods by combining the advantages of the physical model and the learning model. The role of the physical model is to simplify the mapping relationship between the speckle pattern and the target image, thereby reducing the computational complexity. The learning model is applied to learn on an optimized smallscale dataset and achieve high-fidelity image reconstruction according to the optimized direction provided by the physical model. The feasibility of the proposed scheme is verified by imaging experiments, and the results demonstrate that the physics-assisted learning model outperforms the solely data-driven learning model in terms of time cost, experimental effort, and fidelity. The proposed scheme in this work provides an enlightening reference for the combination of model-driven and data-driven methods, and it has the potential to advance the practical application of deep learning in imaging.

Seeing Through Multimode Fibers with Physics-Assisted Deep Learning

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

Dynamic Imaging Through Random Perturbed Fibers Via Physics-Informed Learning

High Definition Images Transmission Through Single Multimode Fiber Using Deep Learning and Simulation Speckles

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Imaging through multimode fibres with physical prior

Image transmission through a flexible multimode fiber by deep learning

Image Reconstruction of Multimode Fiber Scattering Media Based on Deep Learning

Deep learning-based multimode fiber imaging in multispectral and multipolarimetric channels

High Accuracy Transmission and Recognition of Complex Images Through Multimode Fibers Using Deep Learning

Towards optimal multimode fiber imaging by leveraging input polarization and deep learning

Multimode optical fiber transmission with a deep learning network

Learning to transmit images through optical speckle of a multimode fiber with high fidelity

Image Transmission Through a Multimode Fiber Based on Transfer Learning

Self-supervised dynamic learning for long-term high-fidelity image transmission through unstabilized diffusive media

Deep Learning Image Transmission Through a Multimode Fiber Based on a Small Training Dataset.

Deep Learning Imaging Through Specialty Multi-Mode Fibers.

Multiple Side-Coupled Images Recognition in Plastic Optical Fibers Based on Deep Learning

All-fiber high-speed image detection enabled by deep learning

Experimental Demonstration of Multimode Fiber Active Illuminated Imaging Via Deep Learning

Research on Image Transmission Mechanism Through a Multimode Fiber Based on Principal Component Analysis