Abstract:The mode mixing and mode dispersion in the multimode fiber (MMF) will produce complex speckle patterns in the distal end of the fiber as an object passes through the MMF, rendering image reconstruction to be a challenging task. In recent years, convolutional neural networks have been successfully applied to image reconstruction from speckles. However, the imaging spectra of these studies are mostly in the visible spectrum range and require complete speckle information for reconstruction. In this paper, researchers build an optical imaging system that employs up-conversion imaging technology to collect speckle patterns generated by infrared light transmitting through a multimode fiber and a frequency-doubling crystal. They propose a speckle restoration network (SRNet) based on a generative adversarial network (GAN) to reconstruct speckle images. The generator of GAN uses ResNest and atrous spatial pyramid pooling (ASPP) to extract multi-level features and multi-scale context information, respectively. The discriminator of GAN significantly improves the quality of the reconstructed image generated by the generator. In addition, researchers adopt a special training method named pre-training generator to avoid gradient disappearance or gradient explosion in the training process. With the designed network, high-quality images were successfully reconstructed even with only a portion of the speckle information.

High-definition Image Transmission Through Dynamically Perturbed Multimode Fiber by a Self-Attention Based Neural Network.

Efficient Reference-Less Transmission Matrix Retrieval for a Multimode Fiber Using Fast Fourier Transform

Multimode optical fiber transmission with a deep learning network

Learning to transmit images through optical speckle of a multimode fiber with high fidelity

Data-driven Fiber Model Based on the Deep Neural Network with Multi-Head Attention Mechanism

Spatial Pilot-aided Fast-aided Framework for Stable Image Transmission over Long Multi-mode Fiber

Self-supervised dynamic learning for long-term high-fidelity image transmission through unstabilized diffusive media

Spatial pilot-aided fast-adapted framework for stable image transmission over long multi-mode fiber

Neural Network-Based Multimode Fiber Imaging and Characterization Under Thermal Perturbations

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

Multi-Span Long-Haul Fiber Transmission Model Based on Cascaded Neural Networks with Multi-Head Attention Mechanism

Image transmission through a flexible multimode fiber by deep learning

Demonstration of photonic neural network for fiber nonlinearity compensation in long-haul transmission systems

Single-shot enhanced imaging through multimode fiber based on self-learning networks

Multimode fiber-based greyscale image projector enabled by neural networks with high generalization ability

Flexible single multimode fiber imaging using white LED

Single-ended Recovery of Optical fiber Transmission Matrices using Neural Networks

Multimode fiber image reconstruction based on parallel neural network with small training set under wide temperature variations

Feature decoupled knowledge distillation enabled lightweight image transmission through multimode fibers

Reconstructing Images Through Multimode Fibers From the Up-Conversion Speckle Patterns via Deep Learning

Imaging through a multimode optical fiber with principal component analysis and a variational autoencoder