Abstract:Traditional endoscopes use fiber bundles to transverse the images and have the disadvantages of large size and poor flexibility. Unlike the single mode fibers just guide the fundamental mode, multi-mode fibers (MMFs) accommodate a large number of guided modes. Accordingly, one MMF can be utilized to transverse imaging for endoscopy. This MMF based endoscope can effectively overcome the above shortcomings. However, there are effects such as modal dispersion and mode coupling in the transmission process of multimode fiber, which will cause the image transmitted in the fiber to be distorted or even unrecognizable. The randomness of fiber shape in fabrication detoriosate the distortion. By measuring the transmission matrix, it is possible to recover the image through MMF. But the overall shape and structure of MMF will change in the operation of endoscope. The transmission characteristics of multimode fiber are only closely related to the fiber geometry, but traditional MMF imaging techniques are applicable when the shape of the optical fiber during imaging is consistent with the shape of the optical fiber when the transmission characteristics are calibrated. This work will focus on solving these problems. This paper explores the imaging technology of single multimode optical fiber, proposes the use of neural network to fit the multimode optical fiber transmission matrix, and calculates the input light field through the reverse transmission matrix and the output speckle light field. The traditional real number network has limited fitting effect on the multimode fiber transmission matrix. Inspired by the physical process of multimode fiber modulation of the light field, the real number network is extended to the field of complex numbers, and complex number operations are implemented in the network in the form of real numbers. This article studies the imaging regularity and effectiveness of multimode fiber under the condition of slight deformation and severe deformation. The neural network fitting method of multi-mode optical fiber transmission matrix used in this paper can maintain its effectiveness within a certain deformation range, and has great application potential in some endoscopic applications.

High Accuracy Transmission and Recognition of Complex Images Through Multimode Fibers Using Deep Learning

High Definition Images Transmission Through Single Multimode Fiber Using Deep Learning and Simulation Speckles

Spatially Variant Deblur and Image Enhancement in a Single Multimode Fiber Imaged by Deep Learning

Learning to transmit images through optical speckle of a multimode fiber with high fidelity

Deep Learning Image Transmission Through a Multimode Fiber Based on a Small Training Dataset.

Multiple Side-Coupled Images Recognition in Plastic Optical Fibers Based on Deep Learning

Image Transmission Through a Multimode Fiber Based on Transfer Learning

Speckle Classification of a Multimode Fiber Based on Inception V3

Multimode optical fiber transmission with a deep learning network

Seeing Through Multimode Fibers with Physics-Assisted Deep Learning

Image Reconstruction of Multimode Fiber Scattering Media Based on Deep Learning

Deep learning-based multimode fiber imaging in multispectral and multipolarimetric channels

Realization Of Recognition For Multi-Mode Optical Fiber Transmission Speckle Using Neural Network

Reconstructing Images Through Multimode Fibers From the Up-Conversion Speckle Patterns via Deep Learning

Image transmission through a flexible multimode fiber by deep learning

Deep Learning-Based Object Classification Through Multimode Fiber Via a CNN-architecture SpeckleNet.

Research on Image Transmission Mechanism Through a Multimode Fiber Based on Principal Component Analysis

Learning to See High-Density Random Images Long-Term Transmitted in Multimode Fiber

Advances in Deep Learning Based Fiber Optic Imaging(Invited)

Research on Single Fiber Imaging Technology under Fiber Deformation

Deep Learning for Highly Efficient Curvature Recognition Using Fiber Scattering Speckles