Abstract:Lensless fiber endomicroscope is an emerging tool for in-vivo microscopic imaging, where quantitative phase imaging (QPI) can be utilized as a label-free method to enhance image contrast. However, existing single-shot phase reconstruction methods through lensless fiber endomicroscope typically perform well on simple images but struggle with complex microscopic structures. Here, we propose a speckle-conditioned diffusion model (SpecDiffusion), which reconstructs phase images directly from speckles captured at the detection side of a multi-core fiber (MCF). Unlike conventional neural networks, SpecDiffusion employs iterative phase denoising steps for speckle-driven phase reconstruction. The iteration scheme allows SpecDiffusion to break down the phase reconstruction process into multiple steps, gradually building up to the final phase image. This attribute alleviates the computation challenge at each step and enables the reconstruction of rich details in complex microscopic images. To validate its efficacy, we build an optical system to capture speckles from MCF and construct a dataset consisting of 100,000 paired images. SpecDiffusion provides high-fidelity phase reconstruction results and shows powerful generalization capacity for unseen objects, such as test charts and biological tissues, reducing the average mean absolute error of the reconstructed tissue images by 7 times. Furthermore, the reconstructed tissue images using SpecDiffusion shows higher accuracy in zero-shot cell segmentation tasks compared to the conventional method, demonstrating the potential for further cell morphology analysis through the learning-based lensless fiber endomicroscope. SpecDiffusion offers a precise and generalized method to phase reconstruction through scattering media, including MCFs, opening new perspective in lensless fiber endomicroscopic imaging.

Phase contrast image restoration via dictionary representation of diffraction patterns.

Cell Segmentation in Phase Contrast Microscopy Images Via Semi-Supervised Classification over Optics-Related Features

Phase Contrast Image Restoration by Formulating Its Imaging Principle and Reversing the Formulation with Deep Neural Networks

Automatic Phase Recognition Method Based on Convolutional Neural Network

Biological Cell Phase Imaging System Integrated with Optical Scattering Information

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Quantitative Phase Imaging Based on Wavefront Correction of a Digital Micromirror Device

Microscopy image formation, restoration, and segmentation

Interactive Cell Segmentation Based on Phase Contrast Optics

Phase Error Correction by &Lt;inline-Formula><math Display="inline" Overflow="scroll"><mi>π</mi></math></inline-Formula>-shift Odd-Step Fringe Projection and Speckle Filtering in Phase Measuring Profilometry

Cell Segmentation Via Spectral Analysis on Phase Retardation Features

Efficient phase contrast microscopy restoration applied for muscle myotube detection.

Diffusion-driven lensless fiber endomicroscopic quantitative phase imaging towards digital pathology

Defocused image restoration method based on micro-nano scale

An enhanced multimode phase imaging method based on the transport of intensity equation

Single Exposure Quantitative Phase Imaging with a Conventional Microscope using Diffusion Models

Cell-sensitive Phase Contrast Microscopy Imaging by Multiple Exposures

Pupil-driven quantitative differential phase contrast imaging

Cell image reconstruction using digital holography with an improved GS algorithm

Step-Calibrated Diffusion for Biomedical Optical Image Restoration

Single-shot quantitative phase contrast imaging based on deep learning