Abstract:Lensless fiber endomicroscope is an emerging tool for in-vivo microscopic imaging, where quantitative phase imaging (QPI) can be utilized as a label-free method to enhance image contrast. However, existing single-shot phase reconstruction methods through lensless fiber endomicroscope typically perform well on simple images but struggle with complex microscopic structures. Here, we propose a speckle-conditioned diffusion model (SpecDiffusion), which reconstructs phase images directly from speckles captured at the detection side of a multi-core fiber (MCF). Unlike conventional neural networks, SpecDiffusion employs iterative phase denoising steps for speckle-driven phase reconstruction. The iteration scheme allows SpecDiffusion to break down the phase reconstruction process into multiple steps, gradually building up to the final phase image. This attribute alleviates the computation challenge at each step and enables the reconstruction of rich details in complex microscopic images. To validate its efficacy, we build an optical system to capture speckles from MCF and construct a dataset consisting of 100,000 paired images. SpecDiffusion provides high-fidelity phase reconstruction results and shows powerful generalization capacity for unseen objects, such as test charts and biological tissues, reducing the average mean absolute error of the reconstructed tissue images by 7 times. Furthermore, the reconstructed tissue images using SpecDiffusion shows higher accuracy in zero-shot cell segmentation tasks compared to the conventional method, demonstrating the potential for further cell morphology analysis through the learning-based lensless fiber endomicroscope. SpecDiffusion offers a precise and generalized method to phase reconstruction through scattering media, including MCFs, opening new perspective in lensless fiber endomicroscopic imaging.

Implementation of a portable diffraction phase microscope for digital histopathology

Deep Learning Virtual Zernike Phase Contrast Imaging for Singlet Microscopy

Diffraction Phase Microscopy Realized with an Automatic Digital Pinhole

Smart-phone Phase Contrast Microscope with a Singlet Lens and Deep Learning

Assessing tissues' inhomogeneous optical properties based on quantitative phase imaging and dark field microscopy with LED illumination (Conference Presentation)

Deep Learning Virtual Colorization Overcoming Chromatic Aberrations in Singlet Lens Microscopy

A Comprehensive Description of Diffraction Phase Microscopy

Assessment of Tissues’ Inhomogeneous Optical Properties Based on a Portable Microscope under Partially Coherent Illumination

Label- and slide-free tissue histology using 3D epi-mode quantitative phase imaging and virtual H&E staining

Deep learning extended depth-of-field microscope for fast and slide-free histology

Digital Micromirror Device-Based Common-Path Quantitative Phase Imaging

Assessment of tissues' inhomogeneous optical properties by a cost-effective microscope based on LED illumination

Diffusion-driven lensless fiber endomicroscopic quantitative phase imaging towards digital pathology

Ultrafast 3D Histological Imaging Based on a Minutes-Time Scale Tissue Clearing and Multidirectional Selective Plane Illumination Microscopy

DeepDOF-SE: affordable deep-learning microscopy platform for slide-free histology

A universal microscope add-on for snapshot quantitative phase imaging by spectral encoding

Automated Whole Slide Imaging for Label-Free Histology using Photon Absorption Remote Sensing Microscopy

Virtual staining of defocused autofluorescence images of unlabeled tissue using deep neural networks

Hardware-software co-design of an open-source automatic multimodal whole slide histopathology imaging system

PhaseStain: Digital staining of label-free quantitative phase microscopy images using deep learning

Single Exposure Quantitative Phase Imaging with a Conventional Microscope using Diffusion Models