Abstract:Introduction: Although a powerful biological imaging technique, fluorescence lifetime imaging microscopy (FLIM) faces challenges such as a slow acquisition rate, a low signal-to-noise ratio (SNR), and high cost and complexity. To address the fundamental problem of low SNR in FLIM images, we demonstrate how to use pre-trained convolutional neural networks (CNNs) to reduce noise in FLIM measurements. Methods: Our approach uses pre-learned models that have been previously validated on large datasets with different distributions than the training datasets, such as sample structures, noise distributions, and microscopy modalities in fluorescence microscopy, to eliminate the need to train a neural network from scratch or to acquire a large training dataset to denoise FLIM data. In addition, we are using the pre-trained networks in the inference stage, where the computation time is in milliseconds and accuracy is better than traditional denoising methods. To separate different fluorophores in lifetime images, the denoised images are then run through an unsupervised machine learning technique named "K-means clustering". Results and Discussion: The results of the experiments carried out on in vivo mouse kidney tissue, Bovine pulmonary artery endothelial (BPAE) fixed cells that have been fluorescently labeled, and mouse kidney fixed samples that have been fluorescently labeled show that our demonstrated method can effectively remove noise from FLIM images and improve segmentation accuracy. Additionally, the performance of our method on out-of-distribution highly scattering in vivo plant samples shows that it can also improve SNR in challenging imaging conditions. Our proposed method provides a fast and accurate way to segment fluorescence lifetime images captured using any FLIM system. It is especially effective for separating fluorophores in noisy FLIM images, which is common in in vivo imaging where averaging is not applicable. Our approach significantly improves the identification of vital biologically relevant structures in biomedical imaging applications.

End-to-End Fluorescence Lifetime Imaging with Optimized Encoding and Exposure Allocation

Parallelized Fluorescence Lifetime Imaging Microscopy (FLIM) Based on Photon Reassignment

High-throughput Multiplexed Fluorescence Lifetime Microscopy.

Dual-Color Live-Cell Super-Resolution Fluorescence Lifetime Imaging Via Polarization Modulation-Based Fluorescence Emission Difference

Fluorescence Lifetime Imaging with Pulsed Diode Laser Enabled Stimulated Emission.

Ratiometric Photon Reassignment Based on Fluorescence Lifetime to Improve Resolution in Pulse STED Microscopy.

Deep Learning Enhanced Fluorescence Emission Difference Microscopy

Enhancing Fluorescence Lifetime Parameter Estimation Accuracy with Differential Transformer Based Deep Learning Model Incorporating Pixelwise Instrument Response Function

Overcoming photon and spatiotemporal sparsity in fluorescence lifetime imaging with SparseFLIM

Encoder-decoder deep learning network for simultaneous reconstruction of fluorescence yield and lifetime distributions

Light-field tomographic fluorescence lifetime imaging microscopy

Compact and Robust Deep Learning Architecture for Fluorescence Lifetime Imaging and FPGA Implementation

Fluorescence lifetime imaging microscopy: fundamentals and advances in instrumentation, analysis, and applications

Fast fit-free analysis of fluorescence lifetime imaging via deep learning

Linear Scheme for the Direct Reconstruction of Noncontact Time-Domain Fluorescence Molecular Lifetime Tomography.

Net-FLICS: fast quantitative wide-field fluorescence lifetime imaging with compressed sensing – a deep learning approach

A Novel Fit-Flexible Fluorescence Soft Imager: Tri-Sensing of Intensity, Fall-Time, and Life Profile

Improving fluorescence lifetime imaging microscopy phasor accuracy using convolutional neural networks

Advancements in phasor-based FLIM: multi-component analysis and lifetime probes in biological imaging

Rapid fluorescence lifetime imaging microscopy via few-photon imaging

Machine learning for faster and smarter fluorescence lifetime imaging microscopy