Abstract:Introduction: Although a powerful biological imaging technique, fluorescence lifetime imaging microscopy (FLIM) faces challenges such as a slow acquisition rate, a low signal-to-noise ratio (SNR), and high cost and complexity. To address the fundamental problem of low SNR in FLIM images, we demonstrate how to use pre-trained convolutional neural networks (CNNs) to reduce noise in FLIM measurements. Methods: Our approach uses pre-learned models that have been previously validated on large datasets with different distributions than the training datasets, such as sample structures, noise distributions, and microscopy modalities in fluorescence microscopy, to eliminate the need to train a neural network from scratch or to acquire a large training dataset to denoise FLIM data. In addition, we are using the pre-trained networks in the inference stage, where the computation time is in milliseconds and accuracy is better than traditional denoising methods. To separate different fluorophores in lifetime images, the denoised images are then run through an unsupervised machine learning technique named "K-means clustering". Results and Discussion: The results of the experiments carried out on in vivo mouse kidney tissue, Bovine pulmonary artery endothelial (BPAE) fixed cells that have been fluorescently labeled, and mouse kidney fixed samples that have been fluorescently labeled show that our demonstrated method can effectively remove noise from FLIM images and improve segmentation accuracy. Additionally, the performance of our method on out-of-distribution highly scattering in vivo plant samples shows that it can also improve SNR in challenging imaging conditions. Our proposed method provides a fast and accurate way to segment fluorescence lifetime images captured using any FLIM system. It is especially effective for separating fluorophores in noisy FLIM images, which is common in in vivo imaging where averaging is not applicable. Our approach significantly improves the identification of vital biologically relevant structures in biomedical imaging applications.

Neural Networks Push The Limits of Luminescence Lifetime Nanosensing

Convolutional neural networks open up horizons for luminescence thermometry

Deep Learning Enhanced Electrochemiluminescence Microscopy.

Luminescence Interference-Free Lifetime Nanothermometry Pinpoints in Vivo Temperature

Lifetime-based nanothermometry in vivo with ultra-long-lived luminescence.

Towards accurate real-time luminescence thermometry: an automated machine learning approach

Luminescence Lifetime-Based in Vivo Detection with Responsive Rare Earth-Dye Nanocomposite.

Spotlight on Luminescence Thermometry: Basics, Challenges, and Cutting‐Edge Applications

Lanthanide-based nanomaterials for temperature sensing in the near-infrared spectral region: illuminating progress and challenges

Accurate In Vivo Nanothermometry through NIR‐II Lanthanide Luminescence Lifetime

Coupling a Recurrent Neural Network to SPAD TCSPC Systems for Real-time Fluorescence Lifetime Imaging

Dual-excitation Decoding Multiparameter-Based Ratiometric Luminescence Thermometry: a New Strategy Toward Reliable and Accurate Thermal Sensing

On-the-fly Decoding Luminescence Lifetimes in the Microsecond Region for Lanthanide-Encoded Suspension Arrays.

Persistent Luminescence Nanosensors: A Generalized Optode-based Platform for Autofluorescence-free Sensing in Biological Systems

Convolutional Neural Networks Driving Thermally Enhanced Upconversion Luminescence for Temperature Sensing: Achieving High Accuracy and Robustness Across a Wide Temperature Range

Improving fluorescence lifetime imaging microscopy phasor accuracy using convolutional neural networks

Luminescent Silica Nanosensors for Lifetime Based Imaging of Intracellular Oxygen with Millisecond Time Resolution.

Fast fit-free analysis of fluorescence lifetime imaging via deep learning

Convolutional Neural Network Driving Thermally Enhanced Upconversion Luminescence for Temperature Sensing: Achieving High Accuracy and Robustness Across a Wide Temperature Range

Luminescence Lifetime Imaging Based on Lanthanide Nanoparticles.