Abstract:Due to the overlapping emission spectra of fluorophores, fluorescence microscopy images often have bleed-through problems, leading to a false positive detection. This problem is almost unavoidable when the samples are labeled with three or more fluorophores, and the situation is complicated even further when imaged under a multiphoton microscope. Several methods have been developed and commonly used by biologists for fluorescence microscopy spectral unmixing, such as linear unmixing, non-negative matrix factorization, deconvolution, and principal component analysis. However, they either require pre-knowledge of emission spectra or restrict the number of fluorophores to be the same as detection channels, which highly limits the real-world applications of those spectral unmixing methods. In this paper, we developed a robust and flexible spectral unmixing method: Learning Unsupervised Means of Spectra (LUMoS), which uses an unsupervised machine learning clustering method to learn individual fluorophores' spectral signatures from mixed images, and blindly separate channels without restrictions on the number of fluorophores that can be imaged. This method highly expands the hardware capability of two-photon microscopy to simultaneously image more fluorophores than is possible with instrumentation alone. Experimental and simulated results demonstrated the robustness of LUMoS in multi-channel separations of two-photon microscopy images. We also extended the application of this method to background/autofluorescence removal and colocalization analysis. Lastly, we integrated this tool into ImageJ to offer an easy to use spectral unmixing tool for fluorescence imaging. LUMoS allows us to gain a higher spectral resolution and obtain a cleaner image without the need to upgrade the imaging hardware capabilities.

Target-to-background Separation for Spectral Unmixing in In-Vivo Fluorescence Imaging

Unmixing Multiple Adjacent Fluorescent Targets with Multispectral Excited Fluorescence Molecular Tomography

Nonnegative matrix factorization using target-to-background contrast for fluorescence unmixing

Resolving Fluorophores By Unmixing Multispectral Fluorescence Tomography With Independent Component Analysis

Temporal Unmixing of Dynamic Fluorescent Images by Blind Source Separation Method with a Convex Framework.

AutoUnmix: an autoencoder-based spectral unmixing method for multi-color fluorescence microscopy imaging

Robust blind spectral unmixing for fluorescence microscopy using unsupervised learning

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Multi-target reconstruction strategy based on blind source separation of surface measurement signals in FMT

Fluorescence Separation Based on the Spatiotemporal Gaussian Mixture Model for Dynamic Fluorescence Molecular Tomography

Extraction of Target Fluorescence Signal from in Vivo Background Signal Using Image Subtraction Algorithm

Multispectral Excitation Based Multiple Fluorescent Targets Resolving in Fluorescence Molecular Tomography

Classification Initialized Hierarchical Als-Based Nmf With Partial Sparseness Constraints For Fluorescence Spectral Unmixing

Enhanced Spectral Unmixing Scheme with Unknown Target Spectral Signature in Multispectral Photoacoustic Tomography

Compressive Sampling Multispectral Imaging and Unmixing Method for Fluorescent Imaging

Spectral and Spatial Complexity-Based Hyperspectral Unmixing

A Framework of Multi-View Machine Learning for Biological Spectral Unmixing of Fluorophores with Overlapping Excitation and Emission Spectra

Unmixing Biological Fluorescence Image Data with Sparse and Low-Rank Poisson Regression

Separating Fluorescent and Reflective Components by Using a Single Hyperspectral Image

Multi-target Reconstruction of Fluorescence Molecular Tomography Based on BSS

Unmixing Optical Signals from Undersampled Volumetric Measurements by Filtering the Pixel Latent Variables