Abstract:In multi-photon microscopy (MPM), a recent in-vivo fluorescence microscopy system, the task of image restoration can be decomposed into two interlinked inverse problems: firstly, the characterization of the Point Spread Function (PSF) and subsequently, the deconvolution (i.e., deblurring) to remove the PSF effect, and reduce noise. The acquired MPM image quality is critically affected by PSF blurring and intense noise. The PSF in MPM is highly spread in 3D and is not well characterized, presenting high variability with respect to the observed objects. This makes the restoration of MPM images challenging. Common PSF estimation methods in fluorescence microscopy, including MPM, involve capturing images of sub-resolution beads, followed by quantifying the resulting ellipsoidal 3D spot. In this work, we revisit this approach, coping with its inherent limitations in terms of accuracy and practicality. We estimate the PSF from the observation of relatively large beads (approximately 1μm in diameter). This goes through the formulation and resolution of an original non-convex minimization problem, for which we propose a proximal alternating method along with convergence guarantees. Following the PSF estimation step, we then introduce an innovative strategy to deal with the high level multiplicative noise degrading the acquisitions. We rely on a heteroscedastic noise model for which we estimate the parameters. We then solve a constrained optimization problem to restore the image, accounting for the estimated PSF and noise, while allowing a minimal hyper-parameter tuning. Theoretical guarantees are given for the restoration algorithm. These algorithmic contributions lead to an end-to-end pipeline for 3D image restoration in MPM, that we share as a publicly available Python software. We demonstrate its effectiveness through several experiments on both simulated and real data.

Image Reconstruction in Light-Sheet Microscopy: Spatially Varying Deconvolution and Mixed Noise

Regularized Deconvolution for Structured Illumination Microscopy Via Accelerated Linearized ADMM

Estimation-free Spatial-Domain Image Reconstruction of Structured Illumination Microscopy

Multi-frame Blind Deconvolution Using Sparse Priors

Imaging Resolution and Properties Analysis of Super Resolution Microscopy with Parallel Detection under Different Noise, Detector and Image Restoration Conditions

Reconstruction from Multiple Poses in Fluorescence Imaging: Proof of Concept

The spatial correlation problem of noise in imaging deblurring and its solution.

Bayesian Deconvolution of Scanning Electron Microscopy Images Using Point-spread Function Estimation and Non-local Regularization

Noise-robust phase-space deconvolution for light-field microscopy

Self-Supervised Single-Image Deconvolution with Siamese Neural Networks

Spatially-Variant CNN-based Point Spread Function Estimation for Blind Deconvolution and Depth Estimation in Optical Microscopy

Re-thinking Richardson-Lucy without Iteration Cutoffs: Physically Motivated Bayesian Deconvolution

Blind deconvolution subject to sparse representation for fluorescence microscopy

Reconstructing the Image Scanning Microscopy Dataset: an Inverse Problem

Noise-robust, Physical Genuine Deconvolution Algorithm for Fluorescence Microscopy Enabled by Multi-Resolution Analysis

Visualizing minute details in light‐sheet and confocal microscopy data by combining 3D rolling ball filtering and deconvolution

A novel variational approach for multiphoton microscopy image restoration: from PSF estimation to 3D deconvolution

Rapid Image Deconvolution and Multiview Fusion for Optical Microscopy.

Semi-Blind Sparse Image Reconstruction With Application to MRFM

Multiplane Image Restoration Using Multivariate Curve Resolution: An Alternative Approach to Deconvolution in Conventional Brightfield Microscopy