Abstract:In multi-photon microscopy (MPM), a recent in-vivo fluorescence microscopy system, the task of image restoration can be decomposed into two interlinked inverse problems: firstly, the characterization of the Point Spread Function (PSF) and subsequently, the deconvolution (i.e., deblurring) to remove the PSF effect, and reduce noise. The acquired MPM image quality is critically affected by PSF blurring and intense noise. The PSF in MPM is highly spread in 3D and is not well characterized, presenting high variability with respect to the observed objects. This makes the restoration of MPM images challenging. Common PSF estimation methods in fluorescence microscopy, including MPM, involve capturing images of sub-resolution beads, followed by quantifying the resulting ellipsoidal 3D spot. In this work, we revisit this approach, coping with its inherent limitations in terms of accuracy and practicality. We estimate the PSF from the observation of relatively large beads (approximately 1μm in diameter). This goes through the formulation and resolution of an original non-convex minimization problem, for which we propose a proximal alternating method along with convergence guarantees. Following the PSF estimation step, we then introduce an innovative strategy to deal with the high level multiplicative noise degrading the acquisitions. We rely on a heteroscedastic noise model for which we estimate the parameters. We then solve a constrained optimization problem to restore the image, accounting for the estimated PSF and noise, while allowing a minimal hyper-parameter tuning. Theoretical guarantees are given for the restoration algorithm. These algorithmic contributions lead to an end-to-end pipeline for 3D image restoration in MPM, that we share as a publicly available Python software. We demonstrate its effectiveness through several experiments on both simulated and real data.

Deconvolution of confocal microscopy images using proximal iteration and sparse representations

Multi-frame Blind Deconvolution Using Sparse Priors

Blind Deconvolution Using an Improved L0 Sparse Representation

Blind deconvolution subject to sparse representation for fluorescence microscopy

An Improved Image Deconvolution Approach Using Local Constraint

Image Reconstruction in Light-Sheet Microscopy: Spatially Varying Deconvolution and Mixed Noise

Image Deconvolution for Confocal Laser Scanning Microscopy Using Constrained Total Variation with a Gradient Field.

Fast-time Consecutive Confocal Image Deblurring Using Spatiotemporal Fused Regularization.

Blind multi-Poissonian image deconvolution with sparse log-step gradient prior

A novel variational approach for multiphoton microscopy image restoration: from PSF estimation to 3D deconvolution

Bayesian Deconvolution of Scanning Electron Microscopy Images Using Point-spread Function Estimation and Non-local Regularization

Noise-robust, Physical Genuine Deconvolution Algorithm for Fluorescence Microscopy Enabled by Multi-Resolution Analysis

Resolution Improvement for OpticalCoherence Tomography based on Sparse Continuous Deconvolution

Noise-robust, physical microscopic deconvolution algorithm enabled by multi-resolution analysis regularization

Re-thinking Richardson-Lucy without Iteration Cutoffs: Physically Motivated Bayesian Deconvolution

The Secrets of Non-Blind Poisson Deconvolution

Convolutional Deblurring for Natural Imaging

A Sparse Proximal Newton Splitting Method for Constrained Image Deblurring

Resolution enhancement with deblurring by pixel reassignment