Abstract:In multi-photon microscopy (MPM), a recent in-vivo fluorescence microscopy system, the task of image restoration can be decomposed into two interlinked inverse problems: firstly, the characterization of the Point Spread Function (PSF) and subsequently, the deconvolution (i.e., deblurring) to remove the PSF effect, and reduce noise. The acquired MPM image quality is critically affected by PSF blurring and intense noise. The PSF in MPM is highly spread in 3D and is not well characterized, presenting high variability with respect to the observed objects. This makes the restoration of MPM images challenging. Common PSF estimation methods in fluorescence microscopy, including MPM, involve capturing images of sub-resolution beads, followed by quantifying the resulting ellipsoidal 3D spot. In this work, we revisit this approach, coping with its inherent limitations in terms of accuracy and practicality. We estimate the PSF from the observation of relatively large beads (approximately 1μm in diameter). This goes through the formulation and resolution of an original non-convex minimization problem, for which we propose a proximal alternating method along with convergence guarantees. Following the PSF estimation step, we then introduce an innovative strategy to deal with the high level multiplicative noise degrading the acquisitions. We rely on a heteroscedastic noise model for which we estimate the parameters. We then solve a constrained optimization problem to restore the image, accounting for the estimated PSF and noise, while allowing a minimal hyper-parameter tuning. Theoretical guarantees are given for the restoration algorithm. These algorithmic contributions lead to an end-to-end pipeline for 3D image restoration in MPM, that we share as a publicly available Python software. We demonstrate its effectiveness through several experiments on both simulated and real data.

Fast and Robust Restoration of Single Photon 3D Data Using Parameterized Kernel

Fast non-iterative blind restoration of hyperspectral images with PSFs

Multi-slice Ptychographic Imaging with Multistage Coarse-to-fine Reconstruction

Fast and Quantitative Reconstruction of 4D SPECT for Fan-beam Geometry Based on Novikov's Inverse Formula

Fast Multispectral Imaging by Spatial Pixel-Binning and Spectral Unmixing

Data Driven Robust Image Guided Depth Map Restoration

Pet Image Reconstruction: GPU-accelerated Particle Filter Framework

A flexible and accurate total variation and cascaded denoisers-based image reconstruction algorithm for hyperspectrally compressed ultrafast photography

A novel variational approach for multiphoton microscopy image restoration: from PSF estimation to 3D deconvolution

Parameterized Reconstruction Based Fourier Ptychography

3d Fourier Ptychographic Microscopy Based On The Beam Propagation Method And Time-Reversal Scheme

Fast Hyperspectral Reconstruction for Neutron Computed Tomography Using Subspace Extraction

Fast and Robust Deconvolution-Based Image Reconstruction for Photoacoustic Tomography in Circular Geometry: Experimental Validation

Fast Implementation and Quantitative Evaluation of Analytical Methods with Wiener Filters for Image Reconstruction in 3D SPECT

Photon-Efficient 3D Imaging with A Non-local Neural Network

Study of 3D fast Compton camera image reconstruction method by algebraic spatial sampling

Fourier Ptychographic Reconstruction Using Poisson Maximum Likelihood and Truncated Wirtinger Gradient

Fourier ptychographic reconstruction with denoising diffusion probabilistic models

Five-view Three-Dimensional Reconstruction for Ultrafast Dynamic Imaging of Pulsed Radiation Sources

Photon-counting spectral CT reconstruction with sparse and double low-rank components fusion