Abstract:In multi-photon microscopy (MPM), a recent in-vivo fluorescence microscopy system, the task of image restoration can be decomposed into two interlinked inverse problems: firstly, the characterization of the Point Spread Function (PSF) and subsequently, the deconvolution (i.e., deblurring) to remove the PSF effect, and reduce noise. The acquired MPM image quality is critically affected by PSF blurring and intense noise. The PSF in MPM is highly spread in 3D and is not well characterized, presenting high variability with respect to the observed objects. This makes the restoration of MPM images challenging. Common PSF estimation methods in fluorescence microscopy, including MPM, involve capturing images of sub-resolution beads, followed by quantifying the resulting ellipsoidal 3D spot. In this work, we revisit this approach, coping with its inherent limitations in terms of accuracy and practicality. We estimate the PSF from the observation of relatively large beads (approximately 1$\mu$m in diameter). This goes through the formulation and resolution of an original non-convex minimization problem, for which we propose a proximal alternating method along with convergence guarantees. Following the PSF estimation step, we then introduce an innovative strategy to deal with the high level multiplicative noise degrading the acquisitions. We rely on a heteroscedastic noise model for which we estimate the parameters. We then solve a constrained optimization problem to restore the image, accounting for the estimated PSF and noise, while allowing a minimal hyper-parameter tuning. Theoretical guarantees are given for the restoration algorithm. These algorithmic contributions lead to an end-to-end pipeline for 3D image restoration in MPM, that we share as a publicly available Python software. We demonstrate its effectiveness through several experiments on both simulated and real data.

Image restoration of solar spectra

Recovering of Images Degraded by Atmosphere

A method for remote sensing image restoration using gyroscope sensor

Fast non-iterative blind restoration of hyperspectral images with PSFs

Analysis Of Image Restoration And Evaluation For Diffraction-Degraded Remote Sensing Image

A direct restoration method for spectral and image analysis

Image Restoration Using Dual-Domain Fusion Network for Rotating Rectangular Synthetic Aperture System

Image Restoration Via Improved Wiener Filter Applied to Optical Sparse Aperture Systems

3-D deconvolution of hyper-spectral astronomical data

Spectral deconvolution with deep learning: removing the effects of spectral PSF broadening

Enhancement of Ambient Mass Spectrometry Imaging Data by Image Restoration

A Blind Restoration Method for Remote Sensing Images

Hyperspectral Restoration Via $L_0$ Gradient Regularized Low-Rank Tensor Factorization

Introduction of an airborne narrow band multispectral digital camera system and its image restoration method

Wide-field imaging at mid infrared wavelengths: reconstruction of chopped and nodded data

Restoration of Binocular Images Degraded by Optical Scattering through Estimation of Atmospheric Coefficients

Image Restoration Based on Statistic PSF Modeling for Improving the Astrometry of Space Debris

High-Spatial-Resolution Imaging Combining High-Order Adaptive Optics, Frame Selection, and Speckle Masking Reconstruction

A Novel Variational Approach for Multiphoton Microscopy Image Restoration: from PSF Estimation to 3D Deconvolution

Spectral Unmixing Based Image Restoration for Optical Remote Sensing Images Covered by Thin Cloud

Instrument-To-Instrument translation: Instrumental advances drive restoration of solar observation series via deep learning