Abstract:In multi-photon microscopy (MPM), a recent in-vivo fluorescence microscopy system, the task of image restoration can be decomposed into two interlinked inverse problems: firstly, the characterization of the Point Spread Function (PSF) and subsequently, the deconvolution (i.e., deblurring) to remove the PSF effect, and reduce noise. The acquired MPM image quality is critically affected by PSF blurring and intense noise. The PSF in MPM is highly spread in 3D and is not well characterized, presenting high variability with respect to the observed objects. This makes the restoration of MPM images challenging. Common PSF estimation methods in fluorescence microscopy, including MPM, involve capturing images of sub-resolution beads, followed by quantifying the resulting ellipsoidal 3D spot. In this work, we revisit this approach, coping with its inherent limitations in terms of accuracy and practicality. We estimate the PSF from the observation of relatively large beads (approximately 1μm in diameter). This goes through the formulation and resolution of an original non-convex minimization problem, for which we propose a proximal alternating method along with convergence guarantees. Following the PSF estimation step, we then introduce an innovative strategy to deal with the high level multiplicative noise degrading the acquisitions. We rely on a heteroscedastic noise model for which we estimate the parameters. We then solve a constrained optimization problem to restore the image, accounting for the estimated PSF and noise, while allowing a minimal hyper-parameter tuning. Theoretical guarantees are given for the restoration algorithm. These algorithmic contributions lead to an end-to-end pipeline for 3D image restoration in MPM, that we share as a publicly available Python software. We demonstrate its effectiveness through several experiments on both simulated and real data.

Research on the 3d Image Restoration of the Wide-Field Microscope Based on the Mpmap

Imaging Resolution and Properties Analysis of Super Resolution Microscopy with Parallel Detection under Different Noise, Detector and Image Restoration Conditions

Parallel Detecting Super-Resolution Microscopy Using Correlation Based Image Restoration

Maximum a Posteriori Restoration with Markov Constraint for Three-Dimensional Optical-Sectioning Microscopy

A Method of Restoration for the 3D Image of Wide-Field Microscope Based on Wavelet Packet Analysis Denoising

Super-resolution Restoration of Remote-sensing Images

Mpmap Super-Resolution Image Restoration Algorithm Based on Multiframes or Multisensors

A Restoration Method for 3D Image of the Wide-field Microscope Based on the Network

A Positional Misalignment Correction Method for Fourier Ptychographic Microscopy Based on the Quasi-Newton Method with a Global Optimization Module

Adaptive Super-Resolution Restoration Method Based on MAP

3-D microscopical image restoration based on anisotropic Markov random field in wavelet domain

Restoration of 3-Dimensional Microscopical Images Based on Markov Random Field with Adaptive Regularization Parameter

POCS-MPMAP Based Super-Resolution Image Restoration

Super-resolution Algorithm Based on Post Wavelet Treatment

A novel variational approach for multiphoton microscopy image restoration: from PSF estimation to 3D deconvolution

Investigation about 3D Microscopical Image Restoration and PSF

Super-Resolution Interpolation Algorithm Based on Mixed Bi-Cubic MPMAP Algorithm

Application Study Of Near-Neighbor Algorithm On Three-Dimensional Microscope Image Restoration

High-Resolution Reconstruction and Non-Uniformity Correction from Images Sequences Based on Poisson-Markov Model MAP

Improved MAP Based Algorithm for Image Super-resolution Restoration