Abstract:Acoustic-resolution photoacoustic microscopy (AR-PAM) image resolution is determined by the point spread function (PSF) of the imaging system. Previous algorithms, including Richardson–Lucy (R-L) deconvolution and model-based (MB) deconvolution, improve spatial resolution by taking advantage of the PSF as prior knowledge. However, these methods encounter the problems of inaccurate deconvolution, meaning the deconvolved feature size and the original one are not consistent (e.g., the former can be smaller than the latter). We present a novel deep convolution neural network (CNN)-based algorithm featuring high-fidelity recovery of multiscale feature size to improve lateral resolution of AR-PAM. The CNN is trained with simulated image pairs of line patterns, which is to mimic blood vessels. To investigate the suitable CNN model structure and elaborate on the effectiveness of CNN methods compared with non-learning methods, we select five different CNN models, while R-L and directional MB methods are also applied for comparison. Besides simulated data, experimental data including tungsten wires, leaf veins, and in vivo blood vessels are also evaluated. A custom-defined metric of relative size error (RSE) is used to quantify the multiscale feature recovery ability of different methods. Compared to other methods, enhanced deep super resolution (EDSR) network and residual in residual dense block network (RRDBNet) model show better recovery in terms of RSE for tungsten wires with diameters ranging from 30 μm to 120 μm. Moreover, AR-PAM images of leaf veins are tested to demonstrate the effectiveness of the optimized CNN methods (by EDSR and RRDBNet) for complex patterns. Finally, in vivo images of mouse ear blood vessels and rat ear blood vessels are acquired and then deconvolved, and the results show that the proposed CNN method (notably RRDBNet) enables accurate deconvolution of multiscale feature size and thus good fidelity.

Enhanced resolution and sensitivity acoustic-resolution photoacoustic microscopy with semi/unsupervised GANs

Deep and Domain Transfer Learning Aided Photoacoustic Microscopy: Acoustic Resolution to Optical Resolution

Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Feasibility of a Generative Adversarial Network for Artifact Removal in Experimental Photoacoustic Imaging

Artifact Removal in Photoacoustic Tomography with an Unsupervised Method.

Enhancing Photoacoustic Imaging with BFP-GAN

Resolution Enhancement of Under-sampled Photoacoustic Microscopy Images using Implicit Neural Representations

Image enhancement in acoustic-resolution photoacoustic microscopy enabled by a novel directional algorithm

Unsupervised Learning for Enhanced Computed Photoacoustic Microscopy

High-fidelity deconvolution for acoustic-resolution photoacoustic microscopy enabled by convolutional neural networks

De-Noising of Photoacoustic Microscopy Images by Attentive Generative Adversarial Network

Reconstructing undersampled photoacoustic microscopy images using deep learning

DensePANet: An improved generative adversarial network for photoacoustic tomography image reconstruction from sparse data

Resolution enhancement and realistic speckle recovery with generative adversarial modeling of micro-optical coherence tomography

HSD-PAM: High Speed Super Resolution Deep Penetration Photoacoustic Microscopy Imaging Boosted by Dual Branch Fusion Network

Mean-reverting diffusion model-enhanced acoustic-resolution photoacoustic microscopy for resolution enhancement: Toward optical resolution

Achieving depth-independent lateral resolution in AR-PAM using the synthetic-aperture focusing technique

R2D2-GAN: Robust Dual Discriminator Generative Adversarial Network for Microscopy Hyperspectral Image Super-Resolution

Photoacoustic Microscopy Imaging from Acoustic Resolution to Optical Resolution Enhancement with Deep Learning

High-resolution medical image synthesis using progressively grown generative adversarial networks

Photoacoustic Microscopy in Vivo Using Synthetic-Aperture Focusing Technique Combined with Three-Dimensional Deconvolution.