Abstract:Acoustic-resolution photoacoustic microscopy (AR-PAM) image resolution is determined by the point spread function (PSF) of the imaging system. Previous algorithms, including Richardson–Lucy (R-L) deconvolution and model-based (MB) deconvolution, improve spatial resolution by taking advantage of the PSF as prior knowledge. However, these methods encounter the problems of inaccurate deconvolution, meaning the deconvolved feature size and the original one are not consistent (e.g., the former can be smaller than the latter). We present a novel deep convolution neural network (CNN)-based algorithm featuring high-fidelity recovery of multiscale feature size to improve lateral resolution of AR-PAM. The CNN is trained with simulated image pairs of line patterns, which is to mimic blood vessels. To investigate the suitable CNN model structure and elaborate on the effectiveness of CNN methods compared with non-learning methods, we select five different CNN models, while R-L and directional MB methods are also applied for comparison. Besides simulated data, experimental data including tungsten wires, leaf veins, and in vivo blood vessels are also evaluated. A custom-defined metric of relative size error (RSE) is used to quantify the multiscale feature recovery ability of different methods. Compared to other methods, enhanced deep super resolution (EDSR) network and residual in residual dense block network (RRDBNet) model show better recovery in terms of RSE for tungsten wires with diameters ranging from 30 μm to 120 μm. Moreover, AR-PAM images of leaf veins are tested to demonstrate the effectiveness of the optimized CNN methods (by EDSR and RRDBNet) for complex patterns. Finally, in vivo images of mouse ear blood vessels and rat ear blood vessels are acquired and then deconvolved, and the results show that the proposed CNN method (notably RRDBNet) enables accurate deconvolution of multiscale feature size and thus good fidelity.

Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Deep and Domain Transfer Learning Aided Photoacoustic Microscopy: Acoustic Resolution to Optical Resolution

Resolution Enhancement of Under-sampled Photoacoustic Microscopy Images using Implicit Neural Representations

Reconstructing undersampled photoacoustic microscopy images using deep learning

Deep Learning-Powered Biomedical Photoacoustic Imaging

Photoacoustic Microscopy Imaging from Acoustic Resolution to Optical Resolution Enhancement with Deep Learning

High-fidelity deconvolution for acoustic-resolution photoacoustic microscopy enabled by convolutional neural networks

HSD-PAM: High Speed Super Resolution Deep Penetration Photoacoustic Microscopy Imaging Boosted by Dual Branch Fusion Network

Deep learning in photoacoustic imaging: a review

Unsupervised Learning for Enhanced Computed Photoacoustic Microscopy

Deep Learning-Based Super-Resolution Reconstruction and Segmentation of Photoacoustic Images

Image enhancement in acoustic-resolution photoacoustic microscopy enabled by a novel directional algorithm

Reconstructing the Photoacoustic Image with High Quality using the Deep Neural Network Model

Noise‐insensitive defocused signal and resolution enhancement for optical‐resolution photoacoustic microscopy via deep learning

Deep learning-based photoacoustic imaging of vascular network through thick porous media

Advances in Photoacoustic Imaging Reconstruction and Quantitative Analysis for Biomedical Applications

Photoacoustic Microscopy in Vivo Using Synthetic-Aperture Focusing Technique Combined with Three-Dimensional Deconvolution.

Sounding out the hidden data: A concise review of deep learning in photoacoustic imaging

Deep-Learning Image Reconstruction for Real-Time Photoacoustic System

Deep learning for biomedical photoacoustic imaging: A review

Deep learning for photoacoustic imaging: a survey