Abstract:Acoustic-resolution photoacoustic microscopy (AR-PAM) image resolution is determined by the point spread function (PSF) of the imaging system. Previous algorithms, including Richardson–Lucy (R-L) deconvolution and model-based (MB) deconvolution, improve spatial resolution by taking advantage of the PSF as prior knowledge. However, these methods encounter the problems of inaccurate deconvolution, meaning the deconvolved feature size and the original one are not consistent (e.g., the former can be smaller than the latter). We present a novel deep convolution neural network (CNN)-based algorithm featuring high-fidelity recovery of multiscale feature size to improve lateral resolution of AR-PAM. The CNN is trained with simulated image pairs of line patterns, which is to mimic blood vessels. To investigate the suitable CNN model structure and elaborate on the effectiveness of CNN methods compared with non-learning methods, we select five different CNN models, while R-L and directional MB methods are also applied for comparison. Besides simulated data, experimental data including tungsten wires, leaf veins, and in vivo blood vessels are also evaluated. A custom-defined metric of relative size error (RSE) is used to quantify the multiscale feature recovery ability of different methods. Compared to other methods, enhanced deep super resolution (EDSR) network and residual in residual dense block network (RRDBNet) model show better recovery in terms of RSE for tungsten wires with diameters ranging from 30 μm to 120 μm. Moreover, AR-PAM images of leaf veins are tested to demonstrate the effectiveness of the optimized CNN methods (by EDSR and RRDBNet) for complex patterns. Finally, in vivo images of mouse ear blood vessels and rat ear blood vessels are acquired and then deconvolved, and the results show that the proposed CNN method (notably RRDBNet) enables accurate deconvolution of multiscale feature size and thus good fidelity.

Deep learning acceleration of multiscale superresolution localization photoacoustic imaging

Universal and High-Fidelity Resolution Extending for Fluorescence Microscopy Using a Single-Training Physics-Informed Sparse Neural Network

Reconstructing undersampled photoacoustic microscopy images using deep learning

Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Deep-Learning Image Reconstruction for Real-Time Photoacoustic System

Noise‐insensitive defocused signal and resolution enhancement for optical‐resolution photoacoustic microscopy via deep learning

Deep Learning for Super-Resolution Localization Microscopy

Unsupervised deep learning enables real-time image registration of fast-scanning optical-resolution photoacoustic microscopy

Simultaneous Denoising and Localization Network for Photoacoustic Target Localization

Simultaneous reconstruction of the initial pressure and sound speed in photoacoustic tomography using a deep-learning approach

Efficient Photoacoustic Image Synthesis with Deep Learning

High-fidelity deconvolution for acoustic-resolution photoacoustic microscopy enabled by convolutional neural networks

Field-dependent deep learning enables high-throughput whole-cell 3D super-resolution imaging

Cascade neural approximating for few-shot super-resolution photoacoustic angiography

Unsupervised Learning for Enhanced Computed Photoacoustic Microscopy

Deep learning for photoacoustic imaging: a survey

Deep Learning Enhanced Volumetric Photoacoustic Imaging of Vasculature in Human (Adv. Sci. 29/2023)

Super-Resolution on Rotationally Scanned Photoacoustic Microscopy Images Incorporating Scanning Prior

Sparse‐View Photoacoustic Reconstruction Method for Diabetic Retinopathy Using Feature Fusion Network

Unsupervised deep learning enables blur-free super-resolution in two-photon microscopy

Deep learning-based photoacoustic imaging of vascular network through thick porous media