Abstract:The unique advantage of optical-resolution photoacoustic microscopy (OR-PAM) is its ability to achieve high-resolution microvascular imaging without exogenous agents. This ability has excellent potential in the study of tissue microcirculation. However, tracing and monitoring microvascular morphology and hemodynamics in tissues is challenging because the segmentation of microvascular in OR-PAM images is complex due to the high density, structure complexity, and low contrast of vascular structures. Various microvasculature extraction techniques have been developed over the years but have many limitations: they cannot consider both thick and thin blood vessel segmentation simultaneously, they cannot address incompleteness and discontinuity in microvasculature, there is a lack of open-access datasets for DL-based algorithms. We have developed a novel segmentation approach to extract vascularity in OR-PAM images using a deep learning network incorporating a weak signal attention mechanism and multi-scale perception (WSA-MP-Net) model. The proposed WSA network focuses on weak and tiny vessels, while the MP module extracts features from different vessel sizes. In addition, Hessian-matrix enhancement is incorporated into the pre-and post-processing of the input and output data of the network to enhance vessel continuity. We constructed normal vessel (NV-ORPAM, 660 data pairs) and tumor vessel (TV-ORPAM, 1168 data pairs) datasets to verify the performance of the proposed method. We developed a semi-automatic annotation algorithm to obtain the ground truth for our network optimization. We applied our optimized model successfully to monitor glioma angiogenesis in mouse brains, thus demonstrating the feasibility and excellent generalization ability of our model. Compared to previous works, our proposed WSA-MP-Net extracts a significant number of microvascular while maintaining vessel continuity and signal fidelity. In quantitative analysis, the indicator values of our method improved by about 1.3% to 25.9%. We believe our proposed approach provides a promising way to extract a complete and continuous microvascular network of OR-PAM and enables its use in many microvascular-related biological studies and medical diagnoses.

Multi-parametric Quantitative Microvascular Imaging with Optical-Resolution Photoacoustic Microscopy in Vivo

Quantitative Analysis on in Vivo Tumor‐microvascular Images from Optical‐resolution Photoacoustic Microscopy

A microvascular image analysis method for optical-resolution photoacoustic microscopy

Progress in High-Resolution Vascular Imaging and Quantification(Invited)

Multi-focus image fusion with enhancement filtering for robust vascular quantification using photoacoustic microscopy

Longitudinal label-free optical-resolution photoacoustic microscopy of tumor angiogenesis in vivo.

Three-dimensional Hessian Matrix-Based Quantitative Vascular Imaging of Rat Iris with Optical-Resolution Photoacoustic Microscopy in Vivo

Deep Learning-Based Optical-Resolution Photoacoustic Microscopy for In Vivo 3D Microvasculature Imaging and Segmentation

Simultaneous photoacoustic microscopy of microvascular anatomy, oxygen saturation, and blood flow.

Multiscale Vascular Enhancement Filter Applied Toin VivoMorphologic and Functional Photoacoustic Imaging of Rat Ocular Vasculature

Noninvasive three-dimensional optoacoustic localization microangiography of deep tissues

High Resolution Multimodal Photoacoustic Microscopy and Optical Coherence Tomography Visualization of Choroidal Vascular Occlusion

Optical-resolution photoacoustic microscopy for in vivo imaging of single capillaries

Optical-resolution Photoacoustic Microscopy for Monitoring Vascular Normalization During Anti-Angiogenic Therapy

WSA-MP-Net: Weak-signal-attention and multi-scale perception network for microvascular extraction in optical-resolution photoacoustic microcopy

In Vivo Quantitative Vasculature Segmentation and Assessment for Photodynamic Therapy Process Monitoring Using Photoacoustic Microscopy

Depth-Resolved Localization Microangiography in the NIR-II Window

Label-free oxygen-metabolic photoacoustic microscopy in vivo

Ultrasound-aided Multi-parametric Photoacoustic Microscopy of the Mouse Brain

Portable Optical‐resolution Photoacoustic Microscopy for Volumetric Imaging of Multiscale Organisms

Quantitative Cell Nuclear Imaging by Dual-View Optical-Resolution Photoacoustic Microscopy