Abstract:The unique advantage of optical-resolution photoacoustic microscopy (OR-PAM) is its ability to achieve high-resolution microvascular imaging without exogenous agents. This ability has excellent potential in the study of tissue microcirculation. However, tracing and monitoring microvascular morphology and hemodynamics in tissues is challenging because the segmentation of microvascular in OR-PAM images is complex due to the high density, structure complexity, and low contrast of vascular structures. Various microvasculature extraction techniques have been developed over the years but have many limitations: they cannot consider both thick and thin blood vessel segmentation simultaneously, they cannot address incompleteness and discontinuity in microvasculature, there is a lack of open-access datasets for DL-based algorithms. We have developed a novel segmentation approach to extract vascularity in OR-PAM images using a deep learning network incorporating a weak signal attention mechanism and multi-scale perception (WSA-MP-Net) model. The proposed WSA network focuses on weak and tiny vessels, while the MP module extracts features from different vessel sizes. In addition, Hessian-matrix enhancement is incorporated into the pre-and post-processing of the input and output data of the network to enhance vessel continuity. We constructed normal vessel (NV-ORPAM, 660 data pairs) and tumor vessel (TV-ORPAM, 1168 data pairs) datasets to verify the performance of the proposed method. We developed a semi-automatic annotation algorithm to obtain the ground truth for our network optimization. We applied our optimized model successfully to monitor glioma angiogenesis in mouse brains, thus demonstrating the feasibility and excellent generalization ability of our model. Compared to previous works, our proposed WSA-MP-Net extracts a significant number of microvascular while maintaining vessel continuity and signal fidelity. In quantitative analysis, the indicator values of our method improved by about 1.3% to 25.9%. We believe our proposed approach provides a promising way to extract a complete and continuous microvascular network of OR-PAM and enables its use in many microvascular-related biological studies and medical diagnoses.

Multi-focus image fusion with enhancement filtering for robust vascular quantification using photoacoustic microscopy

Multi-focus Image Fusion Via Blind Deconvolution and Registration Based on Photoacoustic Microscopy

Multi-parametric Quantitative Microvascular Imaging with Optical-Resolution Photoacoustic Microscopy in Vivo

A microvascular image analysis method for optical-resolution photoacoustic microscopy

Synthetic multi-focus optical-resolution photoacoustic microscope for large volumetric imaging

Synthetic multi-focus optical-resolution photoacoustic microscope using multi-scale weighted gradient-based fusion

Multiscale Vascular Enhancement Filter Applied Toin VivoMorphologic and Functional Photoacoustic Imaging of Rat Ocular Vasculature

Direct 3D information fusion for depth of field enhancement in optical-resolution photoacoustic microscopy

High-resolution volumetric information fusion for depth of field enhancement in photoacoustic microscopy

Quantitative Analysis on in Vivo Tumor‐microvascular Images from Optical‐resolution Photoacoustic Microscopy

Noise insensitive volumetric fusion method for enhanced photoacoustic microscopy

Adaptive Synthetic-Aperture Focusing Technique for Microvasculature Imaging Using Photoacoustic Microscopy

Deep Learning-Based Optical-Resolution Photoacoustic Microscopy for In Vivo 3D Microvasculature Imaging and Segmentation

Image enhancement in acoustic-resolution photoacoustic microscopy enabled by a novel directional algorithm

WSA-MP-Net: Weak-signal-attention and multi-scale perception network for microvascular extraction in optical-resolution photoacoustic microcopy

High Resolution Multimodal Photoacoustic Microscopy and Optical Coherence Tomography Visualization of Choroidal Vascular Occlusion

Adaptive Vascular Enhancement of Flap Images in the Second Near-Infrared Window Based on Multiscale Fusion and Local Visual Saliency

Multi-Focus Image Fusion for Full-Field Optical Angiography

Vascular Tree Extraction for Photoacoustic Microscopy and Imaging of Cat Primary Visual Cortex

A New Framework for the Integrative Analytics of Intravascular Ultrasound and Optical Coherence Tomography Images

Two-Dimensional Synthetic-Aperture Focusing Technique In Photoacoustic Microscopy