Abstract:The unique advantage of optical-resolution photoacoustic microscopy (OR-PAM) is its ability to achieve high-resolution microvascular imaging without exogenous agents. This ability has excellent potential in the study of tissue microcirculation. However, tracing and monitoring microvascular morphology and hemodynamics in tissues is challenging because the segmentation of microvascular in OR-PAM images is complex due to the high density, structure complexity, and low contrast of vascular structures. Various microvasculature extraction techniques have been developed over the years but have many limitations: they cannot consider both thick and thin blood vessel segmentation simultaneously, they cannot address incompleteness and discontinuity in microvasculature, there is a lack of open-access datasets for DL-based algorithms. We have developed a novel segmentation approach to extract vascularity in OR-PAM images using a deep learning network incorporating a weak signal attention mechanism and multi-scale perception (WSA-MP-Net) model. The proposed WSA network focuses on weak and tiny vessels, while the MP module extracts features from different vessel sizes. In addition, Hessian-matrix enhancement is incorporated into the pre-and post-processing of the input and output data of the network to enhance vessel continuity. We constructed normal vessel (NV-ORPAM, 660 data pairs) and tumor vessel (TV-ORPAM, 1168 data pairs) datasets to verify the performance of the proposed method. We developed a semi-automatic annotation algorithm to obtain the ground truth for our network optimization. We applied our optimized model successfully to monitor glioma angiogenesis in mouse brains, thus demonstrating the feasibility and excellent generalization ability of our model. Compared to previous works, our proposed WSA-MP-Net extracts a significant number of microvascular while maintaining vessel continuity and signal fidelity. In quantitative analysis, the indicator values of our method improved by about 1.3% to 25.9%. We believe our proposed approach provides a promising way to extract a complete and continuous microvascular network of OR-PAM and enables its use in many microvascular-related biological studies and medical diagnoses.

Unsupervised adversarial neural network for enhancing vasculature in photoacoustic tomography images using optical coherence tomography angiography

Quantitative Endoscopic Photoacoustic Tomography Using a Convolutional Neural Network.

VesselNet: A deep convolutional neural network with multi pathways for robust hepatic vessel segmentation

A Deep Learning Based Pipeline for Optical Coherence Tomography Angiography

Deep learning-based photoacoustic imaging of vascular network through thick porous media

Augmenting Vascular Disease Diagnosis by Vasculature-aware Unsupervised Learning

Deep-Learning-based Vasculature Extraction for Single-Scan Optical Coherence Tomography Angiography

WSA-MP-Net: Weak-signal-attention and multi-scale perception network for microvascular extraction in optical-resolution photoacoustic microcopy

Improving Cerebral Microvascular Image Quality of Optical Coherence Tomography Angiography with Deep Learning-Based Segmentation.

Limited View and Sparse Photoacoustic Tomography for Neuroimaging with Deep Learning

Comparative study of deep learning models for optical coherence tomography angiography

Imaging depth adaptive resolution enhancement for optical coherence tomography via deep neural network with external attention

Segmentation of Low-Light Optical Coherence Tomography Angiography Images under the Constraints of Vascular Network Topology

Weakly Supervised Deep Learning-Based Optical Coherence Tomography Angiography.

Deep‐learning visualization enhancement method for optical coherence tomography angiography in dermatology

OVS-Net: an Effective Feature Extraction Network for Optical Coherence Tomography Angiography Vessel Segmentation.

Optical-visualized photoacoustic tomographic navigation

AV-Net: Deep learning for fully automated artery-vein classification in optical coherence tomography angiography

Unsupervised Disentanglement Strategy for Mitigating Artifact in Photoacoustic Tomography under Extremely Sparse View

Integrated deep learning framework for accelerated optical coherence tomography angiography

Photoacoustic digital brain and deep-learning-assisted image reconstruction