Abstract:The unique advantage of optical-resolution photoacoustic microscopy (OR-PAM) is its ability to achieve high-resolution microvascular imaging without exogenous agents. This ability has excellent potential in the study of tissue microcirculation. However, tracing and monitoring microvascular morphology and hemodynamics in tissues is challenging because the segmentation of microvascular in OR-PAM images is complex due to the high density, structure complexity, and low contrast of vascular structures. Various microvasculature extraction techniques have been developed over the years but have many limitations: they cannot consider both thick and thin blood vessel segmentation simultaneously, they cannot address incompleteness and discontinuity in microvasculature, there is a lack of open-access datasets for DL-based algorithms. We have developed a novel segmentation approach to extract vascularity in OR-PAM images using a deep learning network incorporating a weak signal attention mechanism and multi-scale perception (WSA-MP-Net) model. The proposed WSA network focuses on weak and tiny vessels, while the MP module extracts features from different vessel sizes. In addition, Hessian-matrix enhancement is incorporated into the pre-and post-processing of the input and output data of the network to enhance vessel continuity. We constructed normal vessel (NV-ORPAM, 660 data pairs) and tumor vessel (TV-ORPAM, 1168 data pairs) datasets to verify the performance of the proposed method. We developed a semi-automatic annotation algorithm to obtain the ground truth for our network optimization. We applied our optimized model successfully to monitor glioma angiogenesis in mouse brains, thus demonstrating the feasibility and excellent generalization ability of our model. Compared to previous works, our proposed WSA-MP-Net extracts a significant number of microvascular while maintaining vessel continuity and signal fidelity. In quantitative analysis, the indicator values of our method improved by about 1.3% to 25.9%. We believe our proposed approach provides a promising way to extract a complete and continuous microvascular network of OR-PAM and enables its use in many microvascular-related biological studies and medical diagnoses.

Deep Learning-Based Optical-Resolution Photoacoustic Microscopy for In Vivo 3D Microvasculature Imaging and Segmentation

A microvascular image analysis method for optical-resolution photoacoustic microscopy

Multiscale Vascular Enhancement Filter Applied Toin VivoMorphologic and Functional Photoacoustic Imaging of Rat Ocular Vasculature

Blind-deconvolution optical-resolution photoacoustic microscopy in vivo.

Synthetic multi-focus optical-resolution photoacoustic microscope for large volumetric imaging

Multi-parametric Quantitative Microvascular Imaging with Optical-Resolution Photoacoustic Microscopy in Vivo

Optical-resolution photoacoustic microscopy with a needle-shaped beam

HSD-PAM: High Speed Super Resolution Deep Penetration Photoacoustic Microscopy Imaging Boosted by Dual Branch Fusion Network

Optical-resolution photoacoustic microscopy for in vivo imaging of single capillaries

Portable Optical‐resolution Photoacoustic Microscopy for Volumetric Imaging of Multiscale Organisms

WSA-MP-Net: Weak-signal-attention and multi-scale perception network for microvascular extraction in optical-resolution photoacoustic microcopy

Noninvasive three-dimensional optoacoustic localization microangiography of deep tissues

Reconstructing undersampled photoacoustic microscopy images using deep learning

Unsupervised Learning for Enhanced Computed Photoacoustic Microscopy

Longitudinal label-free optical-resolution photoacoustic microscopy of tumor angiogenesis in vivo.

Freehand scanning photoacoustic microscopy with simultaneous localization and mapping

Imaging Enhancement for Acoustic-Resolution Photoacoustic Microscopy by Deep Learning

Deep and Domain Transfer Learning Aided Photoacoustic Microscopy: Acoustic Resolution to Optical Resolution

Imaging 3D Cell Culture Systems Using an Optical Resolution Photoacoustic Microscope

3d High Resolution Photoacoustic Imaging Based On Pure Optical Photoacoustic Microscopy With Microring Resonator

Deep image prior for undersampling high-speed photoacoustic microscopy