Abstract:This study introduces VAN‐GAN, an unsupervised deep learning model for 3D vascular network segmentation in mesoscopic photoacoustic imaging. By integrating synthetic blood vessel networks and advanced training techniques, VAN‐GAN demonstrates accurate and unbiased segmentation across in silico, in vitro, and in vivo datasets, including clinical angiograms, reducing reliance on manual labeling and minimizing bias in vascular research. Mesoscopic photoacoustic imaging (PAI) enables label‐free visualization of vascular networks in tissues with high contrast and resolution. Segmenting these networks from 3D PAI data and interpreting their physiological and pathological significance is crucial yet challenging due to the time‐consuming and error‐prone nature of current methods. Deep learning offers a potential solution; however, supervised analysis frameworks typically require human‐annotated ground‐truth labels. To address this, an unsupervised image‐to‐image translation deep learning model is introduced, the Vessel Segmentation Generative Adversarial Network (VAN‐GAN). VAN‐GAN integrates synthetic blood vessel networks that closely resemble real‐life anatomy into its training process and learns to replicate the underlying physics of the PAI system in order to learn how to segment vasculature from 3D photoacoustic images. Applied to a diverse range of in silico, in vitro, and in vivo data, including patient‐derived breast cancer xenograft models and 3D clinical angiograms, VAN‐GAN demonstrates its capability to facilitate accurate and unbiased segmentation of 3D vascular networks. By leveraging synthetic data, VAN‐GAN reduces the reliance on manual labeling, thus lowering the barrier to entry for high‐quality blood vessel segmentation (F1 score: VAN‐GAN vs. U‐Net = 0.84 vs. 0.87) and enhancing preclinical and clinical research into vascular structure and function.

Hybrid deep learning network for vascular segmentation in photoacoustic imaging

VesselNet: A deep convolutional neural network with multi pathways for robust hepatic vessel segmentation

Accurate Retinal Vessel Segmentation via Octave Convolution Neural Network

Deep learning-based photoacoustic imaging of vascular network through thick porous media

Graph Convolution Based Cross-Network Multiscale Feature Fusion for Deep Vessel Segmentation

Y-Net: Hybrid deep learning image reconstruction for photoacoustic tomography in vivo

Unsupervised Segmentation of 3D Microvascular Photoacoustic Images Using Deep Generative Learning

Deep Learning Enhanced Volumetric Photoacoustic Imaging of Vasculature in Human (Adv. Sci. 29/2023)

Y-Net: A Hybrid Deep Learning Reconstruction Framework for Photoacoustic Imaging in vivo

Joint Segmentation and Image Reconstruction with Error Prediction in Photoacoustic Imaging using Deep Learning

CSDN: Combing Shallow and Deep Networks for Accurate Real-time Segmentation of High-definition Intravascular Ultrasound Images

Wavelet-guided network with fine-grained feature extraction for vessel segmentation

O-Net: A Convolutional Neural Network for Quantitative Photoacoustic Image Segmentation and Oximetry

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

Lightweight Attention Convolutional Neural Network for Retinal Vessel Image Segmentation

Multikernel positional embedding convolutional neural network for photoacoustic reconstruction with sparse data

HDN:Hybrid Deep-learning and Non-line-of-sight Reconstruction Framework for Photoacoustic Brain Imaging

High-precision retinal blood vessel segmentation based on a multi-stage and dual-channel deep learning network

Reconstructing the Photoacoustic Image with High Quality using the Deep Neural Network Model

A U-Net Deep Learning Framework for High Performance Vessel Segmentation in Patients With Cerebrovascular Disease