Abstract:Blood vessel orientation as visualized in 3D medical images is an important descriptor of its geometry that can be used for centerline extraction and subsequent segmentation and visualization. Arteries appear at many scales and levels of tortuosity, and determining their exact orientation is challenging. Recent works have used 3D convolutional neural networks (CNNs) for this purpose, but CNNs are sensitive to varying vessel sizes and orientations. We present SIRE: a scale-invariant, rotation-equivariant estimator for local vessel orientation. SIRE is modular and can generalise due to symmetry preservation. SIRE consists of a gauge equivariant mesh CNN (GEM-CNN) operating on multiple nested spherical meshes with different sizes in parallel. The features on each mesh are a projection of image intensities within the corresponding sphere. These features are intrinsic to the sphere and, in combination with the GEM-CNN, lead to SO(3)-equivariance. Approximate scale invariance is achieved by weight sharing and use of a symmetric maximum function to combine multi-scale predictions. Hence, SIRE can be trained with arbitrarily oriented vessels with varying radii to generalise to vessels with a wide range of calibres and tortuosity. We demonstrate the efficacy of SIRE using three datasets containing vessels of varying scales: the vascular model repository (VMR), the ASOCA coronary artery set, and a set of abdominal aortic aneurysms (AAAs). We embed SIRE in a centerline tracker which accurately tracks AAAs, regardless of the data SIRE is trained with. Moreover, SIRE can be used to track coronary arteries, even when trained only with AAAs. In conclusion, by incorporating SO(3) and scale symmetries, SIRE can determine the orientations of vessels outside of the training domain, forming a robust and data-efficient solution to geometric analysis of blood vessels in 3D medical images.

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is **how to accurately estimate the local orientation of blood vessels in 3D medical images, especially when dealing with blood vessels of different scales and complex curvatures**. Specifically, traditional 3D convolutional neural networks (CNNs) have two main limitations when dealing with blood vessel orientation estimation: 1. **Scale - sensitivity**: Traditional methods usually use fixed - size cubic image patches to estimate blood vessel orientation, which makes them perform poorly when dealing with blood vessels of different diameters. For example, the diameters of coronary arteries and aortas vary greatly, resulting in unstable performance of the same network on blood vessels of different scales. 2. **Rotation - sensitivity**: Due to the complex curvature of blood vessels, local image patches do not have a standard orientation. Traditional CNNs are not rotation - equivariant, that is, when the input image is rotated, the output will not rotate accordingly, which limits their robustness in practical applications. To solve these problems, the authors propose **SIRE (Scale - Invariant, Rotation - Equivariant Estimator of artery orientations using graph neural networks)**, which is a local blood vessel orientation estimator based on graph neural networks. SIRE has the following two key features: - **Scale Invariance**: SIRE achieves robust estimation of blood vessels of different diameters by processing spherical image signals in parallel at multiple scales and using shared weights and a maximum aggregation function to combine prediction results at different scales. - **Rotation Equivariance**: SIRE processes image information in the spherical domain and uses Gauge Equivariant Mesh Convolution (GEM - CNN) to ensure that the output rotates accordingly as the input rotates, thereby improving the adaptability to blood vessels in different postures. Through these improvements, SIRE can generalize to blood vessels of different scales and complex curvatures during the training process, and can also accurately estimate blood vessel orientation during the inference process, providing a more robust and efficient data - driven solution. ### Formula Summary 1. **Haversine Distance Formula**: \[ D(v_i, \tilde{v})=\min_{i \in \{1, 2\}}\|v_i - \tilde{v}_i\|_H \] where \(\|\cdot\|_H\) represents the Haversine distance on the sphere, and \(\tilde{v}_i = \arg\min_{v \in V}\|v - d_i\|_H\). 2. **Target Output Signal Formula**: \[ f_{\text{out}}^{x, \text{GT}}(v_i)= \begin{cases} e^{\alpha\left(1-\frac{D(v_i, \tilde{v})}{\beta}\right)} & \text{if } D(v_i, \tilde{v})<\beta \\ 0 & \text{otherwise} \end{cases} \] 3. **Message Passing Formula for Graph Convolutional Layers**: \[ f_{k + 1}(v_i)=\sigma(\phi * f_k(v_i))=\sigma\left(\sum_{v_j \in N(v_i)\cup v_i}\phi f_k(v_j)\right) \] 4. **Gauge Equivariant Mesh Convolution Formula**: \[ \sigma(\phi *_{\text{GEM}} f_k(v_i))

SIRE: scale-invariant, rotation-equivariant estimation of artery orientations using graph neural networks

Global Control for Local SO(3)-Equivariant Scale-Invariant Vessel Segmentation

SE(3) symmetry lets graph neural networks learn arterial velocity estimation from small datasets

Going Off-Grid: Continuous Implicit Neural Representations for 3D Vascular Modeling

DeepVesselNet: Vessel Segmentation, Centerline Prediction, and Bifurcation Detection in 3-D Angiographic Volumes

Mesh Neural Networks for SE(3)-Equivariant Hemodynamics Estimation on the Artery Wall

CAVE: Cerebral Artery-Vein Segmentation in Digital Subtraction Angiography

Implicit neural representations for unsupervised super-resolution and denoising of 4D flow MRI

DS6, Deformation-aware Semi-supervised Learning: Application to Small Vessel Segmentation with Noisy Training Data

A vascular synthetic model for improved aneurysm segmentation and detection via Deep Neural Networks

756 A 3D Deep-learning Based Algorithm for Cerebral Vessel and Aneurysm Segmentation From CTA Images

Streamlining neuroradiology workflow with AI for improved cerebrovascular structure monitoring

Evaluating a 3D deep learning pipeline for cerebral vessel and intracranial aneurysm segmentation from computed tomography angiography-digital subtraction angiography image pairs.

Learning Hybrid Representations for Automatic 3D Vessel Centerline Extraction

Scalable robust graph and feature extraction for arbitrary vessel networks in large volumetric datasets

Scale-space approximated convolutional neural networks for retinal vessel segmentation

Building a Synthetic Vascular Model: Evaluation in an Intracranial Aneurysms Detection Scenario

3D Coronary Vessel Reconstruction from Bi-Plane Angiography using Graph Convolutional Networks

BRAVE-NET: Fully Automated Arterial Brain Vessel Segmentation in Patients With Cerebrovascular Disease

Coronary Artery Centerline Extraction in Cardiac CT Angiography Using a CNN-Based Orientation Classifier

CerebroVis: Designing an Abstract yet Spatially Contextualized Cerebral Arteries Network Visualization