DeNVeR: Deformable Neural Vessel Representations for Unsupervised Video Vessel Segmentation

Chun-Hung Wu,Shih-Hong Chen,Chih-Yao Hu,Hsin-Yu Wu,Kai-Hsin Chen,Yu-You Chen,Chih-Hai Su,Chih-Kuo Lee,Yu-Lun Liu
2024-10-04
Abstract:This paper presents Deformable Neural Vessel Representations (DeNVeR), an unsupervised approach for vessel segmentation in X-ray videos without annotated ground truth. DeNVeR uses optical flow and layer separation, enhancing segmentation accuracy and adaptability through test-time training. A key component of our research is the introduction of the XACV dataset, the first X-ray angiography coronary video dataset with high-quality, manually labeled segmentation ground truth. Our evaluation demonstrates that DeNVeR outperforms current state-of-the-art methods in vessel segmentation. This paper marks an advance in medical imaging, providing a robust, data-efficient tool for disease diagnosis and treatment planning and setting a new standard for future research in video vessel segmentation. See our project page for video results at <a class="link-external link-https" href="https://kirito878.github.io/DeNVeR/" rel="external noopener nofollow">this https URL</a>.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The main problem that this paper attempts to solve is: how to accurately segment the cardiac blood vessels from X - ray angiography videos in the absence of labeled data. Specifically, the authors propose an unsupervised method named DeNVeR (Deformable Neural Vessel Representations), aiming to overcome the dependence of existing methods on a large amount of labeled data and improve the accuracy, adaptability and temporal consistency of vessel segmentation. ### Main Problems and Challenges 1. **Utilization of Unlabeled Data**: - Most of the existing vessel segmentation methods rely on a large amount of labeled data, which is not only time - consuming and labor - intensive but also limits the generalization ability of the model. - This research proposes an unsupervised learning framework that is directly trained on the test videos without any labeled data. 2. **Complex Vascular Dynamic Changes**: - The cardiac blood vessels change in X - ray videos with the heartbeat and the movement of other organs, making the segmentation task more complex. - DeNVeR can better model and capture these dynamic changes by introducing Eulerian motion fields and parallel vessel motion loss. 3. **Low Signal - to - Noise Ratio and Interfering Structures**: - X - ray angiography images usually have a low signal - to - noise ratio and are easily interfered by surrounding structures (such as catheters and bones). - To deal with these problems, DeNVeR combines optical flow estimation and hierarchical separation techniques to improve the accuracy and robustness of segmentation. 4. **Spatial - Temporal Consistency**: - Single - frame segmentation methods often ignore the temporal information in the video, resulting in inconsistent segmentation results between adjacent frames. - DeNVeR makes full use of the temporal information of the video to ensure the coherence and consistency of the segmentation results over time. ### Solutions - **Unsupervised Learning Framework**: DeNVeR adopts unsupervised learning and is directly trained on the test videos, making use of the full - time information of the video without the need for labeled data. - **Optical Flow and Hierarchical Separation**: Through optical flow estimation and hierarchical separation techniques, the foreground (vessels) and background (other tissues) are separated, improving the accuracy and adaptability of segmentation. - **Dynamic Adaptation**: By introducing Eulerian motion fields and parallel vessel motion loss, the ability to model cardiac motion and blood vessel flow is enhanced, ensuring detailed and temporally consistent vessel segmentation. - **New Dataset**: The first high - quality manually - labeled X - ray coronary artery video dataset (XACV) has been collected, providing a new standard for training and evaluating video vessel segmentation models. Through these innovations, DeNVeR significantly improves the performance of vessel segmentation, especially in dealing with complex dynamic changes and low - quality images, providing strong support for medical image analysis.