Force Sensing Guided Artery-Vein Segmentation via Sequential Ultrasound Images

Yimeng Geng,Gaofeng Meng,Mingcong Chen,Guanglin Cao,Mingyang Zhao,Jianbo Zhao,Hongbin Liu
2024-07-31
Abstract:Accurate identification of arteries and veins in ultrasound images is crucial for vascular examinations and interventions in robotics-assisted surgeries. However, current methods for ultrasound vessel segmentation face challenges in distinguishing between arteries and veins due to their morphological similarities. To address this challenge, this study introduces a novel force sensing guided segmentation approach to enhance artery-vein segmentation accuracy by leveraging their distinct deformability. Our proposed method utilizes force magnitude to identify key frames with the most significant vascular deformation in a sequence of ultrasound images. These key frames are then integrated with the current frame through attention mechanisms, with weights assigned in accordance with force magnitude. Our proposed force sensing guided framework can be seamlessly integrated into various segmentation networks and achieves significant performance improvements in multiple U-shaped networks such as U-Net, Swin-unet and Transunet. Furthermore, we contribute the first multimodal ultrasound artery-vein segmentation dataset, Mus-V, which encompasses both force and image data simultaneously. The dataset comprises 3114 ultrasound images of carotid and femoral vessels extracted from 105 videos, with corresponding force data recorded by the force sensor mounted on the US probe. Our code and dataset will be publicly available.
Image and Video Processing,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the challenge of accurately distinguishing arteries and veins in ultrasound images. Current ultrasound vessel segmentation methods mainly rely on morphological features in a single image, which makes it difficult to distinguish between morphologically similar arteries and veins. Moreover, existing methods are often only able to segment vessels, but cannot clearly distinguish between arteries and veins. To address this challenge, the paper proposes a Force Sensing Guided Segmentation method. By utilizing the different deformation characteristics of arteries and veins when compressed, the segmentation accuracy is improved. Specifically, this method uses force data collected by force sensors to identify key frames containing the maximum vessel deformation, and combines these key frames with the current frame through an attention mechanism to enhance the segmentation effect. This method not only improves the accuracy of segmentation, but can also be seamlessly integrated into various segmentation networks, such as U - Net, Swin - Unet and Transunet. In addition, the paper also contributes a new multi - modal ultrasound artery - vein segmentation dataset (Mus - V), which contains both force data and image data simultaneously, providing a benchmark for future research.