Vascular Segmentation of Functional Ultrasound Images using Deep Learning

Hana Sebia,Thomas Guyet,Mickaël Pereira,Marco Valdebenito,Hugues Berry,Benjamin Vidal
2024-10-28
Abstract:Segmentation of medical images is a fundamental task with numerous applications. While MRI, CT, and PET modalities have significantly benefited from deep learning segmentation techniques, more recent modalities, like functional ultrasound (fUS), have seen limited progress. fUS is a non invasive imaging method that measures changes in cerebral blood volume (CBV) with high spatio-temporal resolution. However, distinguishing arterioles from venules in fUS is challenging due to opposing blood flow directions within the same pixel. Ultrasound localization microscopy (ULM) can enhance resolution by tracking microbubble contrast agents but is invasive, and lacks dynamic CBV quantification. In this paper, we introduce the first deep learning-based segmentation tool for fUS images, capable of differentiating signals from different vascular compartments, based on ULM automatic annotation and enabling dynamic CBV quantification. We evaluate various UNet architectures on fUS images of rat brains, achieving competitive segmentation performance, with 90% accuracy, a 71% F1 score, and an IoU of 0.59, using only 100 temporal frames from a fUS stack. These results are comparable to those from tubular structure segmentation in other imaging modalities. Additionally, models trained on resting-state data generalize well to images captured during visual stimulation, highlighting robustness. This work offers a non-invasive, cost-effective alternative to ULM, enhancing fUS data interpretation and improving understanding of vessel function. Our pipeline shows high linear correlation coefficients between signals from predicted and actual compartments in both cortical and deeperregions, showcasing its ability to accurately capture blood flow dynamics.
Image and Video Processing,Artificial Intelligence,Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to accurately distinguish different vascular structures (such as arteries and veins) in functional ultrasound imaging (fUS), thereby improving the understanding of cerebrovascular dynamics. Specifically, fUS is a non - invasive imaging method that can measure changes in cerebral blood volume with high spatiotemporal resolution, but existing techniques have difficulty distinguishing arteries and veins with opposite flow directions within a single pixel. This challenge is mainly due to the possible presence of blood flow in opposite directions in the same pixel, making these vascular structures difficult to distinguish. To solve this problem, the authors introduced a deep - learning - based segmentation tool that can directly distinguish different vascular compartments from fUS images without relying on invasive ultrasound localization microscopy (ULM). By training models of various UNet architectures and using only 100 - frame time - series fUS data, the authors achieved an accuracy rate of up to 90%, an F1 - score of 71% and an intersection - over - union (IoU) of 0.59. In addition, the study also showed that the model trained with resting - state data can be well generalized to images under visual stimulation, demonstrating the robustness of the model. This work provides a non - invasive and cost - effective alternative to ULM, enhances the interpretability of fUS data and improves the understanding of vascular function.