Motion Magnification in Robotic Sonography: Enabling Pulsation-Aware Artery Segmentation

Dianye Huang,Yuan Bi,Nassir Navab,Zhongliang Jiang

2023-07-08

Abstract:Ultrasound (US) imaging is widely used for diagnosing and monitoring arterial diseases, mainly due to the advantages of being non-invasive, radiation-free, and real-time. In order to provide additional information to assist clinicians in diagnosis, the tubular structures are often segmented from US images. To improve the artery segmentation accuracy and stability during scans, this work presents a novel pulsation-assisted segmentation neural network (PAS-NN) by explicitly taking advantage of the cardiac-induced motions. Motion magnification techniques are employed to amplify the subtle motion within the frequency band of interest to extract the pulsation signals from sequential US images. The extracted real-time pulsation information can help to locate the arteries on cross-section US images; therefore, we explicitly integrated the pulsation into the proposed PAS-NN as attention guidance. Notably, a robotic arm is necessary to provide stable movement during US imaging since magnifying the target motions from the US images captured along a scan path is not manually feasible due to the hand tremor. To validate the proposed robotic US system for imaging arteries, experiments are carried out on volunteers' carotid and radial arteries. The results demonstrated that the PAS-NN could achieve comparable results as state-of-the-art on carotid and can effectively improve the segmentation performance for small vessels (radial artery).

Image and Video Processing,Computer Vision and Pattern Recognition,Robotics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is to improve the accuracy and stability of artery segmentation in ultrasonic imaging, especially for the segmentation of small blood vessels such as the radial artery. To achieve this goal, the author proposes a new Pulsatile - Assisted Segmentation Neural Network (PAS - NN), which improves artery segmentation by explicitly utilizing the heart - induced motion. Specifically, the paper uses motion magnification technology to extract pulsatile signals from continuous ultrasonic images and integrates these real - time pulsatile information as attention guidance into PAS - NN to help locate arteries on cross - sectional ultrasonic images. In addition, since it is not feasible to manually capture the target motion on the scanning path, the paper also introduces a robotic arm to provide stable movement during ultrasonic imaging.

The main contributions of the paper include:
1. Proposing an Intensity - based Pulsatile Map Extraction (PME) algorithm for capturing real - time pulsatile maps from the ultrasonic image stream.
2. Designing the Pulsatile - Assisted Segmentation Neural Network (PAS - NN), which uses the heart - induced motion as guidance and shows better performance especially in the challenging radial artery segmentation task.
3. Demonstrating a robotic ultrasonic imaging pipeline for imaging artery structures, in which an external RGB - D camera is used to autonomously plan the scanning trajectory.

Through these methods, the paper aims to improve the accuracy and robustness of artery segmentation in ultrasonic imaging, especially when dealing with small blood vessels.