A CNN Segmentation-Based Approach to Object Detection and Tracking in Ultrasound Scans with Application to the Vagus Nerve Detection

Abdullah F. Al-Battal,Yan Gong,Lu Xu,Timothy Morton,Chen Du,Yifeng Bu 1,Imanuel R Lerman,Radhika Madhavan,Truong Q. Nguyen

DOI: https://doi.org/10.48550/arXiv.2106.13849

2021-06-26

Abstract:Ultrasound scanning is essential in several medical diagnostic and therapeutic applications. It is used to visualize and analyze anatomical features and structures that influence treatment plans. However, it is both labor intensive, and its effectiveness is operator dependent. Real-time accurate and robust automatic detection and tracking of anatomical structures while scanning would significantly impact diagnostic and therapeutic procedures to be consistent and efficient. In this paper, we propose a deep learning framework to automatically detect and track a specific anatomical target structure in ultrasound scans. Our framework is designed to be accurate and robust across subjects and imaging devices, to operate in real-time, and to not require a large training set. It maintains a localization precision and recall higher than 90% when trained on training sets that are as small as 20% in size of the original training set. The framework backbone is a weakly trained segmentation neural network based on U-Net. We tested the framework on two different ultrasound datasets with the aim to detect and track the Vagus nerve, where it outperformed current state-of-the-art real-time object detection networks.

Computer Vision and Pattern Recognition,Image and Video Processing

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the problem of automatically detecting and tracking specific anatomical structures in ultrasonic scanning. Specifically, the author proposes a method based on convolutional neural network (CNN) segmentation to achieve real - time object detection and tracking, especially in detecting the vagus nerve. This problem is very important in the process of medical diagnosis and treatment, because ultrasonic examination is labor - intensive and its effect highly depends on the operator's technical level. If accurate detection and tracking can be automated, it will significantly improve the consistency and efficiency of the diagnosis and treatment process. The key points of the paper include: - **Problem Background**: Ultrasonic examination plays an important role in medical diagnosis and treatment, but its effectiveness and consistency are greatly affected by the operator's skills, and the misdiagnosis rate of novice operators is relatively high. - **Research Objectives**: Propose a deep - learning framework that can automatically detect and track specific anatomical structures (such as the vagus nerve) in ultrasonic scanning, and this framework can maintain high precision and robustness on different subjects and imaging devices, while achieving real - time operation. - **Method Innovation**: Use weakly - supervised - trained U - Net as the core detection and location algorithm of the framework, reducing the dependence on large - scale training sets, and improving the generalization ability of the model through data augmentation techniques. - **Experimental Verification**: Tests were carried out on two different ultrasonic data sets, and the results show that this method is superior to the current state - of - the - art real - time object detection networks (such as YOLOv4 and EfficientDet) in detecting the vagus nerve. In short, this paper aims to improve the automated detection and tracking in ultrasonic examination through deep - learning technology to improve the accuracy and efficiency of medical diagnosis and treatment.

A CNN Segmentation-Based Approach to Object Detection and Tracking in Ultrasound Scans with Application to the Vagus Nerve Detection

Segmentation Of Nerve On Ultrasound Images Using Deep Adversarial Network

Vascular Segmentation of Functional Ultrasound Images using Deep Learning

Guidewire Segmentation in 4D Ultrasound Sequences Using Recurrent Fully Convolutional Networks

Automatic Recognition and Tracking of Liver Blood Vessels in Ultrasound Image Using Deep Neural Networks

Attention-aware Fully Convolutional Neural Network with Convolutional Long Short-Term Memory Network for Ultrasound-Based Motion Tracking

Deep learning with spatiotemporal consistency for nerve segmentation in ultrasound images

Iterative Multi-domain Regularized Deep Learning for Anatomical Structure Detection and Segmentation from Ultrasound Images.

A Fully Convolutional Neural Network for Beamforming Ultrasound Images

Deep Learning Based Real-time Segmentation in Ultrasonic Imaging Following the Doctor's Voice Guide

DopUS-Net: Quality-Aware Robotic Ultrasound Imaging based on Doppler Signal

Robust Needle Localization and Enhancement Algorithm for Ultrasound by Deep Learning and Beam Steering Methods

An efficient framework for lesion segmentation in ultrasound images using global adversarial learning and region-invariant loss

Topology-preserving segmentation of abdominal muscle layers from ultrasound images

Deep learning-based motion tracking using ultrasound images

SUMNet: Fully Convolutional Model For Fast Segmentation of Anatomical Structures in Ultrasound Volumes

Feature Fusion-Based Siamese Region Proposal Network for Ultrasound Tracking

Weakly supervised real-time instance segmentation for ultrasound images of median nerves

A temporal enhanced semi-supervised training framework for needle segmentation in 3D ultrasound images

Spatial Attention Lesion Detection On Automated Breast Ultrasound

Joint Segmentation and Landmark Localization of Fetal Femur in Ultrasound Volumes