Abstract:Plane wave ultrasound imaging is one of the fastest ultrasound methods available to reduce latency for ultrasound-based robotic tracking tasks. However, the presence of acoustic clutter and speckle in the images can confuse robotic tracking algorithms. In addition, multiple plane wave insonification angles are often necessary to generate good-quality images, which further reduces the speed of the tracking process. To overcome these challenges, we are exploring deep learning as a method to extract pertinent information directly from raw radiofrequency channel data to locate targets of interest from a single plane wave insonification. Particularly, in this work, we trained a deep convolutional neural network (CNN) with 50,000 Field-II simulations corresponding to a single cyst in tissue insonified by one plane wave transmitted at 0 degrees. The simulated cyst radius, axial and lateral positions were varied, along with the simulated tissue sound speed. The output of the training process is an interpretable segmentation mask that is free of clutter and speckle, which we call a CNN-Based image. An additional dataset of 100 simulations was created and two cyst targets in an experimental phantom were imaged to test our approach. The Dice Similarity Coefficient (DSC), representing the overlap between the true cyst location and the cyst location in the CNN-Based image, was 0.91 for simulated data and 0.74 for experimental data. The network was generally sensitive to cyst radius, with mean DSCs increasing from 0.91 to 0.97 when the cyst radius was $\geq$ 5 mm. A robot controlled ultrasound probe enabled volumetric reconstruction of CNN-Based images, revealing the three-dimensional structure of the two cysts in the phantom. These results demonstrate that a deep neural network trained exclusively with simulated data can generalize to experimental data, which is promising for the development of deep learning methods as an alternative to traditional ultrasound beamforming for robotic tracking tasks.

Demo Abstract: RIO-40C - A Low-Cost Wearable Sunlight Exposure Monitor for Skincare

Quantitative Endoscopic Photoacoustic Tomography Using a Convolutional Neural Network.

Computationally efficient deep learning-based image reconstruction for sound speed estimation in ultrasound computed tomography

Deep Learning-based Ultrasound Computed Tomography for Cortical Bone Imaging

Deep Learning with Physics-embedded Neural Network for Full Waveform Ultrasonic Brain Imaging

A deep-learning model for one-shot transcranial ultrasound simulation and phase aberration correction

Learned Full Waveform Inversion Incorporating Task Information for Ultrasound Computed Tomography

Deep-Learning Based Adaptive Ultrasound Imaging From Sub-Nyquist Channel Data

Neural Operator Learning for Ultrasound Tomography Inversion

Deep learning for image reconstruction in thermoacoustic tomography

Deep Learning for Photoacoustic Tomography from Sparse Data

A Fully Convolutional Neural Network for Beamforming Ultrasound Images

LOTUS: Learning to Optimize Task-based US representations

Investigating the Use of Traveltime and Reflection Tomography for Deep Learning-Based Sound-Speed Estimation in Ultrasound Computed Tomography

Cascaded one-shot deformable convolutional neural networks: Developing a deep learning model for respiratory motion estimation in ultrasound sequences

Deep Learning for Super-resolution Ultrasound Imaging with Spatiotemporal Data

Deep Unfolded Robust PCA With Application to Clutter Suppression in Ultrasound

Deep-Learning Image Reconstruction for Real-Time Photoacoustic System

Experimental Validation of Ultrasound Beamforming with End-to-End Deep Learning for Single Plane Wave Imaging

Deep Image Translation for Enhancing Simulated Ultrasound Images