Abstract:By localizing microbubbles (MBs) in the vasculature, ultrasound localization microscopy (ULM) has recently been proposed, which greatly improves the spatial resolution of ultrasound (US) imaging and will be helpful for clinical diagnosis. Nevertheless, several challenges remain in fast ULM imaging. The main problems are that current localization methods used to implement fast ULM imaging, e.g., a previously reported localization method based on sparse recovery (CS-ULM), suffer from long data-processing time and exhaustive parameter tuning (optimization). To address these problems, in this paper, we propose a ULM method based on deep learning, which is achieved by using a modified sub-pixel convolutional neural network (CNN), termed as mSPCN-ULM. Simulations and in vivo experiments are performed to evaluate the performance of mSPCN-ULM. Simulation results show that even if under high-density condition (6.4 MBs/mm<sup>2</sup>), a high localization precision ( $sim 28mu text{m}$ in the lateral direction and $sim 24mu text{m}$ in the axial direction) and a high localization reliability (Jaccard index of 0.66) can be obtained by mSPCN-ULM, compared to CS-ULM. The in vivo experimental results indicate that with plane wave scan at a transmit center frequency of 15.625 MHz, microvessels with diameters of $sim 17mu text{m}$ can be detected and adjacent microvessels with a distance of $sim 42mu text{m}$ can be separated. Furthermore, when using GPU acceleration, the data-processing time of mSPCN-ULM can be shortened to ~6 sec/frame in the simulations and ~23 sec/frame in the in vivo experim-nts, which is 3–4 orders of magnitude faster than CS-ULM. Finally, once the network is trained, mSPCN-ULM does not need parameter tuning to implement ULM. As a result, mSPCN-ULM opens the door to implement ULM with fast data-processing speed, high imaging accuracy, short data-acquisition time, and high flexibility (robustness to parameters) characteristics.

SFCN: Spoon Fully Convolutional Networks for Pulse Localization.

Pulse localization networks with infrared camera

Automated Heartbeat Classification Using 3-D Inputs Based on Convolutional Neural Network with Multi-Fields of View.

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Accurate Targeting in Robot-Assisted TCM Pulse Diagnosis Using Adaptive Sensor Fusion

FM-FCN: A Neural Network with Filtering Modules for Accurate Vital Signs Extraction

3Dcnn-Based Palpation Localization with Temporal Attention Module.

Ultrasound-Guided Localization System for Pericardial Effusion Puncture Robot Utilizing Deep Learning Models

Deep Learning for Ultrasound Localization Microscopy

SACNet: A Scattered Attention-based Network with Feature Compensator for Visual Localization

Fcn And Unit-Linking Pcnn Based Image Saliency Detection

Catheter localization in 3D ultrasound using voxel-of-interest-based ConvNets for cardiac intervention

A Coarse-Fine Network for Keypoint Localization

Feature fusion method based on spiking neural convolutional network for edge detection

Improving Catheter Segmentation & Localization in 3D Cardiac Ultrasound Using Direction-Fused FCN

Conformal Convolutional Neural Network (CCNN) for Single-Shot Sensorless Wavefront Sensing.

Learning Spatio-Temporal Pulse Representation With Global-Local Interaction and Supervision for Remote Prediction of Heart Rate

A Unified Framework for Multi-Guidewire Endpoint Localization in Fluoroscopy Images

Efficient and Robust Instrument Segmentation in 3D Ultrasound Using Patch-of-Interest-FuseNet with Hybrid Loss

SqueezeNet and Fusion Network-Based Accurate Fast Fully Convolutional Network for Hand Detection and Gesture Recognition

RegFSC-Net: Medical Image Registration via Fourier Transform With Spatial Reorganization and Channel Refinement Network