Abstract:Super-resolution ultrasound imaging (SRUS) is an active area of research as it brings up to a ten-fold improvement in the resolution of microvascular structures. The limitations to the clinical adoption of SRUS include long acquisition times and long image processing times. Both these limitations can be alleviated with deep learning approaches to the processing of SRUS images. In this study we propose an optimized architecture based on modern improvements to convolutional neural networks from the ConvNeXt architecture and further customize the choice of features to improve performance on the specific tasks of both MB detection and localization within a single network. We employ a spatiotemporal input of up to five successive image frames to increase the number of MBs detected. The output structure produces three classifications: a MB detection Boolean for each pixel in the central image frame, as well as x and z offsets at 4-fold subpixel resolution for each MB detected. Ultrasound simulations generated images based on the L22-14v transducer (Verasonics) for training and testing of the proposed SRUS-ConvNeXt network. In vivo image data of a mouse brain was used as further validation of the architecture. The proposed network had the highest performance as measured by F1 score when configured for a 3-frame spatiotemporal input. The smallest localization error of {\lambda}/22 was achieved when the network was configured for a single input frame. The flexibility of the proposed architecture allows extension to 10-fold upscaling for SRUS images with a much lower impact to number of parameters and subsequent increase in inference time than typical U-Net style approaches. This network is promising in the quest to develop a SRUS deep network architecture for real time image formation.

UArch: A Super-Resolution Processor with Heterogeneous Triple-Core Architecture for Workloads of U-Net Networks

NoUCSR: Efficient Super-Resolution Network Without Upsampling Convolution.

Epistemic-Uncertainty-Based Divide-and-Conquer Network for Single-Image Super-Resolution

HDSuper: High-Quality and High Computational Utilization Edge Super-Resolution Accelerator With Hardware-Algorithm Co-Design Techniques

SR-USRN: Learning Image Super-Resolution with Unified Structure and Reverse Network.

ESSR: An 8K@30FPS Super-Resolution Accelerator With Edge Selective Network

ACNPU: A 4.75TOPS/W 1080P@30FPS Super Resolution Accelerator with Decoupled Asymmetric Convolution

A 28-nm Computing-in-Memory-Based Super-Resolution Accelerator Incorporating Macro-Level Pipeline and Texture/Algebraic Sparsity

NAWQ-SR: A Hybrid-Precision NPU Engine for Efficient On-Device Super-Resolution

A High-Performance Accelerator for Real-Time Super-Resolution on Edge FPGAs

URNet: A U-Shaped Residual Network for Lightweight Image Super-Resolution

Single Image Super-Resolution Via the Implementation of the Hardware-Friendly Sparse Coding

Efficient Super-Resolution System with Block-Wise Hybridization and Quantized Winograd on FPGA

Orientation-Aware Deep Neural Network for Real Image Super-Resolution.

Deep Learning for Super-resolution Ultrasound Imaging with Spatiotemporal Data

Multi-Depth Branch Network for Efficient Image Super-Resolution

A Weight-Reload-Eliminated Compute-in-Memory Accelerator for 60 fps 4K Super-Resolution

UACT: A Unified Energy-efficient Computing Architecture for CNN and TCNN.

PlainUSR: Chasing Faster ConvNet for Efficient Super-Resolution

FuseSR: Super Resolution for Real-time Rendering through Efficient Multi-resolution Fusion