Abstract:Computer-aided ultrasound (US) imaging is an important prerequisite for early clinical diagnosis and treatment. Due to the harsh ultrasound (US) image quality and the blurry tumor area, recent memory-based video object segmentation models (VOS) achieve frame-level segmentation by performing intensive similarity matching among the past frames which could inevitably result in computational redundancy. Furthermore, the current attention mechanism utilized in recent models only allocates the same attention level among whole spatial-temporal memory features without making distinctions, which may result in accuracy degradation. In this paper, we first build a larger annotated benchmark dataset for breast lesion segmentation in ultrasound videos, then we propose a lightweight clip-level VOS framework for achieving higher segmentation accuracy while maintaining the speed. The Inner-Outer Clip Retformer is proposed to extract spatialtemporal tumor features in parallel. Specifically, the proposed Outer Clip Retformer extracts the tumor movement feature from past video clips to locate the current clip tumor position, while the Inner Clip Retformer detailedly extracts current tumor features that can produce more accurate segmentation results. Then a Clip Contrastive loss function is further proposed to align the extracted tumor features along both the spatial-temporal dimensions to improve the segmentation accuracy. In addition, the Global Retentive Memory is proposed to maintain the complementary tumor features with lower computing resources which can generate coherent temporal movement features. In this way, our model can significantly improve the spatial-temporal perception ability without increasing a large number of parameters, achieving more accurate segmentation results while maintaining a faster segmentation speed. Finally, we conduct extensive experiments to evaluate our proposed model on several video object segmentation datasets, the results show that our framework outperforms state-of-theart segmentation methods.

Search for the best matching ultrasound frame based on spatial and temporal saliencies

Self-Adaptive Ultrasound Scanning System for Imaging Human Spine

Multi-Frame Image Fusion Method Combining Spatial-Temporal Saliency Detection and Nsct

Cascaded Inner-Outer Clip Retformer for Ultrasound Video Object Segmentation

Full-reference image quality assessment-based B-mode ultrasound image similarity measure

Enhancing Multi-Object Detection in Ultrasound Images Through Semi-Supervised Learning, Focal Loss and Relation of Frame

A Hierarchical Descriptor Framework for On-the-Fly Anatomical Location Matching between Longitudinal Studies

Spatial Attention Lesion Detection On Automated Breast Ultrasound

A Wavelet Frame Method with Shape Prior for Ultrasound Video Segmentation.

Accurate segmentation of ultrasound images using the motion cue

A Hybrid Framework for Tumor Saliency Estimation

[Automatic Search for the Best Cross-Sections of the Three-Dimensional Ultrasound Image of Heart by Template Matching].

MedSeq: Semantic Segmentation for Medical Image Sequences

Joint Lesion Detection and Classification of Breast Ultrasound Video Via a Clinical Knowledge-Aware Framework

A Spatial-Temporal Deformable Attention based Framework for Breast Lesion Detection in Videos

Recognizing Focal Liver Lesions in Contrast-Enhanced Ultrasound with Discriminatively Trained Spatio-Temporal Model.

Hot Spot Detection Based on Feature Space Representation of Visual Search in Medical Imaging

BAAF: A Benchmark Attention Adaptive Framework for Medical Ultrasound Image Segmentation Tasks

Fast and robust short video clip search using an index structure.

An Image Retrieval Framework for Real-Time Endoscopic Image Retargeting.

FPSN-FNCC: an accurate and fast motion tracking algorithm in 3D ultrasound for image-guided interventions