Abstract:Ultrasound is an important routine screening modality for breast cancer. Breast ultrasound screening is a dynamic process, and clinical practice involves radiologists recording representative frames during dynamic breast scanning for subsequent diagnosis. However, existing computer-assisted diagnosis methods often concentrate on dull diagnostic results by analyzing these representative frames and ignore the valuable information in the dynamic examination process that facilitates diagnosis. Moreover, breast lesions could exhibit various characteristic differences during scanning, and effective learning of lesion representations is challenging and may affect the clinical interpretability of the methods. To this end, we draw insights from the behavior of radiologists during the dynamic breast examination and leverage the knowledge of breast anatomy to propose a clinical knowledge-aware framework for lesion detection and classification of breast lesions in ultrasound videos. It is equipped with global-local attentive aggregation and a dynamic allocation mechanism that simulates the behavior of radiologists searching for diagnostic clues, thus integrating local localization and global semantic information from the video into the feature representation of the lesion. An anatomically-aware transformer is also designed to refine the lesion feature representation using spatial relationships within and across different anatomical layers of the breast anatomy. Extensive experiments show that the proposed framework can achieve competitive performance in both lesion detection and video classification tasks while exhibiting good clinical availability and interpretability, with an average precision of 40.80% and an AUC of 85.86% on our constructed breast video dataset and an average precision of 39.79% and an AUC of 87.04% on a publicly available dataset.

Domain Knowledge Powered Deep Learning for Breast Cancer Diagnosis Based on Contrast-Enhanced Ultrasound Videos

Domain Knowledge-Guided Adversarial Adaptive Fusion of Hybrid Breast Ultrasound Data

A multimodal breast cancer diagnosis method based on Knowledge-Augmented Deep Learning

Integrate Domain Knowledge in Training CNN for Ultrasonography Breast Cancer Diagnosis

Diagnostic Performance of Deep Learning in Video-Based Ultrasonography for Breast Cancer: A Retrospective Multicentre Study

A Deep Learning Approach for Targeted Contrast-Enhanced Ultrasound Based Prostate Cancer Detection

A domain knowledge-based interpretable deep learning system for improving clinical breast ultrasound diagnosis

Automatic Detection of Breast Lesions in Automated 3D Breast Ultrasound with Cross-Organ Transfer Learning

Breast Lesion Diagnosis Using Static Images and Dynamic Video

Dual-Intended Deep Learning Model for Breast Cancer Diagnosis in Ultrasound Imaging

Assessing breast disease with deep learning model using bimodal bi-view ultrasound images and clinical information

ResNet-101 Empowered Deep Learning for Breast Cancer Ultrasound Image Classification

Deep Learning-assisted Diagnosis of Breast Lesions on US Images: A Multivendor, Multicenter Study.

The Clinical Application of Artificial Intelligence Assisted Contrast-Enhanced Ultrasound on BI-RADS Category 4 Breast Lesions.

Discrimination of Breast Cancer Based on Ultrasound Images and Convolutional Neural Network

A Comparative Study of Multiple Deep Learning Models Based on Multi-Input Resolution for Breast Ultrasound Images

Breast Tumor Detection In Ultrasound Images Using Deep Learning

Masked Video Modeling with Correlation-aware Contrastive Learning for Breast Cancer Diagnosis in Ultrasound

Joint Lesion Detection and Classification of Breast Ultrasound Video Via a Clinical Knowledge-Aware Framework

Breast tumor classification based on self-supervised contrastive learning from ultrasound videos

Deep Fusion of Human-Machine Knowledge with Attention Mechanism for Breast Cancer Diagnosis