Abstract:Lesion segmentation in ultrasound images is an essential yet challenging step for early evaluation and diagnosis of cancers. In recent years, many automatic CNN-based methods have been proposed to assist this task. However, most modern approaches often lack capturing long-range dependencies and prior information making it difficult to identify the lesions with unfixed shapes, sizes, locations, and textures. To address this, we present a novel lesion segmentation framework that guides the model to learn the global information about lesion characteristics and invariant features (e.g., morphological features) of lesions to improve the segmentation in ultrasound images. Specifically, the segmentation model is guided to learn the characteristics of lesions from the global maps using an adversarial learning scheme with a self-attention-based discriminator. We argue that under such a lesion characteristics-based guidance mechanism, the segmentation model gets more clues about the boundaries, shapes, sizes, and positions of lesions and can produce reliable predictions. In addition, as ultrasound lesions have different textures, we embed this prior knowledge into a novel region-invariant loss to constrain the model to focus on invariant features for robust segmentation. We demonstrate our method on one in-house breast ultrasound (BUS) dataset and two public datasets (i.e., breast lesion (BUS B) and thyroid nodule from TNSCUI2020). Experimental results show that our method is specifically suitable for lesion segmentation in ultrasound images and can outperform the state-of-the-art approaches with Dice of 0.931, 0.906, and 0.876, respectively. The proposed method demonstrates that it can provide more important information about the characteristics of lesions for lesion segmentation in ultrasound images, especially for lesions with irregular shapes and small sizes. It can assist the current lesion segmentation models to better suit clinical needs.

Semi-supervised Gastrointestinal Lesion Segmentation using Adversarial Learning

Semi-Supervised Segmentation Framework for Gastrointestinal Lesion Diagnosis in Endoscopic Images

Semi-supervised Segmentation of Liver Using Adversarial Learning with Deep Atlas Prior.

Supervised Contrastive Learning for Gastrointestinal Lesions Classification in Endoscopic Images

Lesion Segmentation in Gastroscopic Images Using Generative Adversarial Networks.

Self- and Semi-supervised Learning for Gastroscopic Lesion Detection

Unsupervised Adaptive Lesion Segmentation with Similarity Based Cross Pseudo Supervision

Many Birds, One Stone: Medical Image Segmentation with Multiple Partially Labeled Datasets

Generative Adversarial Semi-Supervised Network for Medical Image Segmentation

Semi-Supervised Brain Lesion Segmentation Using Training Images with and Without Lesions

An efficient framework for lesion segmentation in ultrasound images using global adversarial learning and region-invariant loss

Medical image segmentation with generative adversarial semi-supervised network

Annotation-Free Gliomas Segmentation Based on a Few Labeled General Brain Tumor Images

A deep weakly semi-supervised framework for endoscopic lesion segmentation

MTANS: Multi-Scale Mean Teacher Combined Adversarial Network with Shape-Aware Embedding for Semi-Supervised Brain Lesion Segmentation

Weakly-Supervised Cross-Domain Adaptation for Endoscopic Lesions Segmentation

Semantic-Transferable Weakly-Supervised Endoscopic Lesions Segmentation

Annotation-Efficient Learning for Medical Image Segmentation Based on Noisy Pseudo Labels and Adversarial Learning

Semi-Supervised Leukocyte Segmentation Based on Adversarial Learning with Reconstruction Enhancement

BMAnet: Boundary Mining With Adversarial Learning for Semi-Supervised 2D Myocardial Infarction Segmentation

Utilizing GCN and Meta-Learning Strategy in Unsupervised Domain Adaptation for Pancreatic Cancer Segmentation