Abstract:Background and objective: Accurate and efficient segmentation of thyroid nodules on ultrasound images is critical for computer-aided nodule diagnosis and treatment. For ultrasound images, Convolutional neural networks (CNNs) and Transformers, which are widely used in natural images, cannot obtain satisfactory segmentation results, because they either cannot obtain precise boundaries or segment small objects. Methods: To address these issues, we propose a novel Boundary-preserving assembly Transformer UNet (BPAT-UNet) for ultrasound thyroid nodule segmentation. In the proposed network, a Boundary point supervision module (BPSM), which adopts two novel self-attention pooling approaches, is designed to enhance boundary features and generate ideal boundary points through a novel method. Meanwhile, an Adaptive multi-scale feature fusion module (AMFFM) is constructed to fuse features and channel information at different scales. Finally, to fully integrate the characteristics of high-frequency local and low-frequency global, the Assembled transformer module (ATM) is placed at the bottleneck of the network. The correlation between deformable features and features-among computation is characterized by introducing them into the above two modules of AMFFM and ATM. As the design goal and eventually demonstrated, BPSM and ATM promote the proposed BPAT-UNet to further constrain boundaries, whereas AMFFM assists to detect small objects. Results: Compared to other classical segmentation networks, the proposed BPAT-UNet displays superior segmentation performance in visualization results and evaluation metrics. Significant improvement of segmentation accuracy was shown on the public thyroid dataset of TN3k with Dice similarity coefficient (DSC) of 81.64% and 95th percentage of the asymmetric Hausdorff distance (HD95) of 14.06, whereas those on our private dataset were with DSC of 85.63% and HD95 of 14.53, respectively. Conclusions: This paper presents a method for thyroid ultrasound image segmentation, which achieves high accuracy and meets the clinical requirements. Code is available at https://github.com/ccjcv/BPAT-UNet.

Hybrid transformer UNet for thyroid segmentation from ultrasound scans

Mixed Transformer U-Net for Medical Image Segmentation

BPAT-UNet: Boundary preserving assembled transformer UNet for ultrasound thyroid nodule segmentation

H2MaT-Unet:Hierarchical hybrid multi-axis transformer based Unet for medical image segmentation

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

A Novel Model of Thyroid Nodule Segmentation for Ultrasound Images.

HCT-Unet: multi-target medical image segmentation via a hybrid CNN-transformer Unet incorporating multi-axis gated multi-layer perceptron

ATTransUNet: an Enhanced Hybrid Transformer Architecture for Ultrasound and Histopathology Image Segmentation

Federated learning via multi-attention guided UNet for thyroid nodule segmentation of ultrasound images

MSCT-UNET: multi-scale contrastive transformer within U-shaped network for medical image segmentation

HmsU-Net: A hybrid multi-scale U-net based on a CNN and transformer for medical image segmentation

TransUNet: Transformers Make Strong Encoders for Medical Image Segmentation

A dual-branch and dual attention transformer and CNN hybrid network for ultrasound image segmentation

HAU-Net: Hybrid CNN-transformer for breast ultrasound image segmentation

Research on thyroid CT image segmentation based on U-shaped convolutional neural network

UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation

HCA-former: Hybrid Convolution Attention Transformer for 3D Medical Image Segmentation

A Hybrid Network Integrating Convolution and Transformer for Thymoma Segmentation

3D TransUNet: Advancing Medical Image Segmentation through Vision Transformers

Enhanced Transformer Encoder and Hybrid Cascaded Upsampler for Medical Image Segmentation.

HTC-Net: A hybrid CNN-transformer framework for medical image segmentation