Abstract:Background In recent years, skin lesion has become a major public health concern, and the diagnosis and management of skin lesions depend heavily on the correct segmentation of the lesions. Traditional convolutional neural networks (CNNs) have demonstrated promising results in skin lesion segmentation, but they are limited in their ability to capture distant connections and intricate features. In addition, current medical image segmentation algorithms rarely consider the distribution of different categories in different regions of the image and do not consider the spatial relationship between pixels. Objectives This study proposes a self-adaptive position-aware skin lesion segmentation model SapFormer to capture global context and fine-grained detail, better capture spatial relationships, and adapt to different positional characteristics. The SapFormer is a multi-scale dynamic position-aware structure designed to provide a more flexible representation of the relationships between skin lesion characteristics and lesion distribution. Additionally, it increases skin lesion segmentation accuracy and decreases incorrect segmentation of non-lesion areas. Innovations SapFormer designs multiple hybrid transformers for multi-scale feature encoding of skin images and multi-scale positional feature sensing of the encoded features using a transformer decoder to obtain fine-grained features of the lesion area and optimize the regional feature distribution. The self-adaptive feature framework, built upon the transformer decoder module, dynamically and automatically generates parameterizations with learnable properties at different positions. These parameterizations are derived from the multi-scale encoding characteristics of the input image. Simultaneously, this paper utilizes the cross-attention network to optimize the features of the current region according to the features of other regions, aiming to increase skin lesion segmentation accuracy. Main results The ISIC-2016, ISIC-2017, and ISIC-2018 datasets for skin lesions are used as the basis for the experiment. On these datasets, the proposed model has accuracy values of 97.9 %, 94.3 %, and 95.7 %, respectively. The proposed model's IOU values are, in order, 93.2 %, 86.4 %, and 89.4 %. The proposed model's DSC values are 96.4 %, 92.6 %, and 94.3 %, respectively. All three metrics surpass the performance of the majority of state-of-the-art (SOTA) models. SapFormer's metrics on these datasets demonstrate that it can precisely segment skin lesions. Notably, our approach exhibits remarkable noise resistance in non-lesion areas, while simultaneously conducting finer-grained regional feature extraction on the skin lesion image. Conclusions In conclusion, the integration of a transformer-guided position-aware network into semantic skin lesion segmentation results in a notable performance boost. The ability of our proposed network to capture spatial relationships and fine-grained details proves beneficial for effective skin lesion segmentation. By enhancing lesion localization, feature extraction, quantitative analysis, and classification accuracy, the proposed segmentation model improves the diagnostic efficiency of skin lesion analysis on dermoscopic images. It assists dermatologists in making more accurate and efficient diagnoses, ultimately leading to better patient care and outcomes. This research paves the way for advances in diagnosing and treating skin lesions, promoting better understanding and decision-making in the clinical setting.

SkinDiff: A Novel Data Synthesis Method Based on Latent Diffusion Model for Skin Lesion Segmentation

Attention-Guided Network with Densely Connected Convolution for Skin Lesion Segmentation

DiffSeg: A Segmentation Model for Skin Lesions Based on Diffusion Difference

DermoSegDiff: A Boundary-aware Segmentation Diffusion Model for Skin Lesion Delineation

Boosting Dermatoscopic Lesion Segmentation via Diffusion Models with Visual and Textual Prompts

Derm-T2IM: Harnessing Synthetic Skin Lesion Data via Stable Diffusion Models for Enhanced Skin Disease Classification using ViT and CNN

Transformer guided self-adaptive network for multi-scale skin lesion image segmentation

Learning from Dermoscopic Images in Association with Clinical Metadata for Skin Lesion Segmentation and Classification

LeFusion: Controllable Pathology Synthesis via Lesion-Focused Diffusion Models

A Novel Multi-task Deep Learning Model for Skin Lesion Segmentation and Classification

Verdiff-Net: A Conditional Diffusion Framework for Spinal Medical Image Segmentation

FairDiff: Fair Segmentation with Point-Image Diffusion

Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance

Interpretable Semantic-aware Unsupervised Segmentation of Skin Lesions

Cold SegDiffusion: A Novel Diffusion Model for Medical Image Segmentation

Data Augmentation in Class-Conditional Diffusion Model for Semi-Supervised Medical Image Segmentation

DiffuMask: Synthesizing Images with Pixel-level Annotations for Semantic Segmentation Using Diffusion Models

SkinFormer: Learning Statistical Texture Representation with Transformer for Skin Lesion Segmentation

Unsupervised Skin Lesion Segmentation via Structural Entropy Minimization on Multi-Scale Superpixel Graphs

PalScDiff: A diffusion-based framework with progressive augmentation learning and semantic consistency for breast ultrasound tumor segmentation

From Majority to Minority: A Diffusion-based Augmentation for Underrepresented Groups in Skin Lesion Analysis