Abstract:Medical image analysis is a crucial step required for accurate disease diagnosis, treatment planning, and condition monitoring. In recent years, the field has undergone a groundbreaking transformation due to the advancement in artificial intelligence (AI) and deep learning (DL). These cutting-edge developments have particularly revolutionized automated segmentation and classification tasks, making them more efficient and reliable. The simultaneous performance of segmentation and classification enables the AI model to identify and isolate regions of interest, thereby enhancing the accuracy of the classification process. Several research reports showed that this simultaneous optimization posed a significant challenge, particularly in medical image analysis, of capturing intricate details and complex structures and having mitigating issues, such as vanishing gradient, distracting information, and multi-scale context. Therefore, this study proposed a hybrid hierarchical approach, SSC (Simultaneous Segmentation and Classification), integrating image segmentation and classification tasks within a redesigned network architecture. The main contribution of the study was the combination of the UNet architecture, classification block (C ), residual block, attention mechanism, and Atrous Spatial Pyramid Pooling (ASPP) block together to achieve the improvement of segmentation and classification. A thorough comparative analysis and performance evaluation on two benchmark datasets, namely COVID-19 Radiography (CoR) and Breast Ultrasound Images (BUSI), were also conducted with 5-fold cross-validation. The experimental results showed that the proposed SSC model outperformed the baseline models. For the CoR dataset, the segmentation accuracy, Dice, IoU, classification accuracy, Recall, and Precision increased by 1.16%, 1.68%, 3.11%, 0.61%, 1.11%, and 1.20%, respectively. Meanwhile, for the BUSI dataset, 3.98%, 1.09%, 8.21%, 0.20%, 4.72%, and 1.55% increments were observed in the segmentation accuracy, Dice, IoU, classification accuracy, Recall, and Precision, respectively. These results showed the proposed method's efficiency and potential for advancing simultaneous segmentation and classification tasks in medical image analysis.

UC-Hybrid: Uncertainty-based contrastive learning on hybrid network for medical image segmentation

Semi-Supervised Convolutional Vision Transformer with Bi-Level Uncertainty Estimation for Medical Image Segmentation

UCTNet: Uncertainty-guided CNN-Transformer hybrid networks for medical image segmentation

Multi-task contrastive learning for semi-supervised medical image segmentation with multi-scale uncertainty estimation

Uncertainty-Guided Voxel-Level Supervised Contrastive Learning for Semi-Supervised Medical Image Segmentation

A hybrid approach of simultaneous segmentation and classification for medical image analysis

MSCT-UNET: multi-scale contrastive transformer within U-shaped network for medical image segmentation

Uncertainty-guided cross learning via CNN and transformer for semi-supervised honeycomb lung lesion segmentation

Learning to segment subcortical structures from noisy annotations with a novel uncertainty-reliability aware learning framework

A hybrid approach for improving U-Net variants in medical image segmentation

Hybrid Intelligent-Annotation Organ Segmentation on Medical Datasets

A Medical Image Segmentation Method Combining Knowledge Distillation and Contrastive Learning

BCU-Net: Bridging ConvNeXt and U-Net for medical image segmentation

Uncertainty-aware Hierarchical Aggregation Network for Medical Image Segmentation

HCT-Unet: multi-target medical image segmentation via a hybrid CNN-transformer Unet incorporating multi-axis gated multi-layer perceptron

Semantic-Aware Contrastive Learning for Multi-Object Medical Image Segmentation

Calibrated Uncertainty-Guided Multi-task Framework for Medical Image Segmentation.

A Hybrid Enhanced Attention Transformer Network for Medical Ultrasound Image Segmentation

Effective hybrid attention network based on pseudo-color enhancement in ultrasound image segmentation

Hybrid dual mean-teacher network with double-uncertainty guidance for semi-supervised segmentation of magnetic resonance images

TEC-Net: Vision Transformer Embrace Convolutional Neural Networks for Medical Image Segmentation