Abstract:The primary objective of interactive medical image segmentation systems is to achieve more precise segmentation outcomes with reduced human intervention. This endeavor holds significant clinical importance for both pre-diagnostic pathological assessments and prognostic recovery. Among the various interaction methods available, click-based interactions stand out as an intuitive and straightforward approach compared to alternatives such as graffiti, bounding boxes, and extreme points. To improve the model's ability to interpret click-based interactions, we propose a comprehensive interactive segmentation framework that leverages an iterative weighted loss function based on user clicks. To enhance the segmentation capabilities of the Plain-ViT backbone, we introduce a Residual Multi-Headed Self-Attention encoder with hierarchical inputs and residual connections, offering multiple perspectives on the data. This innovative architecture leads to a remarkable improvement in segmentation model performance. In this research paper, we assess the robustness of our proposed framework using a self-compiled T2-MRI image dataset of the prostate and three publicly available datasets containing images of other organs. Our experimental results convincingly demonstrate that our segmentation model surpasses existing state-of-the-art methods. Furthermore, the incorporation of an iterative loss function training strategy significantly accelerates the model's convergence rate during interactions. In the prostate dataset, we achieved an impressive Intersection over Union (IoU) score of 88.11% and Number of Clicks(NoC) at 80% are 7.03 clicks.

Interactive Image Segmentation with First Click Attention

FocalClick: Towards Practical Interactive Image Segmentation.

Interactive Segmentation by Considering First-Click Intentional Ambiguity

One-Click-Based Perception for Interactive Image Segmentation

Focused and Collaborative Feedback Integration for Interactive Image Segmentation.

Rethinking click embedding for deep interactive image segmentation

CSANet: Cross-self attention guided by semantic click embedding for interactive segmentation

Click-Pixel Cognition Fusion Network With Balanced Cut for Interactive Image Segmentation

ClickAttention: Click Region Similarity Guided Interactive Segmentation

Spatiotemporal Consistent Selection-Correction Network for Deep Interactive Image Segmentation.

Pseudoclick: Interactive image segmentation with click imitation

Error Attention Interactive Segmentation of Medical Image Through Matting and Fusion

Deep Interactive Image Segmentation Based on Region and Boundary-Click Guidance

A Click-Based Interactive Segmentation Network for Point Clouds

Efficient Mask Correction for Click-Based Interactive Image Segmentation

Constrained fixation point based segmentation via deep neural network.

AdaptiveClick: Click-Aware Transformer with Adaptive Focal Loss for Interactive Image Segmentation

AdaptiveClick: Clicks-aware Transformer with Adaptive Focal Loss for Interactive Image Segmentation

Efficient click-based interactive segmentation for medical image with improved Plain-ViT

Residual Refinement for Interactive Skin Lesion Segmentation