Annotator Consensus Prediction for Medical Image Segmentation with Diffusion Models

Tomer Amit,Shmuel Shichrur,Tal Shaharabany,Lior Wolf

2023-06-15

Abstract:A major challenge in the segmentation of medical images is the large inter- and intra-observer variability in annotations provided by multiple experts. To address this challenge, we propose a novel method for multi-expert prediction using diffusion models. Our method leverages the diffusion-based approach to incorporate information from multiple annotations and fuse it into a unified segmentation map that reflects the consensus of multiple experts. We evaluate the performance of our method on several datasets of medical segmentation annotated by multiple experts and compare it with state-of-the-art methods. Our results demonstrate the effectiveness and robustness of the proposed method. Our code is publicly available at <a class="link-external link-https" href="https://github.com/tomeramit/Annotator-Consensus-Prediction" rel="external noopener nofollow">this https URL</a>.

Image and Video Processing,Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

The paper attempts to address the issue of inconsistency and unreliability in medical image segmentation due to significant inter-observer and intra-observer variability in annotations provided by multiple experts. To tackle this challenge, the authors propose a multi-expert prediction method based on a diffusion model, which integrates annotations from multiple experts to generate a unified segmentation map that reflects the consensus of the experts. This method aims to improve the accuracy and reliability of segmentation results while reducing the time and cost of manual annotation.

Specifically, the main contributions of the paper include:
1. **Proposing a new multi-expert prediction method**: Utilizing a diffusion model to integrate annotations from multiple experts and generate a consensus segmentation map.
2. **Validation of the method's effectiveness and robustness**: Evaluating the performance of the method on multiple medical image datasets annotated by multiple experts and comparing it with existing state-of-the-art methods. The results show that the proposed method has higher accuracy and robustness in handling inter-observer and intra-observer variability.
3. **Open-source code**: The authors have made the code publicly available so that other researchers can reproduce and further improve the method.

Through these contributions, the paper provides new insights and technical support for improving the efficiency and quality of medical image segmentation, contributing to the optimization of the clinical decision-making process.