Deep Learning for Medical Image Segmentation with Imprecise Annotation

Binyan Hu,A. K. Qin
2024-02-12
Abstract:Medical image segmentation (MIS) plays an instrumental role in medical image analysis, where considerable efforts have been devoted to automating the process. Currently, mainstream MIS approaches are based on deep neural networks (DNNs) which are typically trained on a dataset that contains annotation masks produced by doctors. However, in the medical domain, the annotation masks generated by different doctors can inherently vary because a doctor may unnecessarily produce precise and unique annotations to meet the goal of diagnosis. Therefore, the DNN model trained on the data annotated by certain doctors, often just a single doctor, could undesirably favour those doctors who annotate the training data, leading to the unsatisfaction of a new doctor who will use the trained model. To address this issue, this work investigates the utilization of multi-expert annotation to enhance the adaptability of the model to a new doctor and we conduct a pilot study on the MRI brain segmentation task. Experimental results demonstrate that the model trained on a dataset with multi-expert annotation can efficiently cater for a new doctor, after lightweight fine-tuning on just a few annotations from the new doctor.
Neural and Evolutionary Computing
What problem does this paper attempt to address?
The paper mainly proposes a solution to the issue of inaccurate annotations in Medical Image Segmentation (MIS). Specifically, it explores how to utilize multi-expert annotations to improve the adaptability of deep learning models for new doctors. ### Research Background - Medical image segmentation is a crucial step and plays a key role in most medical image analysis processes. - Automated medical image segmentation techniques, especially those based on Deep Neural Networks (DNNs), have achieved significant success in various tasks. - Different doctors may have varying annotations for the same image, leading to annotation inaccuracies, which in turn affect the performance of the trained model when used by new doctors. ### Main Problem - When a model is trained solely on annotations from a single doctor, it may become overly biased towards that doctor's annotation style, making it difficult for the model to meet the needs of other doctors. ### Solution - Utilize a dataset with annotations from multiple experts to train the model, thereby reducing the model's dependency on the annotation style of individual doctors. - A two-stage training paradigm is proposed: 1. **First Stage**: Train the model using a dataset with annotations from multiple doctors, allowing the model to learn the differences in annotations among different doctors. 2. **Second Stage**: Fine-tune the model with a small amount of annotation data provided by new doctors to adapt to their needs. ### Experimental Validation - The paper conducted experiments using an MRI brain image dataset annotated by 7 doctors. - Results show that models trained with multi-expert annotations can achieve good segmentation performance with only a small amount of annotation data from new doctors, significantly reducing the number of images that new doctors need to re-annotate. ### Conclusion Through the aforementioned method, the paper effectively addresses the issue of individual doctor annotation differences in medical image segmentation, improving the model's applicability and generalization for new doctors. Future research directions include exploring how to better utilize annotations from different doctors and evaluating the contribution of each doctor's annotations to model training.