Uncertainty-informed Mutual Learning for Joint Medical Image Classification and Segmentation

Kai Ren,Ke Zou,Xianjie Liu,Yidi Chen,Xuedong Yuan,Xiaojing Shen,Meng Wang,Huazhu Fu

2023-08-02

Abstract:Classification and segmentation are crucial in medical image analysis as they enable accurate diagnosis and disease monitoring. However, current methods often prioritize the mutual learning features and shared model parameters, while neglecting the reliability of features and performances. In this paper, we propose a novel Uncertainty-informed Mutual Learning (UML) framework for reliable and interpretable medical image analysis. Our UML introduces reliability to joint classification and segmentation tasks, leveraging mutual learning with uncertainty to improve performance. To achieve this, we first use evidential deep learning to provide image-level and pixel-wise confidences. Then, an Uncertainty Navigator Decoder is constructed for better using mutual features and generating segmentation results. Besides, an Uncertainty Instructor is proposed to screen reliable masks for classification. Overall, UML could produce confidence estimation in features and performance for each link (classification and segmentation). The experiments on the public datasets demonstrate that our UML outperforms existing methods in terms of both accuracy and robustness. Our UML has the potential to explore the development of more reliable and explainable medical image analysis models. We will release the codes for reproduction after acceptance.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

### What problem does this paper attempt to solve? This paper aims to address the issues of reliability and interpretability in classification and segmentation tasks in medical image analysis. Specifically: 1. **Problems with existing methods**: - Current methods often prioritize joint learning of features and sharing model parameters, while neglecting the reliability and performance of the features. - In clinical applications, a single result lacking decision basis may lead to misdiagnosis and suboptimal treatment. 2. **Proposed new method**: - The paper proposes a new Uncertainty-informed Mutual Learning (UML) framework to improve the reliability and interpretability of medical image classification and segmentation tasks. - UML improves joint classification and segmentation tasks by introducing uncertainty and utilizes a mutual learning mechanism to enhance performance. 3. **Main contributions**: - Using evidential deep learning to provide image-level and pixel-level confidence estimates. - Constructing an Uncertainty Navigator to better utilize mutual learning features to generate segmentation results. - Proposing an Uncertainty Instructor to filter reliable masks for classification. - Experiments show that UML has higher accuracy and robustness compared to existing methods on public datasets. In summary, this paper aims to enhance the reliability and interpretability of medical image analysis models by introducing uncertainty.

Uncertainty-informed Mutual Learning for Joint Medical Image Classification and Segmentation

Joint Dermatological Lesion Classification and Confidence Modeling with Uncertainty Estimation

Semi-Supervised Convolutional Vision Transformer with Bi-Level Uncertainty Estimation for Medical Image Segmentation

MedUHIP: Towards Human-In-the-Loop Medical Segmentation

Uncertainty-aware Evidential Fusion-based Learning for Semi-supervised Medical Image Segmentation

Learning Robust Medical Image Segmentation from Multi-source Annotations

Uncertainty teacher with dense focal loss for semi-supervised medical image segmentation

Uncertainty-Guided Mutual Consistency Learning for Semi-Supervised Medical Image Segmentation

Uncertainty-Aware Multi-Dimensional Mutual Learning for Brain and Brain Tumor Segmentation

Mutually aided uncertainty incorporated Dual Consistency Regularization with Pseudo Label for Semi-Supervised Medical Image Segmentation

Quantifying and leveraging predictive uncertainty for medical image assessment

Double-Uncertainty Weighted Method for Semi-supervised Learning

Correlation-Aware Mutual Learning for Semi-supervised Medical Image Segmentation

Mutual learning with reliable pseudo label for semi-supervised medical image segmentation

Uncertainty bidirectional guidance of multi-task mamba network for medical image classification and segmentation

Uncertainty-aware Deep Co-Training for Semi-Supervised Medical Image Segmentation

Uncertainty-Error correlations in Evidential Deep Learning models for biomedical segmentation

Dual uncertainty-guided multi-model pseudo-label learning for semi-supervised medical image segmentation

Uncertainty-aware Multi-View Co-Training for Semi-Supervised Medical Image Segmentation and Domain Adaptation.

Learning to segment subcortical structures from noisy annotations with a novel uncertainty-reliability aware learning framework

Towards Generalizable Medical Image Segmentation with Pixel-wise Uncertainty Estimation