SL: Stable Learning in Source-Free Domain Adaption for Medical Image Segmentation

Yixin Chen,Yan Wang

2023-07-24

Abstract:Deep learning techniques for medical image analysis usually suffer from the domain shift between source and target data. Most existing works focus on unsupervised domain adaptation (UDA). However, in practical applications, privacy issues are much more severe. For example, the data of different hospitals have domain shifts due to equipment problems, and data of the two domains cannot be available simultaneously because of privacy. In this challenge defined as Source-Free UDA, the previous UDA medical methods are limited. Although a variety of medical source-free unsupervised domain adaption (MSFUDA) methods have been proposed, we found they fall into an over-fitting dilemma called "longer training, worse performance." Therefore, we propose the Stable Learning (SL) strategy to address the dilemma. SL is a scalable method and can be integrated with other research, which consists of Weight Consolidation and Entropy Increase. First, we apply Weight Consolidation to retain domain-invariant knowledge and then we design Entropy Increase to avoid over-learning. Comparative experiments prove the effectiveness of SL. We also have done extensive ablation experiments. Besides, We will release codes including a variety of MSFUDA methods.

Computer Vision and Pattern Recognition,Artificial Intelligence

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that in the medical image segmentation task, due to the data distribution differences between the source domain and the target domain (i.e., domain shift), the performance of existing Unsupervised Domain Adaptation (UDA) methods declines in practical applications. Especially in the Source - Free UDA (SFUDA) scenario, due to privacy and data transmission issues, it is impossible to access the data of the source domain and the target domain simultaneously, which makes the existing SFUDA methods face the over - fitting dilemma of "the longer the training time, the worse the performance". For this reason, the paper proposes a Stable Learning (SL) strategy to solve this problem through two components, Weight Consolidation (WC) and Entropy Increase (EI), thereby improving the training stability of SFUDA methods and avoiding over - fitting.

### Specific problem description:
1. **Domain shift problem**: Deep - learning techniques in medical image analysis are usually affected by the data distribution differences between the source domain and the target domain, resulting in performance degradation on the target domain.
2. **Privacy problem**: In practical applications, data from different hospitals have domain shifts due to equipment problems, and due to privacy issues, the data of the two domains cannot be accessed simultaneously.
3. **Over - fitting problem**: Existing SFUDA methods will have the over - fitting phenomenon of "the longer the training time, the worse the performance" after long - term training.

### Solution:
1. **Weight Consolidation (WC)**:
- By adding a weight penalty term to the loss function, the update of model parameters is restricted, and the domain - invariant knowledge is retained, preventing the model from completely forgetting the source - domain - specific knowledge and domain - invariant knowledge.
- Expressed by the formula:
\[
L'(\theta) = L(\theta)+\sum_i|\theta_i - \theta^*_i|_1
\]
where \(\theta\) is the parameter set of the model, \(\theta^*\) is the parameter set of the source model, and \(L(\theta)\) is the adaptation loss.

2. **Entropy Increase (EI)**:
- By reducing the influence of high - confidence samples on the model, over - fitting is avoided.
- Expressed by the formula:
\[
L_a=-(\hat{y}-p)\log p =-\hat{y}\log p + p\log p
\]
where \(L_a\) is the adaptation loss, \(\hat{y}\) is the pseudo - label, and \(p\) is the softmax prediction value of the model.

### Experimental verification:
- The paper conducted experiments on abdominal and cardiac data sets to verify the effectiveness and stability of the SL strategy.
- The experimental results show that the method using the SL strategy can still maintain high performance after long - term training and avoid the over - fitting phenomenon.

### Conclusion:
The SL strategy proposed in the paper effectively solves the over - fitting problem of SFUDA methods in medical image segmentation tasks, improves the training stability of the model, and provides a reliable solution for practical applications.