FedCL: Federated Contrastive Learning for Multi-center Medical Image Classification

Zhenbing Liu,Fengfeng Wu,Yumeng Wang,Mengyu Yang,Xipeng Pan

DOI: https://doi.org/10.1016/j.patcog.2023.109739

IF: 8

2023-06-05

Pattern Recognition

Abstract:Federated learning, which allows distributed medical institutions to train a shared deep learning model with privacy protection, has become increasingly popular recently. However, in practical application, due to data heterogeneity between different hospitals, the performance of the model will be degraded in the training process. In this paper, we propose a federated contrastive learning (FedCL) approach. FedCL integrates the idea of contrastive learning into the federated learning framework. Specifically, it combines the local model and the global model for contrastive learning, so that the local model gradually approaches the global model with the increase of communication rounds, which improves the generalization ability of the model. We validate our method on two public datasets. Extensive experiments show that our method is superior to other federated learning algorithms in medical image classification.

computer science, artificial intelligence,engineering, electrical & electronic

What problem does this paper attempt to address?

The paper attempts to address the issue of performance degradation in federated learning models for multi-center medical image classification due to data heterogeneity (i.e., inconsistent data distribution) among different hospitals. Specifically, data from different medical institutions may differ significantly due to variations in sampling methods, imaging equipment, and patient populations. This leads to a gradual deterioration in model performance as the number of communication rounds increases during federated learning. Therefore, the authors propose a method based on Federated Contrastive Learning (FedCL), which aims to improve the generalization ability of the model and effectively mitigate the negative impact of data heterogeneity by combining global and local models for contrastive learning, making the local models gradually approach the global model.

The main contributions of the paper include:
1. Proposing a federated contrastive learning method that utilizes the feature representations learned by the global and local models for contrastive learning, allowing the final model to gradually approach the global model during training to achieve better model generalization.
2. Addressing the issue of data heterogeneity in current medical scenarios, this method can effectively reduce its impact on experimental results, demonstrating high performance and good generalization ability in heterogeneous data scenarios.
3. Conducting experiments on two medical image classification datasets, including a skin lesion classification dataset and a chest X-ray dataset for detecting COVID-19, with extensive experiments validating the effectiveness of the proposed method.