Abstract:Federated learning (FL) offers an effective privacy protection mechanism for cross-center medical collaboration and data sharing. In multi-site medical image segmentation, FL allows each medical site to act as a client, forming its own data domain. FL has the potential to enhance the performance of models on known domains. However, practical deployment faces the challenge of domain generalization (DG) due to the non-identical and non-independent (non-IID) nature of data from different domains. This results in decreased model performance in unseen domains. Current DG solutions are overly complex in addressing style differences and lack focus on inter-domain image features causing model differences. Furthermore, these solutions are not suitable for the FL paradigm that requires data storage separation. Hence, the lightweight model-level attention and batch-instance style normalization (MLA-BIN) is proposed to solve the DG of FL in this study. The MLA module represents the unseen domain as a linear combination of seen domain models. It does not require access to raw data but learns from the sufficient exploration of data features in known domains, thereby identifying differences in inter-domain data features and enabling the global model to generalize from seen to unseen domains. In the BIN block, batch normalization (BN) and instance normalization (IN) are combined to perform the shallow layers of the segmentation network for style normalization. By integrating the segmentation backbone network with the BIN block (BIN-Net), it ensures effective learning of intra-domain features and addresses the impact of inter-domain image style differences on domain generalization without accessing data from other centers. Extensive experimental results demonstrate that the proposed method achieved a Dice similarity coefficient of 88.27, 88.25 and 64.94 on the prostate, the optic disc and cup, and the COVID-19 lesion segmentation dataset, respectively, outperforming the state-of-the-art methods.

Normalization in Training U-Net for 2-D Biomedical Semantic Segmentation

Normalization in Training Deep Convolutional Neural Networks for 2D Bio-medical Semantic Segmentation.

U-Net Training with Instance-Layer Normalization

Batch Group Normalization

3D U$$^$$-Net: A 3D Universal U-Net for Multi-domain Medical Image Segmentation

Unified Batch Normalization: Identifying and Alleviating the Feature Condensation in Batch Normalization and a Unified Framework

Understanding and Improving Group Normalization

Enhancing Semantic Segmentation in High-Resolution TEM Images: A Comparative Study of Batch Normalization and Instance Normalization

BCN: Batch Channel Normalization for Image Classification

Kalman Normalization - Normalizing Internal Representations Across Network Layers.

AC-Norm: Effective Tuning for Medical Image Analysis via Affine Collaborative Normalization

SS-Norm: Spectral-spatial Normalization for Single-Domain Generalization with Application to Retinal Vessel Segmentation.

"BNN - BN = ?": Training Binary Neural Networks Without Batch Normalization

“BNN - BN = ?”: Training Binary Neural Networks Without Batch Normalization

Deep Convolutional Neural Network Based Medical Concept Normalization

Batch Kalman Normalization: Towards Training Deep Neural Networks with Micro-Batches

Double-branch U-Net for multi-scale organ segmentation

Exploring the Efficacy of Group-Normalization in Deep Learning Models for Alzheimer's Disease Classification

Scalable model for segmenting Cells' Nuclei using the U-NET architecture

Model-level Attention and Batch-instance Style Normalization for Federated Learning on Medical Image Segmentation

New Interpretations of Normalization Methods in Deep Learning.