Abstract:Magnetic resonance imaging (MRI) is extensively utilized in clinical practice for diagnostic purposes, owing to its non-invasive nature and remarkable ability to provide detailed characterization of soft tissues. However, its drawback lies in the prolonged scanning time. To accelerate MR imaging, how to reconstruct MR images from under-sampled data quickly and accurately has drawn intensive research interest; it, however, remains a challenging task. While some deep learning models have achieved promising performance in MRI reconstruction, these models usually require a substantial quantity of paired data for training, which proves challenging to gather and share owing to high scanning costs and data privacy concerns. Federated learning (FL) is a potential tool to alleviate these difficulties. It enables multiple clinical clients to collaboratively train a global model without compromising privacy. However, it is extremely challenging to fit a single model to diverse data distributions of different clients. Moreover, existing FL algorithms treat the features of each channel equally, lacking discriminative learning ability across feature channels, and hence hindering their representational capability. In this study, we propose a novel Adaptive Channel-Modulated Federal learning framework for personalized MRI reconstruction, dubbed as ACM-FedMRI. Specifically, considering each local client may focus on features in different channels, we first design a client-specific hypernetwork to guide the channel selection operation in order to optimize the extracted features. Additionally, we introduce a performance-based channel decoupling scheme, which dynamically separates the global model at the channel level to facilitate personalized adjustments based on the performance of individual clients. This approach eliminates the need for heuristic design of specific personalization layers. Extensive experiments on four datasets under two different settings show that our ACM-FedMRI achieves outstanding results compared to other cutting-edge federated learning techniques in the field of MRI reconstruction.

Client-Adaptive Cross-Model Reconstruction Network for Modality-Incomplete Multimodal Federated Learning

X-Gacmn: An X-Shaped Generative Adversarial Cross-Modal Network With Hypersphere Embedding

Cross-Modal Prototype based Multimodal Federated Learning under Severely Missing Modality

FedMMR: Multi-Modal Federated Learning Via Missing Modality Reconstruction

Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection

Cross-Modal Vertical Federated Learning for MRI Reconstruction

Multimodal Federated Learning with Missing Modality via Prototype Mask and Contrast

FedCMR: Federated Cross-Modal Retrieval

FedMAC: Tackling Partial-Modality Missing in Federated Learning with Cross-Modal Aggregation and Contrastive Regularization

Towards Multi-modal Transformers in Federated Learning

Federated learning for supervised cross-modal retrieval

Multimodal Convolutional Neural Networks with Cross-Channel Reconstruction.

Leveraging Foundation Models for Multi-modal Federated Learning with Incomplete Modality

Unimodal Training-Multimodal Prediction: Cross-modal Federated Learning with Hierarchical Aggregation

Adaptive channel-modulated personalized federated learning for magnetic resonance image reconstruction

Cross-modal retrieval based on fusion lightweight network.

FedMFS: Federated Multimodal Fusion Learning with Selective Modality Communication

Balanced Multi-modal Federated Learning via Cross-Modal Infiltration

Optimizing Multimodal Federated Learning: Novel Approaches for Efficient Model Aggregation and Client Sampling