Abstract:E-health allows smart devices and medical institutions to collaboratively collect patients' data, which is trained by Artificial Intelligence (AI) technologies to help doctors make diagnosis. By allowing multiple devices to train models collaboratively, federated learning is a promising solution to address the communication and privacy issues in e-health. However, applying federated learning in e-health faces many challenges. First, medical data is both horizontally and vertically partitioned. Since single Horizontal Federated Learning (HFL) or Vertical Federated Learning (VFL) techniques cannot deal with both types of data partitioning, directly applying them may consume excessive communication cost due to transmitting a part of raw data when requiring high modeling accuracy. Second, a naive combination of HFL and VFL has limitations including low training efficiency, unsound convergence analysis, and lack of parameter tuning strategies. In this paper, we provide a thorough study on an effective integration of HFL and VFL, to achieve communication efficiency and overcome the above limitations when data is both horizontally and vertically partitioned. Specifically, we propose a hybrid federated learning framework with one intermediate result exchange and two aggregation phases. Based on this framework, we develop a Hybrid Stochastic Gradient Descent (HSGD) algorithm to train models. Then, we theoretically analyze the convergence upper bound of the proposed algorithm. Using the convergence results, we design adaptive strategies to adjust the training parameters and shrink the size of transmitted data. Experimental results validate that the proposed HSGD algorithm can achieve the desired accuracy while reducing communication cost, and they also verify the effectiveness of the adaptive strategies.

A Communication-efficient Federated Learning Assisted by Central Data: Implementation of Vertical Training into Horizontal Federated Learning

How global observation works in Federated Learning: Integrating vertical training into Horizontal Federated Learning

How Global Observation Embedding in Vertical-Horizontal Federated Learning

A Communication Efficient Vertical Federated Learning Framework.

FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation

Distributed and Deep Vertical Federated Learning with Big Data

Secure and Efficient Decentralized Federated Learning with Data Representation Protection

Evaluating Federated Learning Simulators: A Comparative Analysis of Horizontal and Vertical Approaches

Communication-Efficient Hybrid Federated Learning for E-health with Horizontal and Vertical Data Partitioning

Vertical Federated Learning: Concepts, Advances, and Challenges

Vertical Federated Learning: Concepts, Advances and Challenges

HQsFL: A Novel Training Strategy for Constructing High-performance and Quantum-safe Federated Learning

Communication-efficient hierarchical federated learning for IoT heterogeneous systems with imbalanced data

Hierarchical Federated Learning with Adaptive Clustering on Non-IID Data

Vertical Federated Learning: Challenges, Methodologies and Experiments

FedV: Privacy-Preserving Federated Learning over Vertically Partitioned Data

VAFL: a Method of Vertical Asynchronous Federated Learning

A Hybrid Self-Supervised Learning Framework for Vertical Federated Learning

Computation and Communication Efficient Lightweighting Vertical Federated Learning

Secure Vertical Federated Learning Under Unreliable Connectivity