Abstract:Spatiotemporal forecasting has emerged as an indispensable building block of diverse smart city applications, such as intelligent transportation and smart energy management. Recent advancements have uncovered that the performance of spatiotemporal forecasting can be significantly improved by integrating knowledge in geo-distributed time series data from different domains, \eg enhancing real-estate appraisal with human mobility data; joint taxi and bike demand predictions. While effective, existing approaches assume a centralized data collection and exploitation environment, overlooking the privacy and commercial interest concerns associated with data owned by different parties. In this paper, we investigate multi-party collaborative spatiotemporal forecasting without direct access to multi-source private data. However, this task is challenging due to 1) cross-domain feature heterogeneity and 2) cross-client geographical heterogeneity, where standard horizontal or vertical federated learning is inapplicable. To this end, we propose a Heterogeneous SpatioTemporal Federated Learning (HSTFL) framework to enable multiple clients to collaboratively harness geo-distributed time series data from different domains while preserving privacy. Specifically, we first devise vertical federated spatiotemporal representation learning to locally preserve spatiotemporal dependencies among individual participants and generate effective representations for heterogeneous data. Then we propose a cross-client virtual node alignment block to incorporate cross-client spatiotemporal dependencies via a multi-level knowledge fusion scheme. Extensive privacy analysis and experimental evaluations demonstrate that HSTFL not only effectively resists inference attacks but also provides a significant improvement against various baselines.

Federating from History in Streaming Federated Learning

Take History as a Mirror in Heterogeneous Federated Learning

HSFL: an Efficient Split Federated Learning Framework Via Hierarchical Organization.

FedDS: Data Selection for Streaming Federated Learning with Limited Storage

Federation-Paced Learning: Towards Efficient Federated Learning with Synchronized Pace

Memory-adaptive Depth-wise Heterogenous Federated Learning

A Fair Federated Learning Framework with Reinforcement Learning.

FLIS: Clustered Federated Learning via Inference Similarity for Non-IID Data Distribution

Hierarchical Federated Learning for Heterogeneous Features and Distributed Data in IoT Networks.

Federated mutual learning

Communication-efficient federated continual learning for distributed learning system with Non-IID data

Personalized Federated Learning on Flowing Data Heterogeneity under Restricted Storage

Federated Continual Learning via Knowledge Fusion: A Survey

FedH2L: A Federated Learning Approach with Model and Statistical Heterogeneity

Towards Federated Learning on Fresh Datasets

A Survey of Federated Learning on Non-IID Data

HSTFL: A Heterogeneous Federated Learning Framework for Misaligned Spatiotemporal Forecasting

Exploring Amplified Heterogeneity Arising from Heavy-Tailed Distributions in Federated Learning

ISFL: Federated Learning for Non-i.i.d. Data with Local Importance Sampling

WassFFed: Wasserstein Fair Federated Learning

Federated Impression for Learning with Distributed Heterogeneous Data