Abstract:Federated learning (FL) is an emerging distributed learning paradigm widely used in vehicular networks, where vehicles are enabled to train the deep model for the server while keeping private data locally. However, the annotation of private data by vehicular users is very difficult since the high costs and professional needs, and one solution is that roadside infrastructures could provide label mapping to the data according to the geographical coordinates. In this scenario where vehicles and roadside infrastructures hold the data and labels, respectively, traditional FL is not applicable since it needs each participant to have both data and labels. In this paper, we propose a federated split learning (FSL) paradigm that split the deep model into two submodels which are trained separately in the vehicles and the roadside infrastructures. The vehicles and the roadside infrastructures exchange the intermediate data (i.e., smashed data and cut layer gradients) in training local submodels and upload the local gradients to the global server for aggregation into the global model. Specifically, we first adopt three types of privacy attacks to demonstrate that attackers could recover the private data and labels according to the shared intermediate data and uploaded local gradients. We then propose a differential privacy (DP)-based defense mechanism to defend the privacy attacks by perturbing the intermediate data. Furthermore, we design a contract-based incentive mechanism that encourages vehicles and roadside infrastructures to enhance training performance by adjusting their privacy strategies. The simulation results illustrated that the proposed defense mechanism can remarkably emasculate the performance of attacks and the proposed incentive mechanism is efficient in the FSL paradigm for vehicular networks.

Collaborative Multimodal Vehicular Transformer Training Using Federated Learning

Federated Vehicular Transformers and Their Federations: Privacy-Preserving Computing and Cooperation for Autonomous Driving

Towards Multi-modal Transformers in Federated Learning

Enhancing Federated Learning in Heterogeneous Internet of Vehicles: A Collaborative Training Approach

On the Federated Learning Framework for Cooperative Perception

Joint Resource Management for Mobility Supported Federated Learning in Internet of Vehicles

Multi-Modal Virtual-Real Fusion based Transformer for Collaborative Perception

Unimodal Training-Multimodal Prediction: Cross-modal Federated Learning with Hierarchical Aggregation

Federated Learning for Vehicular Internet of Things: Recent Advances and Open Issues

Mobility, Communication and Computation Aware Federated Learning for Internet of Vehicles

Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verification

The Prospect of Enhancing Large-Scale Heterogeneous Federated Learning with Transformers

IoV-SFL: A blockchain-based federated learning framework for secure and efficient data sharing in the internet of vehicles

Content-based Vehicle Selection and Resource Allocation for Federated Learning in IoV

Federated Split Learning with Data and Label Privacy Preservation in Vehicular Networks

An Enhancing Semi-Supervised Federated Learning Framework for Internet of Vehicles

Hierarchical Decentralized Federated Learning Framework with Adaptive Clustering: Bloom-Filter-Based Companions Choice for Learning Non-IID Data in IoV

A Dynamic Clustering-Based Hierarchical Federated Learning Scheme in Internet of Vehicles

Multimodal Federated Learning on IoT Data

Matching Game for Multi-task Federated Learning in Internet of Vehicles

FedBEVT: Federated Learning Bird's Eye View Perception Transformer in Road Traffic Systems