FedPAW: Federated Learning with Personalized Aggregation Weights for Urban Vehicle Speed Prediction

Yuepeng He,Pengzhan Zhou,Yijun Zhai,Fang Qu,Zhida Qin,Mingyan Li,Songtao Guo
2024-12-02
Abstract:Vehicle speed prediction is crucial for intelligent transportation systems, promoting more reliable autonomous driving by accurately predicting future vehicle conditions. Due to variations in drivers' driving styles and vehicle types, speed predictions for different target vehicles may significantly differ. Existing methods may not realize personalized vehicle speed prediction while protecting drivers' data privacy. We propose a Federated learning framework with Personalized Aggregation Weights (FedPAW) to overcome these challenges. This method captures client-specific information by measuring the weighted mean squared error between the parameters of local models and global models. The server sends tailored aggregated models to clients instead of a single global model, without incurring additional computational and communication overhead for clients. To evaluate the effectiveness of FedPAW, we collected driving data in urban scenarios using the autonomous driving simulator CARLA, employing an LSTM-based Seq2Seq model with a multi-head attention mechanism to predict the future speed of target vehicles. The results demonstrate that our proposed FedPAW ranks lowest in prediction error within the time horizon of 10 seconds, with a 0.8% reduction in test MAE, compared to eleven representative benchmark baselines. The source code of FedPAW and dataset CarlaVSP are open-accessed at: <a class="link-external link-https" href="https://github.com/heyuepeng/PFLlibVSP" rel="external noopener nofollow">this https URL</a> and <a class="link-external link-https" href="https://pan.baidu.com/s/1qs8fxUvSPERV3C9i6pfUIw?pwd=tl3e" rel="external noopener nofollow">this https URL</a>.
Artificial Intelligence,Distributed, Parallel, and Cluster Computing
What problem does this paper attempt to address?
### Problems the paper attempts to solve This paper aims to solve two main problems in personalized vehicle speed prediction: 1. **Existing methods cannot achieve personalized prediction**: Due to differences in driving styles among different drivers and vehicle types, existing vehicle speed prediction methods cannot provide personalized prediction results. Traditional methods usually assume that all vehicles have similar behavior patterns, which is not accurate in practical applications. 2. **Insufficient data privacy protection**: In order to improve prediction accuracy, it is necessary to cooperatively train data from multiple vehicles. However, traditional distributed machine - learning techniques require concentrating all vehicles' private driving data on a central server for processing, which may lead to the risk of data privacy leakage. To solve the above problems, the author proposes a new framework based on Federated Learning (FL) - Federated Learning with Personalized Aggregation Weights (FedPAW). This framework overcomes the limitations of existing methods in the following ways: - **Personalized aggregation**: FedPAW captures specific information of each client (i.e., vehicle) by introducing Personalized Aggregation Weights (PAW) and performing element - level weighted aggregation of local models and global models on the server side. - **No extra overhead**: Unlike existing personalized federated learning methods, FedPAW does not require additional computing or communication operations on the client side, thus avoiding increasing the computing and communication burden on the client. ### Method overview The specific implementation of FedPAW includes the following key steps: 1. **Select clients**: In each iteration, the server selects a set of clients to participate in training and collects local trained model parameters from these clients. 2. **Average aggregation**: The server first performs average aggregation on the local models of these clients to generate a global model. 3. **Personalized aggregation**: Next, the server performs element - level weighted aggregation on the global model and each client's local model according to the personalized aggregation weights to generate a personalized aggregated model. The specific formula is as follows: \[ \hat{\Theta}_{i}^{t + 1}:=\Theta^{t}+(\Theta_{i}^{t}-\Theta^{t})\odot W_{t} \] where \(\Theta^{t}\) is the global model, \(\Theta_{i}^{t}\) is the local model of client \(i\), \(W_{t}\) is the aggregation weight matrix, and \(\odot\) represents the Hadamard product. 4. **Distribute personalized models**: Finally, the server sends the personalized aggregated models back to each client for the next round of local training. ### Experimental verification To verify the effectiveness of FedPAW, the author collected driving data in urban scenes using the CARLA self - driving simulator and used the LSTM - based Seq2Seq model combined with the Multi - Head Attention mechanism for vehicle speed prediction. The experimental results show that FedPAW achieved the lowest prediction error within the 10 - second prediction time range, reducing the test Mean Squared Error (MAE) by 0.8% compared to other benchmark methods. ### Summary By introducing personalized aggregation weights, FedPAW not only improves the accuracy of vehicle speed prediction but also effectively protects drivers' privacy data while avoiding additional computing and communication overheads. This method provides new ideas and solutions for the application of personalized federated learning in intelligent transportation systems.