DRL-Based Federated Self-Supervised Learning for Task Offloading and Resource Allocation in ISAC-Enabled Vehicle Edge Computing

Xueying Gu,Qiong Wu,Pingyi Fan,Nan Cheng,Wen Chen,Khaled B. Letaief
2024-08-27
Abstract:Intelligent Transportation Systems (ITS) leverage Integrated Sensing and Communications (ISAC) to enhance data exchange between vehicles and infrastructure in the Internet of Vehicles (IoV). This integration inevitably increases computing demands, risking real-time system stability. Vehicle Edge Computing (VEC) addresses this by offloading tasks to Road Side Unit (RSU), ensuring timely services. Our previous work FLSimCo algorithm, which uses local resources for Federated Self-Supervised Learning (SSL), though vehicles often can't complete all iterations task. Our improved algorithm offloads partial task to RSU and optimizes energy consumption by adjusting transmission power, CPU frequency, and task assignment ratios, balancing local and RSU-based training. Meanwhile, setting an offloading threshold further prevents inefficiencies. Simulation results show that the enhanced algorithm reduces energy consumption, improves offloading efficiency and the accuracy of Federated SSL.
Machine Learning,Distributed, Parallel, and Cluster Computing,Networking and Internet Architecture
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to effectively offload tasks and allocate resources through vehicle - edge computing (VEC) in intelligent transportation systems (ITS), in order to reduce energy consumption, improve offloading efficiency, and enhance the accuracy of federated self - supervised learning (Federated SSL) in the Internet of Vehicles (IoV) environment supported by integrated sensing and communication (ISAC). Specifically, the paper focuses on the following points: 1. **Excessive computational burden**: With the increase in data exchange requirements in intelligent transportation systems, the pressure on vehicle - local computing resources increases, which may lead to a decline in real - time processing capabilities. The paper proposes to reduce the computational burden on vehicles by offloading some computational tasks to roadside units (RSU). 2. **Uneven resource allocation**: If the computing resources of RSU are not properly allocated, it may not be able to meet the task offloading requests of a large number of vehicles during peak hours. The paper explores how to maximize the utilization rate of a single RSU by rationally allocating the computing resources of RSU to meet the offloading needs of more vehicles. 3. **Optimization in a dynamic environment**: Since vehicles are in motion, network conditions and computational tasks will keep changing, and an algorithm that can adapt to these changes is required. The paper uses the deep reinforcement learning (DRL) method to dynamically adjust the transmission power, CPU frequency, and task allocation ratio to optimize the overall energy efficiency and task offloading efficiency of the system. 4. **Offloading threshold mechanism**: In order to further optimize the offloading efficiency, the paper introduces an offloading threshold mechanism to quickly respond according to different network conditions and computational tasks, ensuring the high efficiency of task offloading. In summary, the main objective of this paper is to propose an efficient task offloading and resource allocation method by combining federated self - supervised learning and deep reinforcement learning, so as to improve the computational efficiency and system stability in the Internet of Vehicles environment.