Quality-Cost Trade-off on Constructing Logical Views for Vehicular Cyber-Physical Systems: A Deep Reinforcement Learning Approach

Junyuan Wu,Xincao Xu,Chuzhao Li,Hao Zhang,Ke Xiao,Kai Liu
2023-09-19
Abstract:With the development of sensing technologies, vehicle-to-everything (V2X) communications, edge computing paradigm, vehicular cyber-physical systems (VCPS) are emerging as the most fundamental platform for realizing future intelligent transportation systems (ITSs). In particular, the construction of logical views at the edge nodes based on heterogeneous information sensing and uploading are critical to the realization of VCPS. However, a higher-quality view in terms of timeliness and accuracy may require higher cost on sensing and uploading. In view of this, this paper is dedicated to striking a balance between the quality and the cost for constructing logical views of VCPS. Specifically, we first derive an information sensing model based on multi-class M/G/1 priority queue and a data uploading model based on reliability-guaranteed vehicle-to-infrastructure (V2I) communications. On this basis, we design two metrics, namely, age of view (AoV) and cost of view (CoV), simultaneously. Then, we formulate a bi-objective problem to maximize the AoV and minimize the CoV. Further, we propose a distributed distributional deep deterministic policy gradient (D4PG) solution to determine sensing information, frequency, uploading priority, transmission power, and V2I bandwidth. Finally, we build a simulation model and give a comprehensive performance evaluation, and the simulation results conclusively demonstrate the superiority of the proposed solution.
Networking and Internet Architecture
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to strike a balance between ensuring the quality of the view and reducing the construction cost when constructing the logical view of the Vehicular Cyber - Physical System (VCPS). Specifically: 1. **Trade - off between view quality and cost**: A high - quality logical view requires higher real - time performance and accuracy, which usually means higher sensing and uploading costs, increasing energy consumption and information processing overhead. Therefore, researchers hope to find a method to minimize the construction cost while ensuring the quality of the logical view. 2. **Model establishment**: - Researchers first established an information - sensing model based on the multi - class M/G/1 priority queue and established a data - uploading model based on the vehicle - to - infrastructure (V2I) communication with reliability guarantee. - Then, they designed two measurement indicators: the freshness of the view (Age of View, AoV) and the cost of the view (Cost of View, CoV) to quantify the quality and cost of the logical view. 3. **Problem formulation**: Researchers formulated the problem as a bi - objective optimization problem, aiming to maximize the view quality (by maximizing AoV) and minimize the view cost (by minimizing CoV). 4. **Solution**: In order to determine the sensing information, sensing frequency, uploading priority, transmission power, and V2I bandwidth allocation, researchers proposed a Distributed Distributional Deep Deterministic Policy Gradient (D4PG) algorithm. 5. **Performance evaluation**: Finally, researchers conducted a comprehensive performance evaluation by constructing a simulation model. The simulation results show that the proposed D4PG algorithm is significantly superior to the Random Allocation (RA) and Multi - Agent Deep Deterministic Policy Gradient (MADDPG) algorithms in terms of cumulative rewards, increasing by approximately 20.79% and 13.88% respectively. In conclusion, the core problem of this paper is to reduce the construction cost of the VCPS logical view as much as possible under the premise of ensuring its quality through reasonable resource allocation and scheduling strategies.