Distributed DRL-Based Integrated Sensing, Communication and Computation in Cooperative UAV-Enabled Intelligent Transportation Systems

Peng Hou,Yi Huang,Hongbin Zhu,Zhihui Lu,Shin-Chia Huang,Yang,Hongfeng Chai
DOI: https://doi.org/10.1109/jiot.2024.3489655
IF: 10.6
2024-01-01
IEEE Internet of Things Journal
Abstract:The integration of sensing, communication, and computation (ISCC) is a critical technology that will support various emerging wireless services in future 6G networks. The unmanned aerial vehicles (UAVs) equipped with edge servers can be used as an aerial service platform in intelligent transportation systems (ITS) to offer ISCC services to vehicles. This paper studies an aerial UAV network comprising a central UAV and secondary UAVs to realize sensing of the global ITS environment and data fusion computation through collaborative UAVs. To enhance the service performance of ISCC, we maximize the success rate of ISCC services and the energy efficiency of UAVs by jointly optimizing bandwidth allocation, power allocation, and computing capacity control while ensuring the sensing and data processing latency requirements. Leveraging the network architecture and collaboration requirements of UAVs, we propose the multi-UAV collaborative Air-ISCC (MCAI) algorithm based on the asynchronous advantage actor-critic algorithm, which obtains the optimal ISCC service policy by co-training a deep reinforcement learning model with multiple UAVs. Sufficient experimental results show that MCAI enhances energy efficiency by 10.51% to 80.12% compared with the baselines. Moreover, MCAI exhibits good scalability, strengthening its feasibility in real scenarios.
What problem does this paper attempt to address?