Semantic-Aware Spectrum Sharing in Internet of Vehicles Based on Deep Reinforcement Learning

Zhiyu Shao,Qiong Wu,Pingyi Fan,Nan Cheng,Wen Chen,Jiangzhou Wang,Khaled B. Letaief
2024-06-17
Abstract:This work aims to investigate semantic communication in high-speed mobile Internet of vehicles (IoV) environments, with a focus on the spectrum sharing between vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) communications. We specifically address spectrum scarcity and network traffic and then propose a semantic-aware spectrum sharing algorithm (SSS) based on the deep reinforcement learning (DRL) soft actor-critic (SAC) approach. Firstly, we delve into the extraction of semantic information. Secondly, we redefine metrics for semantic information in V2V and V2I spectrum sharing in IoV environments, introducing high-speed semantic spectrum efficiency (HSSE) and semantic transmission rate (HSR). Finally, we employ the SAC algorithm for decision optimization in V2V and V2I spectrum sharing based on semantic information. This optimization encompasses the optimal link of V2V and V2I sharing strategies, the transmission power for vehicles sending semantic information and the length of transmitted semantic symbols, aiming at maximizing HSSE of V2I and enhancing success rate of effective semantic information transmission (SRS) of V2V. Experimental results demonstrate that the SSS algorithm outperforms other baseline algorithms, including other traditional-communication-based spectrum sharing algorithms and spectrum sharing algorithm using other reinforcement learning approaches. The SSS algorithm exhibits a 15% increase in HSSE and approximately a 7% increase in SRS.
Machine Learning
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to effectively utilize the limited spectrum resources in the high - speed mobile Internet of Vehicles (IoV) environment to support efficient communication between vehicle - to - vehicle (V2V) and vehicle - to - infrastructure (V2I). Specifically, the paper focuses on the following aspects: 1. **Scarcity of Spectrum Resources**: In the IoV environment, due to the increase in the number of vehicles and the diversification of applications, spectrum resources are becoming increasingly scarce, which leads to the problem of spectrum sharing. Traditional spectrum allocation methods are often unable to effectively cope with this dynamically changing environment. 2. **Network Traffic Problems**: With the diversification of IoV applications and the explosive growth of content, traditional bit - based communication methods are facing new challenges. The maximum transmission rate of these traditional methods is limited by the Shannon limit and cannot meet the increasingly complex information exchange requirements. 3. **Application of Semantic Communication**: In order to overcome the above problems, the paper introduces the concept of semantic communication. Semantic communication not only focuses on data transmission but also pays more attention to the meaning of data, can convey more abundant information, adapt to the dynamic environment, and reduce spectrum waste. Therefore, the paper proposes a semantic - aware spectrum - sharing algorithm (SSS) based on deep reinforcement learning (DRL), aiming to maximize the high - speed semantic efficiency (HSSE) of the V2I link and improve the success rate of effective semantic information transmission (SRS) of the V2V link. ### Specific Objectives - **Extract Semantic Information**: Research how to extract semantic information from different data streams, which is the basis for realizing semantic communication. - **Redefine Measurement Metrics**: Introduce two new measurement metrics, HSSE and HSR, specifically used to evaluate the spectrum - sharing performance in the highly dynamic mobile IoV environment. - **Optimize Decisions**: Use the Soft Actor - Critic (SAC) algorithm in DRL to optimize the V2V and V2I spectrum - sharing strategies, including selecting the optimal link, determining the transmission power, and the length of the transmitted semantic symbols, in order to maximize HSSE and SRS. ### Solutions The paper proposes an SSS algorithm based on DRL. The main steps are as follows: 1. **Semantic Information Extraction**: Extract semantic information from text data through a deep - learning model (such as DeepSC). 2. **Definition of Measurement Metrics**: Define two new measurement metrics, HSSE and HSR, for evaluating the performance of semantic communication. 3. **Modeling of Optimization Problems**: Model the spectrum - sharing problem as a Markov decision process (MDP) and solve it using the SAC algorithm. 4. **Experimental Verification**: Verify the effectiveness of the SSS algorithm through simulation experiments. The results show that the SSS algorithm is superior to other baseline algorithms in terms of HSSE and SRS. In conclusion, by introducing semantic communication and DRL technologies, this paper proposes an effective spectrum - sharing solution, aiming to improve the communication efficiency and reliability in the IoV environment.