Adaptive Bitrate Video Semantic Communication over Wireless Networks

Wentao Gong,Haonan Tong,Sihua Wang,Zhaohui Yang,Xinxin He,Changchuan Yin

2023-08-01

Abstract:This paper investigates the adaptive bitrate (ABR) video semantic communication over wireless networks. In the considered model, video sensing devices must transmit video semantic information to an edge server, to facilitate ubiquitous video sensing services such as road environment monitoring at the edge server in autonomous driving scenario. However, due to the varying wireless network conditions, it is challenging to guarantee both low transmission delay and high semantic accuracy at the same time if devices continuously transmit a fixed bitrate video semantic information. To address this challenge, we develop an adaptive bitrate video semantic communication (ABRVSC) system, in which devices adaptively adjust the bitrate of video semantic information according to network conditions. Specifically, we first define the quality of experience (QoE) for video semantic communication. Subsequently, a swin transformer-based semantic codec is proposed to extract semantic information with considering the influence of QoE. Then, we propose an Actor-Critic based ABR algorithm for the semantic codec to enhance the robustness of the proposed ABRVSC scheme against network variations. Simulation results demonstrate that at low bitrates, the mean intersection over union (MIoU) of the proposed ABRVSC scheme is nearly twice that of the traditional scheme. Moreover, the proposed ABRVSC scheme, which increases the QoE in video semantic communication by 36.57%, exhibits more robustness against network variations compared to both the fixed bitrate schemes and traditional ABR schemes.

Networking and Internet Architecture

What problem does this paper attempt to address?

The paper attempts to address the issue of achieving high semantic accuracy while ensuring low transmission latency during video semantic communication under dynamic wireless network conditions. Specifically, due to the variability of wireless network conditions, it is challenging to ensure both low latency and high accuracy if the device continuously transmits video semantic information at a fixed bit rate. To this end, the authors propose an Adaptive Bit Rate Video Semantic Communication (ABRVSC) system, where the device can dynamically adjust the bit rate of video semantic information based on network conditions.

The main contributions are as follows:
1. Developed the ABRVSC system, enabling devices to adaptively adjust the bit rate of video semantic information according to network conditions.
2. Defined the Quality of Experience (QoE) for video semantic communication and proposed a QoE maximization problem to improve semantic accuracy and meet latency requirements.
3. Proposed a semantic codec based on Swin Transformer to extract semantic information and introduced an ABR algorithm based on the Actor-Critic algorithm to select the appropriate bit rate, ensuring low latency and high accuracy.
4. Simulation results show that at low bit rates, the proposed ABRVSC scheme's average Intersection over Union (MIoU) is almost twice that of traditional schemes. Additionally, compared to fixed bit rate schemes and traditional ABR schemes, this scheme improves QoE in video semantic communication and demonstrates stronger robustness to network changes.