Communication-Efficient Framework for Distributed Image Semantic Wireless Transmission

Bingyan Xie,Yongpeng Wu,Yuxuan Shi,Derrick Wing Kwan Ng,Wenjun Zhang

2023-08-08

Abstract:Multi-node communication, which refers to the interaction among multiple devices, has attracted lots of attention in many Internet-of-Things (IoT) scenarios. However, its huge amounts of data flows and inflexibility for task extension have triggered the urgent requirement of communication-efficient distributed data transmission frameworks. In this paper, inspired by the great superiorities on bandwidth reduction and task adaptation of semantic communications, we propose a federated learning-based semantic communication (FLSC) framework for multi-task distributed image transmission with IoT devices. Federated learning enables the design of independent semantic communication link of each user while further improves the semantic extraction and task performance through global aggregation. Each link in FLSC is composed of a hierarchical vision transformer (HVT)-based extractor and a task-adaptive translator for coarse-to-fine semantic extraction and meaning translation according to specific tasks. In order to extend the FLSC into more realistic conditions, we design a channel state information-based multiple-input multiple-output transmission module to combat channel fading and noise. Simulation results show that the coarse semantic information can deal with a range of image-level tasks. Moreover, especially in low signal-to-noise ratio and channel bandwidth ratio regimes, FLSC evidently outperforms the traditional scheme, e.g. about 10 peak signal-to-noise ratio gain in the 3 dB channel condition.

Machine Learning,Information Theory,Image and Video Processing

What problem does this paper attempt to address?

### Problems Addressed by the Paper

The paper primarily focuses on efficient distributed image semantic wireless transmission between Internet of Things (IoT) devices. Specifically, it proposes a Federated Learning-based Semantic Communication framework (FLSC) to address issues such as large data volumes and poor task scalability in multi-node communication.

#### Main Issues:
1. **Huge Data Flow**: In multi-node communication, the large data flow makes it difficult for traditional methods to meet the requirements of efficient transmission.
2. **Poor Task Scalability**: Existing methods are not flexible enough when dealing with changes in downstream tasks.
3. **Isolated Data Transmission**: Current distributed transmission methods treat each user's transmission as an isolated process, failing to fully utilize the correlation between users.
4. **Lack of Robustness under Real Channel Conditions**: Existing methods mainly consider additive Gaussian noise or stable channel fading, which cannot adapt to the actual changing wireless channel environment.

#### Solutions:
The paper proposes a Federated Learning-based Semantic Communication framework (FLSC), combining the advantages of federated learning and semantic communication to achieve efficient distributed image transmission. Specifically, it includes the following aspects:

1. **Hierarchical Vision Transformer (HVT)**: Used to extract semantic information at different levels and adapt to various downstream tasks.
2. **Task-Adaptive Translator**: Interprets and translates semantic information according to the specific needs of different tasks.
3. **Robust Transmission under MIMO Channels**: By introducing a MIMO transmission module based on Channel State Information (CSI), it improves robustness under actual changing channel conditions.

Through the above methods, FLSC significantly outperforms traditional schemes under low Signal-to-Noise Ratio (SNR) conditions, achieving approximately 10 dB peak SNR gain under 3 dB channel conditions. Additionally, FLSC demonstrates superior performance under limited bandwidth resources.