Semantic Redundancy-Aware Multi-View Edge Inference Based on Rate-Distortion in IoT Systems

Zhe Liu,Caili Guo,Meiyi Zhu
DOI: https://doi.org/10.1109/wcnc57260.2024.10571204
2024-01-01
Abstract:As the Internet of Things (IoT) continues to evolve, it is feasible to deploy multiple edge devices to capture objects from various angles, yielding comprehensive multi-view data which provides sufficient information for edge inference. This escalation in data volume, however, presents formidable challenges to communication systems with constrained communication resources. To tackle this issue, existing work designed a Multi-View Convolutional Neural Network (MVCNN) to extract low-dimensional features with high information, thus improving the spectral efficiency. However, in spite of its endeavor to identify and extract feature information within views, it ignores the redundancy present in multi-view data, especially the possibility that the views themselves are redundancy. Taking advantage of advancements in semantic communication, this paper proposes a semantic redundancy-aware multi-view joint edge inference network based on rate-distortion designed for IoT systems, named Compression Multi-View Convolutional Neural Network (CMVCNN), addressing the challenge that MVCNN faces in identifying redundant views and reducing channel bandwidth. Specifically, a compression network is meticulously designed to identify and remove the semantic redundancy in multi-view data, while a optimization algorithm is designed based on rate-distortion theory to guide semantic compression. Simulation results validate the effectiveness of the proposed CMVCNN scheme.
What problem does this paper attempt to address?