A New Residual-Based Image Semantic Transmission System

Youfang Wang,Jun Yan,Yongyi Miao,Zhongdang Li,Die Hu
DOI: https://doi.org/10.1109/cisce62493.2024.10653199
2024-01-01
Abstract:This paper investigates a residual-based image semantic transmission system, which achieves high compression ratio image transmission by transmitting semantic map and residual map. In order to further improve the semantic transmission performance of the system under a given compression ratio, this paper proposes to add a new residual processing module to the system. This module includes two sub-modules: Semantic-based Patch Se-lection and Selective Zeroing. By applying different treatments to residuals of different categories, the proposed method effectively reduces the impact of residuals of low-proportion categories on the final performance. Simulation experiments demonstrate that compared with existing methods, the proposed method achieves better performance in terms of MIoU (Mean Intersection over Union) and FID (Fréchet Inception Distance).
What problem does this paper attempt to address?