Abstract:Semantic communication is a newly emerged communication paradigm that exploits deep learning (DL) models to realize communication processes like source coding and channel coding. Recent advances have demonstrated that DL-based joint source-channel coding (DeepJSCC) can achieve exciting data compression and noise-resiliency performances for wireless image transmission tasks, especially in environments with low channel signal-to-noises (SNRs). However, existing DeepJSCC-based semantic communication frameworks still cannot achieve adaptive code rates for different channel SNRs and image contents, which reduces its flexibility and bandwidth efficiency. In this paper, we propose a predictive and adaptive deep coding (PADC) framework for realizing flexible code rate optimization with a given target transmission quality requirement. PADC is realized by a variable code length enabled DeepJSCC (DeepJSCC-V) model for realizing flexible code length adjustment, an Oracle Network (OraNet) model for predicting peak-signal-to-noise (PSNR) value for an image transmission task according to its contents, channel signal to noise ratio (SNR) and the compression ratio (CR) value, and a CR optimizer aims at finding the minimal data-level or instance-level CR with a PSNR quality constraint. By using the above three modules, PADC can transmit the image data with minimal CR, which greatly increases bandwidth efficiency. Simulation results demonstrate that the proposed DeepJSCC-V model can achieve similar PSNR performances compared with the state-of-the-art Attention-based DeepJSCC (ADJSCC) model, and the proposed OraNet model is able to predict high-quality PSNR values with an average error lower than 0.5dB. Results also demonstrate that the proposed PADC can use nearly minimal bandwidth consumption for wireless image transmission tasks with different channel SNR and image contents, at the same time guaranteeing the PSNR constraint for each image data.

Deep Learning-Based Image Semantic Coding for Semantic Communications

Towards Semantic Communications: Deep Learning-Based Image Semantic Coding

Toward Semantic Communications: Deep Learning-Based Image Semantic Coding

A GAN-based Tunable Image Compression System

Towards Semantically Scalable Image Coding Using Semantic Map.

A novel image semantic communication method via dynamic decision generation network and generative adversarial network

Deep Learning-Based Image Semantic Communication System

A Deep Image Coding Scheme With Generative Network to Learn From Correlated Images

Semantic-Aware Visual Decomposition for Image Coding

Semantic Perceptual Image Compression with a Laplacian Pyramid of Convolutional Networks

Robust Semantic Transmission of Images with Generative Adversarial Networks

Perceptual Learned Source-Channel Coding for High-Fidelity Image Semantic Transmission

Linear Progressive Coding for Semantic Communication using Deep Neural Networks

Deep Conditional Generative Semantic Communication for Image Transmission

Semantic-empowered visible light communication for image transmission based on deep convolutional generative adversarial network

Layered Conceptual Image Compression Via Deep Semantic Synthesis.

Predictive and Adaptive Deep Coding for Wireless Image Transmission in Semantic Communication

Generative Model Based Highly Efficient Semantic Communication Approach for Image Transmission

Rate-Adaptive Generative Semantic Communication Using Conditional Diffusion Models

Deep Image Semantic Communication Model for Artificial Intelligent Internet of Things

Nonlinear Transform Source-Channel Coding for Semantic Communications