Abstract:Semantic communication is expected to be one of the cores of next-generation AI-based communications. One of the possibilities offered by semantic communication is the capability to regenerate, at the destination side, images or videos semantically equivalent to the transmitted ones, without necessarily recovering the transmitted sequence of bits. The current solutions still lack the ability to build complex scenes from the received partial information. Clearly, there is an unmet need to balance the effectiveness of generation methods and the complexity of the transmitted information, possibly taking into account the goal of communication. In this paper, we aim to bridge this gap by proposing a novel generative diffusion-guided framework for semantic communication that leverages the strong abilities of diffusion models in synthesizing multimedia content while preserving semantic features. We reduce bandwidth usage by sending highly-compressed semantic information only. Then, the diffusion model learns to synthesize semantic-consistent scenes through spatially-adaptive normalizations from such denoised semantic information. We prove, through an in-depth assessment of multiple scenarios, that our method outperforms existing solutions in generating high-quality images with preserved semantic information even in cases where the received content is significantly degraded. More specifically, our results show that objects, locations, and depths are still recognizable even in the presence of extremely noisy conditions of the communication channel. The code is available at <a class="link-external link-https" href="https://github.com/ispamm/GESCO" rel="external noopener nofollow">this https URL</a>.

Adaptive Semantic Image Transmission Using Generative Foundation Model

Semantic Satellite Communications Based on Generative Foundation Model

Position-Aided Semantic Communication for Efficient Image Transmission: Design, Implementation, and Experimental Results

Generative Semantic Communications with Foundation Models: Perception-Error Analysis and Semantic-Aware Power Allocation

Deep Conditional Generative Semantic Communication for Image Transmission

Language-oriented Semantic Communication for Image Transmission with Fine-Tuned Diffusion Model

Robust Semantic Transmission of Images with Generative Adversarial Networks

Generative Model Based Highly Efficient Semantic Communication Approach for Image Transmission

Semantic-Aware Power Allocation for Generative Semantic Communications with Foundation Models

Image Generation with Multimodule Semantic Feature-Aided Selection for Semantic Communications

Rate-Adaptive Generative Semantic Communication Using Conditional Diffusion Models

Semantic Communications with Explicit Semantic Base for Image Transmission

Segment Anything Meets Semantic Communication

Deep Learning-Based Image Semantic Communication System

Semantic Communications Based on Adaptive Generative Models and Information Bottleneck

Adaptive Wireless Image Semantic Transmission: Design, Simulation, and Prototype Validation

Generative Semantic Communication: Diffusion Models Beyond Bit Recovery

Semantic Feature Decomposition based Semantic Communication System of Images with Large-scale Visual Generation Models

Semantic Successive Refinement: A Generative AI-aided Semantic Communication Framework

Semantic Communication Approach for Multi-Task Image Transmission

Toward Semantic Communications: Deep Learning-Based Image Semantic Coding