Semantic Communications Based on Adaptive Generative Models and Information Bottleneck

S. Barbarossa,D. Comminiello,E. Grassucci,F. Pezone,S. Sardellitti,P. Di Lorenzo

2023-09-06

Abstract:Semantic communications represent a significant breakthrough with respect to the current communication paradigm, as they focus on recovering the meaning behind the transmitted sequence of symbols, rather than the symbols themselves. In semantic communications, the scope of the destination is not to recover a list of symbols symbolically identical to the transmitted ones, but rather to recover a message that is semantically equivalent to the semantic message emitted by the source. This paradigm shift introduces many degrees of freedom to the encoding and decoding rules that can be exploited to make the design of communication systems much more efficient. In this paper, we present an approach to semantic communication building on three fundamental ideas: 1) represent data over a topological space as a formal way to capture semantics, as expressed through relations; 2) use the information bottleneck principle as a way to identify relevant information and adapt the information bottleneck online, as a function of the wireless channel state, in order to strike an optimal trade-off between transmit power, reconstruction accuracy and delay; 3) exploit probabilistic generative models as a general tool to adapt the transmission rate to the wireless channel state and make possible the regeneration of the transmitted images or run classification tasks at the receiver side.

Signal Processing

What problem does this paper attempt to address?

The paper aims to address the efficiency and sustainability issues of traditional communication systems when facing future 6G networks, particularly the importance of semantic information that is often overlooked during symbol transmission. The authors propose a semantic communication method based on three core ideas:

1. **Knowledge Representation in Topological Space**: Formalizing the capture of semantics by defining relationships between elements, such as graphs in graph theory or other higher-order structures (e.g., simplicial complexes or cell complexes).

2. **Application of the Information Bottleneck Principle**: Using the information bottleneck principle to identify key information relevant to communication goals and dynamically adjusting the information bottleneck to adapt to changes in wireless channel conditions, thereby finding the optimal balance between transmission power, reconstruction accuracy, and latency.

3. **Utilization of Probabilistic Generative Models**: Employing probabilistic generative models as a general tool to adaptively adjust the transmission rate according to the state of the wireless channel, enabling the receiver to regenerate transmitted images or perform classification tasks.

Through these methods, the researchers aim to construct a new type of semantic communication framework that focuses on recovering the meaning behind the transmitted sequences rather than the specific symbols themselves, thereby achieving more efficient data transmission and processing. This framework not only helps improve the efficiency of communication systems but also meets the future network demands for deep integration of artificial intelligence and communication technologies.