Semantic Information Theory: Recent Advances and Future Challenges

Gangtao Xin,Pingyi Fan,Khaled B. Letaief
DOI: https://doi.org/10.20944/preprints202310.1208.v1
2023-01-01
Abstract:In recent years, semantic communication has received significant attention from both academia and industry, driven by the growing demands for ultra-low latency and high-throughput capabilities in emerging intelligent services. Nonetheless, a comprehensive and effective theoretical framework for semantic communication has yet to be established. In particular, finding the fundamental limits of semantic communication, exploring the capabilities of semantic-aware networks, or utilizing theoretical guidance for deep learning in semantic communication are very important but yet still unresolved issues. In this paper, we delve into the pertinent advancements in semantic information theory. Grounded in the foundational work of Claude Shannon, we present the latest developments in semantic entropy, semantic rate distortion, and semantic channel capacity. Additionally, we will analyze some open problems in semantic information measurement and semantic coding, providing a theoretical basis for the design of a semantic communication system. Furthermore, we carefully review several mathematical theories and tools and evaluate their applicability in the context of semantic communication. Finally, we shed light on the challenges encountered in both semantic communication and semantic information theory.
What problem does this paper attempt to address?