A Wireless AI-Generated Content (AIGC) Provisioning Framework Empowered by Semantic Communication

Runze Cheng,Yao Sun,Dusit Niyato,Lan Zhang,Lei Zhang,Muhammad Ali Imran
2024-05-29
Abstract:Generative AI applications have been recently catering to a vast user base by creating diverse and high-quality AI-generated content (AIGC). With the proliferation of mobile devices and rapid growth of mobile traffic, providing ubiquitous access to high-quality AIGC services via wireless communication networks is becoming the future direction. However, it is challenging to provide qualified AIGC services in wireless networks with unstable channels, limited bandwidth resources, and unevenly distributed computational resources. To tackle these challenges, we propose a semantic communication (SemCom)-empowered AIGC (SemAIGC) generation and transmission framework, where only semantic information of the content rather than all the binary bits should be generated and transmitted by using SemCom. Specifically, SemAIGC integrates diffusion models within the semantic encoder and decoder to design a workload-adjustable transceiver thereby allowing adjustment of computational resource utilization in edge and local. In addition, a Resource-aware wOrk lOad Trade-off (ROOT) scheme is devised to intelligently make workload adaptation decisions for the transceiver, thus efficiently generating, transmitting, and fine-tuning content as per dynamic wireless channel conditions and service requirements. Simulations verify the superiority of our proposed SemAIGC framework in terms of latency and content quality compared to conventional approaches.
Networking and Internet Architecture,Artificial Intelligence,Machine Learning,Image and Video Processing
What problem does this paper attempt to address?
### Problems the Paper Attempts to Solve The paper aims to address the challenges faced in providing high-quality AI-generated content (AIGC) services in wireless networks. Specifically, these challenges include: 1. **Unstable Channels**: Channel conditions in wireless networks frequently change, leading to unstable transmissions. 2. **Limited Bandwidth Resources**: The bandwidth resources of wireless networks are limited, making it difficult to support the demand for a large amount of high-quality AIGC services. 3. **Uneven Distribution of Computing Resources**: Computing resources in wireless networks are unevenly distributed, with edge devices and local devices having limited computing capabilities. To tackle these challenges, the authors propose a semantic communication (SemCom)-based AIGC generation and transmission framework (SemAIGC). The main features of this framework include: - **Semantic Information Transmission**: Transmitting only the semantic information of the content instead of all binary bits, thereby reducing bandwidth pressure. - **Diffusion Model Integration**: Integrating diffusion models in the semantic encoder and decoder to design transceivers with adjustable workloads, allowing dynamic adjustment of computing resource utilization based on edge and local computing resources. - **Intelligent Workload Adaptation Scheme (ROOT)**: Proposing a resource-aware workload trade-off scheme that intelligently makes workload adaptation decisions, thereby efficiently generating, transmitting, and fine-tuning content to meet dynamic wireless channel conditions and service requirements. Through these technical means, the framework can effectively improve the latency and quality of content generation under dynamic resource availability, changing channel quality, and diverse service demands.