Online AI-Generated Content Request Scheduling with Deep Reinforcement Learning

Chenglong Feng,Ying Zheng,Yuedong Xu
DOI: https://doi.org/10.1109/infocomwkshps61880.2024.10620786
2024-01-01
Abstract:Artificial Intelligence-Generated Content (AIGC) represents a technique that AI automatically generates various forms of content that meet the personalized requirements of humans. To offer an easy access to AIGC techniques, an edge computing system is introduced with heterogeneous computing capability to process users' text-to-image AIGC requests. For text-to-image AIGC tasks, inference steps configuration of diffusion models has a great impact on inference time and quality of generated results. Thus, it is necessary to design an online scheduling scheme to dispatch users' AIGC requests to suitable servers and tune proper inference steps for AIGC requests in order to achieve better quality of service. Based on this motivation, we define a novel online text-to-image AIGC request scheduling problem under a heterogeneous edge computing scenario with the objective of striking a balance between tardiness of AIGC requests and quality of generated results. We formulate it into an integer programming problem. Then we transform this problem into a Markov Decision Process (MDP) model and adopt a deep reinforcement learning-based algorithm to solve this online problem. Simulation results show that our approach performs better and has a strong generalization ability, compared with the baseline random policy and greedy policy.
What problem does this paper attempt to address?