Multiple Gradient Descent-based Reinforcement Learning for Multi-Task Semantic Broadcast Communication

Zhilin Lu,Rongpeng Li,Zhifeng Zhao,Jianhua Liu,Ming Lei,Honggang Zhang
DOI: https://doi.org/10.1145/3641512.3690163
2024-01-01
Abstract:Semantic broadcast communications (SemanticBC) for image and text transmission have achieved significant performance gains for single tasks. Nevertheless, extending these methods to a multi-task scenario presents challenges, as different tasks often require distinct objective functions, and the shared encoder must handle potential conflicts effectively. In this paper, we propose a tri-level multiple gradient descent algorithm (MGDA) based reinforcement learning (RL) approach MagicRL for multi-task SemanticBC to effectively balance the multi-task learning conflicts and serve multiple different tasks simultaneously at the receiver sides, including classification and content-reconstruction tasks. In particular, we provide optimized decoders with given encoder parameters by a self-critical RL approach. Subsequently, MGDA-based weight assignment is applied to balance multiple decoders and a first-order Frank-Wolfe algorithm efficiently solves the underlying quadratic programming problem. On this basis, the encoder gets improved through a proper weighted summation of multi-task objective functions. Extensive simulation results have been conducted to verify the effectiveness, especially under low signal-to-noise ratio.
What problem does this paper attempt to address?