Multi-Task Learning as enabler for General-Purpose AI-native RAN

Hasan Farooq,Julien Forgeat,Shruti Bothe,Kristijonas Cyras,Md Moin

2024-04-06

Abstract:The realization of data-driven AI-native architecture envisioned for 6G and beyond networks can eventually lead to multiple machine learning (ML) workloads distributed at the network edges driving downstream tasks like secondary carrier prediction, positioning, channel prediction etc. The independent life-cycle management of these edge-distributed independent multiple workloads sharing a resource-constrained compute node e.g., base station (BS) is a challenge that will scale with denser deployments. This study explores the effectiveness of multi-task learning (MTL) approaches in facilitating a general-purpose AI native Radio Access Network (RAN). The investigation focuses on four RAN tasks: (i) secondary carrier prediction, (ii) user location prediction, (iii) indoor link classification, and (iv) line-of-sight link classification. We validate the performance using realistic simulations considering multi-faceted design aspects of MTL including model architecture, loss and gradient balancing strategies, distributed learning topology, data sparsity and task groupings. The quantification and insights from simulations reveal that for the four RAN tasks considered (i) adoption of customized gate control-based expert architecture with uncertainty-based weighting makes MTL perform either best among all or at par with single task learning (STL) (ii) LoS classification task in MTL setting helps other tasks but its own performance is degraded (iii) for sparse training data, training a single global MTL model is helpful but MTL performance is on par with STL (iv) optimal set of group pairing exists for each task and (v) partial federation is much better than full model federation in MTL setting.

Networking and Internet Architecture,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenges brought by independently managing the lifecycles of multiple edge - distributed machine - learning workloads on resource - constrained computing nodes (such as base stations). Specifically, the paper explores the effectiveness of multi - task learning (MTL) methods in promoting a universal AI - native radio access network (RAN). The research focuses on four RAN tasks: (i) auxiliary carrier prediction, (ii) user location prediction, (iii) indoor link classification, and (iv) line - of - sight link classification. The paper verifies the performance through practical simulations, considering multiple aspects of MTL design, including model architecture, loss and gradient balancing strategies, distributed learning topologies, data sparsity and task grouping. The goal is to reduce RAN complexity and operating expenses while improving the performance of multiple RAN - related tasks.

The main research questions in the paper include:
1. How does the design space of state - of - the - art MTL methods (such as model architecture and weighting strategies) affect the overall performance of RAN - related tasks?
2. In different scenarios, among the three distributed learning topology modes - local model, global model or partial federated model, which one is the most suitable as an implementation method for MTL?
3. How does the sparsity of training data and the grouping of different RAN tasks affect the performance of MTL?