Generative-AI for AI/ML Model Adaptive Retraining in Beyond 5G Networks

Venkateswarlu Gudepu,Bhargav Chirumamilla,Venkatarami Reddy Chintapalli,Piero Castoldi,Luca Valcarenghi,Bheemarjuna Reddy Tamma,Koteswararao Kondepu
2024-08-27
Abstract:Beyond fifth-generation (B5G) networks aim to support high data rates, low-latency applications, and massive machine communications. Artificial Intelligence/Machine Learning (AI/ML) can help to improve B5G network performance and efficiency. However, dynamic service demands of B5G use cases cause AI/ML model performance degradation, resulting in Service Level Agreements (SLA) violations, over- or under-provisioning of resources, etc. Retraining is essential to address the performance degradation of the AI/ML models. Existing threshold and periodic retraining approaches have potential disadvantages, such as SLA violations and inefficient resource utilization for setting a threshold parameter in a dynamic environment. This paper proposes a novel approach that predicts when to retrain AI/ML models using Generative Artificial Intelligence. The proposed predictive approach is evaluated for a Quality of Service Prediction use case on the Open Radio Access Network (O-RAN) Software Community platform and compared to the predictive approach based on the classifier and a threshold approach. Also, a realtime dataset from the Colosseum testbed is considered to evaluate Network Slicing (NS) use case with the proposed predictive approach. The results show that the proposed predictive approach outperforms both the classifier-based predictive and threshold approaches.
Networking and Internet Architecture,Signal Processing
What problem does this paper attempt to address?
### What problem does this paper attempt to solve? This paper aims to solve the problem of performance degradation of artificial intelligence/machine learning (AI/ML) models in the fifth - generation mobile communication (5G) and beyond (Beyond 5G, B5G) networks. Specifically: 1. **Performance degradation caused by dynamic service requirements**: The dynamic service requirements in B5G networks can lead to a decline in the performance of AI/ML models, resulting in issues such as service - level agreement (SLA) violations, over - or under - allocation of resources. 2. **Limitations of existing retraining methods**: - **Threshold retraining method**: Trigger retraining by setting thresholds for performance indicators (such as accuracy, precision, recall, etc.). However, in a dynamic environment, it is difficult to set appropriate thresholds using this method, which may lead to frequent retraining or poor performance. - **Periodic retraining method**: Retrain the model regularly regardless of changes in user traffic or model performance. This may lead to waste of resources or failure to respond to performance changes in a timely manner. - **Classifier - based prediction method**: Use an unsupervised classifier (such as local outlier factor LOF) to predict when retraining is required. However, this method is not effective in dealing with non - continuous changes or high - variance user traffic. 3. **The proposed new method**: To overcome the limitations of the above methods, the paper proposes a new method based on generative artificial intelligence (Generative AI, Gen - AI), using variational auto - encoder (VAE) and generative adversarial network (GAN) to predict when AI/ML models need to be retrained. By generating synthetic data similar to the observed data and using the Kolmogorov - Smirnov (KS) test to detect changes in user traffic, it is determined whether the model needs to be retrained. ### Main contributions - **Proposed a new Gen - AI - based prediction method**: Use VAE and GAN to generate synthetic data close to the observed data, and use the KS test to predict when AI/ML models need to be retrained. - **Evaluated the effectiveness of the new method**: Evaluated on the QoS prediction use case on the O - RAN software community platform and the real - time data set of the Colosseum testbed, and compared with the classifier - based prediction method and the threshold method. - **Discussed the challenges and complexity of applying Gen - AI in B5G networks**: Including applications in generating synthetic data, resource optimization, network planning, and QoS management. Through these improvements, the paper aims to improve the performance stability of AI/ML models in B5G networks, reduce SLA violations, and optimize resource utilization.