16th European Congress on Obesity (ECO), Geneva, Switzerland, 14–17 May 2008

T. Wijnhoven,S. TommyL.,Visscher,C. Doak,J. Seidell

DOI: https://doi.org/10.1038/ijo.2008.140

International Journal of Obesity

Abstract:

What problem does this paper attempt to address?

Synergies Between Federated Learning and O-RAN: Towards an Elastic Architecture for Multiple Distributed Machine Learning Services

Payam Abdisarabshali,Nicholas Accurso,Filippo Malandra,Weifeng Su,Seyyedali Hosseinalipour

2024-12-03

Abstract:Federated learning (FL) is a popular distributed machine learning (ML) technique. However, implementation of FL over 5G-and-beyond wireless networks faces key challenges caused by (i) dynamics of the wireless network conditions and (ii) the coexistence of multiple FL-services in the system, which are not jointly considered in prior works. We first take a closer look into these challenges and unveil nuanced phenomena called over-/under-provisioning of resources and perspective-driven load balancing. We then take the first steps towards addressing these phenomena by proposing a novel distributed ML architecture called elastic FL (EFL). EFL unleashes the full potential of Open RAN (O-RAN) systems and introduces an elastic resource provisioning methodology to execute FL-services. It further constitutes a multi-time-scale FL management system that introduces three dedicated network control functionalities tailored for FL-services, including (i) non-real-time (non-RT) system descriptor, which trains ML-based applications to predicted both system and FL-related dynamics and parameters; (ii) near-RT FL controller, which handles O-RAN slicing and mobility management for the seamless execution of FL-services; (iii) FL MAC scheduler, which conducts real-time resource allocation to the end clients of various FL-services. We finally prototype EFL to demonstrate its potential in improving the performance of FL-services.

Networking and Internet Architecture,Artificial Intelligence,Machine Learning
Deep Reinforcement Learning for Multi-Functional RIS-Aided Over-the-Air Federated Learning in Internet of Robotic Things

Xinran Zhang,Hui Tian,Wanli Ni,Zhaohui Yang

DOI: https://doi.org/10.1109/icc51166.2024.10622931

2024-01-01

Abstract:To facilitate edge intelligence in Internet of Robotic Things (IoRT), over-the-air federated learning (AirFL) is a communication-efficient enabler by virtue of its high spectrum efficiency and low transmission latency. Supported by multi-functional reconfigurable intelligent surface (MF-RIS), the model aggregation process of AirFL can be facilitated thanks to full-space signal amplification. However, the learning performance of AirFL may be degraded by the uncertainty of wireless channels originated from inaccurate channel estimation and robot mobility. In this paper, we investigate the model aggregation problem of MF-RIS-aided AirFL in a dynamic IoRT system with imperfect channel state information (CSI). We aim to minimize the long-term mean square error (MSE) of AirFL model aggregation by jointly optimizing MF-RIS coefficients and transceiver beamforming. To enable online decision-making in the dynamic system, we propose a novel deep reinforcement learning (DRL)-based double-agent algorithm, where one agent first decides operating modes of MF-RIS elements, and then the other agent devises transceiver beamforming and other MF-RIS coefficients referring to the mode switching strategy. Numerical results unveil the effectiveness and robustness of the proposed DRL-based algorithm in suppressing long-term MSE under hostile CSI.
Federated Learning with Unsourced Random Access.

Yuqing Tian,Jingze Che,Zhaoyang Zhang,Zhaohui Yang

DOI: https://doi.org/10.1109/vtc2023-spring57618.2023.10201005

2023-01-01

Abstract:A large number of new applications are emerging in the future sixth-generation (6G) communication systems. Federated learning (FL) enables massive user equipments (UEs), such as mobile phones and Internet of Things (IoT) devices, to cooperatively learn a shared model for prediction in various applications, while keeping the training data local. However, in practical scenarios, there are still some problems in deploying FL systems, including serving a large number of active UEs, longtime delay, and the risk of UEs’ privacy leakage. To tackle these issues, we introduce unsourced random access (URA) into the FL systems. URA can support massive connectivity and its unsourced property can protect the UEs’ identity privacy. Moreover, considering the trade-off between communication and computation performance and the various importance of different UEs’ local models in training epochs, two importance metrics are designed. The UEs can decide their own active probability according to the metrics among the communication rounds, which avoids the additional cost of being scheduled by the base station (BS) and maximums the use of the limited communication resources to ensure UEs with higher priority can upload trained models, thus improving the training efficiency. Simulation results verify the remarkable communication and computation performance of the proposed schemes.
On the Specialization of FDRL Agents for Scalable and Distributed 6G RAN Slicing Orchestration

Farhad Rezazadeh,Lanfranco Zanzi,Francesco Devoti,Hatim Chergui,Xavier Costa-Perez,Christos Verikoukis

DOI: https://doi.org/10.48550/arXiv.2211.03088

2022-11-06

Abstract:Network slicing enables multiple virtual networks to be instantiated and customized to meet heterogeneous use case requirements over 5G and beyond network deployments. However, most of the solutions available today face scalability issues when considering many slices, due to centralized controllers requiring a holistic view of the resource availability and consumption over different networking domains. In order to tackle this challenge, we design a hierarchical architecture to manage network slices resources in a federated manner. Driven by the rapid evolution of deep reinforcement learning (DRL) schemes and the Open RAN (O-RAN) paradigm, we propose a set of traffic-aware local decision agents (DAs) dynamically placed in the radio access network (RAN). These federated decision entities tailor their resource allocation policy according to the long-term dynamics of the underlying traffic, defining specialized clusters that enable faster training and communication overhead reduction. Indeed, aided by a traffic-aware agent selection algorithm, our proposed Federated DRL approach provides higher resource efficiency than benchmark solutions by quickly reacting to end-user mobility patterns and reducing costly interactions with centralized controllers.

Networking and Internet Architecture
Federated Learning in Multi-RIS-Aided Systems

Wanli Ni,Yuanwei Liu,Zhaohui Yang,Hui Tian,Xuemin Shen

DOI: https://doi.org/10.1109/jiot.2021.3130444

IF: 10.6

2022-01-01

IEEE Internet of Things Journal

Abstract:The fundamental communication paradigms in the next-generation mobile networks are shifting from connected things to connected intelligence. The potential result is that current communication-centric wireless systems are greatly stressed when supporting computation-centric intelligent services with distributed big data. This is one reason that makes federated learning come into being, it allows collaborative training over many edge devices while avoiding the transmission of raw data. To tackle the problem of model aggregation in federated learning systems, this article resorts to multiple reconfigurable intelligent surfaces (RISs) to achieve efficient and reliable learning-oriented wireless connectivity. The seamless integration of communication and computation is actualized by over-the-air computation (AirComp), which can be deemed as one of the uplink nonorthogonal multiple access (NOMA) techniques without individual information decoding. Since all local parameters are uploaded via noisy concurrent transmissions, the unfavorable propagation error inevitably deteriorates the accuracy of the aggregated global model. The goals of this work are to 1) alleviate the signal distortion of AirComp over shared wireless channels and 2) speed up the convergence rate of federated learning. More specifically, both the mean-square error (MSE) and the device set in the model uploading process are optimized by jointly designing transceivers, tuning reflection coefficients, and selecting clients. Compared to baselines, extensive simulation results show that 1) the proposed algorithms can aggregate model more accurately and accelerate convergence and 2) the training loss and inference accuracy of federated learning can be improved significantly with the aid of multiple RISs.
Federated Machine Reasoning for Resource Provisioning in 6G O-RAN

Swastika Roy,Hatim Chergui,Adlen Ksentini,Christos Verikoukis

2024-06-10

Abstract:O-RAN specifications reshape RANs with function disaggregation and open interfaces, driven by RAN Intelligent Controllers. This enables data-driven management through AI/ML but poses trust challenges due to human operators' limited understanding of AI/ML decision-making. Balancing resource provisioning and avoiding overprovisioning and underprovisioning is critical, especially among the multiple virtualized base station(vBS) instances. Thus, we propose a novel Federated Machine Reasoning (FLMR) framework, a neurosymbolic method for federated reasoning, learning, and querying. FLMR optimizes CPU demand prediction based on contextual information and vBS configuration using local monitoring data from virtual base stations (vBS) on a shared O-Cloud platform.This optimization is critical, as insufficient computing resources can result in synchronization loss and significantly reduce network throughput. In the telecom domain, particularly in the virtual Radio Access Network (vRAN) sector, predicting and managing the CPU load of vBSs poses a significant challenge for network operators. Our proposed FLMR framework ensures transparency and human understanding in AI/ML decisions and addresses the evolving demands of the 6G O-RAN landscape, where reliability and performance are paramount. Furthermore, we performed a comparative analysis using \textit{DeepCog} as the baseline method. The outcomes highlight how our proposed approach outperforms the baseline and strikes a better balance between resource overprovisioning and underprovisioning. Our method notably lowers both provisioning relative to the baseline by a factor of 6.

Information Theory,Networking and Internet Architecture
Efficient Ring-topology Decentralized Federated Learning with Deep Generative Models for Industrial Artificial Intelligent

Zhao Wang,Yifan Hu,Jun Xiao,Chao Wu

DOI: https://doi.org/10.48550/arxiv.2104.08100

2021-01-01

Abstract:By leveraging deep learning based technologies, the data-driven based approaches have reached great success with the rapid increase of data generated of Industrial Indernet of Things(IIot). However, security and privacy concerns are obstacles for data providers in many sensitive data-driven industrial scenarios, such as healthcare and auto-driving. Many Federated Learning(FL) approaches have been proposed with DNNs for IIoT applications, these works still suffer from low usability of data due to data incompleteness, low quality, insufficient quantity, sensitivity, etc. Therefore, we propose a ring-topogy based decentralized federated learning(RDFL) scheme for Deep Generative Models(DGMs), where DGMs is a promising solution for solving the aforementioned data usability issues. Compare with existing IIoT FL works, our RDFL schemes provides communication efficiency and maintain training performance to boost DGMs in target IIoT tasks. A novel ring FL topology as well as a map-reduce based synchronizing method are designed in the proposed RDFL to improve decentralized FL performance and bandwidth utilization. In addition, InterPlanetary File System(IPFS) is introduced to further improve communication efficiency and FL security. Extensive experiments have been taken to demonstate the superiority of RDFL with either independent and identically distributed(IID) datasets or non-independent and identically distributed(Non-IID) datasets.
Intelligent O-RAN Beyond 5G: Architecture, Use Cases, Challenges, and Opportunities

Simona Marinova,Alberto Leon-Garcia

DOI: https://doi.org/10.1109/access.2024.3367289

IF: 3.9

2024-02-28

IEEE Access

Abstract:Open RAN (Radio Access Network) is revolutionizing the telecom space by introducing a framework based on the concepts of virtualization and openness. O-RAN fosters virtualized and disaggregated RAN components connected via open interfaces based on specifications by the O-RAN Alliance. The network is optimized using RAN intelligent controllers (RICs), which can take data-driven, closed-loop actions in a RAN built in a multi-vendor, interoperable environment. The goal of this paper is to provide insights and guidance about the paradigm shift brought by O-RAN in order to create open, softwarized, intelligent and optimized networks. We focus on the intelligence aspects by providing an in-depth view of the near-RT and non-RT RICs specified by the O-RAN Alliance, including the architecture and interfaces. A novel aspect of this paper is that we provide guidelines in terms of the artificial intelligence and machine learning (AI/ML) approaches and frameworks that are useful in the O-RAN context, and consider the applications (xApps and rApps) that can be created to programmatically and autonomously control and optimize the network through the RICs for V2X, Industry 5.0, and other very demanding service types. Additionally, we provide the E2E network slice orchestration architecture, and demonstrate the suitability of O-RAN for the requirements of the service types to be achieved. Finally, we discuss research challenges and opportunities and overview existing experimental research platforms that are used to innovate and drive advances in the O-RAN effort.

computer science, information systems,telecommunications,engineering, electrical & electronic
Federated Deep Reinforcement Learning for Efficient Jamming Attack Mitigation in O-RAN

Zakaria Abou El Houda,Hajar Moudoud,Bouziane Brik

DOI: https://doi.org/10.1109/tvt.2024.3359998

IF: 6.8

2024-01-01

IEEE Transactions on Vehicular Technology

Abstract:Open RAN (ORAN or O-RAN) revolutionizes Radio Access Networks (RAN) by offering flexibility and cost-efficiency through inter-vendor equipment interoperability. More importantly, it addresses emerging security threats, such as jamming attacks, by incorporating network softwarization and leveraging Artificial Intelligence (AI) techniques. However, AI-based systems face challenges such as limited training data, slow convergence, and vulnerability to dynamic attack patterns like Zero-day attacks. To enhance jamming attack mitigation in O-RAN, Multi-Agent Reinforcement Learning (MARL) has been introduced for improved flexibility and robustness. However, MARL requires data sharing, which consumes network bandwidth and slows down training, and the curse of dimensionality limits its benefits due to the exponential growth of the state-action space. To overcome these limitations, we provide a novel framework that combines federated learning (FL) and deep reinforcement learning (DRL) for efficient jamming attack detection in O-RAN. FL allows decentralized agents to train local models using their data sources, and the models are aggregated into a global model at a Non-real-time RAN Intelligent Controller (RIC) to guide decision-making. The federated learning process enables distributed intelligence, while deep reinforcement learning ensures adaptive and robust jamming attack detection. Our proposed framework improves security, privacy, and resilience in ORAN through collaborative FL and adaptive DRL. Extensive simulations demonstrate its superiority in detection accuracy, resource efficiency, and scalability.

telecommunications,engineering, electrical & electronic,transportation science & technology
Mobility aware and energy-efficient federated deep reinforcement learning assisted resource allocation for 5G-RAN slicing

Yaser Azimi,Saleh Yousefi,Hashem Kalbkhani,Thomas Kunz

DOI: https://doi.org/10.1016/j.comcom.2024.01.028

IF: 5.047

2024-01-31

Computer Communications

Abstract:Network slicing is one of the foundations for the realization of 5G and beyond. However, due to the mobility of the users and the network dynamics, flexible and efficient radio access network (RAN) resource slicing is still a challenge. In this paper, we allocate the power and radio block (RB) resources in a multi-RAN scenario to the users of both rate-based and resource-based slices. We propose a mobility-aware and energy-efficient federated deep reinforcement learning-assisted resource allocation (ME-FDRL-RA) method for RAN slicing in a large multiple RAN environment. ME-FDRL-RA includes both federated deep reinforcement learning (FDRL) and deep learning (DL) models as follows: Stacked and bidirectional long-short-term-memory (SBiLSTM), allocate resources to slices on a large time-scale. Additionally, federated advantage actor-critic (F-A2C) allocates resources on a small time-scale and speeds up convergence. Moreover, to solve the optimization problem of determining the required resources for the users of slices, we propose an efficient iterative algorithm called the interference-aware and energy-efficient power allocation (IA-EPA) method. According to simulation results, ME-FDRL-RA outperforms competitive methods in terms of convergence speed, computational complexity, energy efficiency, and the number of accepted users while addressing the challenges of user mobility and maintaining a desirable degree of inter-slice isolation.

computer science, information systems,telecommunications,engineering, electrical & electronic
Safe and Accelerated Deep Reinforcement Learning-based O-RAN Slicing: A Hybrid Transfer Learning Approach

Ahmad M. Nagib,Hatem Abou-Zeid,Hossam S. Hassanein

DOI: https://doi.org/10.48550/arXiv.2309.07265

2023-09-19

Abstract:The open radio access network (O-RAN) architecture supports intelligent network control algorithms as one of its core capabilities. Data-driven applications incorporate such algorithms to optimize radio access network (RAN) functions via RAN intelligent controllers (RICs). Deep reinforcement learning (DRL) algorithms are among the main approaches adopted in the O-RAN literature to solve dynamic radio resource management problems. However, despite the benefits introduced by the O-RAN RICs, the practical adoption of DRL algorithms in real network deployments falls behind. This is primarily due to the slow convergence and unstable performance exhibited by DRL agents upon deployment and when encountering previously unseen network conditions. In this paper, we address these challenges by proposing transfer learning (TL) as a core component of the training and deployment workflows for the DRL-based closed-loop control of O-RAN functionalities. To this end, we propose and design a hybrid TL-aided approach that leverages the advantages of both policy reuse and distillation TL methods to provide safe and accelerated convergence in DRL-based O-RAN slicing. We conduct a thorough experiment that accommodates multiple services, including real VR gaming traffic to reflect practical scenarios of O-RAN slicing. We also propose and implement policy reuse and distillation-aided DRL and non-TL-aided DRL as three separate baselines. The proposed hybrid approach shows at least: 7.7% and 20.7% improvements in the average initial reward value and the percentage of converged scenarios, and a 64.6% decrease in reward variance while maintaining fast convergence and enhancing the generalizability compared with the baselines.

Networking and Internet Architecture,Artificial Intelligence,Machine Learning
Attention-based Open RAN Slice Management using Deep Reinforcement Learning

Fatemeh Lotfi,Fatemeh Afghah,Jonathan Ashdown

2023-06-16

Abstract:As emerging networks such as Open Radio Access Networks (O-RAN) and 5G continue to grow, the demand for various services with different requirements is increasing. Network slicing has emerged as a potential solution to address the different service requirements. However, managing network slices while maintaining quality of services (QoS) in dynamic environments is a challenging task. Utilizing machine learning (ML) approaches for optimal control of dynamic networks can enhance network performance by preventing Service Level Agreement (SLA) violations. This is critical for dependable decision-making and satisfying the needs of emerging networks. Although RL-based control methods are effective for real-time monitoring and controlling network QoS, generalization is necessary to improve decision-making reliability. This paper introduces an innovative attention-based deep RL (ADRL) technique that leverages the O-RAN disaggregated modules and distributed agent cooperation to achieve better performance through effective information extraction and implementing generalization. The proposed method introduces a value-attention network between distributed agents to enable reliable and optimal decision-making. Simulation results demonstrate significant improvements in network performance compared to other DRL baseline methods.

Distributed, Parallel, and Cluster Computing,Machine Learning,Networking and Internet Architecture,Systems and Control
A Multi-Agent Deep Reinforcement Learning Approach for RAN Resource Allocation in O-RAN

Farhad Rezazadeh,Lanfranco Zanzi,Francesco Devoti,Sergio Barrachina-Munoz,Engin Zeydan,Xavier Costa-Pérez,Josep Mangues-Bafalluy

2023-07-03

Abstract:Artificial intelligence (AI) and Machine Learning (ML) are considered as key enablers for realizing the full potential of fifth-generation (5G) and beyond mobile networks, particularly in the context of resource management and orchestration. In this demonstration, we consider a fully-fledged 5G mobile network and develop a multi-agent deep reinforcement learning (DRL) framework for RAN resource allocation. By leveraging local monitoring information generated by a shared gNodeB instance (gNB), each DRL agent aims to optimally allocate radio resources concerning service-specific traffic demands belonging to heterogeneous running services. We perform experiments on the deployed testbed in real-time, showing that DRL-based agents can allocate radio resources fairly while improving the overall efficiency of resource utilization and minimizing the risk of over provisioning.

Networking and Internet Architecture
Federated Deep Reinforcement Learning for Resource Allocation in O-RAN Slicing

Han Zhang,Hao Zhou,Melike Erol-Kantarci

DOI: https://doi.org/10.48550/arXiv.2208.01736

2022-08-02

Networking and Internet Architecture

Abstract:Recently, open radio access network (O-RAN) has become a promising technology to provide an open environment for network vendors and operators. Coordinating the x-applications (xAPPs) is critical to increase flexibility and guarantee high overall network performance in O-RAN. Meanwhile, federated reinforcement learning has been proposed as a promising technique to enhance the collaboration among distributed reinforcement learning agents and improve learning efficiency. In this paper, we propose a federated deep reinforcement learning algorithm to coordinate multiple independent xAPPs in O-RAN for network slicing. We design two xAPPs, namely a power control xAPP and a slice-based resource allocation xAPP, and we use a federated learning model to coordinate two xAPP agents to enhance learning efficiency and improve network performance. Compared with conventional deep reinforcement learning, our proposed algorithm can achieve 11% higher throughput for enhanced mobile broadband (eMBB) slices and 33% lower delay for ultra-reliable low-latency communication (URLLC) slices.
O-RAN architecture, interfaces, and standardization: Study and application to user intelligent admission control

Mohammad Alavirad,Umair Sajid Hashmi,Marwan Mansour,Ali Esswie,Ramy Atawia,Gwenael Poitau,Morris Repeta

DOI: https://doi.org/10.3389/frcmn.2023.1127039

2023-03-22

Frontiers in Communications and Networks

Abstract:Open radio access network (O-RAN), driven by O-RAN Alliance is based on the disaggregation of the traditional RAN systems into radio unit (RU), distributed unit (DU) and central unit (CU) components. It provides a unique opportunity to reduce the cost of wireless network deployment by using open-source software, serving as a foundation for O-RAN compliant functions, and by utilizing low-cost, generic white-box hardware for radio components. Relying on the two core pillars of openness and intelligence , there has been a coordinated global effort from operators and equipment providers to enhance the RAN architecture and improve its performance through virtualized network elements and open interfaces that incorporate intelligence in RAN. With the increased complexity of 5G networks and the demand to fulfill requirements, intelligence is becoming a key factor for automated deployment, operation, and optimization of open wireless networks. The first thrust of this paper surveys the AI/ML architecture in O-RAN specifications, key discussion points and future standardization directions, respectively. In the second part, we introduce a proof-of-concept use case on AI-driven network optimization within the near real-time RAN intelligent controller (near-RT RIC) and non-real time RIC (non-RT RIC). In particular, we investigate the user admission control problem, led by a deep learning-based algorithm, implemented as an xApp for network performance enhancement. Extensive system-level simulations are performed with NS-3 LTE to assess the proposed admission control algorithm. Accordingly, the proposed dynamic algorithm shows a significant admission control performance improvement and flexibility, compared to existing admission control static techniques, while satisfying the stringent quality of service targets of admitted devices. Finally, the paper offers insightful conclusions and findings on the AI-based modeling, model inference performance, key performance challenges and future research directions, respectively.
Intelligent Resource Management at the Edge for Ubiquitous IoT: An SDN-Based Federated Learning Approach

Venkatraman Balasubramanian,Moayad Aloqaily,Martin Reisslein,Anna Scaglione

DOI: https://doi.org/10.1109/mnet.011.2100121

IF: 10.294

2021-09-01

IEEE Network

Abstract:The ubiquitous nature of Internet of Things (IoT) devices has posited many challenges that need innovative solutions in the 5G era. Software defined networks (SDNs) are becoming indispensable in managing several aspects of next-generation IoT networking that arise from the need to control highly heterogeneous, geographically dispersed, mobile IoT devices. One such aspect is cache management at the edge. Recently, multiple forms of edge resources, including mobile device clouds and micro-edge data centers have emerged to provide scalable cache placement locations that reduce the costs for the mobile network operator (MNO). As all of these service locations are registered with the MNO (or links established after registration with the 5G base station, BS), content should be placed according to the user's demand and the cost the user is willing to pay to receive the desired level of QoS. To this end, it is important to understand the future popularity of the content for its optimal placement considering the highly dynamic user mobility. In this article, we address two key aspects of a mobile IoT network: security and seamless connectivity for data delivery. We rely on the federated learning (FL) architecture, which enables harnessing data and computational capabilities at end-user devices to train machine learning models. We study FL concepts in the domain of edge computing for IoT use cases, such as caching. We draw conclusions from various state-of-the-art models and posit several challenges that can be overcome via a novel proposed control algorithm.

computer science, information systems,telecommunications,engineering, electrical & electronic, hardware & architecture
Evolutionary Deep Reinforcement Learning for Dynamic Slice Management in O-RAN

Fatemeh Lotfi,Omid Semiari,Fatemeh Afghah

DOI: https://doi.org/10.48550/arXiv.2208.14394

2022-09-30

Abstract:The next-generation wireless networks are required to satisfy a variety of services and criteria concurrently. To address upcoming strict criteria, a new open radio access network (O-RAN) with distinguishing features such as flexible design, disaggregated virtual and programmable components, and intelligent closed-loop control was developed. O-RAN slicing is being investigated as a critical strategy for ensuring network quality of service (QoS) in the face of changing circumstances. However, distinct network slices must be dynamically controlled to avoid service level agreement (SLA) variation caused by rapid changes in the environment. Therefore, this paper introduces a novel framework able to manage the network slices through provisioned resources intelligently. Due to diverse heterogeneous environments, intelligent machine learning approaches require sufficient exploration to handle the harshest situations in a wireless network and accelerate convergence. To solve this problem, a new solution is proposed based on evolutionary-based deep reinforcement learning (EDRL) to accelerate and optimize the slice management learning process in the radio access network's (RAN) intelligent controller (RIC) modules. To this end, the O-RAN slicing is represented as a Markov decision process (MDP) which is then solved optimally for resource allocation to meet service demand using the EDRL approach. In terms of reaching service demands, simulation results show that the proposed approach outperforms the DRL baseline by 62.2%.

Systems and Control,Artificial Intelligence,Information Theory,Machine Learning,Neural and Evolutionary Computing
Dynamic D2D-Assisted Federated Learning over O-RAN: Performance Analysis, MAC Scheduler, and Asymmetric User Selection

Payam Abdisarabshali,Kwang Taik Kim,Michael Langberg,Weifeng Su,Seyyedali Hosseinalipour

2024-04-09

Abstract:Existing studies on federated learning (FL) are mostly focused on system orchestration for static snapshots of the network and making static control decisions (e.g., spectrum allocation). However, real-world wireless networks are susceptible to temporal variations of wireless channel capacity and users' datasets. In this paper, we incorporate multi-granular system dynamics (MSDs) into FL, including (M1) dynamic wireless channel capacity, captured by a set of discrete-time events, called $\mathscr{D}$-Events, and (M2) dynamic datasets of users. The latter is characterized by (M2-a) modeling the dynamics of user's dataset size via an ordinary differential equation and (M2-b) introducing dynamic model drift}, formulated via a partial differential inequality} drawing concrete analytical connections between the dynamics of users' datasets and FL accuracy. We then conduct FL orchestration under MSDs by introducing dynamic cooperative FL with dedicated MAC schedulers (DCLM), exploiting the unique features of open radio access network (O-RAN). DCLM proposes (i) a hierarchical device-to-device (D2D)-assisted model training, (ii) dynamic control decisions through dedicated O-RAN MAC schedulers, and (iii) asymmetric user selection. We provide extensive theoretical analysis to study the convergence of DCLM. We then optimize the degrees of freedom (e.g., user selection and spectrum allocation) in DCLM through a highly non-convex optimization problem. We develop a systematic approach to obtain the solution for this problem, opening the door to solving a broad variety of network-aware FL optimization problems. We show the efficiency of DCLM via numerical simulations and provide a series of future directions.

Networking and Internet Architecture,Artificial Intelligence,Machine Learning
Deep Learning for B5G Open Radio Access Network: Evolution, Survey, Case Studies, and Challenges

Bouziane Brik,Karim Boutiba,Adlen Ksentini

DOI: https://doi.org/10.1109/ojcoms.2022.3146618

2022-01-01

IEEE Open Journal of the Communications Society

Abstract:Open Radio Access Network (O-RAN) alliance was recently launched to devise a new RAN architecture featuring open, software-driven, virtual, and intelligent radio access architecture. O-RAN architecture is based on (1) disaggregated RAN functions that run as Virtual Network Function (VNF) and Physical Network Function (PNF); (2) the notion of RAN controller that runs centrally RAN applications such as mobility management, users’ scheduling, radio resources allocation, etc. The RAN controller is in charge of enforcing the application decisions by using open interfaces with the RAN functions. One important feature introduced by O-RAN is the heavy usage of Machine Learning (ML) techniques, particularly Deep Learning (DL), to foster innovation and ease the deployment of intelligent RAN applications that are able to fulfill the Quality of Service (QoS) requirements of the envisioned 5G and beyond network services. In this work, we first give an overview of the evolution of RAN architectures toward 5G and beyond, namely C-RAN, vRAN, and O-RAN. We also compare them based on various perspectives, such as edge support, virtualization, control and management, energy consumption, and AI support. Then, we review existing DL-based solutions addressing the RAN part. We also show how they can be integrated/mapped to the O-RAN architecture since these works were not initially adapted to the O-RAN architecture. In addition, we present two case studies for DL techniques deployment in O-RAN. Furthermore, we describe how the main steps of deployed DL models in O-RAN can be automated, to ensure stable performance of these models, introducing ML system operations (MLOps) concept in O-RAN. Finally, we identify key technical challenges, open issues, and future research directions related to the Artificial Intelligence (AI)-enabled O-RAN architecture.
Distributed Learning Meets 6G: A Communication and Computing Perspective

Shashank Jere,Yifei Song,Yang Yi,Lingjia Liu

2023-03-02

Abstract:With the ever-improving computing capabilities and storage capacities of mobile devices in line with evolving telecommunication network paradigms, there has been an explosion of research interest towards exploring Distributed Learning (DL) frameworks to realize stringent key performance indicators (KPIs) that are expected in next-generation/6G cellular networks. In conjunction with Edge Computing, Federated Learning (FL) has emerged as the DL architecture of choice in prominent wireless applications. This article lays an outline of how DL in general and FL-based strategies specifically can contribute towards realizing a part of the 6G vision and strike a balance between communication and computing constraints. As a practical use case, we apply Multi-Agent Reinforcement Learning (MARL) within the FL framework to the Dynamic Spectrum Access (DSA) problem and present preliminary evaluation results. Top contemporary challenges in applying DL approaches to 6G networks are also highlighted.

Networking and Internet Architecture,Machine Learning

16th European Congress on Obesity (ECO), Geneva, Switzerland, 14–17 May 2008

Synergies Between Federated Learning and O-RAN: Towards an Elastic Architecture for Multiple Distributed Machine Learning Services

Deep Reinforcement Learning for Multi-Functional RIS-Aided Over-the-Air Federated Learning in Internet of Robotic Things

Federated Learning with Unsourced Random Access.

On the Specialization of FDRL Agents for Scalable and Distributed 6G RAN Slicing Orchestration

Federated Learning in Multi-RIS-Aided Systems

Federated Machine Reasoning for Resource Provisioning in 6G O-RAN

Efficient Ring-topology Decentralized Federated Learning with Deep Generative Models for Industrial Artificial Intelligent

Intelligent O-RAN Beyond 5G: Architecture, Use Cases, Challenges, and Opportunities

Federated Deep Reinforcement Learning for Efficient Jamming Attack Mitigation in O-RAN

Mobility aware and energy-efficient federated deep reinforcement learning assisted resource allocation for 5G-RAN slicing

Safe and Accelerated Deep Reinforcement Learning-based O-RAN Slicing: A Hybrid Transfer Learning Approach

Attention-based Open RAN Slice Management using Deep Reinforcement Learning

A Multi-Agent Deep Reinforcement Learning Approach for RAN Resource Allocation in O-RAN

Federated Deep Reinforcement Learning for Resource Allocation in O-RAN Slicing

O-RAN architecture, interfaces, and standardization: Study and application to user intelligent admission control

Intelligent Resource Management at the Edge for Ubiquitous IoT: An SDN-Based Federated Learning Approach

Evolutionary Deep Reinforcement Learning for Dynamic Slice Management in O-RAN

Dynamic D2D-Assisted Federated Learning over O-RAN: Performance Analysis, MAC Scheduler, and Asymmetric User Selection

Deep Learning for B5G Open Radio Access Network: Evolution, Survey, Case Studies, and Challenges

Distributed Learning Meets 6G: A Communication and Computing Perspective