DRL-Based Network Orchestration to Realize Cooperative, Distributed and Tenant-Driven Virtual Network Slicing

Xu Zhang,Wei Lu,Baojia Li,Zuqing Zhu

2019-01-01

Abstract:We propose a cooperative, distributed and tenant -driven framework for realizing virtual network embedding (VNE) in optical datacenter interconnections (O-DCIs), by leveraging a deep reinforcement learning (DRL) module.

What problem does this paper attempt to address?

Ai-Assisted Resource Advertising And Pricing To Realize Distributed Tenant-Driven Virtual Network Slicing In Inter-Dc Optical Networks

Wei Lu,Hongqiang Fang,Zuqing Zhu

DOI: https://doi.org/10.23919/ondm.2018.8396119

2018-01-01

Abstract:We propose a novel artificial intelligence (AI) assisted framework to realize virtual network (VNT) slicing in an inter-datacenter optical network (IDCON), where the infrastructure provider (InP) performs resource advertising and pricing based on deep reinforcement learning (DRL) and grants the virtual network embedding (VNE) schemes calculated distributedly by the tenants. Simulation results confirm that compared with the traditional centralized VNT slicing framework, our proposal can not only make the InP more profitable but also relieve its computation complexity effectively.
You Calculate and I Provision: A DRL-Assisted Service Framework to Realize Distributed and Tenant-Driven Virtual Network Slicing

Xu Zhang,Baojia Li,Jianquan Peng,Xiaoqin Pan,Zuqing Zhu

DOI: https://doi.org/10.1109/jlt.2020.3023693

IF: 4.7

2021-01-01

Journal of Lightwave Technology

Abstract:Xu Zhang, Baojia Li, Jianquan Peng, Xiaoqin Pan, Zuqing Zhu<br/>This article studies the problem of virtual network (VNT) slicing in datacenter interconnections (DCIs), and proposes a novel service ... [J. Lightwave Technol. 39, 4-16 (2021)]

engineering, electrical & electronic,optics,telecommunications
Deep-NFVOrch: Leveraging Deep Reinforcement Learning to Achieve Adaptive Vnf Service Chaining in DCI-EONs

Baojia Li,Wei Lu,Zuqing Zhu

DOI: https://doi.org/10.1364/jocn.12.000a18

IF: 4.508

2019-01-01

Journal of Optical Communications and Networking

Abstract:Due to the rise of cloud computing, how to realize adaptive and cost-effective virtual network function service chaining (vNF-SC) in a datacenter interconnection based on an elastic optical network (DCI-EON) has become an interesting but challenging problem. In this work, we tackle this problem by optimizing the design of a deep reinforcement learning (DRL)-based adaptive service framework, namely, Deep-NFVOrch. Specifically, Deep-NFVOrch works in service cycles and tries to reduce the setup latency of vNF-SC by invoking request prediction and pre-deployment at the beginning of each service cycle. We introduce a DRL-based observer (DRL-Observer) to select the duration of each service cycle adaptively according to the network status. The DRL-Observer is designed based on the advantage actor critic, which can interact with the network environment constantly through its deep neural network and learn how to make wise decisions based on the environment’s feedback. Our simulation results demonstrate that the DRL-Observer converges fast in online training with the help of a few asynchronous training threads, and the Deep-NFVOrch with it achieves better performance than several benchmarks, in terms of balancing the tradeoffs among overall resource utilization, vNF-SC request-blocking probability, and the number of network reconfigurations in a DCI-EON.
Deep-learning-assisted Network Orchestration for On-Demand and Cost-Effective VNF Service Chaining in Inter-Dc Elastic Optical Networks

Baojia Li,Wei Lu,Siqi Liu,Zuqing Zhu

DOI: https://doi.org/10.1364/jocn.10.000d29

IF: 4.508

2018-01-01

Journal of Optical Communications and Networking

Abstract:This work addresses the relatively long setup latency and complicated network control and management caused by on-demand virtual network function service chain (vNF-SC) provisioning in inter-datacenter elastic optical networks. We first design a provisioning framework with resource pre-deployment to resolve the aforementioned challenge. Specifically, the framework is designed as a discrete-time system, in which the operations are performed periodically in fixed time slots (TS). Each TS includes a pre-deployment phase followed by a provisioning phase. In the pre-deployment phase, a deep-learning (DL) model is designed to predict future vNF-SC requests, then lightpath establishment and vNF deployment are performed accordingly to pre-deploy resources for the predicted requests. Then, the system proceeds to the provisioning phase, which collects dynamic vNF-SC requests from clients and serves them in real-time by steering their traffic through the required vNFs in sequence. In order to forecast the high-dimensional data of future vNF-SC requests accurately, we design our DL model based on the long/short-term memory-based neural network and develop an effective training scheme for it. Then, the provisioning framework and DL model are optimized from several perspectives. We evaluate our proposed framework with simulations that leverage real traffic traces. The results indicate that our DL model achieves higher request prediction accuracy and lower blocking probability than two benchmarks that also predict vNF-SC requests and follow the principle of the proposed provisioning framework.
GNN-Based Hierarchical Deep Reinforcement Learning for NFV-Oriented Online Resource Orchestration in Elastic Optical DCIs

Baojia Li,Zuqing Zhu

DOI: https://doi.org/10.1109/jlt.2021.3125974

IF: 4.7

2022-02-15

Journal of Lightwave Technology

Abstract:Network function virtualization (NFV) in elastic optical datacenter interconnections (EO-DCIs) enables flexible and timely deployment of network services. However, as the service provisioning of virtual network function service chains (vNF-SCs) in an EO-DCI needs to orchestrate the allocations of IT resources in datacenters (DCs) and spectrum resources on fiber links dynamically, it is a complex and challenging problem. In this work, we model the problem as a Markov decision process (MDP), and propose a hierarchical deep reinforcement learning (DRL) model based on graph neural network (GNN), namely, HRLOrch, to tackle it. To ensure its universality and scalability, we design the policy neural network (NN) in HRLOrch based on a GNN. As the GNN-based policy NN can operate on the graph-structured network state of an EO-DCI directly, it can adapt to an arbitrary EO-DCI topology without any structural changes. Then, through analysis, we find that the EO-DCI is a sparse reward environment if we want to train a DRL model to minimize the blocking probability of vNF-SCs in it directly. To address this issue, we design a hierarchical DRL with lower-level and upper-level models to improve the convergence performance of training. Specifically, we make the lower-level DRL optimize the provisioning scheme of each vNF-SC to minimize its resource usage, while the upper-level one coordinates the provisioning of all the active vNF-SCs to minimize the overall blocking probability. Hence, the lower-level and upper-level DRL models operate cooperatively in the training to optimize the dynamic provisioning of vNF-SCs. Our simulations demonstrate the universality and scalability of HRLOrch, and confirm that it can outperform the existing algorithms for vNF-SC provisioning in an EO-DCI.

engineering, electrical & electronic,optics,telecommunications
Semi-Decentralized Network Slicing for Reliable V2V Service Provisioning: A Model-Free Deep Reinforcement Learning Approach

Jie Mei,Xianbin Wang,Kan Zheng

DOI: https://doi.org/10.1109/tits.2021.3109878

IF: 8.5

2022-01-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Applying of network slicing in vehicular networks becomes a promising paradigm to support emerging Vehicle-to-Vehicle (V2V) applications with diverse quality of service (QoS) requirements. However, achieving effective network slicing in dynamic vehicular communications still faces many challenges, particularly time-varying traffic of Vehicle-to-Vehicle (V2V) services and the fast-changing network topology. By leveraging the widely deployed LTE infrastructures, we propose a semi-decentralized network slicing framework in this paper based on the C-V2X Mode-4 standard to provide customized network slices for diverse V2V services. With only the long-term and partial information of vehicular networks, eNodeB (eNB) can infer the underlying network situation and then intelligently adjust the configuration for each slice to ensure the long-term QoS performance. Under the coordination of eNB, each vehicle can autonomously select radio resources for its V2V transmission in a decentralized manner. Specifically, the slicing control at the eNB is realized by a model-free deep reinforcement learning (DRL) algorithm, which is a convergence of Long Short Term Memory (LSTM) and actor-critic DRL. Compared to the existing DRL algorithms, the proposed DRL neither requires any prior knowledge nor assumes any statistical model of vehicular networks. Furthermore, simulation results show the effectiveness of our proposed intelligent network slicing scheme.
Deep-Nfvorch: Deep Reinforcement Learning Based Service Framework For Adaptive Vnf Service Chaining In Idc-Eons

Baojia Li,Wei Lu,Zuqing Zhu

DOI: https://doi.org/10.1364/ofc.2019.th1h.2

2019-01-01

Abstract:By leveraging deep reinforcement learning (DRL), we design Deep-NFVOrch as a novel service framework with resource pre-deployment to achieve adaptive virtual network function (vNF) service chaining in inter-datacenter elastic optical networks (IDC-EONs).
EdgeSlice: Slicing Wireless Edge Computing Network with Decentralized Deep Reinforcement Learning

Qiang Liu,Tao Han,Ephraim Moges

DOI: https://doi.org/10.48550/arXiv.2003.12911

2020-03-29

Abstract:5G and edge computing will serve various emerging use cases that have diverse requirements of multiple resources, e.g., radio, transportation, and computing. Network slicing is a promising technology for creating virtual networks that can be customized according to the requirements of different use cases. Provisioning network slices requires end-to-end resource orchestration which is challenging. In this paper, we design a decentralized resource orchestration system named EdgeSlice for dynamic end-to-end network slicing. EdgeSlice introduces a new decentralized deep reinforcement learning (D-DRL) method to efficiently orchestrate end-to-end resources. D-DRL is composed of a performance coordinator and multiple orchestration agents. The performance coordinator manages the resource orchestration policies in all the orchestration agents to ensure the service level agreement (SLA) of network slices. The orchestration agent learns the resource demands of network slices and orchestrates the resource allocation accordingly to optimize the performance of the slices under the constrained networking and computing resources. We design radio, transport and computing manager to enable dynamic configuration of end-to-end resources at runtime. We implement EdgeSlice on a prototype of the end-to-end wireless edge computing network with OpenAirInterface LTE network, OpenDayLight SDN switches, and CUDA GPU platform. The performance of EdgeSlice is evaluated through both experiments and trace-driven simulations. The evaluation results show that EdgeSlice achieves much improvement as compared to baseline in terms of performance, scalability, compatibility.

Networking and Internet Architecture
Deep Reinforcement Learning for Resource Management in Network Slicing

Rongpeng Li,Zhifeng Zhao,Qi Sun,Chi-Lin I,Chenyang Yang,Xianfu Chen,Minjian Zhao,Honggang Zhang

DOI: https://doi.org/10.48550/arXiv.1805.06591

2018-11-21

Abstract:Network slicing is born as an emerging business to operators, by allowing them to sell the customized slices to various tenants at different prices. In order to provide better-performing and cost-efficient services, network slicing involves challenging technical issues and urgently looks forward to intelligent innovations to make the resource management consistent with users' activities per slice. In that regard, deep reinforcement learning (DRL), which focuses on how to interact with the environment by trying alternative actions and reinforcing the tendency actions producing more rewarding consequences, is assumed to be a promising solution. In this paper, after briefly reviewing the fundamental concepts of DRL, we investigate the application of DRL in solving some typical resource management for network slicing scenarios, which include radio resource slicing and priority-based core network slicing, and demonstrate the advantage of DRL over several competing schemes through extensive simulations. Finally, we also discuss the possible challenges to apply DRL in network slicing from a general perspective.

Networking and Internet Architecture,Machine Learning
Deep Reinforcement Learning for End-to-End Network Slicing: Challenges and Solutions

Qiang Liu,Nakjung Choi,Tao Han

DOI: https://doi.org/10.48550/arXiv.2207.14766

2022-07-30

Abstract:5G and beyond is expected to enable various emerging use cases with diverse performance requirements from vertical industries. To serve these use cases cost-effectively, network slicing plays a key role in dynamically creating virtual end-to-end networks according to specific resource demands. A network slice may have hundreds of configurable parameters over multiple technical domains that define the performance of the network slice, which makes it impossible to use traditional model-based solutions to orchestrate resources for network slices. In this article, we discuss how to design and deploy deep reinforcement learning (DRL), a model-free approach, to address the network slicing problem. First, we analyze the network slicing problem and present a standard-compliant system architecture that enables DRL-based solutions in 5G and beyond networks. Second, we provide an in-depth analysis of the challenges in designing and deploying DRL in network slicing systems. Third, we explore multiple promising techniques, i.e., safety and distributed DRL, and imitation learning, for automating end-to-end network slicing.

Networking and Internet Architecture
Deep Reinforcement Learning Approaches to Network Slice Scaling and Placement: A Survey

Niloy Saha,Mohammad Zangooei,Morteza Golkarifard,Raouf Boutaba

DOI: https://doi.org/10.1109/mcom.006.2200534

IF: 9.03

2023-02-18

IEEE Communications Magazine

Abstract:Network slicing in 5G and beyond networks allows the network to be customized for each application or service by chaining together different virtualized network functions (VNFs) according to service requirements. The increased flexibility offered by network slicing comes at the cost of complexity in management and orchestration, which cannot be solved by traditional reactive human-in-the-loop solutions. This necessitates minimizing human intervention through the use of artificial intelligence techniques (zero touch network management). In particular, the scaling and placement of the chain of VNFs that constitute a network slice is a complex combinatorial optimization problem that is difficult to solve effectively with traditional approaches. Driven by the benefits of deep reinforcement learning (DRL) in solving various combinatorial optimization problems, in this article, we survey various DRL-based approaches to slice scaling and placement, including different ways to model the problem and benefits of various DRL techniques in addressing specific aspects of the problem. Further, we highlight key challenges and open issues in the effective use of DRL for network slice scaling and placement.
Opti-DeepRoute: A Topology-Adaptive Deep Reinforcement Learning Based Service Provisioning Framework for Elastic Optical Network

Zexi Zhou,Rentao Gu,Xiaoya Zhang,Yunxuan Li,Lin Bai,Yuefeng Ji

DOI: https://doi.org/10.1109/infocomwkshps61880.2024.10620793

2024-01-01

Abstract:The satisfaction of AI computing demands relies on the robust computational foundation provided by efficient optical backbone network. Deep reinforcement learning (DRL) methods have been widely adopted recently to address elastic optical network (EON) service provisioning problems with complex spectrum constraints. However, previous frameworks utilizing path-level decision spaces face challenges as path-level features cannot be directly transferred when network topology changes, making it necessary to retrain the agent, hindering the practical deployment of the algorithm. Based on the above observations, this paper proposes a novel hop-by-hop DRL service provisioning framework for EON: Opti-DeepRoute. A node-level feature engineering is employed to construct solutions incrementally through the creation of node sequences. Utilizing the topological and spectral local receptive fields provided by the Graph Attention Network (GAT), the agent acquires local network states and partial solution information to achieve topological adaptability. Preliminary evaluations demonstrate the advantages of Opti-DeepRoute in terms of topological adaptability compared with SOTA DRL approaches.
A Dynamic and Collaborative Multi-Layer Virtual Network Embedding Algorithm in SDN Based on Reinforcement Learning

Meilian Lu,Yun Gu,Dongliang Xie

DOI: https://doi.org/10.1109/tnsm.2020.3012588

2020-01-01

IEEE Transactions on Network and Service Management

Abstract:Most of existing virtual network embedding (VNE) algorithms only consider how to construct virtual networks more efficiently on a physical infrastructure, without considering the possibility that the constructed virtual networks may be further virtualized to multiple smaller ones. We define the former scenario as single-layer VNE and the later as multi-layer VNE. As the increasing popularity of deploying large datacenter networks and wide area networks with Software Defined Network (SDN) architectures, it becomes a new requirement and possibility to provide multi-layer encapsulated network services for large tenants who have hierarchical organizational structures or need fine-grained service isolation. However, existing VNE algorithm are not specifically designed for the above requirement and not flexible enough to deal with mapping virtual network requirements (VNRs) to a physical network and smaller VNRs to a mapped virtual network. In this paper, we aim to propose a unified and flexible multi-layer VNE algorithm combining with reinforcement learning to solve the embedding of multi-layer VNRs, which can better distinguish the differences between VNRs and physical networks. Simulation results show that our algorithm achieves good performance both in single-layer and multi-layer VNE scenarios.
Novel Framework of Risk-Aware Virtual Network Embedding in Optical Data Center Networks

Weigang Hou,Zhaolong Ning,Lei Guo,Zhikui Chen,Mohammad S. Obaidat

DOI: https://doi.org/10.1109/jsyst.2017.2673828

IF: 4.802

2018-01-01

IEEE Systems Journal

Abstract:The traffic between geographically distributed data centers (DCs) becomes bandwidth hungry. Since the optical interconnection has a high capacity, the optical data center network (ODCN)-where DCs are located at the edge of the optical backbone-emerges. By virtualization, the virtual networks- representing service requirements-are embedded onto the same part of the substrate ODCN. Each virtual network has virtual machine (VM) nodes interconnected by virtual links (VLs). Therefore, a virtual network embedding (VNE) operation includes two components: 1) the VM mapping for putting a VM into the server of an appropriate DC and 2) the VL mapping for establishing one substrate path to support inter-VM communications. In this paper, we focus on a risk-aware VNE framework because a blind VNE operation would result in severe information leakage among coresident VMs in the server. By evaluating VM threat and vulnerability, risky VMs are identified according to experimental results. To perform physical isolation between risky and security VMs, a risk-aware VNE heuristic algorithm is proposed. The simulation results show that our heuristic algorithm performs better than the benchmark in terms of maintaining ODCN security and earning rental revenue. There is also a good match between our algorithm solution and the problem bound.
Security-Aware Resource Allocation Scheme Based on DRL in Cloud–Edge–Terminal Cooperative Vehicular Network

Yi Zhang,Chunxiao Jiang,Peiying Zhang

DOI: https://doi.org/10.1109/jiot.2023.3293497

IF: 10.6

2024-01-01

IEEE Internet of Things Journal

Abstract:Virtual network embedding (VNE) refers to the process of mapping virtual networks onto physical networks, which can improve the utilization and flexibility of network resources. However, due to the complexity of VNE problems and the requirement for network security, how to efficiently complete VNE and ensure network security is important. In this article, we analyze the characteristics of the cloud-edge-terminal collaborative vehicular network and design a resource allocation mechanism based on VNEVNE, abbreviated as DRLS-VNE. First, we establish a multidimensional heterogeneous network model and design a five-layer neural network as the deep reinforcement learning (DRL) agent. The DRL agent can adaptively extract network feature attributes, thereby improving the performance of DRLS-VNE. Second, we introduce a dynamic trust evaluation mechanism, which can evaluate the trustworthiness of each node in the virtual network in real time and set embedding constraints based on the evaluation results. Finally, we conduct experiments to verify the practicality and effectiveness of DRLS-VNE. The experimental results show that our solution can significantly enhance the performance of the VNE solution.
Dynamic Network Slice Reconfiguration by Exploiting Deep Reinforcement Learning

Fengsheng Wei,Gang Feng,Yao Sun,Yatong Wang,Ying-Chang Liang

DOI: https://doi.org/10.1109/icc40277.2020.9148848

2020-01-01

Abstract:It is widely acknowledged that network slicing can tackle the diverse usage scenarios and connectivity services that the 5G-and-beyond systems need to support. To guarantee performance isolation while maximizing network resource utilization under traffic uncertainty, network slice needs to be reconfigured adaptively. However, it is commonly believed that the fine-grained resource reconfiguration problem is intractable due to the extremely high computational complexity caused by the numerous variables. In this paper, we investigate network slice reconfiguration with aim of minimizing long-term resource consumption by exploiting Deep Reinforcement Learning (DRL). To address the curse of dimensionality of the problem, we propose to incorporate the Branching Dueling Q-network (BDQ) into DRL, to avoid some unnecessary calculations of Q-value by separating the Q-network into a shared value branch and a number of distributed advantage branches. Furthermore, the value branch and the advantage branch of each dimension are aggregated to derive the corresponding dimension's sub-Q-value. Then the best reconfiguration action is composed of the sub-actions in individual dimensions which are selected by epsilon-greedy policy. Finally, we design an intelligent online network slice reconfiguration policy based on BDQ and extensive simulation experiments are conducted to validate the effectiveness of the proposed slice reconfiguration policy.
Space-Air-Ground Integrated Multi-Domain Network Resource Orchestration Based on Virtual Network Architecture: A DRL Method

Peiying Zhang,Chao Wang,Neeraj Kumar,Lei Liu

DOI: https://doi.org/10.1109/tits.2021.3099477

IF: 8.5

2022-03-01

IEEE Transactions on Intelligent Transportation Systems

Abstract:Traditional ground wireless communication networks cannot provide high-quality services for artificial intelligence (AI) applications such as intelligent transportation systems (ITS) due to deployment, coverage and capacity issues. The space-air-ground integrated network (SAGIN) has become a research focus in the industry. Compared with traditional wireless communication networks, SAGIN is more flexible and reliable, and it has wider coverage and higher quality of seamless connection. However, due to its inherent heterogeneity, time-varying and self-organizing characteristics, the deployment and use of SAGIN still faces huge challenges, among which the orchestration of heterogeneous resources is a key issue. Based on virtual network architecture and deep reinforcement learning (DRL), we model SAGIN's heterogeneous resource orchestration as a multi-domain virtual network embedding (VNE) problem, and propose a SAGIN cross-domain VNE algorithm. We model the different network segments of SAGIN, and set the network attributes according to the actual situation of SAGIN and user needs. In DRL, the agent is acted by a five-layer policy network. We build a feature matrix based on network attributes extracted from SAGIN and use it as the agent training environment. Through training, the probability of each underlying node being embedded can be derived. In test phase, we complete the embedding process of virtual nodes and links in turn based on this probability. Finally, we verify the effectiveness of the algorithm from both training and testing.

engineering, electrical & electronic,transportation science & technology, civil
DRL-Deploy:Adaptive Service Function Chains Deployment with Deep Reinforcement Learning

Xiaohui Wei,Yong Sheng,Lina Li,Changbao Zhou

DOI: https://doi.org/10.1109/ISPA-BDCloud-SocialCom-SustainCom52081.2021.00027

2021-01-01

Abstract:With the development of software-defined networking (SDN) and network function virtualization (NFV), the service function chain (SFC) has become a popular paradigm for carrying and completing network services. In this new computing and networking paradigm, virtual network functions (VNFs) are deployed in software entities/virtual machines through physical device networks in a flexible manner to im...
Neural Architecture Search-enabled Deep Reinforcement Learning for Slice Deployment in a Converged Optical-Wireless Access Network

Ruikun Wang,Jiawei Zhang,Zhiqun Gu,Zhuo Chen,Yuefeng Ji

DOI: https://doi.org/10.1364/acpc.2021.t3c.5

2021-01-01

Abstract:We propose a neural architecture search-enabled deep reinforcement learning (NAS-DRL) for RAN slice deployment in a converged optical-wireless access network. Simulation results validate its superiority in resources saving and DRL retaining times.
DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing

Qiang Liu,Tao Han,Ning Zhang,Ye Wang

DOI: https://doi.org/10.1109/globecom42002.2020.9322106

2020-01-01

Abstract:Network slicing enables multiple virtual networks run on the same physical infrastructure to support various use cases in 5G and beyond. These use cases, however, have very diverse network resource demands, e.g., communication and computation, and various performance metrics such as latency and throughput. To effectively allocate network resources to slices, we propose DeepSlicing that integrates the alternating direction method of multipliers (ADMM) and deep reinforcement learning (DRL). DeepSlicing decomposes the network slicing problem into a master problem and several slave problems. The master problem is solved based on convex optimization and the slave problem is handled by DRL method which learns the optimal resource allocation policy. The performance of the proposed algorithm is validated through network simulations.

DRL-Based Network Orchestration to Realize Cooperative, Distributed and Tenant-Driven Virtual Network Slicing

Ai-Assisted Resource Advertising And Pricing To Realize Distributed Tenant-Driven Virtual Network Slicing In Inter-Dc Optical Networks

You Calculate and I Provision: A DRL-Assisted Service Framework to Realize Distributed and Tenant-Driven Virtual Network Slicing

Deep-NFVOrch: Leveraging Deep Reinforcement Learning to Achieve Adaptive Vnf Service Chaining in DCI-EONs

Deep-learning-assisted Network Orchestration for On-Demand and Cost-Effective VNF Service Chaining in Inter-Dc Elastic Optical Networks

GNN-Based Hierarchical Deep Reinforcement Learning for NFV-Oriented Online Resource Orchestration in Elastic Optical DCIs

Semi-Decentralized Network Slicing for Reliable V2V Service Provisioning: A Model-Free Deep Reinforcement Learning Approach

Deep-Nfvorch: Deep Reinforcement Learning Based Service Framework For Adaptive Vnf Service Chaining In Idc-Eons

EdgeSlice: Slicing Wireless Edge Computing Network with Decentralized Deep Reinforcement Learning

Deep Reinforcement Learning for Resource Management in Network Slicing

Deep Reinforcement Learning for End-to-End Network Slicing: Challenges and Solutions

Deep Reinforcement Learning Approaches to Network Slice Scaling and Placement: A Survey

Opti-DeepRoute: A Topology-Adaptive Deep Reinforcement Learning Based Service Provisioning Framework for Elastic Optical Network

A Dynamic and Collaborative Multi-Layer Virtual Network Embedding Algorithm in SDN Based on Reinforcement Learning

Novel Framework of Risk-Aware Virtual Network Embedding in Optical Data Center Networks

Security-Aware Resource Allocation Scheme Based on DRL in Cloud–Edge–Terminal Cooperative Vehicular Network

Dynamic Network Slice Reconfiguration by Exploiting Deep Reinforcement Learning

Space-Air-Ground Integrated Multi-Domain Network Resource Orchestration Based on Virtual Network Architecture: A DRL Method

DRL-Deploy:Adaptive Service Function Chains Deployment with Deep Reinforcement Learning

Neural Architecture Search-enabled Deep Reinforcement Learning for Slice Deployment in a Converged Optical-Wireless Access Network

DeepSlicing: Deep Reinforcement Learning Assisted Resource Allocation for Network Slicing