Abstract:Network function virtualization (NFV) is a promising paradigm where network functions are migrated from dedicated hardware appliances onto software middleboxes to promote service agility and reduce management costs. Benefiting from the NFV, the service function chain (SFC) has emerged as a popular network service form. It allows network traffic to pass through a series of virtual network functions in a specific order required by the business logic to arrange a complex service. However, SFC deployment is facing new challenges in seeking a trade-off between pursuing the objective of high long-term average revenue and making decisions in an online manner. In this paper, we propose DRL-D, a deep reinforcement learning-based approach for the online SFC deployment problem to satisfy different demands of SFC requests within resource constraints of the underlying infrastructure. DRL-D aims to maximize the long-term average revenue by combining the strengths of the graph convolutional network in learning a comprehensive representation of network state and the temporal-difference learning in generating deployment solutions for the SFC requests on the fly. Then a heuristic algorithm and a new prioritized experience replay technique are integrated to optimize the DRL framework and reduce the time complexity. Experimental results demonstrate the superiority of our DRL-D approach when compared with other benchmarks in terms of the long-term average revenue, acceptance ratio, and revenue-to-cost ratio. Performance evaluation shows that DRL-D possesses good robustness under different scales of physical networks and achieves excellent deployment performance within acceptable runtime.

Deep Reinforcement Learning for Demand-Aware Joint VNF Placement-and-Routing.

Multiagent Deep Reinforcement Learning for Cost- and Delay-Sensitive Virtual Network Function Placement and Routing

Leveraging Deep Reinforcement Learning with Attention Mechanism for Virtual Network Function Placement and Routing

An Attention Based Deep Reinforcement Learning Method for Virtual Network Function Placement

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

A Parallel Placement Approach for Service Function Chain Using Deep Reinforcement Learning

Intelligent VNF Orchestration and Flow Scheduling Via Model-Assisted Deep Reinforcement Learning

Network Resource Allocation Strategy Based on Deep Reinforcement Learning

Combining Deep Reinforcement Learning with Graph Neural Networks for Optimal VNF Placement

A Reinforcement Learning Approach for Virtual Network Function Chaining and Sharing in Softwarized Networks

A Reinforcement Learning Approach for Placement of Stateful Virtualized Network Functions

DRL-SFCP: Adaptive Service Function Chains Placement with Deep Reinforcement Learning

Delay-Aware NFV Resource Allocation with Deep Reinforcement Learning.

Online Service Provisioning in NFV-enabled Networks Using Deep Reinforcement Learning

DRL-QOR: Deep Reinforcement Learning-Based QoS/QoE-Aware Adaptive Online Orchestration in NFV-Enabled Networks

Optimal VNF Placement Via Deep Reinforcement Learning in SDN/NFV-Enabled Networks.

Online Fault-tolerant VNF Chain Placement: A Deep Reinforcement Learning Approach

DeepVNP:Virtual Network Placing with Deep Reinforcement Learning in Industrial IoT

Deep Reinforcement Learning (DRL)-based Resource Management in Software-Defined and Virtualized Vehicular Ad Hoc Networks

Deep Reinforcement Learning for Controller Placement in Software Defined Network

A Deep Reinforcement Learning-Based Approach for Adaptive SFC Deployment in Multi-Domain Networks