Abstract:Network function virtualization (NFV) is a promising paradigm where network functions are migrated from dedicated hardware appliances onto software middleboxes to promote service agility and reduce management costs. Benefiting from the NFV, the service function chain (SFC) has emerged as a popular network service form. It allows network traffic to pass through a series of virtual network functions in a specific order required by the business logic to arrange a complex service. However, SFC deployment is facing new challenges in seeking a trade-off between pursuing the objective of high long-term average revenue and making decisions in an online manner. In this paper, we propose DRL-D, a deep reinforcement learning-based approach for the online SFC deployment problem to satisfy different demands of SFC requests within resource constraints of the underlying infrastructure. DRL-D aims to maximize the long-term average revenue by combining the strengths of the graph convolutional network in learning a comprehensive representation of network state and the temporal-difference learning in generating deployment solutions for the SFC requests on the fly. Then a heuristic algorithm and a new prioritized experience replay technique are integrated to optimize the DRL framework and reduce the time complexity. Experimental results demonstrate the superiority of our DRL-D approach when compared with other benchmarks in terms of the long-term average revenue, acceptance ratio, and revenue-to-cost ratio. Performance evaluation shows that DRL-D possesses good robustness under different scales of physical networks and achieves excellent deployment performance within acceptable runtime.

NFVdeep

Scheduling Reconfigurable Service Function Chain

Efficient Service Reconfiguration with Partial Virtual Network Function Migration

Online Fault-tolerant VNF Chain Placement: A Deep Reinforcement Learning Approach

Dynamic Backup Sharing Scheme of Service Function Chains in NFV

Fault Tolerance Oriented SFC Optimization in SDN/NFV-Enabled Cloud Environment Based on Deep Reinforcement Learning

DDQP: A Double Deep Q-Learning Approach to Online Fault-Tolerant SFC Placement

Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning

Parallel Placement of Virtualized Network Functions via Federated Deep Reinforcement Learning

Two-Phase Virtual Network Function Selection and Chaining Algorithm Based on Deep Learning in SDN/NFV-Enabled Networks

Service Function Chain Embedding Meets Machine Learning: Deep Reinforcement Learning Approach

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

Online VNF Chaining and Predictive Scheduling: Optimality and Trade-offs

Proactive Vnf Provisioning With Multi-Timescale Cloud Resources: Fusing Online Learning And Online Optimization

On Dynamic Service Function Chain Deployment and Readjustment

Service Function Chain Placement for Joint Cost and Latency Optimization.

Traffic Prediction-Based VNF Auto-Scaling and Deployment Mechanism for Flexible and Elastic Service Provision

Energy-delay-aware VNF scheduling: a reinforcement learning approach with hierarchical reward enhancement

Multi-Timescale Online Optimization of Network Function Virtualization for Service Chaining

Dynamic Prioritization and Adaptive Scheduling using Deep Deterministic Policy Gradient for Deploying Microservice-based VNFs

Towards deploying SFC with parallelized VNFs under resource demand uncertainty in mobile edge computing