Abstract:Network function virtualization (NFV) is a promising paradigm where network functions are migrated from dedicated hardware appliances onto software middleboxes to promote service agility and reduce management costs. Benefiting from the NFV, the service function chain (SFC) has emerged as a popular network service form. It allows network traffic to pass through a series of virtual network functions in a specific order required by the business logic to arrange a complex service. However, SFC deployment is facing new challenges in seeking a trade-off between pursuing the objective of high long-term average revenue and making decisions in an online manner. In this paper, we propose DRL-D, a deep reinforcement learning-based approach for the online SFC deployment problem to satisfy different demands of SFC requests within resource constraints of the underlying infrastructure. DRL-D aims to maximize the long-term average revenue by combining the strengths of the graph convolutional network in learning a comprehensive representation of network state and the temporal-difference learning in generating deployment solutions for the SFC requests on the fly. Then a heuristic algorithm and a new prioritized experience replay technique are integrated to optimize the DRL framework and reduce the time complexity. Experimental results demonstrate the superiority of our DRL-D approach when compared with other benchmarks in terms of the long-term average revenue, acceptance ratio, and revenue-to-cost ratio. Performance evaluation shows that DRL-D possesses good robustness under different scales of physical networks and achieves excellent deployment performance within acceptable runtime.

Delay Constrained SFC Orchestration for Edge Intelligence-Enabled IIoT: A DRL Approach

Distributed Orchestration of Service Function Chains for Edge Intelligence in the Industrial Internet of Things

Dynamic Service Function Chain Orchestration for NFV/MEC-Enabled IoT Networks: A Deep Reinforcement Learning Approach

Trusted Cloud-Edge Network Resource Management: DRL-Driven Service Function Chain Orchestration for IoT.

DRL-Based Two-Stage SFC Deployment Approach under Latency Constraints

DRL-Based Service Function Chain Edge-to-Edge and Edge-to-Cloud Joint Offloading in Edge-Cloud Network

SFC Orchestration Method for Edge Cloud and Central Cloud Collaboration: QoS and Energy Consumption Joint Optimization Combined with Reputation Assessment

Deep Reinforcement Learning-based Dynamic SFC Deployment in IoT-MEC Networks

On Dynamic Service Function Chain Reconfiguration in IoT Networks

SFC Embedding Meets Machine Learning: Deep Reinforcement Learning Approaches.

A Multi-Agent Reinforcement Learning Scheme for SFC Placement in Edge Computing Networks

DRL-Based VNF Cooperative Scheduling Framework with Priority-Weighted Delay

A Double-Timescale Reinforcement Learning Based Cloud-Edge Collaborative Framework for Decomposable Intelligent Services in Industrial Internet of Things

Cloud–Edge Collaborative SFC Mapping for Industrial IoT Using Deep Reinforcement Learning

Delay-Sensitive SFC Scheduling Optimization with DRL in Satellite-Terrestrial Networks

TF-DDRL: A Transformer-enhanced Distributed DRL Technique for Scheduling IoT Applications in Edge and Cloud Computing Environments

Deep Reinforcement Learning for Scheduling in an Edge Computing-Based Industrial Internet of Things

QoS-Driven Distributed Cooperative Data Offloading and Heterogeneous Resource Scheduling for IIoT

Joint Optimization of Energy Consumption and Latency Based on DRL: an Edge Server Activation and Task Scheduling Scheme in IIoT.

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

A New Scheme for IoT Service Function Chains Orchestration in SDN-IoT Network Systems