Abstract:Effective Service Function Chains (SFCs) mapping and Virtual Network Functions (VNFs) scheduling are crucial to ensure high-quality service provision for Internet of Things (IoT) tasks. Meeting the varying demands of multiple SFCs poses a significant challenge, particularly when working with the limited resources available in edge computing networks. Most existing working focuses on uniformly mapping and scheduling service requests in a batch processing manner within a given time period, without taking the diversity and priority of VNFs into account. When there is a sudden surge in demand, the issues of VNF queueing waiting and resources imbalance become prominent. To address the mentioned issues, this paper proposes a Deep Reinforcement Learning (DRL)-based VNF cooperative scheduling framework with priority-weighted delay. In light of the urgency of VNFs with higher priorities and the limitations of available resources, we begin by modeling an average queuing delay with priority weight based on the shortest remaining time priority technique. We then formulate a mathematical optimization problem to minimize the modeled delay in VNF scheduling process while providing suitable multidimensional resources in the edge network. Finally, a DRL method with experience replay and target Q-network is designed to effectively obtain the optimal solutions of the optimization problem from experience. The experimental results show that our proposed method outperforms its peers in terms of SFC request acceptance, delay, load balance, and resource utilization.

Delay-Aware VNF Scheduling: A Reinforcement Learning Approach with Variable Action Set

Reinforcement Learning Based Vnf Scheduling With End-To-End Delay Guarantee

Energy-delay-aware VNF scheduling: a reinforcement learning approach with hierarchical reward enhancement

Fair Virtual Network Function Scheduling with Deep Reinforcement Learning

Delay-Aware Resource Management for Multi-Service Coexisting LTE-D2D Networks with Wireless Network Virtualization

DRL-Based VNF Cooperative Scheduling Framework with Priority-Weighted Delay

On Dynamic Mapping and Scheduling of Service Function Chains in SDN/NFV-Enabled Networks

AI-based software-defined virtual network function scheduling with delay optimization

Optimal VNF Placement Via Deep Reinforcement Learning in SDN/NFV-Enabled Networks.

Effective Scheduling Function Design in SDN through Deep Reinforcement Learning

Intelligent VNF Orchestration and Flow Scheduling Via Model-Assisted Deep Reinforcement Learning

A reinforcement learning method for scheduling service function chains with multi-resource constraints

Leveraging Deep Reinforcement Learning with Attention Mechanism for Virtual Network Function Placement and Routing

Age of Information Aware VNF Scheduling in Industrial IoT Using Deep Reinforcement Learning

Multi-Resource Scheduling for Multiple Service Function Chains with Deep Reinforcement Learning

NFVdeep

Fair and delay adaptive scheduler for UC and NGN networks

A Reinforcement Learning Approach for Virtual Network Function Chaining and Sharing in Softwarized Networks

Two-Phase Virtual Network Function Selection and Chaining Algorithm Based on Deep Learning in SDN/NFV-Enabled Networks

Online Virtual Network Function Scheduling Towards Deterministic Latency

Joint VNF Placement and Scheduling for Latency-sensitive Services