Abstract:Effective Service Function Chains (SFCs) mapping and Virtual Network Functions (VNFs) scheduling are crucial to ensure high-quality service provision for Internet of Things (IoT) tasks. Meeting the varying demands of multiple SFCs poses a significant challenge, particularly when working with the limited resources available in edge computing networks. Most existing working focuses on uniformly mapping and scheduling service requests in a batch processing manner within a given time period, without taking the diversity and priority of VNFs into account. When there is a sudden surge in demand, the issues of VNF queueing waiting and resources imbalance become prominent. To address the mentioned issues, this paper proposes a Deep Reinforcement Learning (DRL)-based VNF cooperative scheduling framework with priority-weighted delay. In light of the urgency of VNFs with higher priorities and the limitations of available resources, we begin by modeling an average queuing delay with priority weight based on the shortest remaining time priority technique. We then formulate a mathematical optimization problem to minimize the modeled delay in VNF scheduling process while providing suitable multidimensional resources in the edge network. Finally, a DRL method with experience replay and target Q-network is designed to effectively obtain the optimal solutions of the optimization problem from experience. The experimental results show that our proposed method outperforms its peers in terms of SFC request acceptance, delay, load balance, and resource utilization.

Fair Virtual Network Function Scheduling with Deep Reinforcement Learning

Reinforcement Learning Based Vnf Scheduling With End-To-End Delay Guarantee

Fair Virtual Network Function Mapping and Scheduling Using Proximal Policy Optimization.

Delay-Aware VNF Scheduling: A Reinforcement Learning Approach with Variable Action Set

Scheduling Reconfigurable Service Function Chain

Energy-delay-aware VNF scheduling: a reinforcement learning approach with hierarchical reward enhancement

AI-based software-defined virtual network function scheduling with delay optimization

Online Virtual Network Function Scheduling Towards Deterministic Latency

DRL-Based VNF Cooperative Scheduling Framework with Priority-Weighted Delay

Dynamic Scheduling of IoV Edge Cloud Service Functions under NFV: A Multi-Agent Reinforcement Learning Approach

Parallel Placement of Virtualized Network Functions via Federated Deep Reinforcement Learning

Optimal VNF Placement Via Deep Reinforcement Learning in SDN/NFV-Enabled Networks.

Intelligent VNF Orchestration and Flow Scheduling Via Model-Assisted Deep Reinforcement Learning

Network Resource Allocation Strategy Based on Deep Reinforcement Learning

Fairness-aware Dynamic Rate Control and Flow Scheduling for Network Function Virtualization.

Effective Scheduling Function Design in SDN through Deep Reinforcement Learning

Energy-Efficient and Interference-Aware VNF Placement with Deep Reinforcement Learning

Applications of Reinforcement Learning in Virtual Network Function Placement: A Survey.

A Reliable Resource Scheduling for Network Function Virtualization.

On Dynamic Mapping and Scheduling of Service Function Chains in SDN/NFV-Enabled Networks

DeepVNP:Virtual Network Placing with Deep Reinforcement Learning in Industrial IoT