Abstract:As the size and service requirements of today's networks gradually increase, large numbers of proprietary devices are deployed, which leads to network complexity, information security crises and makes network service and service provider management increasingly difficult. Network function virtualization (NFV) technology is one solution to this problem. NFV separates network functions from hardware and deploys them as software on a common server. NFV can be used to improve service flexibility and isolate the services provided for each user, thus guaranteeing the security of user data. Therefore, the use of NFV technology includes many problems worth studying. For example, when there is a free choice of network path, one problem is how to choose a service function chain (SFC) that both meets the requirements and offers the service provider maximum profit. Most existing solutions are heuristic algorithms with high time efficiency, or integer linear programming (ILP) algorithms with high accuracy. It's necessary to design an algorithm that symmetrically considers both time efficiency and accuracy. In this paper, we propose the Q-learning Framework Hybrid Module algorithm (QLFHM), which includes reinforcement learning to solve this SFC deployment problem in dynamic networks. The reinforcement learning module in QLFHM is responsible for the output of alternative paths, while the load balancing module in QLFHM is responsible for picking the optimal solution from them. The results of a comparison simulation experiment on a dynamic network topology show that the proposed algorithm can output the approximate optimal solution in a relatively short time while also considering the network load balance. Thus, it achieves the goal of maximizing the benefit to the service provider.

External Memories of PDP Switches for In-Network Implementable Functions Placement: Deep Learning Based Reconfiguration of SFCs

Scheduling Reconfigurable Service Function Chain

LightNF: Simplifying Network Function Offloading in Programmable Networks

Efficient Service Reconfiguration with Partial Virtual Network Function Migration

Service Function Chain Placement for Joint Cost and Latency Optimization.

Programmable Device Deployment for Efficient Network Function Offloading

OptRec: an Efficient DRL-Based SFC Reconfiguration Optimization Framework in Programmable Networks

Parallel Placement of Virtualized Network Functions via Federated Deep Reinforcement Learning

Cutting Long-Tail Latency of Routing Response in Software Defined Networks.

NFCache: Fine-grained and Flexible Offloading of Network Functions to Programmable Switches.

A Reinforcement Learning Approach for Placement of Stateful Virtualized Network Functions

On-the-fly Traffic Classification and Control with a Stateful SDN Approach

St-Sfc: Optimizing Dynamic Deployment of Stateful SFCs on P4-Based PDP Switches

A New Realistic Platform for Benchmarking and Performance Evaluation of DRL-Driven and Reconfigurable SFC Provisioning Solutions

Flexible Offloading of Service Function Chains to Programmable Switches.

Optimizing Service Function Chain Mapping in Network Function Virtualization through Simultaneous NF Decomposition and VNF Placement

Automatic Performance-Optimal Offloading of Network Functions on Programmable Switches

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

A Q-Learning-Based Approach For Deploying Dynamic Service Function Chains

Hybrid Flow Table Installation: Optimizing Remote Placements of Flow Tables on Servers to Enhance PDP Switches for In-Network Computing

Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning