Abstract:As the size and service requirements of today's networks gradually increase, large numbers of proprietary devices are deployed, which leads to network complexity, information security crises and makes network service and service provider management increasingly difficult. Network function virtualization (NFV) technology is one solution to this problem. NFV separates network functions from hardware and deploys them as software on a common server. NFV can be used to improve service flexibility and isolate the services provided for each user, thus guaranteeing the security of user data. Therefore, the use of NFV technology includes many problems worth studying. For example, when there is a free choice of network path, one problem is how to choose a service function chain (SFC) that both meets the requirements and offers the service provider maximum profit. Most existing solutions are heuristic algorithms with high time efficiency, or integer linear programming (ILP) algorithms with high accuracy. It's necessary to design an algorithm that symmetrically considers both time efficiency and accuracy. In this paper, we propose the Q-learning Framework Hybrid Module algorithm (QLFHM), which includes reinforcement learning to solve this SFC deployment problem in dynamic networks. The reinforcement learning module in QLFHM is responsible for the output of alternative paths, while the load balancing module in QLFHM is responsible for picking the optimal solution from them. The results of a comparison simulation experiment on a dynamic network topology show that the proposed algorithm can output the approximate optimal solution in a relatively short time while also considering the network load balance. Thus, it achieves the goal of maximizing the benefit to the service provider.

An Approach for Service Function Chain Reconfiguration in Network Function Virtualization Architectures.

Scheduling Reconfigurable Service Function Chain

Efficient Service Reconfiguration with Partial Virtual Network Function Migration

On Dynamic Service Function Chain Reconfiguration in IoT Networks

An online service function chain orchestration method for profit maximization in edge computing networks

On Dynamic Service Function Chain Deployment and Readjustment

Service Function Chain Placement for Joint Cost and Latency Optimization.

Dynamic Heuristic for the Recomposition of Service Function Chain

A Dynamic Placement Mechanism of Service Function Chaining Based on Software-defined Networking.

A Multi-Stage Approach for Virtual Network Function Migration and Service Function Chain Reconfiguration in NFV-enabled Networks

Virtual network function placement and resource optimization in NFV and edge computing enabled networks.

A Lagrangian-Relaxation-Based Approach for Service Function Chain Dynamic Orchestration for the Internet of Things

Design and Evaluation of Schemes for Provisioning Service Function Chain with Function Scalability.

Cost-Efficient Virtual Network Function Placement and Traffic Steering

Network Function Consolidation in Service Function Chaining Orchestration

A Q-Learning-Based Approach For Deploying Dynamic Service Function Chains

Constructing Service Function Chain Test Database: an Optimal Modeling Approach for Coordinated Resource Allocation.

Application-Driven Provisioning of Service Function Chains Over Heterogeneous NFV Platforms

Research on Deployment of Service Function Chains under Hybrid Network Functions

Near-Optimal Deployment of Service Chains by Exploiting Correlations Between Network Functions

Efficient Online Scheduling of Service Function Chains Across Multiple Geo-Distributed Regions