Abstract:As the size and service requirements of today's networks gradually increase, large numbers of proprietary devices are deployed, which leads to network complexity, information security crises and makes network service and service provider management increasingly difficult. Network function virtualization (NFV) technology is one solution to this problem. NFV separates network functions from hardware and deploys them as software on a common server. NFV can be used to improve service flexibility and isolate the services provided for each user, thus guaranteeing the security of user data. Therefore, the use of NFV technology includes many problems worth studying. For example, when there is a free choice of network path, one problem is how to choose a service function chain (SFC) that both meets the requirements and offers the service provider maximum profit. Most existing solutions are heuristic algorithms with high time efficiency, or integer linear programming (ILP) algorithms with high accuracy. It's necessary to design an algorithm that symmetrically considers both time efficiency and accuracy. In this paper, we propose the Q-learning Framework Hybrid Module algorithm (QLFHM), which includes reinforcement learning to solve this SFC deployment problem in dynamic networks. The reinforcement learning module in QLFHM is responsible for the output of alternative paths, while the load balancing module in QLFHM is responsible for picking the optimal solution from them. The results of a comparison simulation experiment on a dynamic network topology show that the proposed algorithm can output the approximate optimal solution in a relatively short time while also considering the network load balance. Thus, it achieves the goal of maximizing the benefit to the service provider.

Towards Chain-Aware Scaling Detection in NFV with Reinforcement Learning

Scheduling Reconfigurable Service Function Chain

FastScale: Fast Scaling out of Network Functions

Scaling Geo-Distributed Network Function Chains: A Prediction and Learning Framework

Scalable Orchestration of Service Function Chains in NFV-Enabled Networks: A Federated Reinforcement Learning Approach

Reliable Service Function Chain Deployment Method Based on Deep Reinforcement Learning

A Reinforcement Learning Approach for Virtual Network Function Chaining and Sharing in Softwarized Networks

Service Function Chain Embedding Meets Machine Learning: Deep Reinforcement Learning Approach

DRL-D: Revenue-Aware Online Service Function Chain Deployment Via Deep Reinforcement Learning

Online Scaling of NFV Service Chains across Geo-distributed Datacenters

GSDM: Graph-based Scaling Detection Model in Network Function Virtualization

ENSC: Multi-Resource Hybrid Scaling for Elastic Network Service Chain in Clouds

Elastic Network Service Chain with Fine-Grained Vertical Scaling

Two-Phase Virtual Network Function Selection and Chaining Algorithm Based on Deep Learning in SDN/NFV-Enabled Networks

A Deep Reinforcement Learning-Based Algorithm for Reliability-Aware Multi-Domain Service Deployment in Smart Ecosystems

A Q-Learning-Based Approach For Deploying Dynamic Service Function Chains

Co-Scaler: Cooperative Scaling of Software-Defined NFV Service Function Chain.

Online VNF Chaining and Predictive Scheduling: Optimality and Trade-offs

Energy-delay-aware VNF scheduling: a reinforcement learning approach with hierarchical reward enhancement

Using Reinforcement Learning to Allocate and Manage Service Function Chains in Cellular Networks

Proactive Auto-Scaling for Service Function Chains in Cloud Computing Based on Deep Learning