Abstract:Virtualization of network functions (as virtual routers, virtual firewalls, etc.) enables network owners to efficiently respond to the increasing dynamicity of network services. Virtual Network Functions (VNFs) are easy to deploy, update, monitor, and manage. The number of VNF instances, similar to generic computing resources in cloud, can be easily scaled based on load. Hence, auto-scaling (of resources without human intervention) has been receiving attention. Prior studies on auto-scaling use measured network traffic load to dynamically react to traffic changes. In this study, we propose a proactive Machine Learning (ML) based approach to perform auto-scaling of VNFs in response to dynamic traffic changes. Our proposed ML classifier learns from past VNF scaling decisions and seasonal/spatial behavior of network traffic load to generate scaling decisions ahead of time. Compared to existing approaches for ML-based auto-scaling, our study explores how the properties (e.g., start-up time) of underlying virtualization technology impacts Quality of Service (QoS) and cost savings. We consider four different virtualization technologies: Xen and KVM, based on hypervisor virtualization, and Docker and LXC, based on container virtualization. Our results show promising accuracy of the ML classifier using real data collected from a private ISP. We report in-depth analysis of the learning process (learning-curve analysis), feature ranking (feature selection, Principal Component Analysis (PCA), etc.), impact of different sets of features, training time, and testing time. Our results show how the proposed methods improve QoS and reduce operational cost for network owners. We also demonstrate a practical use-case example (Software-Defined Wide Area Network (SD-WAN) with VNFs and backbone network) to show that our ML methods save significant cost for network service leasers.

RAS: Reliable auto-scaling of virtual machines in multi-tenant cloud networks

A Comparison of Machine Learning Algorithms for Automatic Cloud Resource Scaling on a Multi-Tenant Platform

MultiScaler: A Multi-Loop Auto-Scaling Approach for Cloud-Based Applications

RAS: A novel approach for dynamic resource allocation

Managing Recurrent Virtual Network Updates in Multi-Tenant Datacenters: A System Perspective

Smart-DRS: A Strategy of Dynamic Resource Scheduling in Cloud Data Center

Elastic and Efficient Virtual Network Provisioning for Cloud-Based Multi-Tier Applications

RPPS: A Novel Resource Prediction and Provisioning Scheme in Cloud Data Center

Auto-Scaling Network Resources using Machine Learning to Improve QoS and Reduce Cost

Self-Aware and Self-Adaptive Autoscaling for Cloud Based Services

Leveraging tenant flexibility in resource allocation for virtual networks

Agile auto scaling for supporting large scale cloud service platform

Secure multi-cloud resource allocation with SDN and self-adaptive authentication

ENSC: Multi-Resource Hybrid Scaling for Elastic Network Service Chain in Clouds

SRAF: A Service-Aware Resource Allocation Framework for VM Management in Mobile Data Networks

A Dynamic Scalable Auto-Scaling Model as a Load Balancer in the Cloud Computing Environment

Elastic Network Service Chain with Fine-Grained Vertical Scaling

Virtualization-based autonomic resource management for multi-tier Web applications in shared data center

Automatic Scaling of Internet Applications for Cloud Computing Services

Service-Oriented Resource Allocation in Clouds: Pursuing Flexibility and Efficiency

Cost-Aware Automatic Virtual Machine Scaling in Fine Granularity for Cloud Applications