Abstract:Modern data center consists of thousands of servers, racks and switches. Complicated structure means it requires well-designed algorithms to utilize resources of data centers efficiently. Current virtual machine scheduling algorithms mainly focus on the initial allocation of virtual machines based on the CPU, memory and network bandwidth requirements. However, when tasks finished or lease expired, related virtual machines would be deleted from the system which would generate resource fragments. Such fragments lead to unbalanced resource utilization and decline of communication performance. This paper investigates the network influence on typical applications in data centers and proposed a self-adaptive network-aware virtual machine clustering and consolidation algorithm to maintain an optimal system-wide status. Our consolidation algorithm periodically checks whether consolidation is necessary and then clusters and consolidates virtual machines to lower communication cost with an online heuristic. We used two benchmarks in a real environment to examine network influence on different tasks. To evaluate the advantages of the proposed algorithm, we also built a cloud computing testbed. Real workload trace-driven simulations and testbed-based experiments showed that, our algorithm greatly shortened the average finish time of map-reduce tasks and reduced time delay of web applications. Simulation results showed that our algorithm considerably reduced the amount of high-delay jobs, lowered the average traffic passed through aggregate switches and improved the communication ability among virtual machines.

Communication Mode of Computer Cluster Network in Cloud Environment based on Neural Computing

Efficient Partitioning and Communication Scheme-Based Distributed Edge Computing to Accelerate Deep Neural Network

A Novel Job Scheduling Model to Enhance Efficiency and Overall User Fairness of Cloud Computing Environment.

Cloud computing model for big data processing and performance optimization of multimedia communication

A Policy of Task Allocation Base on Distributed Cluster Computing Towards Cloud

CLUSTER-BASED OCEAN REMOTE SENSING IMAGE FUSION PARALLEL COMPUTING STRATEGY

Distance-aware Virtual Cluster Performance Optimization: A Hadoop Case Study

A Rendering Cloud Frame Based on 3D-Graphics-Accelerating Technique for Virtualization

Sdn Based Vxlan Optimization In Cloud Computing Networks

Autonomous Mobile Learning Model of Cloud Education Based on Intelligent Algorithm of Wireless Network Communication

A collaborative cloud-edge computing framework in distributed neural network

A MODEL OF DISTRIBUTED NETWORK COMPUTER SYSTEM DOMAIN AND THE FILE SYSTEM

Cloud Computing Based Network Analysis in Smart Healthcare System with Neural Network Architecture

Distributed Cache Memory Data Migration Strategy Based on Cloud Computing

Fuzzy Method and Neural Network Model Parallel Implementation of Multi-Layer Neural Network Based on Cloud Computing for Real Time Data Transmission in Large Offshore Platform

Improving performance by network-aware virtual machine clustering and consolidation

Fuzzy Weighted Clustering Method for Numerical Attributes of Communication Big Data Based on Cloud Computing

The Transplantation Technology of Communication Intensive Applications on Heterogeneous Clusters.

Cluster-Aware Virtual Machine Collaborative Migration in Media Cloud

A New Network Storage Architecture of Cache-Cluster Based on Scheduling Decision Strategy

A Novel Node Selection Method for Real-Time Collaborative Computation in Cloud