Abstract:Cloud computing has become a compelling paradigm built on compute and storage virtualization technologies. The current virtualization solution in the Cloud widely relies on hypervisor-based technologies. Given the recent booming of the container ecosystem, the container-based virtualization starts receiving more attention for being a promising alternative. Although the container technologies are generally considered to be lightweight, no virtualization solution is ideally resource-free, and the corresponding performance overheads will lead to negative impacts on the quality of Cloud services. To facilitate understanding container technologies from the performance engineering's perspective, we conducted two-stage performance investigations into Docker containers as a concrete example. At the first stage, we used a physical machine with “just-enough” resource as a baseline to investigate the performance overhead of a standalone Docker container against a standalone virtual machine (VM). With findings contrary to the related work, our evaluation results show that the virtualization's performance overhead could vary not only on a feature-by-feature basis but also on a job-to-job basis. Moreover, the hypervisor-based technology does not come with higher performance overhead in every case. For example, Docker containers particularly exhibit lower QoS in terms of storage transaction speed. At the ongoing second stage, we employed a physical machine with “fair-enough” resource to implement a container-based MapReduce application and try to optimize its performance. In fact, this machine failed in affording VM-based MapReduce clusters in the same scale. The performance tuning results show that the effects of different optimization strategies could largely be related to the data characteristics. For example, LZO compression can bring the most significant performance improvement when dealing with text data in our case. (Less)

Implementation and evaluation of a container management platform on Docker: Hadoop deployment as an example

Performance Evaluation of Docker Container and Virtual Machine

Two-Stage Performance Engineering of Container-based Virtualization

Performance evaluation of container-based virtualization for high performance computing environments

A Comparative Study of Containers and Virtual Machines in Big Data Environment

The research and implementation of cloud computing platform based on docker

Vhadoop: A Scalable Hadoop Virtual Cluster Platform for MapReduce-Based Parallel Machine Learning with Performance Consideration

Real-time network virtualization based on SDN and Docker container

Analysis of Big Data Platform with OpenStack and Hadoop.

Evaluate The Performance And Scalability Of Image Deployment In Virtual Data Center

Analyzing & modeling the performance in Xen-based virtual cluster environment

Evaluation of Docker Containers for Scientific Workloads in the Cloud

Research and implementation of intelligent monitoring for containerized PaaS

Containerization: Cloud Computing based Inspiration Technology for Adoption through Docker and Kubernetes

Performance Overhead Comparison between Hypervisor and Container based Virtualization

Containerisation for High Performance Computing Systems: Survey and Prospects

Performance Evaluation of Virtualized Hadoop Clusters

Resource Management Schemes for Cloud-Native Platforms with Computing Containers of Docker and Kubernetes

Experimental Assessment of Containers Running on Top of Virtual Machines

Performance Combinative Evaluation From Single Virtual Machine To Multiple Virtual Machine Systems

Enhanced beluga whale optimization-based container migration between virtual machines