A System for Exploratory Analysis in Cloud

Liangchen Guo,Yazhong Zhang,Chang Lu,Yinan Jing,Zhenying He,X. Sean Wang
DOI: https://doi.org/10.1109/CSCloud/EdgeCom.2018.00014
2018-01-01
Abstract:This paper designs and implements a system which provides interactive data analysis services in cloud. These services allow users to analyze and explore large-scale in-cloud datasets quickly and interactively with a simple graphical user interface by leveraging the distributed computing ability of cloud data computing engine. The system decouples the analysis process and the computing engine. Users can construct the data flow graph in GUI, and review the results that are presented through the visualization tools. The back-end of the system is responsible for converting data flow graphs to the computation jobs that can be executed in cloud clusters. In addition, the system makes full use of the characteristics of overlapping results in the interactive analysis, and avoids repetitive computation through the caching mechanism. As a consequence, with this system, we make it easy and fast to perform interactive exploratory data analysis in cloud without losing flexibility.
What problem does this paper attempt to address?