Distributed Query Engine For Multiple-Query Optimization Over Data Stream

Junye Yang,Yong Zhang,Jin Wang,Chunxiao Xing
DOI: https://doi.org/10.1007/978-3-030-18590-9_79
2019-01-01
Abstract:Query processing over data stream has attracted much attention in real-time applications. While many efforts have been paid for query processing of data streams in distributed environment, no previous study focused on multiple-query optimization. To address this problem, we propose EsperDist, a distributed query engine for multiple-query optimization over data stream. EsperDist can significant reduce the overhead of network transmission and memory usage by reusing operators in the query plan. Moreover, EsperDist also makes best effort to minimize the query cost so as to avoid resource bottle neck in a single machine. In this demo, we will present the architecture and work-flow of EsperDist using datasets collected from real world applications. We also propose a user-friendly to monitor query results and interact with the system in real time.
What problem does this paper attempt to address?