Abstract:Graph stream, which represents an evolving graph updating as an infinite edge stream, is a special emerging graph data model widely adopted in big data analysis applications. Entirely storing the continuously produced and tremendously large-scale datasets is impractical. Therefore, graph stream summarization structures which support approximate graph stream storage and management attract much recent attention. Existing designs commonly leverage a compressive matrix and use hash-based schemes to map each edge to a bucket of the matrix. Accordingly, they store the edges associated with the same node in the same row or column of the matrix. We show that existing designs suffer from unacceptable query latency and precision in the presence of node degree skewness in graph streams.We argue that the key to efficient graph stream summarization is to identify the high-degree nodes and leverage a differentiated strategy for the associated edges. However, it is not trivial to estimate the degree of a node in real-time graph streams due to the rigorous requirements of space and time efficiency. Moreover, the existence of duplicate edges makes high-degree nodes identification difficult. To solve the problem, we propose Scube, an efficient summarization structure for skewed graph streams. Two factors contribute to the efficiency of Scube. First, Scube proposes a space and computation efficient probabilistic counting scheme to identify high-degree nodes in a graph stream. Second, Scube differentiates the storage strategy for the edges associated with high-degree nodes by dynamically allocating multiple rows or columns. We conduct comprehensive experiments to evaluate the performance of Scube on large-scale real-world datasets. The results show that Scube significantly reduces the query latency over a graph stream by 48%-99%, as well as achieving acceptable query accuracy compared to the state-of-the-art designs.

Horae: A Graph Stream Summarization Structure for Efficient Temporal Range Query

Persistent Graph Stream Summarization for Real-Time Graph Analytics

HIGGS: HIerarchy-Guided Graph Stream Summarization

Auxo: A Scalable and Efficient Graph Stream Summarization Structure.

Scube: Efficient Summarization for Skewed Graph Streams

Graph Stream Sketch: Summarizing Graph Streams with High Speed and Accuracy

Approximate Query on Historical Stream Data

Distributed scheduling and storage scheme based on LSM-OCTree for spatiotemporal stream

SIM: A Fast Real-Time Graph Stream Summarization with Improved Memory Efficiency and Accuracy

MRST—An Efficient Monitoring Technology of Summarization on Stream Data

Mayfly: a Neural Data Structure for Graph Stream Summarization.

HyperBit: A Temporal Graph Store for Fast Answering Queries.

Conditional Heavy Hitter Monitoring and Application of Heterogeneous Graph Streams Based on Sketches

TeGraph: A Novel General-Purpose Temporal Graph Computing Engine

An Efficient Keyword Search on Temporal Graphs

Approximate continuous querying over distributed streams

gSketch: On Query Estimation in Graph Streams

LSGraph: A Locality-centric High-performance Streaming Graph Engine.

Approximately Processing Multi-granularity Aggregate Queries over Data Streams

Stream Cube: an Architecture for Multi-Dimensional Analysis of Data Streams

A Cube Analytical Mining Framework for Stream Data