Abstract:A bipartite graph extensively models relationships between real-world entities of two different types, such as user-product data in e-commerce. Such graph data are inherently becoming more and more streaming, entailing continuous insertions and deletions of edges. A butterfly (i.e., 2x2 bi-clique) is the smallest non-trivial cohesive structure that plays a crucial role. Counting such butterfly patterns in streaming bipartite graphs is a core problem in applications such as dense subgraph discovery and anomaly detection. Yet, existing approximate solutions consider insert-only streams and, thus, achieve very low accuracy in fully dynamic bipartite graph streams that involve both insertions and deletions of edges. Adapting them to consider deletions is not trivial either, because different sampling schemes and new accuracy analyses are required. In this paper, we propose Abacus, a novel approximate algorithm that counts butterflies in the presence of both insertions and deletions by utilizing sampling. We prove that Abacus always delivers unbiased estimates of low variance. Furthermore, we extend Abacus and devise a parallel mini-batch variant, namely, Parabacus, which counts butterflies in parallel. Parabacus counts butterflies in a load-balanced manner using versioned samples, which results in significant speedup and is thus ideal for critical applications in the streaming environment. We evaluate Abacus/Parabacus using a diverse set of real bipartite graphs and assess its performance in terms of accuracy, throughput, and speedup. The results indicate that our proposal is the first capable of efficiently providing accurate butterfly counts in the most generic setting, i.e., a fully dynamic graph streaming environment that entails both insertions and deletions. It does so without sacrificing throughput and even improving it with the parallel version.

SGES: A General and Space-efficient Framework for Graphlet Counting in Graph Streams

A Fast Sampling Method of Exploring Graphlet Degrees of Large Directed and Undirected Graphs.

A general framework for estimating graphlet statistics via random walk

Graph Stream Sketch: Summarizing Graph Streams with High Speed and Accuracy

Compact Estimator for Streaming Triangle Counting

Approximately Counting Triangles in Large Graph Streams Including Edge Duplicates with A Fixed Memory Usage

Space-Efficient Subgraph Search Over Streaming Graph With Timing Order Constraint

Time Constrained Continuous Subgraph Search over Streaming Graphs

Reinforcement Learning Enhanced Weighted Sampling for Accurate Subgraph Counting on Fully Dynamic Graph Streams

SBG-Sketch: A Self-Balanced Sketch for Labeled-Graph Stream Summarization

Global triangle estimation based on first edge sampling in large graph streams

Distributed Triangle Approximately Counting Algorithms in Simple Graph Stream

Counting Triangles in Real-World Graph Streams: Dealing with Repeated Edges and Time Windows

Counting Butterflies in Fully Dynamic Bipartite Graph Streams

Sampling Content Distributed Over Graphs

Clustering-Structure Representative Sampling from Graph Streams.

gSketch: On Query Estimation in Graph Streams

Learning-Based Dynamic Graph Stream Sketch

Faster Streaming and Scalable Algorithms for Finding Directed Dense Subgraphs in Large Graphs

Anomaly Detection over Streaming Graphs with Finger-Based Higher-Order Graph Sketch

Sampling Graphlets of Multiplex Networks: A Restricted Random Walk Approach