Abstract:The set similarity join finds all pairs of similar sets from two collections of sets. It has many real world applications, such as personalized recommendation and community mining. In this paper, we study the problem of computing the similarity join in a dynamic context, where the sets are updated dynamically. This, however, is inefficient with the state-of-the-art join methods, because they usually assume that data collections are static and have to compute the join result from scratch whenever a set is updated. To address this issue, we propose ${{\sf ALJoin}}$ , an adaptive filtering approach that computes the join result incrementally based on the update logs. We first investigate the effect of set updates on the similarity values, and on this basis we propose to build a neighborhood index for each set. The neighborhood index of a specific set consists of any other sets that can be transformed into its similar sets within a threshold number of update operations. ${{\sf ALJoin}}$ then uses this index to effectively identify both similar and dissimilar set pairs based on their update logs. To efficiently build the neighborhood index, we devise several filtering techniques and propose a “lazy-forward” method to reduce the computational cost. In addition, to improve the efficiency on varying workloads, we propose an analytical cost model, and design an online algorithm with performance guarantees to dynamically consolidate the update logs and adapt the neighborhood indexes. We evaluated our method using four real-world datasets. Experimental results show that our approach outperforms existing methods by up to $3.7\times$ .

Efficient Subgraph Join Based on Connectivity Similarity

Efficient graph similarity join for information integration on graphs

Efficient SimRank-based Similarity Join over Large Graphs.

Graph Similarity Join with K-Hop Tree Indexing

Fast Similar Subgraph Search with Maximum Common Connected Subgraph Constraints

Efficient Graph Similarity Search over Large Graph Databases

Efficient and Accurate SimRank-Based Similarity Joins: Experiments, Analysis, and Improvement

Learning-based Efficient Graph Similarity Computation via Multi-Scale Convolutional Set Matching

Graph Partitioning and Graph Neural Network Based Hierarchical Graph Matching for Graph Similarity Computation

An Efficient Probabilistic Approach for Graph Similarity Search

An Efficient MapReduce Algorithm for Similarity Join in Metric Spaces

Measuring Similarity of Graphs and their Nodes by Neighbor Matching

Efficient Parallel Partition-Based Algorithms for Similarity Search and Join with Edit Distance Constraints

A Graph Similarity Algorithm Based on Graph Partitioning and Attention Mechanism

K-Join: Knowledge-Aware Similarity Join

Dynamic Set Similarity Join: an Update Log Based Approach

An Efficient Partition Based Method for Exact Set Similarity Joins

Efficient Top-K SimRank-based Similarity Join.

Approximate Subgraph Matching Query over Large Graph.

Towards Distributed Node Similarity Search on Graphs

Hybrid Subgraph Matching Framework Powered by Sketch Tree for Distributed Systems