Abstract:strongly connected component ( 𝖲𝖢𝖢 ) is a maximal subgraph of a directed graph G in which every pair of nodes is reachable from each other in the 𝖲𝖢𝖢 . With such a property, a general directed graph can be represented by a directed acyclic graph ( DAG ) by contracting every 𝖲𝖢𝖢 of G to a node in DAG . In many real applications that need graph pattern matching, topological sorting, or reachability query processing, the best way to deal with a general directed graph is to deal with its DAG representation. Therefore, finding all 𝖲𝖢𝖢 s in a directed graph G is a critical operation. The existing in-memory algorithms based on depth first search ( DFS ) can find all 𝖲𝖢𝖢 s in linear time with respect to the size of a graph. However, when a graph cannot reside entirely in the main memory, the existing external or semi-external algorithms to find all 𝖲𝖢𝖢 s have limitation to achieve high I/O efficiency. In this paper, we study new I/O-efficient semi-external algorithms to find all 𝖲𝖢𝖢 s for a massive directed graph G that cannot reside in main memory entirely. To overcome the deficiency of the existing DFS -based semi-external algorithm that heavily relies on a total order, we explore a weak order based on which we investigate new algorithms. We propose a new two-phase algorithm, namely, tree construction and tree search. In the tree construction phase, a spanning tree of G can be constructed in bounded number of sequential scans of G . In the tree search phase, it needs to sequentially scan the graph once to find all 𝖲𝖢𝖢 s. In addition, we propose a new single-phase algorithm, which combines the tree construction and tree search phases into a single phase, with three new optimization techniques. They are early acceptance, early rejection, and batch processing. By the single-phase algorithm with the new optimization techniques, we can significantly reduce the number of I/Os and the CPU cost. We prove the correctness of the algorithms. We conduct extensive experimental studies using 4 real datasets including a massive real dataset and several synthetic datasets to confirm the I/O efficiency of our approaches.

A Hybrid Evolutionary Algorithm for Finding Low Conductance of Large Graphs

Scalable and Effective Conductance-based Graph Clustering

Efficient Search in Networks Using Conductance

A Hybrid Graph-drawing Algorithm for Large, Naturally-clustered, Disconnected Graphs

Highly Connected Graph Partitioning: Exact Formulation and Solution Methods

Local Graph Edge Partitioning with a Two-Stage Heuristic Method.

Frequent Itemset-driven Search for Finding Minimum Node Separators in Complex Networks

Practical and high-quality partitioning algorithm for large-scale and time-evolving graphs

A Feasible Graph Partition Framework for Parallel Computing of Big Graph

A parallel graph partitioning algorithm to speed up the large-scale distributed graph mining.

Optimizing Graph Partition by Optimal Vertex-Cut: A Holistic Approach.

Enhancing Balanced Graph Edge Partition with Effective Local Search

Engineering a scalable high quality graph partitioner

Minimize the Average Mean First Passage Time of Random Walk in Complex Networks by Genetic Algorithm.

Brief Announcement: Distributed Unconstrained Local Search for Multilevel Graph Partitioning

I/O efficient: computing SCCs in massive graphs

In Search of Dense Subgraphs: How Good is Greedy Peeling?

Genetic Algorithm with a Novel Leiden-based Mutation Operator for Community Detection

Edge-set reduction to efficiently solve the graph partitioning problem with the genetic algorithm

A Network Reduction-Based Multiobjective Evolutionary Algorithm for Community Detection in Large-Scale Complex Networks

A Fast Tri-Individual Memetic Search Approach for the Distance-Based Critical Node Problem