Abstract:The inherent structure and connectivity of a group are important features of social networks. Finding the densest subgraphs of a graph directly maps to revealing the densest communities of a social network. Various techniques, e.g., edge density, k-core, near-cliques and k-cliques, have been developed to characterize graphs and extract the densest subgraphs of the graphs. However, as extraction of subgraphs with constraints is NP-hard, these techniques face a major difficulty of processing big and/or streaming data sets from social networks. This demands new methods from the expert and intelligent systems perspective for computation of the densest subgraph problem (DSP) with big and/or streaming data. The most recent method for this purpose is the "Sampling" method. It samples the big data sets, thus reducing the data space and consequently speeding up the DSP computation. But the sampled data inevitably miss out many useful data items. A new approach is presented in this paper for accelerated DSP computation with big and/or steaming data through data space reduction without loss of useful information. It uses a sliding window of small graphs with a fixed number of edges. Then, it filters out the least connected edges for each small graph. While the small graphs are processed, subgraphs are incrementally put together to reveal the densest subgraphs. Finally, the data space previously filtered out is checked for recovery of globally important edges. The approach is incorporated with existing subgraph extraction techniques for scalable and efficient DSP computation with improved accuracy. It is demonstrated for four subgraph extraction techniques over four Twitter data sets, and is shown to outperform the "sampling" method. (C) 2017 Elsevier Ltd. All rights reserved.

Slither: Finding Local Dense Subgraphs Measured by Average Degree

Efficient Algorithms for Densest Subgraph Discovery

Mining Density Contrast Subgraphs

Locally Densest Subgraph Discovery

In-depth Analysis of Densest Subgraph Discovery in a Unified Framework

On Finding Dense Subgraphs in Bipartite Graphs: Linear Algorithms

Local Breadth-first Expansion and Shrinking for Densest Subgraph Detection

In Search of Dense Subgraphs: How Good is Greedy Peeling?

Efficient and Effective Anchored Densest Subgraph Search: A Convex-programming Based Approach

Faster Streaming and Scalable Algorithms for Finding Directed Dense Subgraphs in Large Graphs

Finding Dense Subgraphs with Maximum Weighted Triangle Density

Finding a Dense Subgraph with Sparse Cut

DIGRank: using global degree to facilitate ranking in an incomplete graph.

Efficient Processing of Subsequent Densest Subgraph Query

An Improved Search Strategy for Even Degree Distribution Networks.

Discovering Densest Subgraph over Heterogeneous Information Networks.

Dense subgraphs induced by edge labels

Revealing the Densest Communities of Social Networks Efficiently Through Intelligent Data Space Reduction.

Finding Subgraphs with Maximum Total Density and Limited Overlap in Weighted Hypergraphs

Multiplicative Weights Update, Area Convexity and Random Coordinate Descent for Densest Subgraph Problems

Efficient and effective algorithms for densest subgraph discovery and maintenance