Abstract:Social networks have been part of people's daily life and plenty of users have registered accounts in multiple social networks. Interconnections among multiple social networks add a multiplier effect to social applications when fully used. With the sharp expansion of network size, traditional standalone algorithms can no longer support computing on large scale networks while alternatively, distributed and parallel computing become a solution to utilize the data-intensive information hidden in multiple social networks. As such, synergistic partitioning, which takes the relationships among different networks into consideration and focuses on partitioning the same nodes of different networks into same partitions. With that, the partitions containing the same nodes can be assigned to the same server to improve the data locality and reduce communication overhead among servers, which are very important for distributed applications. To date, there have been limited studies on multiple large scale network partitioning due to three major challenges: 1) the need to consider relationships across multiple networks given the existence of intricate interactions, 2) the difficulty for standalone programs to utilize traditional partitioning methods, 3) the fact that to generate balanced partitions is NP-complete. In this paper, we propose a novel framework to partition multiple social networks synergistically. In particular, we apply a distributed multilevel k-way partitioning method to divide the first network into k partitions. Based on the given anchor nodes which exist in all the social networks and the partition results of the first network, using MapReduce, we then develop a modified distributed multilevel partitioning method to divide other networks. Extensive experiments on two real data sets demonstrate that our method can significantly outperform baseline independent-partitioning method in accuracy and scalability.

A Two-Tier Partition Algorithm for the Optimization of the Large-Scale Simulation of Information Diffusion in Social Networks.

Design and Implementation of Information Dissemination Simulation Algorithm in Large-Scale Complex Network Based on Spark.

Synergistic partitioning in multiple large scale social networks

CommPar: A Community-Based Model Partitioning Approach for Large-Scale Networked Social Dynamics Simulation.

Partitioning Large-Scale Artificial Society on Distributed Cluster with Statistical Movement Graph

An Optimized Partitioning Algorithm for Complex Network Based on Social Simulations on Cluster Computing Platform

Graph partitioning method for social networks based on communication load balancing

Design and Implementation of Large-Scale Network Propagation Simulation Method Inspired by Pregel Mechanism

Towards a Distributed Local-Search Approach for Partitioning Large-Scale Social Networks.

Optimizing Data Center Traffic of Online Social Networks

Distributed Node Covering Optimization for Large Scale Networks and Its Application on Social Advertising

Dynamic Partition and Replication Algorithm for Storage Capacity Limited Distributed Social Network

Parallel K-Way Partitioning Approach for Large Graphs

Data placement approach for scalable online social networks

Divide and Conquer: Partitioning Online Social Networks

Modeling and Simulation of Large-Scale Social Networks Using Parallel Discrete Event Simulation

Parallel Algorithm for Discovering Communities in Large-Scale Complex Networks

Analyzing the parallelization and structural impact of machine learning algorithms in social networks: a simulation-based approach

A Parallel Graph Partitioning Approach to Enhance Community Detection in Social Networks

A New Graph-Partitioning Algorithm for Large-Scale Knowledge Graph

Grid-based partitioning for large-scale distributed agent-based crowd simulation