Abstract:ABSTRACTFor the large-scale distributed graph mining, the graph is distributed over a cluster of nodes, thus performing computations on the distributed graph is expensive when large amount of data have to be moved between different computers. A good partitioning of distributed graph is needed to reduce the communication between computers and scale a system up. Existing graph partitioning algorithms incur high computation and communication cost when applied on large distributed graphs. A efficient and scalable partitioning algorithm is crucial for large-scale distributed graph mining. In this paper, we propose a novel parallel multi-level stepwise partitioning algorithm. The algorithm first efficiently aggregates the large graph into a small weighted graph, and then makes a balance partitioning on the weighted graph based on a stepwise minimizing RatioCut Algorithm. The experimental results show that our algorithm generally outperforms the existing algorithms and has a high efficiency and scalability for large-scale graph partitioning. Using our partitioning method, we are able to greatly speed up PageRank computation.

Design and Implementation of a Parallel Data Partitioning Algorithm for XML Data

Data Based Application Partitioning and Workload Balance in Distributed Environment

Parallel Data Partitioning Strategy In Solving Large Scale Electromagnetic Scattering Problems

Scalable Parallel Quadrilateral Mesh Generation Coupled with Mesh Partitioning

Parallel Storing and Querying XML Documents Using Relational DBMS.

Implementation of large-scale distributed information retrieval system

Handling distributed XML queries over large XML data based on MapReduce framework.

Distributed XPath Query Processing over Large XML Data Based on MapReduce Framework

A Method of Spatial Data Partition for Efficient Parallel Computing of Topological Relations

Parallel Speculative Dom-based XML Parser

Indexing Techniques For Query Of Xml Documents

Exploiting Even Partition to Accelerate Structure Join

A Novel Parallel Approach of Radix Sort with Bucket Partition Preprocess

Distribution Design for XML documents

Adaptive indexing structure on XML data stored in RDBMS

XML2HBase: Storing and querying large collections of XML documents using a NoSQL database system

Xml Structural Similarity Search Using Mapreduce

Switch-SSD Cache Based XML Query Processing in Hadoop

An Efficient Document-Split Algorithm for On-Demand XML Data Broadcast Scheduling

Buffer Management of the Results of Queries over XML Streams

A parallel graph partitioning algorithm to speed up the large-scale distributed graph mining.