Graph processing method and device as well as rasterization representation and storage method

Zhu Xiaowei,Han Wentao,Chen Wenguang
2015-01-01
Abstract:The invention provides a graph processing method and device as well as a rasterization representation and storage method. The graph processing method comprises steps as follows: an original graph is processed to be in a raster structure; edge groups are processed in a streaming manner, edges in each edge group are processed one by one according to a predetermined processing function, data of the edge groups are read in a rapid storage device from a slow storage device, and data of a starting peak group and data of a target peak group are read in the rapid storage device. As for a three-layer storage structure including a cache, a memory and a magnetic disk, primary partition is executed according to the cache size during preprocessing, and virtual secondary partition is executed according to the memory size in a raster merging manner during execution. During graph rasterization representation, sequences of the edges are not required, the calculation cost is low, relevant peak groups can be loaded into the rapid storage device during streaming processing, and read-write locality of peaks is guaranteed.
What problem does this paper attempt to address?