Abstract:The calculation of contributing areas from digital elevation models (DEMs) is one of the important tasks in digital terrain analysis (DTA). The computational process usually involves two steps in a real application: (1) calculating flow directions via a flow model, and (2) computing the contributing area for each grid cell in the DEM. The traditional algorithm for calculating contributing areas is coded as a sequential program executed on a single processor. With the increase of scope and resolution of DEMs, the serial algorithm has become increasingly difficult to perform and is often very time-consuming, especially for DEMs of large areas and fine scales. In recent years, parallel computing is able to meet this challenge with the development of computer technology. However, the parallel implementation with granularity control, an efficient strategy to reap the best parallel performance and to break the limitation of computing resources in processing massive grid terrain datasets, has not been found in DTA research field. This paper develops a message-passing-interface (MPI) parallel approach with granularity control to calculate contributing areas. According to the proposed parallelization strategy, the parallel D8 algorithm with granularity control is designed as well as the parallel AreaD8 algorithm. Based on the domain decomposition of DEM data, it is possible for each process to process multiple partitions decomposed under a grain size. According to an iterative procedure of reading source data, executing the operator and writing resulting data, the partitions achieve the calculation results one by one in each process. The experimental results on a multi-node cluster show that the proposed parallel algorithms with granularity control are the powerful tools to process the big dataset and the parallel D8 algorithm is insensitive to granularity, while the parallel AreaD8 algorithm has an optimal grain size to reap the best parallel performance.

The Parallel Algorithm of Clique and It's Application on Data Mining Grid System

A Method of Data Mining Based on SOM Clustering and Its Application

The Design of Architecture, Workflow, Algorithm on Grid System for Social Network Context Prediction Analysis

Application Of Clustering Technologies In Very Large Power Grid Dispatch And Control System

Parallel Mining of Closed Quasi-Cliques

A Parallel Computing Model for Large-Graph Mining with MapReduce.

Parallel Data Mining Optimal Algorithm of Virtual Cluster

Parallel Clique-Like Subgraph Counting And Listing

Grid-based Approaches for Distributed Data Mining Applications

Research on Distributed Data Mining Technology Based on Grid.

Clustering Algorithms Used in Data Mining

Data Mining Algorithm for Cloud Network Information Based on Artificial Intelligence Decision Mechanism

A Parallel Varied Density-Based Clustering Algorithm with Optimized Data Partition

Parallel Contributing Area Calculation with Granularity Control on Massive Grid Terrain Datasets

Utility Based Query Dissemination in Spatial Data Grid

A Framework to Support Distributed Data Mining on Grid

Parallel and Distributed Spatial Outlier Mining in Grid: Algorithm, Design and Application

TeleDatA: data mining, social network analysis and statistics analysis system based on cloud computing in telecommunication industry

Exploring the Hidden Dimension in Graph Processing.

Parallel data mining techniques on Graphics Processing Unit with Compute Unified Device Architecture (CUDA)

Distributed Clustering Based on K-Means and CPGA