Abstract:The calculation of contributing areas from digital elevation models (DEMs) is one of the important tasks in digital terrain analysis (DTA). The computational process usually involves two steps in a real application: (1) calculating flow directions via a flow model, and (2) computing the contributing area for each grid cell in the DEM. The traditional algorithm for calculating contributing areas is coded as a sequential program executed on a single processor. With the increase of scope and resolution of DEMs, the serial algorithm has become increasingly difficult to perform and is often very time-consuming, especially for DEMs of large areas and fine scales. In recent years, parallel computing is able to meet this challenge with the development of computer technology. However, the parallel implementation with granularity control, an efficient strategy to reap the best parallel performance and to break the limitation of computing resources in processing massive grid terrain datasets, has not been found in DTA research field. This paper develops a message-passing-interface (MPI) parallel approach with granularity control to calculate contributing areas. According to the proposed parallelization strategy, the parallel D8 algorithm with granularity control is designed as well as the parallel AreaD8 algorithm. Based on the domain decomposition of DEM data, it is possible for each process to process multiple partitions decomposed under a grain size. According to an iterative procedure of reading source data, executing the operator and writing resulting data, the partitions achieve the calculation results one by one in each process. The experimental results on a multi-node cluster show that the proposed parallel algorithms with granularity control are the powerful tools to process the big dataset and the parallel D8 algorithm is insensitive to granularity, while the parallel AreaD8 algorithm has an optimal grain size to reap the best parallel performance.

Parallel DEA-Dantzig-Wolfe Algorithm for Massive Data Applications.

A Hybrid Parallel Processing Strategy for Large-Scale DEA Computation

Data Based Application Partitioning and Workload Balance in Distributed Environment

Ieee Access Special Section Editorial: Advanced Data Analytics For Large-Scale Complex Data Environments

Accelerating large-scale DEA computation using sequential categorization and dynamic reference set selection

DEA under big data: data enabled analytics and network data envelopment analysis

A novel agent-based parallel ETL system for massive data

A new parallel framework algorithm for solving large-scale DEA models

Parallel Contributing Area Calculation with Granularity Control on Massive Grid Terrain Datasets

A new approach for fair efficiency decomposition in two-stage structure system

A Sampling-Based Density Peaks Clustering Algorithm for Large-Scale Data

Distributed Bayesian Matrix Decomposition for Big Data Mining and Clustering

Parallel Massive Clustering of Discrete Distributions

Alternative Secondary Goals in Multiplicative Two-Stage Data Envelopment Analysis

DEA Cross-Efficiency Aggregation with Deviation Degree Based on Standardized Euclidean Distance

An application procedure for DEA

DATA ENVELOPMENT ANALYSIS WITH MISSING DATA: A MULTIPLE LINEAR REGRESSION ANALYSIS APPROACH

Resource Allocation and Target Setting for Parallel Production System Based on DEA

BigDataflow: A Distributed Interprocedural Dataflow Analysis Framework

A Data Partitioning Method for Parallel Digital Terrain Analysis

Distributed Differential Evolution With Adaptive Resource Allocation