Abstract:Sustainability research faces many challenges as respective environmental, urban and regional contexts are experiencing rapid changes at an unprecedented spatial granularity level, which involves growing massive data and the need for spatial relationship detection at a faster pace. Spatial join is a fundamental method for making data more informative with respect to spatial relations. The dramatic growth of data volumes has led to increased focus on high-performance large-scale spatial join. In this paper, we present Spatial Join with Spark (SJS), a proposed high-performance algorithm, that uses a simple, but efficient, uniform spatial grid to partition datasets and joins the partitions with the built-in join transformation of Spark. SJS utilizes the distributed in-memory iterative computation of Spark, then introduces a calculation-evaluating model and in-memory spatial repartition technology, which optimize the initial partition by evaluating the calculation amount of local join algorithms without any disk access. We compare four in-memory spatial join algorithms in SJS for further performance improvement. Based on extensive experiments with real-world data, we conclude that SJS outperforms the Spark and MapReduce implementations of earlier spatial join approaches. This study demonstrates that it is promising to leverage high-performance computing for large-scale spatial join analysis. The availability of large-sized geo-referenced datasets along with the high-performance computing technology can raise great opportunities for sustainability research on whether and how these new trends in data and technology can be utilized to help detect the associated trends and patterns in the human-environment dynamics.

Research of Decision Support Framework for Spatial Customer Intelligence

Research on Decision-making Support System Application for Remote Sensing Integrated Survey of Land Resources

A Spatial Decision Support System for Large Scale Vehicle Routing

Spatial Decision Support System for Tobacco Enterprise Based on Spatial Data Mining

Spatial OLAP and Multicriteria Integrated Approach for Decision Support System

A CIMS-based decision support system for e-commerce: boosting real-time and effective digital marketing

Agent and decision-supporting-based on-spatial information

Spatial Data Intelligence and City Metaverse: a Review

Research on Electric Power Marketing Decision Support System. Based on Data Warehousing

Research on the Spatial Data Intelligent Foundation Model

Advanced Researches on Intelligent Spatial Decision Support System (ISDSS): A Combination of Model-Blade, Generalized Repository and GIS

A New Design of High-Performance Large-Scale GIS Computing at a Finer Spatial Granularity: A Case Study of Spatial Join with Spark for Sustainability

A Web Services Based Framework for Spatial Information and Services Integration

Spatial Data Cube: Provides Better Support for Spatial Data Mining

A Framework of Decision Support System for Quality-Oriented Management

Intelligent Decision Support System for Building Project Management Based on Artificial Intelligence

Analysis of Intelligent Decision Support Systems and a Multi Criteria Framework for Assessment

The Integration of Dual Evaluation and Minimum Spanning Tree Clustering to Support Decision-Making in Territorial Spatial Planning

An Intelligent Decision Support System In Construction Management By Data Warehousing Technique

Fuzzy Rule-based Integrated System Multi-indicators Economic Performance Evaluation and Decision Making Support Framework

A Solution of Spatial Query Processing and Query Optimization for Spatial Databases