Abstract:With the booming of high-resolution Earth observation and open-data efforts, petabyte-scale Earth observation data have been available for free access. Due to the unprecedented availability of big data deluge, regional to global spatio-temporal analysis has been significantly challenged with the huge computational barriers, the tedious cycles of download-preprocess-store-analyze leading to excessive data downloading overhead, and the acquisition-oriented 2-D file-based structure, which is not fit for spatio-temporal analysis. The Earth observation data cube (EODC) paradigm revolutionizes the traditional way of storing, managing, and analyzing spatio-temporal RS data, and solves problems of easy-to-use of RS data to a certain extent. However, different EODC solutions are becoming information silos. Therefore, the sharing and joint use of remote sensing (RS) data across EODCs have become extremely challenging. To address the abovementioned challenges, we proposed a method of in-memory distributed data cube autodiscovery and retrieval across clouds. We construct a distributed in-memory data orchestration across clouds to shield the heterogeneity of the EODC storage solutions, solving information silos problems, and we put forward a larger-sites-first and spatio-temporal aware RS data discovery strategy, which can automatically discover data across clouds for requirements. Based on the data cube paradigm, this article proposes a quality-first data filtering strategy, which can help users to filter out high-quality data covering the target spatio-temporal range from the huge amount of data, and solve the problem of data cube joint retrieval and efficient use across clouds. In addition, we have confirmed that our method is effective and efficient through comparative experiments.

OpenEOcubes: an open-source and lightweight R-based RESTful web service for analyzing earth observation data cubes

A Novel and Extensible Remote Sensing Collaboration Platform: Architecture Design and Prototype Implementation

An In-memory Data-Cube Aware Distributed Data Discovery Across Clouds for Remote Sensing Big Data

Earth Video Cube: A Geospatial Data Cube for Multisource Earth Observation Video Management and Analysis

Lexcube: Interactive Visualization of Large Earth System Data Cubes

On-Demand Earth System Data Cubes

The EL-BIOS Earth Observation Data Cube for Supporting Biodiversity Monitoring in Greece

OpenCUBE: Building an Open Source Cloud Blueprint with EPI Systems

Brazil Data Cube Workflow Engine: a tool for big Earth observation data processing

A Tile Service-Driven Architecture for Online Climate Analysis with an Application to Estimation of Ocean Carbon Flux

OpenEarth - Inter-Company Management of: Data, Models, Tools & Knowledge

Earth System Data Cubes: Avenues for advancing Earth system research

Analyzing large-scale Data Cubes with user-defined algorithms: A cloud-native approach

China Data Cube (CDC) for Big Earth Observation Data: Lessons Learned from the Design and Implementation

USING OPEN DATA CUBE ON THE CLOUD TO INVESTIGATE FOOD SECURITY BY MEANS OF CROPLAND CHANGES IN DJIBOUTI

CubeExplorer: online exploration of data cubes.

Distributed mining of large scale remote sensing image archives on public computing infrastructures

Research on a Kind of Web Based Distributed Forest Remote Sensing Parallel Processing Service

A Tile-Based Framework with a Spatial-Aware Feature for Easy Access and Efficient Analysis of Marine Remote Sensing Data

The Astronomy Commons Platform: A Deployable Cloud-Based Analysis Platform for Astronomy

CEBA: A Data Lake for Data Sharing and Environmental Monitoring