Abstract:Since Landsat-1 first started to deliver volumes of pixels in 1972, the volumes of archived data in remote sensing data centers have increased continuously. Due to various satellite orbit parameters and the specifications of different sensors, the storage formats, projections, spatial resolutions, and revisit periods of these archived data are vastly different. In addition, the remote sensing data received continuously by each data center arrives at a faster code rate; it is best to ingest and archive the newly received data to ensure users have access to the latest data retrieval and distribution services. Hence, an excellent data integration, organization, and management program is urgently needed. However, the multi-source, massive, heterogeneous, and distributed storage features of remote sensing data have not only caused difficulties for integration across distributed data center spatial infrastructures, but have also resulted in the current modes of data organization and management being unable meet the rapid retrieval and access requirements of users. Hence, this paper proposes an object-oriented data technology (OODT) and SolrCloud-based remote sensing data integration and management framework across a distributed data center spatial infrastructure. In this framework, all of the remote sensing metadata in the distributed sub-centers are transformed into the International Standardization Organization (ISO) 19115-based unified format, and then ingested and transferred to the main center by OODT components, continuously or at regular intervals. In the main data center, in order to improve the efficiency of massive data retrieval, we proposed a logical segmentation indexing (LSI) model-based data organization approach, and took SolrCloud to realize the distributed index and retrieval of massive metadata. Finally, a series of distributed data integration, retrieval, and comparative experiments showed that our proposed distributed data integration and management program is effective and promises superior results. Specifically, the LSI model-based data organization and the SolrCloud-based distributed indexing schema was able to effectively improve the efficiency of massive data retrieval.

The Technical Framework of Multi-source Remote Sensing Data Mining

The Technological Framework of Data Mining from the Polygenetic Remotely Sensed Data

Design and Implementation of Multi-Source Data Mining System for Land Use

Research On Remote Sensing Image Data Mining Prototype System And The Rsidmm-Dtm

Preliminary Research in Using the Technology of Data Mining to Analyze Remote Sensing Data

Big Earth Observation Data Integration in Remote Sensing Based on a Distributed Spatial Framework

Technical framework and preliminary practices of photogrammetric remote sensing intelligent processing of multi-source satellite images

On the framework, algorithms and applications of hyperspectral remote sensing data mining.

The Technology and Methods of Spatial Data Mining and Their Application

Key Technologies for Remote Sensing Intelligent Monitoring and Simulation of Urban Spatial Elements

Big Data Integration in Remote Sensing Across a Distributed Metadata-Based Spatial Infrastructure

A Modular Remote Sensing Big Data Framework

Updating Framework for Multi-Sources of Subcompartment Spatio-Temporal Data

THE RESEARCH IN THE FRAMEWORK OF REMOTE SENSING INFORMATION MINING

A Systemic Framework for the Field of Data Mining and Knowledge Discovery

Study on Data Mining Technology in Hyperspectral Remote Sensing

Research and application verification of intelligent interpretation system for multi-source remote sensing data

The Design of Deep Learning Framework and Model for Intelligent Remote Sensing

Geospatial Big Data: New Paradigm of Remote Sensing Applications.

Extensible Topic Modeling and Analysis Framework for Multisource Data*

Towards Building a Distributed Data Management Architecture to Integrate Multi-Sources Remote Sensing Big Data.