Abstract:Since Landsat-1 first started to deliver volumes of pixels in 1972, the volumes of archived data in remote sensing data centers have increased continuously. Due to various satellite orbit parameters and the specifications of different sensors, the storage formats, projections, spatial resolutions, and revisit periods of these archived data are vastly different. In addition, the remote sensing data received continuously by each data center arrives at a faster code rate; it is best to ingest and archive the newly received data to ensure users have access to the latest data retrieval and distribution services. Hence, an excellent data integration, organization, and management program is urgently needed. However, the multi-source, massive, heterogeneous, and distributed storage features of remote sensing data have not only caused difficulties for integration across distributed data center spatial infrastructures, but have also resulted in the current modes of data organization and management being unable meet the rapid retrieval and access requirements of users. Hence, this paper proposes an object-oriented data technology (OODT) and SolrCloud-based remote sensing data integration and management framework across a distributed data center spatial infrastructure. In this framework, all of the remote sensing metadata in the distributed sub-centers are transformed into the International Standardization Organization (ISO) 19115-based unified format, and then ingested and transferred to the main center by OODT components, continuously or at regular intervals. In the main data center, in order to improve the efficiency of massive data retrieval, we proposed a logical segmentation indexing (LSI) model-based data organization approach, and took SolrCloud to realize the distributed index and retrieval of massive metadata. Finally, a series of distributed data integration, retrieval, and comparative experiments showed that our proposed distributed data integration and management program is effective and promises superior results. Specifically, the LSI model-based data organization and the SolrCloud-based distributed indexing schema was able to effectively improve the efficiency of massive data retrieval.

Towards Realization of Open Cloud Services Architecture for Data Service in Materials Field ⋆

Building an Open Cloud Virtual Dataspace Model for Materials Scientific Data

An Effective User Behavior Modeling Approach for Data Services in the Field of Materials Engineering.

Process Materials Scientific Data for Intelligent Service Using a Dataspace Model.

Virtual Dataspace -- A Service Oriented Model for Scientific Big Data

A Virtual Dataspaces Model for Large-Scale Materials Scientific Data Access

Practicability of Dataspace Systems

Research and Implementation of a Science Data Cloud and Services

Towards Realization of Domain-Specific Scientific Data Cloud for Material Data Sharing.

A Semantic-Driven Knowledge Representation Model for the Materials Engineering Application.

Data Mining Service Architecture - an Exploration on Self-organizing Software.

Semantic Web-Based Data Service Discovery and Composition

Resources Aggregation Model towards Domain-specific Scientific Data Cloud

Design and Realization of Materials Service Safety Assessment System Based on Ontology

Semantic orchestration and exploitation of material data: A dataspace solution demonstrated on steel and copper applications

Data Architecture for Digital Object Space Management Service (DOSM) using DAT

Architecture Design for Management As a Service Cloud

Big Data Integration in Remote Sensing Across a Distributed Metadata-Based Spatial Infrastructure

Dataspace:A New Data Organization and Management Model

An open experimental platform of astronomy big data based on cloud computing

Study on Web Service-Based Remote Sensing Data Service Platform for Digital Earth