Abstract:With the continuous development of remote sensing technology, the data volume of remote sensing images has increased exponentially, resulting in many difficulties in the storage, management, transmission, calculation, and other processes of remote sensing images. In order to solve the above problems, this paper studies the use of the Hadoop Distributed File System (HDFS) and related technologies to design and implement a browser/server (B/S) architecture for a massive, multisource, remote sensing images distributed storage management system. The image data are stored in the HDFS, and the image metadata are stored in a MySQL database. The distributed parallel construction of the image pyramid is completed based on the Spark computing engine, and the Akka framework is used to construct WMTS (Web Map Tile Service) to realize the release of remote sensing images. Finally, the rapid visual display of remote sensing images is carried out using Leaflet. The system also supports image data management, image target detection, user management, and other functions. After testing, this system can support the storage and management of multisource remote sensing image data, and can solve perfectly the problems of insufficient storage space and insufficient computing power of a single server. It is found that the upload and download speeds of a large amount of remote sensing images can be close to the maximum speed of a gigabit local area network (LAN). In the gigabit LAN environment, the average upload speed of a single remote sensing image is 97.74 MB/s, and the average download speed is 87.62 MB/s. In terms of image pyramid construction, the speed of a multi-node parallel construction based on Spark is two times higher than that of a single-node construction. Additionally, compared to similar systems, this system has better data transmission and retrieval speed, better data computing ability, and higher concurrency processing ability.

Pipscloud: High Performance Cloud Computing for Remote Sensing Big Data Management and Processing

Cloud Computing Cloud Computing in Remote Sensing : High Performance Remote Sensing Data Processing in a Big data Environment

OpenRS-Cloud: A Remote Sensing Image Processing Platform Based on Cloud Computing Environment

An Efficient Organization Method for Large-Scale and Long Time-Series Remote Sensing Data in a Cloud Computing Environment

An Efficient and Scalable Framework for Processing Remotely Sensed Big Data in Cloud Computing Environments

A Cloud Computing Solution for Big Imagery Data Analytics

Recent Developments in Parallel and Distributed Computing for Remotely Sensed Big Data Processing

On-Demand Processing for Remote Sensing Big Data Analysis

Efficient Retrieval of Massive Ocean Remote Sensing Images via a Cloud-Based Mean-Shift Algorithm

Cloud Storage of Massive Remote Sensing Data Based on Distributed File System

Efficient Management and Processing of Massive InSAR Images Using an HPC-Based Cloud Platform

Research on remote sensing image storage management and a fast visualization system based on cloud computing technology

Large-scale Storage and High-performance Processing Environment for Remote Sensor Images

A Cloud-Based Remote Sensing Data Production System.

An In-memory Data-Cube Aware Distributed Data Discovery Across Clouds for Remote Sensing Big Data

RSIMS: Large-Scale Heterogeneous Remote Sensing Images Management System

A novel approach for large‐scale environmental data partitioning on cloud and on‐premises storage for compute continuum applications

Analyzing large-scale Data Cubes with user-defined algorithms: A cloud-native approach

On-the-Fly Fusion of Remotely-Sensed Big Data Using an Elastic Computing Paradigm with a Containerized Spark Engine on Kubernetes

Cloud Deep Networks for Hyperspectral Image Analysis.

Recent Developments in High Performance Computing for Remote Sensing: A Review