Abstract:With the continuous development of remote sensing technology, the data volume of remote sensing images has increased exponentially, resulting in many difficulties in the storage, management, transmission, calculation, and other processes of remote sensing images. In order to solve the above problems, this paper studies the use of the Hadoop Distributed File System (HDFS) and related technologies to design and implement a browser/server (B/S) architecture for a massive, multisource, remote sensing images distributed storage management system. The image data are stored in the HDFS, and the image metadata are stored in a MySQL database. The distributed parallel construction of the image pyramid is completed based on the Spark computing engine, and the Akka framework is used to construct WMTS (Web Map Tile Service) to realize the release of remote sensing images. Finally, the rapid visual display of remote sensing images is carried out using Leaflet. The system also supports image data management, image target detection, user management, and other functions. After testing, this system can support the storage and management of multisource remote sensing image data, and can solve perfectly the problems of insufficient storage space and insufficient computing power of a single server. It is found that the upload and download speeds of a large amount of remote sensing images can be close to the maximum speed of a gigabit local area network (LAN). In the gigabit LAN environment, the average upload speed of a single remote sensing image is 97.74 MB/s, and the average download speed is 87.62 MB/s. In terms of image pyramid construction, the speed of a multi-node parallel construction based on Spark is two times higher than that of a single-node construction. Additionally, compared to similar systems, this system has better data transmission and retrieval speed, better data computing ability, and higher concurrency processing ability.

Landq(Upsilon 2): A Mapreduce-Based System For Processing Arable Land Quality Big Data

ELM-MapReduce: MapReduce Accelerated Extreme Learning Machine for Big Spatial Data Analysis

A Cloud Computing Application in Land Resources Information Management

HBaseSpatial: A Scalable Spatial Data Storage Based on HBase

Research on the Analysis and Statistic of Geographical Conditions Based on the Strategy of "grid Index + MapReduce"

Research on Efficient Processing Mechanism Based on Multi-Grid Platform of Land Resource

Design of Management Tools of Land Data Center for Integration of Urban and Rural Areas

An Effective NoSQL-Based Vector Map Tile Management Approach.

A Cloud-Based System for Spatial Analysis Service

A real-time publication system of massive marine remote sensing data

Efficient Spatial Big Data Storage and Query in HBase.

Analytical Insight of Earth: A Cloud-Platform of Intelligent Computing for Geospatial Big Data

Analyzing large-scale Data Cubes with user-defined algorithms: A cloud-native approach

A MapReduce Cluster Deployment Optimization Framework with Geo-distributed Data.

SPATIAL DATA QUALITY EVALUATION FOR LAND COVER CLASSIFICATION APPROACHES

Geospatial big data for urban planning and urban management

Research on Guangdong Province Meteorological Data Analysis System under Hadoop Environment

Power Big Data Analysis Platform Design Based on Hadoop

Research on remote sensing image storage management and a fast visualization system based on cloud computing technology

The Construction and Practice of Big Data Mapping GIS under Low Altitude Remote Sensing

The Design and Implementation of Geographic Information Storage System Based on the Cloud Platform.