Abstract:With the continuous development of remote sensing technology, the data volume of remote sensing images has increased exponentially, resulting in many difficulties in the storage, management, transmission, calculation, and other processes of remote sensing images. In order to solve the above problems, this paper studies the use of the Hadoop Distributed File System (HDFS) and related technologies to design and implement a browser/server (B/S) architecture for a massive, multisource, remote sensing images distributed storage management system. The image data are stored in the HDFS, and the image metadata are stored in a MySQL database. The distributed parallel construction of the image pyramid is completed based on the Spark computing engine, and the Akka framework is used to construct WMTS (Web Map Tile Service) to realize the release of remote sensing images. Finally, the rapid visual display of remote sensing images is carried out using Leaflet. The system also supports image data management, image target detection, user management, and other functions. After testing, this system can support the storage and management of multisource remote sensing image data, and can solve perfectly the problems of insufficient storage space and insufficient computing power of a single server. It is found that the upload and download speeds of a large amount of remote sensing images can be close to the maximum speed of a gigabit local area network (LAN). In the gigabit LAN environment, the average upload speed of a single remote sensing image is 97.74 MB/s, and the average download speed is 87.62 MB/s. In terms of image pyramid construction, the speed of a multi-node parallel construction based on Spark is two times higher than that of a single-node construction. Additionally, compared to similar systems, this system has better data transmission and retrieval speed, better data computing ability, and higher concurrency processing ability.

Peer-To-Peer Transmission of Remote Sensing Image Data Using Image Subset Block

Image Transmission Method Based on Prediction Reconstruction and Progressive Remote Rendering

A P2P Computing Approach to Remote Sensing Data Distributed Processing on High-speed LAN

Progressive streaming of massive terrain data

A distributed storage method of remote sensing data based on image blocks organization

Progressive transmission of point set surfaces based on geometry image representation.

A Mechanism of Remote Sensing Image for Parallel Processing Base on Splitting Blocks

Research on the Data Transmission Strategy of the P2P Network

Preliminary Studies On Remote Sensing Images Transmission By Bd Short Message System Based On Gsg

A Policy of Multi-Spatial Data Access for Mobile Terminal Based on P2P

Research on remote sensing image storage management and a fast visualization system based on cloud computing technology

Interference-constrained routing over P2P-share enabled multi-hop D2D networks

Cloud Storage of Massive Remote Sensing Data Based on Distributed File System

Technology Research of the Ground Real-Time Data Processing for Long Range Image and Information Broadcast of Remote Sensing Satellite

Understand traffic locality of peer-to-peer video file swarming

A Distributed Approach For Retrieving Spatial Data In Gis

The Design and Implementation of Remote Sensing Image Transmission System

P2P Accelerated Mass Data Distribution over Booming Internet: Effectiveness and Bottlenecks

Design and Implementation of a Decentralized Self-Coordinating Distributed Remote Sensing Image Processing System

Near Real-Time Remote Sensing Based on Satellite Internet: Architectures, Key Techniques, and Experimental Progress

Accelerating Large-Scale Data Distribution in Booming Internet: Effectiveness, Bottlenecks and Practices