Abstract:With the continuous development of remote sensing technology, the data volume of remote sensing images has increased exponentially, resulting in many difficulties in the storage, management, transmission, calculation, and other processes of remote sensing images. In order to solve the above problems, this paper studies the use of the Hadoop Distributed File System (HDFS) and related technologies to design and implement a browser/server (B/S) architecture for a massive, multisource, remote sensing images distributed storage management system. The image data are stored in the HDFS, and the image metadata are stored in a MySQL database. The distributed parallel construction of the image pyramid is completed based on the Spark computing engine, and the Akka framework is used to construct WMTS (Web Map Tile Service) to realize the release of remote sensing images. Finally, the rapid visual display of remote sensing images is carried out using Leaflet. The system also supports image data management, image target detection, user management, and other functions. After testing, this system can support the storage and management of multisource remote sensing image data, and can solve perfectly the problems of insufficient storage space and insufficient computing power of a single server. It is found that the upload and download speeds of a large amount of remote sensing images can be close to the maximum speed of a gigabit local area network (LAN). In the gigabit LAN environment, the average upload speed of a single remote sensing image is 97.74 MB/s, and the average download speed is 87.62 MB/s. In terms of image pyramid construction, the speed of a multi-node parallel construction based on Spark is two times higher than that of a single-node construction. Additionally, compared to similar systems, this system has better data transmission and retrieval speed, better data computing ability, and higher concurrency processing ability.

Research on Remote Data Access and Visualization for Long Pulse Experiment Based on Web Technologies

The Design and Implementation of the Remote Control and Visualization System for Pulse Application Experiments

A High-Speed Data Acquisition and Control System Based on LabVIEW for Long-Pulse Experiments

Virtual experiment system of signal analysis based on Web and MATLAB

Progress in Data Transmission and Storage for Long Pulse Data Acquisition System

Real time data access log analysis system of EAST tokamak based on spark

A Java web application based MDSplus data analysis and real-time monitoring system for EAST

Research on remote sensing image storage management and a fast visualization system based on cloud computing technology

DESIGN AND IMPLEMENTATION OF WEBGIS SYSTEM BASED ON BLAZEDS MESSAGE PUSH TECHNOLOGY

The Upgrade of the J-TEXT Experimental Data Access and Management System

Internet-based Rotating Transformer Experiment System

Research of a New High-Performance Data-Collecting Transmissive System

Development of Distributed On-line Experimental System Based on Virtual Instruments

A real-time publication system of massive marine remote sensing data - art. no. 67951V

Special Software Design for Data Acquisition and Experi-Mental Database Management of Electromagnetic Launch System

An Mhealth Monitoring System for Telemedicine Based on WebSocket Wireless Communication.

An Management and Visualization System for Massive Remote Sensing Image: Research and Implementation.

Design and Implementation of Remote Experiment Teaching System Framework under B/S Mode

Study of High Performance Processing Platform Architecture in Remote Sensing

Web architecture for the remote browsing and analysis of distributed medical images and data

The Long-distance Emulation of Digital Signal Processing Based on Matlab WebServer