A distributed storage method of remote sensing data based on image blocks organization

CHI Ziwen,ZHANG Feng,DU Zhenhong,LIU Renyi

DOI: https://doi.org/10.3785/j.issn.1008-9497.2014.01.021

2014-01-01

Abstract:As the volume of remote sensing data products is massive and growing rapidly in recent years, cloud storage with unparalleled scalability and high throughput is considered as a most potential way to solve the challenges of the storage and management, and reduce the investment for storage equipment. In this paper, the problems existing in the application of cloud storage for remote sensing data were brought up, and a distributed Key-Value storage module based on image blocks organization was put forward to settle them. Thus, the storage inefficiencies problem of distributed file system of cloud platforms for massive image blocks was solved, and the ability of spatial data access of the remote sensing data cloud storage was introduced. On the basis of HDFS, an open-source cloud-based distributed file system, the efficient distributed storage and retrieval of image data were implemented. The experiment and analysis showed that the storage system maintains a high throughput under multiple concurrent connections, having a good level of scalability and stability.