A Fast Compression Approach of Geo-raster Data for Network Transmission
Ling JIANG,Chun WANG,Mingwei ZHAO,Cancan YANG
DOI: https://doi.org/10.3724/SP.J.1047.2016.00894
2016-01-01
Abstract:As the main form of representing the geographical information, geo-raster data contains abundant geographical knowl-edge. With the rapid development of earth observation technology, high-resolution geo-raster data has been widely applied to many research fields, such as landform, soil, environment and hydrology. With respect to this context, the contradiction between the sav-ing and transferring of massive geo-raster data and a limited channel capacity has become increasingly prominent with regard to the intensive increase of data size. Data compression techniques provide the possibility to solve this problem. This paper studies the compression method of geo-raster data based on gridded DEMs for the purpose of realizing massive data’s online transmission. By analyzing the characteristics of geo-grid data, this paper proposes a new compression method named as the two-phase compression method, which combines the conversion compression and the coding compression based on the data fidelity and the real-time com-pression principle. Meanwhile, this paper establishes an assessment method of two-phase compression method from the perspec-tives of accuracy and efficiency. In order to test and verify the data fidelity and the compression performance of the two-phase com-pression method, this paper conducted several experiments on a 10-node server cluster under the Linux operating system by using different sizes of gridded DEMs. The experiment results showed that the proposed two-phase compression method has provided good data fidelity. It keeps the data accuracy on both of the numerical and the representation structure. At the same time, the com-pression ratio is generally above 50%, and the almost real-time decompression/compression efficiency also indicates that it has a good performance. The two-phase compression method can significantly reduce the time consumption of data transmission through network, and improve the efficiency of network transmission. In all, this two-phase compression method of geo-raster data presents a good universality, and it can provide a technical support to the application of geo-raster data, such as the high-performance geo-computation.