A Framework of Hadoop based Geology Big Data Fusion and Mining Techno l og i es

ZHU Yueqin,TAN Yongjie,ZHANG Jiantong,MAO Bo,SHEN Jie,JI Chaofei
DOI: https://doi.org/10.11947/j.AGCS.2015.F059
2015-01-01
Abstract:Geology studies requiremount of data in various types.It is important to implement high efficiency fusion and mining methods for the big data in geology.These methods will promote the research on the geology mechanism and geological exploration.However,the existing methods are divided by different data type,format and coverage,so it is difficult to share the methods among different datasets. Therefore,in this paper,we propose a Hadoop based geology big data fusion and mining framework.This framework contains a unified data gathering and preprocess methods,a Meta data index based storage and management platform,a Map/Reduce based data mining system and a reusability oriented geology services to support such as 3D online visualization and other applications.The proposed framework can be easily extend and the preliminary demo shows the efficiency of the proposed framework.
What problem does this paper attempt to address?