Real-time data storage and query method

Chen Yueguo,Du Xiaoyong,Tan Xiongpai,Bian Haoqiong,Cheng Ao,Zhao Liping

2015-01-01

Abstract:The invention provides a real-time data storage and query method. The method comprises the steps that when storage is conducted, partition is conducted on data to be stored by adopting consistency Hash sharding, primary index data carried with index information of the consistency Hash sharding are obtained from at least one distributed node of a distributed storage system, merger processing is conducted on at least two primary index data of one same distributed node to form a distributed file block corresponding to the distributed node, and a clustered index is established for the primary index data in the distributed file block; secondary index data carried with clustered index information are obtained from the distributed file block corresponding to the distributed node, and the secondary index data in the distributed file block are written in a disk in which the corresponding distributed node is located; when query is conducted, by means of the index information of the consistency Hash sharding established when the data to be inquired are stored and the clustered index information established in the distributed file block, a needed result can be located accurately and rapidly.