Data processing method and apparatus, storage medium, and electronic apparatus

Fu Canmiao,Cao Qiong,Pei Wenjie,Shen Xiaoyong,Tai Yuwing,Jia Jiaya
2019-01-01
Abstract:Embodiments of the present invention provide a data processing method, an apparatus, an electronic device, and a storage medium. The data processing method comprises the following steps: acquiring a data file to be processed; storing the data in the data file according to a format of a row group and a column block, the data file comprising a file header; the file header comprising row component metadata; and the row component metadata comprising a search mark corresponding to the data; Based on the received data query request, filtering the data in the data file according to the search identifier contained in the row metadata to obtain a query result corresponding to the data query request. The method of the invention can quickly filter the data in the data file through the search mark inthe file header of the data file, thus improving the data inquiry efficiency and inquiry accuracy, and reducing the consumption of hardware resources.
What problem does this paper attempt to address?