A Universal Storage Architecture for Heterogeneous Data of Internet of Things

Yong Lin Leng,Qing Chen Zhang,Yue Wang
DOI: https://doi.org/10.4028/www.scientific.net/amm.713-715.2423
2015-01-01
Applied Mechanics and Materials
Abstract:With the rapid development of the Internet of Things technology, IOT terminal equipments collect a large amount of data. So the preprocessing and storage become a big challenge. In this paper we presents a universal preprocessing and storage architecture for IOT data in cloud environment. In the data preprocessing module, with the sensor equipments are not stable, a large number of mistake, missing data will be produced, so we propose a imputation algorithm based on clustering to perform data preprocessing. For the data storage module, because of the existence of a large number of unstructured and semi-structured data, we present a storage architecture for heterogeneous data in cloud environment. Experiments show that our architecture can effectively complete the data preprocessing and storage, for the subsequent work, such as query data provides good support.
What problem does this paper attempt to address?