NEST: Node with Statistics Tree for IoT Data Persistence and Real-time Queries

Jiahua Huang,Chun Cao,Jun Ma,Xiaoxing Ma

DOI: https://doi.org/10.1145/3671016.3671393

2024-01-01

Abstract:Data persistence is a critical foundation for Internet of Things (IoT), it provides the capability of data collection from IoT devices and pulls out these data by queries for applications to consume. In most cases, both the relationship between devices and the metrics on devices are required, so polyglot persistence systems consisting of graph databases and time series databases are deployed for data persistence. However, as the scale of IoT device network continues to grow, polyglot persistence finds it hard to achieve the need of real-time queries demanded by query-bound applications like artificial intelligence in IoT, which is where multi-model database be proficient in. In this article, we introduce NEST, a clustered tree index with statistics stored on its nodes, which is designed to solve the problem of real-time queries in query-bounding scenarios. We implement NEST on the open-source multi-model database ArcadeDB, using its document model to persist time series data together with graph model, which allows NEST to manage both graph model and time series model in a single database. NEST can process queries two times faster compared to polyglot persistence and other data models under IoT scenarios, providing data persistence support to IoT query-bound use cases.