Abstract:In the real word, temporal data can be found in many applications, and it is rapidly increasing nowadays. It is urgently important and challenging to manage and operate big temporal data efficiently and effectively, due to the large volume of big temporal data and the real-time response requirement. Processing big temporal data using a distributed system is a desired choice, since a single-machine based system usually has the limited computing ability. Nevertheless, existing distributed systems or methods either are disk-based solutions, or cannot support native queries, which may not well meet the demands of low latency and high throughput. To attack these issues, this article suggests a new approach to handle big temporal data. Our approach is an In-memory based Two-level Index Solution in Spark, dubbed as ITISS. The proposed framework of our solution is easily understood and implemented, but without loss of effectiveness and efficiency. Based on the proposed framework, this article develops targeted algorithms for handling time travel, temporal aggregation, and temporal join queries, respectively. We have implemented our framework in Apache Spark, extended the Apache Spark SQL to support declarative SQL interface that enables users to perform temporal queries with a few lines of SQL statements, and conducted extensive experiments to verify the performance of our solution. The experimental results, based on both real and synthetic datasets, consistently demonstrate that our proposed solution is efficient and competitive for processing big temporal data.

Timo: In-Memory Temporal Query Processing for Big Temporal Data

Distributed In-Memory Analytics For Big Temporal Data

ITISS: an Efficient Framework for Querying Big Temporal Data.

TSCache

Research on Temporal Query Expansion and Temporal Index Optimization Based on Spark

A Study of Performance Optimization Method for Massive Spaito-temporal Data Based on Spatio-temporal Partition Clustering

Distributed scheduling and storage scheme based on LSM-OCTree for spatiotemporal stream

Temporal Query Processing in Social Network

Temporal Graph Cube

A Lightweight and Efficient Temporal Database Management System in TDSQL

Building an Efficient Storage Model of Spatial-Temporal Information Based on HBase

T-SQL: A Lightweight Implementation to Enable Built-in Temporal Support in MVCC-based RDBMSs

LocationSpark: In-memory Distributed Spatial Query Processing and Optimization

A Workload-Controllable Dynamic Spatio-Temporal Index Scheme for Streaming Processing

In-memory big data analytics under space constraints using dynamic programming.

ImmortalGraph: A System for Storage and Analysis of Temporal Graphs

Elastic and Effective Spatio-Temporal Query Processing Scheme on Hadoop

Kairos: Efficient Temporal Graph Analytics on a Single Machine

HyperBit: A Temporal Graph Store for Fast Answering Queries.

Research on Join Operation of Temporal Big Data in Distributed Environment

Simba: Efficient In-Memory Spatial Analytics