Abstract:In the real word, temporal data can be found in many applications, and it is rapidly increasing nowadays. It is urgently important and challenging to manage and operate big temporal data efficiently and effectively, due to the large volume of big temporal data and the real-time response requirement. Processing big temporal data using a distributed system is a desired choice, since a single-machine based system usually has the limited computing ability. Nevertheless, existing distributed systems or methods either are disk-based solutions, or cannot support native queries, which may not well meet the demands of low latency and high throughput. To attack these issues, this article suggests a new approach to handle big temporal data. Our approach is an In-memory based Two-level Index Solution in Spark, dubbed as ITISS. The proposed framework of our solution is easily understood and implemented, but without loss of effectiveness and efficiency. Based on the proposed framework, this article develops targeted algorithms for handling time travel, temporal aggregation, and temporal join queries, respectively. We have implemented our framework in Apache Spark, extended the Apache Spark SQL to support declarative SQL interface that enables users to perform temporal queries with a few lines of SQL statements, and conducted extensive experiments to verify the performance of our solution. The experimental results, based on both real and synthetic datasets, consistently demonstrate that our proposed solution is efficient and competitive for processing big temporal data.

Generating Market Basket Data with Temporal Information

Multi-level temporal data model in GIS

Discovering Temporal Patterns in Multiple Granularities.

TSGM: A Flexible Framework for Generative Modeling of Synthetic Time Series

Temporal Pattern Mining from User-Generated Content

An Approach to Discovering Multi-Temporal Patterns and Its Application to Financial Databases

Mining High-utility Temporal Patterns on Time Interval–based Data

Sequential Pattern Mining in Databases with Temporal Uncertainty

Mining frequent temporal duration-based patterns on time interval sequential database

Generation of Realistic Synthetic Financial Time-series

GRATIS: GeneRAting TIme Series with diverse and controllable characteristics

Towards Efficient Sequential Pattern Mining in Temporal Uncertain Databases

Representing Models for Local Sequential Behaviors in Temporal Sequence Database

Mining Temporal Characteristics of Behaviors from Interval Events in E-Learning.

Sequence Pattern Matching over Time-Series Data with Temporal Uncertainty

Temporal Mediators: Supporting Uniform Accesses to Heterogeneous Temporal Information.

GenSyn: A Multi-stage Framework for Generating Synthetic Microdata using Macro Data Sources

ITISS: an Efficient Framework for Querying Big Temporal Data.

Utility-Driven Mining of Trend Information for Intelligent System

Calendar Graph Neural Networks for Modeling Time Structures in Spatiotemporal User Behaviors

Towards Controllable Time Series Generation