Abstract:With the explosive use of GPS-enabled devices, increasingly massive volumes of trajectory data capturing the movements of people and vehicles are becoming available, which is useful in many application areas, such as transportation, traffic management, and location-based services. As a result, many trajectory data management and analytic systems have emerged that target either offline or online settings. However, some applications call for both offline and online analyses. For example, in traffic management scenarios, offline analyses of historical trajectory data can be used for traffic planning purposes, while online analyses of streaming trajectories can be adopted for congestion monitoring purposes. Existing trajectory-based systems tend to perform offline and online trajectory analysis separately, which is inefficient. In this paper, we propose a hybrid and efficient framework, called Dragoon , based on Spark, to support both offline and online big trajectory management and analytics. The framework features a mutable resilient distributed dataset model, including RDD Share, RDD Update, and RDD Mirror, which enables hybrid storage of historical and streaming trajectories. It also contains a real-time partitioner capable of efficiently distributing trajectory data and supporting both offline and online analyses. Therefore, Dragoon provides a hybrid analysis pipeline. Support for several typical trajectory queries and mining tasks demonstrates the flexibility of Dragoon. An extensive experimental study using both real and synthetic trajectory datasets shows that Dragoon (1) has similar offline trajectory query performance with the state-of-the-art system UlTraMan; (2) decreases up to doubled storage overhead compared with UlTraMan during trajectory editing; (3) achieves at least 40% improvement of scalability compared with popular streaming processing frameworks (i.e., Flink and Spark Streaming); and (4) offers an average doubled performance improvement for online trajectory data analytics.

Tinba: Incremental partitioning for efficient trajectory analytics

Time-Based Trajectory Data Partitioning for Efficient Range Query.

Dragoon: a Hybrid and Efficient Big Trajectory Management System for Offline and Online Analytics

Dynamic trajectory partition optimization method based on historical trajectory data

DITA: Distributed In-Memory Trajectory Analytics.

Cloud-Based Framework for Spatio-Temporal Trajectory Data Segmentation and Query

Compression of Uncertain Trajectories in Road Networks.

Partition-based range query for uncertain trajectories in road networks

TRACE: Real-time Compression of Streaming Trajectories in Road Networks

Scalable and Adaptive Joins for Trajectory Data in Distributed Stream System

An Efficient Online Approach for Direction-Preserving Trajectory Simplification with Interval Bounds.

Optimizing segmented trajectory data storage with HBase for improved spatio-temporal query efficiency

Recursive Partitioning Method for Trajectory Indexing

Ratel: Interactive Analytics for Large Scale Trajectories

Reference-Based Framework for Spatio-Temporal Trajectory Compression and Query Processing

SQUID: Subtrajectory Query in Trillion-Scale GPS Database

An Online Approach For Direction-Based Trajectory Compression With Error Bound Guarantee

Succinct Trit-array Trie for Scalable Trajectory Similarity Search

Non-Uniform Spatial Partitions and Optimized Trajectory Segments for Storage and Indexing of Massive GPS Trajectory Data

Distributed Subtrajectory Join on Massive Datasets

Distributed trajectory similarity search