Abstract:With the explosive use of GPS-enabled devices, increasingly massive volumes of trajectory data capturing the movements of people and vehicles are becoming available, which is useful in many application areas, such as transportation, traffic management, and location-based services. As a result, many trajectory data management and analytic systems have emerged that target either offline or online settings. However, some applications call for both offline and online analyses. For example, in traffic management scenarios, offline analyses of historical trajectory data can be used for traffic planning purposes, while online analyses of streaming trajectories can be adopted for congestion monitoring purposes. Existing trajectory-based systems tend to perform offline and online trajectory analysis separately, which is inefficient. In this paper, we propose a hybrid and efficient framework, called Dragoon , based on Spark, to support both offline and online big trajectory management and analytics. The framework features a mutable resilient distributed dataset model, including RDD Share, RDD Update, and RDD Mirror, which enables hybrid storage of historical and streaming trajectories. It also contains a real-time partitioner capable of efficiently distributing trajectory data and supporting both offline and online analyses. Therefore, Dragoon provides a hybrid analysis pipeline. Support for several typical trajectory queries and mining tasks demonstrates the flexibility of Dragoon. An extensive experimental study using both real and synthetic trajectory datasets shows that Dragoon (1) has similar offline trajectory query performance with the state-of-the-art system UlTraMan; (2) decreases up to doubled storage overhead compared with UlTraMan during trajectory editing; (3) achieves at least 40% improvement of scalability compared with popular streaming processing frameworks (i.e., Flink and Spark Streaming); and (4) offers an average doubled performance improvement for online trajectory data analytics.

Cloud-Based Framework for Spatio-Temporal Trajectory Data Segmentation and Query

Time-Based Trajectory Data Partitioning for Efficient Range Query.

Optimizing segmented trajectory data storage with HBase for improved spatio-temporal query efficiency

An Effective Spatio-Temporal Query Framework for Massive Trajectory Data in Urban Computing

Parallel Trajectory Search Based on Distributed Index

High-performance spatiotemporal trajectory matching across heterogeneous data sources

Distributed trajectory similarity search

Non-Uniform Spatial Partitions and Optimized Trajectory Segments for Storage and Indexing of Massive GPS Trajectory Data

An Efficient and Distributed Framework for Real-Time Trajectory Stream Clustering

Distributed Skyline Trajectory Query Processing

Trajectory Big Data Processing Based on Frequent Activity

Multi-scale Trajectory Data Management and Query

A Cloud-Based Trajectory Data Management System

Scalable and Adaptive Joins for Trajectory Data in Distributed Stream System

Managing massive trajectories on the cloud.

Trajspark: A Scalable And Efficient In-Memory Management System For Big Trajectory Data

SQUID: Subtrajectory Query in Trillion-Scale GPS Database

A trajectory data density partition based distributed parallel clustering method

Parallel Skyline Query Processing of Massive Incomplete Activity-Trajectories Data.

Dragoon: a Hybrid and Efficient Big Trajectory Management System for Offline and Online Analytics

Query Processing of Massive Trajectory Data Based on Mapreduce