Abstract:With the explosive use of GPS-enabled devices, increasingly massive volumes of trajectory data capturing the movements of people and vehicles are becoming available, which is useful in many application areas, such as transportation, traffic management, and location-based services. As a result, many trajectory data management and analytic systems have emerged that target either offline or online settings. However, some applications call for both offline and online analyses. For example, in traffic management scenarios, offline analyses of historical trajectory data can be used for traffic planning purposes, while online analyses of streaming trajectories can be adopted for congestion monitoring purposes. Existing trajectory-based systems tend to perform offline and online trajectory analysis separately, which is inefficient. In this paper, we propose a hybrid and efficient framework, called Dragoon , based on Spark, to support both offline and online big trajectory management and analytics. The framework features a mutable resilient distributed dataset model, including RDD Share, RDD Update, and RDD Mirror, which enables hybrid storage of historical and streaming trajectories. It also contains a real-time partitioner capable of efficiently distributing trajectory data and supporting both offline and online analyses. Therefore, Dragoon provides a hybrid analysis pipeline. Support for several typical trajectory queries and mining tasks demonstrates the flexibility of Dragoon. An extensive experimental study using both real and synthetic trajectory datasets shows that Dragoon (1) has similar offline trajectory query performance with the state-of-the-art system UlTraMan; (2) decreases up to doubled storage overhead compared with UlTraMan during trajectory editing; (3) achieves at least 40% improvement of scalability compared with popular streaming processing frameworks (i.e., Flink and Spark Streaming); and (4) offers an average doubled performance improvement for online trajectory data analytics.

Mining Massive-Scale Spatiotemporal Trajectories in Parallel: A Survey.

A General and Parallel Platform for Mining Co-Movement Patterns over Large-scale Trajectories.

Time-Based Trajectory Data Partitioning for Efficient Range Query.

Dragoon: a Hybrid and Efficient Big Trajectory Management System for Offline and Online Analytics

An Efficient Data Processing Framework for Mining the Massive Trajectory of Moving Objects.

Trajectory Big Data Processing Based on Frequent Activity

Parallel Skyline Query Processing of Massive Incomplete Activity-Trajectories Data.

A Survey on Trajectory Data Mining: Techniques and Applications

Making Sense of Spatial Trajectories

Big Trajectory Data Mining: A Survey of Methods, Applications, and Services

Mining Spatio-Temporal Reachable Regions Over Massive Trajectory Data

Spatiotemporal Data Mining: A Survey

Distributed Skyline Trajectory Query Processing

High-performance spatiotemporal trajectory matching across heterogeneous data sources

Parallel Trajectory Search Based on Distributed Index

Deep Learning for Trajectory Data Management and Mining: A Survey and Beyond

A Comparative Study of Frequent Pattern Mining with Trajectory Data

Mining Trajectory Patterns Using Hidden Markov Models

Trajectory Big Data: A Review of Key Technologies in Data Processing

Non-Uniform Spatial Partitions and Optimized Trajectory Segments for Storage and Indexing of Massive GPS Trajectory Data

Efficient Mining of Hotspot Regional Patterns with Multi-Semantic Trajectories