Abstract:With the widespread deployment of mobile devices with positioning capabilities, increasingly massive volumes of trajectory data are being collected that capture the movements of people and vehicles. This data enables co-movement pattern detection, which is important in applications such as trajectory compression and future-movement prediction. Existing co-movement pattern detection studies generally consider historical data and thus propose offline algorithms. However, applications such as future movement prediction need real-time processing over streaming trajectories. Thus, we investigate real-time distributed co-movement pattern detection over streaming trajectories. Existing off-line methods assume that all data is available when the processing starts. Nevertheless, in a streaming setting, unbounded data arrives in real time, making pattern detection challenging. To this end, we propose a framework based on Apache Flink, which is designed for efficient distributed streaming data processing. The framework encompasses two phases: clustering and pattern enumeration. To accelerate the clustering, we use a range join based on two-layer indexing, and provide techniques that eliminate unnecessary verifications. To perform pattern enumeration efficiently, we present two methods FBA and VBA that utilize id-based partitioning. When coupled with bit compression and candidate-based enumeration techniques, we reduce the enumeration cost from exponential to linear. Extensive experiments offer insight into the efficiency of the proposed framework and its constituent techniques compared with existing methods.

Efficient Evaluation of Composite Correlations for Streaming Time Series

Filcorr: Filtered And Lagged Correlation On Streaming Time Series

Correlation Joins over Time Series Data Streams Utilizing Complementary Dimension Reduction and Transformation

Continually Evaluating Similarity-Based Pattern Queries on a Streaming Time Series

Local Correlation Detection with Linearity Enhancement in Streaming Data

Multi-Dimensional Regression Analysis of Time-Series Data Streams.

RLC: ranking lag correlations with flexible sliding windows in data streams

Static and Streaming Discovery of Maximal Linear Representation Between Time Series

Online Multi-label Streaming Feature Selection with Label Correlation

Efficient Principal Subspace Projection of Streaming Data Through Fast Similarity Matching

SCD-CA: Stable Concept Drift Learning Based on Correlation Alignment for Streaming Data Forecasting.

Identifying Correlated Heavy-Hitters in a Two-Dimensional Data Stream

Lead-lag Analysis Via Sparse Co-Projection in Correlated Text Streams

Exploring Inter-Frame Correlation Analysis and Wavelet-Domain Modeling for Real-Time Caption Detection in Streaming Video

Correlated Anomaly Detection from Large Streaming Data

Differentially Private Streaming Data Release under Temporal Correlations via Post-processing

Low-Latency ML Inference by Grouping Correlated Data Objects and Computation

Fast and Accurate Dual-Way Streaming PARAFAC2 for Irregular Tensors -- Algorithm and Application

Real-time distributed co-movement pattern detection on streaming trajectories

Condition Evaluation for Speculative Systems: a Streaming Time Series Case.

Evaluating Continuous Nearest Neighbor Queries for Streaming Time Series Via Pre-Fetching.