Abstract:In this paper, we focus on a special problem in transportation studies that concerns the so called "Big Data" challenge, which is: how to build concise yet accurate traffic flow prediction models based on the massive data collected by different sensors? The size of the data, the hidden causal dependence and the complexity of traffic time series are some of the obstacles that affect making reliable forecast at a reasonable cost, both time-wise and computationwise. To better prepare the data for traffic modeling, we introduce a multiple-step strategy to process the raw "Big Data" into compact time series that are better suited for regression and causality analysis. First, we use the Granger causality to define and determine the potential dependence among data, and produce a much condensed set of times series who are also highly dependent. Next, we deploy a decomposition algorithm to separate daily-similar trend and nonstationary bursts components from the traffic flow time series yielded by the Granger test. The decomposition results are then treated by two rounds of Lasso regression: the standard Lasso method is first used to quickly filter out most of the irrelevant data, followed by a robust Lasso method to further remove the disturbance caused by bursts components and recover the strongest dependence among the remaining data. Test results show that the proposed method significantly reduces the costs of building prediction models. Moreover, the obtained causal dependence graph reveals the relationship between the structure of road networks and the correlations among traffic time series. All these findings are useful for building better traffic flow prediction models. (C) 2015 Elsevier Ltd. All rights reserved.

Mining Dependencies Considering Time Lag In Spatio-Temporal Traffic Data

Discovering Spatio-Temporal Dependencies Based on Time-Lag in Intelligent Transportation Data

Mining Spatio-Temporal Co-Location Patterns With Weighted Sliding Window

Robust Causal Dependence Mining in Big Data Network and Its Application to Traffic Flow Predictions

Mining Spatial Co-Location Patterns With Dynamic Neighborhood Constraint

Learning Dynamic Dependency Network Structure with Time Lag

A Deep Learning Framework for Traffic Data Imputation Considering Spatiotemporal Dependencies

Fuzzy Hybrid Framework with Dynamic Weights for Short‐term Traffic Flow Prediction by Mining Spatio‐temporal Correlations

A Short-Term Traffic Flow Prediction Model for Road Networks Using Inverse Isochrones to Determine Dynamic Spatiotemporal Correlation Ranges

Modeling Spatial-Temporal Dynamics for Traffic Prediction.

Mining Dependence Structures from Statistical Learning Perspective

A Deep Learning Approach for Traffic Condition Prediction with Dependency Extraction and Transfer.

Discovering Urban Spatio-temporal Structure from Time-Evolving Traffic Networks

Mining Spatio-Temporal Relations Via Self-Paced Graph Contrastive Learning

Mining Complex Time-Series Data by Learning Markovian Models

Improving Mining Quality by Exploiting Data Dependency

Mining Topological Dependencies of Recurrent Congestion in Road Networks

Revisiting Spatial-Temporal Similarity: A Deep Learning Framework for Traffic Prediction

A Spatio-Temporal Graph Neural Network Approach for Traffic Flow Prediction

Analyzing and modeling spatio-temporal dependence of cellular traffic at city scale