Abstract:Research on traffic data analysis is becoming more available and important. One of the key challenges is how to accurately decompose the high-dimensional, noisy observation traffic flow matrix into sub-matrices that correspond to different classes of traffic flow which builds a foundation for traffic flow prediction, abnormal data detection and missing data imputation. While in traditional research, Principal Component Analysis (PCA) is usually used for traffic matrix analysis. However, the traffic matrix is usually corrupted by large volume anomalies, the resulting principal components will be significantly skewed from those in the anomaly-free case. In this paper, we introduce the Robust Principal Component Analysis (robust PCA) for decomposition. It can mine more accurate and robust underlining temporal and spatial characteristics of traffic flow with all kinds of fluctuations. We performed a comparative experimental analysis based on robust PCA with PCA-based method on a real-life dataset and got better decomposition performance. In the real-life dataset, results show that through robust PCA most of the large volume anomalies are short-lived and well isolated in the residual traffic matrix while PCA failed. In traffic flow prediction experiments based on decomposition, it shows that the result based on robust PCA outperforms the PCA and simple average. It provide adequate evidence that robust PCA is more appropriate for traffic flow matrix analysis. Robust PCA shows promising abilities in improving the accuracy and reliability of traffic flow analysis.

A Comparison Study For Traffic Flow Data Compression

A Flow Volumes Data Compression Approach for Traffic Network Based on Principal Component Analysis

Comparative Study of PCA and ICA Based Traffic Flow Compression

Traffic flow data compression considering burst components

Mining Road Network Correlation for Traffic Estimation Via Compressive Sensing

P4CTM: Compressed Traffic Pattern Matching Based on Programmable Data Plane

Estimating Traffic Flow in Large Road Networks Based on Multi-Source Traffic Data

A Method for Urban Traffic Data Compression Based on Wavelet-PCA

Traffic Flow Decomposition and Prediction Based on Robust Principal Component Analysis

Comparison on PPCA, KPPCA and MPPCA based missing data imputing for traffic flow

Missing Traffic Data: Comparison of Imputation Methods

The Combined Short-Term Forecasting Approach to Traffic Flow Based on Non-Parametric Regression

Comparative Study On Feature Extraction Of Mass Traffic Data Using Multiple Methods

Leveraging Spatial and Temporal Correlations for Network Traffic Compression

Structural Analysis of Network Traffic Matrix via Relaxed Principal Component Pursuit

Traffic Prediction, Data Compression, Abnormal Data Detection and Missing Data Imputation: an Integrated Study Based on the Decomposition of Traffic Time Series

Forecasting Approach for Short-term Traffic Flow Based on Principal Component Analysis and Combined Neural Network

Robust PCA-Based Abnormal Traffic Flow Pattern Isolation and Loop Detector Fault Detection

Tracing Road Network Bottleneck By Data Driven Approach

A Survey on Data Compression Techniques for Automotive LiDAR Point Clouds

Traffic Data Analysis Using Kernel PCA and Self-Organizing Map