Abstract:Research on traffic data analysis is becoming more available and important. One of the key challenges is how to accurately decompose the high-dimensional, noisy observation traffic flow matrix into sub-matrices that correspond to different classes of traffic flow which builds a foundation for traffic flow prediction, abnormal data detection and missing data imputation. While in traditional research, Principal Component Analysis (PCA) is usually used for traffic matrix analysis. However, the traffic matrix is usually corrupted by large volume anomalies, the resulting principal components will be significantly skewed from those in the anomaly-free case. In this paper, we introduce the Robust Principal Component Analysis (robust PCA) for decomposition. It can mine more accurate and robust underlining temporal and spatial characteristics of traffic flow with all kinds of fluctuations. We performed a comparative experimental analysis based on robust PCA with PCA-based method on a real-life dataset and got better decomposition performance. In the real-life dataset, results show that through robust PCA most of the large volume anomalies are short-lived and well isolated in the residual traffic matrix while PCA failed. In traffic flow prediction experiments based on decomposition, it shows that the result based on robust PCA outperforms the PCA and simple average. It provide adequate evidence that robust PCA is more appropriate for traffic flow matrix analysis. Robust PCA shows promising abilities in improving the accuracy and reliability of traffic flow analysis.

Robust PCA-Based Abnormal Traffic Flow Pattern Isolation and Loop Detector Fault Detection

Traffic Flow Decomposition and Prediction Based on Robust Principal Component Analysis

&Lt;title>automatic Traffic Real-Time Analysis System Based on Video</title>

The abnormal traffic detection scheme based on PCA and SSH

Real‐time Passenger Flow Anomaly Detection in Metro System

Traffic Data Analysis Using Kernel PCA and Self-Organizing Map

Methods of real-time screening and reconstruction for dynamic traffic abnormal data

PCA-subspace Method - is It Good Enough for Network-Wide Anomaly Detection.

Statistical Analysis for Origin-Destination Traffic Anomalies

Multi-dimensional Traffic Anomaly Detection Based on ICA

Structure Analysis of Network Traffic Matrix Based on Relaxed Principal Component Pursuit

A PCA-Based Traffic Monitoring Approach for Distributed Computing Systems

On-line diagnosis of abnormal conditions of air separation process by dynamic PCA

Structural Analysis of Network Traffic Matrix via Relaxed Principal Component Pursuit

Fault Detection and Isolation Based on Abnormal Sub-Regions Using the Improved Pca

Traffic System Anomaly Detection Using Spatiotemporal Pattern Networks

Traffic Abnormality Detection Through Directional Motion Behavior Map

Features Retrieval of Urban Traffic Flow Using PCA

Use of Principal Component Analysis to Deal with Class Imbalance Problem for Traffic Incident Detection

Research on the detection of abnormal traffic for multi-channel network

A RMT and PCA-Based Method of Monitoring the Large-Scale Traffic Pattern