Abstract:Some special natural and social events like natural disasters, terrorism attacks, and traffic accidents may have remarkable effect on people's collective behaviors, which means the behaviors of a large number of people viewed as a whole. Analysis of the patterns of collective behaviors in the sense of data mining is an important topic. Solving this problem is crucial and practical in that online detection of abnormal patterns of people's collective behaviors may lead to rapid response to emergent affairs. In terms of technology, the task can be regarded as detection of abnormal particle movement patterns from a global point of view. In this study, we propose a solution to solve this problem. First, the traffic flows observed by more than 4000 sensors are organized as high-dimensional time series. Second, a widely used manifold learning technique referred to as locally linear embedding (LLE) is used to compute the K coefficients in fitting every data point with its K nearest neighbors in the high-dimensional space, which can be regarded as a K-dimensional local feature associated with every data point. Then, the local features of the data points within a time window are summarized by using principal component analysis (PCA) to obtain a global feature to represent the traffic data in every time window. Finally, outlier detection is performed on such PCALLE feature space. The experimental results show that the proposed method can effectively detect abnormal traffic patterns, which correspond with some special days, like the New Year day, the national day of America, and some days with extreme weather. © 2011 IEEE.

Manifold Structure Analysis of Tactical Network Traffic Matrix Based on Maximum Variance Unfolding Algorithm

Structural Analysis of Network Traffic Matrix via Relaxed Principal Component Pursuit

Structure Analysis of Network Traffic Matrix Based on Relaxed Principal Component Pursuit

A Matrix-Based Visualization System for Network Traffic Forensics

Internet Traffic Matrix Structural Analysis Based on Multi-Resolution RPCA

Grassmann Manifold Based State Analysis Method of Traffic Surveillance Video

Anomaly Detection on Collective Moving Patterns: Manifold Learning Based Analysis of Traffic Streams.

A Novel Network Tomography Approach for Traffic Matrix Estimation Problem in Large-Scale IP Backbone Networks

Joint Time-Frequency Sparse Estimation of Large-Scale Network Traffic

A Large-Scale Network Data Analysis Via Sparse and Low Rank Reconstruction

Urban Traffic Pattern Analysis and Applications Based on Spatio-Temporal Non-Negative Matrix Factorization

An Entropy Based Algorithm to Find Critical Traffic Matrices

Structure Regularized Traffic Monitoring for Traffic Matrix Estimation and Anomaly Detection by Link-Load Measurements.

Network Traffic Analysis System Based on Multidimensional Data Model

Traffic Anomaly Detection in Backbone Networks Using Classification of Multidimensional Time Series of Entropy

Traffic State Spatial-Temporal Characteristic Analysis and Short-Term Forecasting Based on Manifold Similarity

Analysis of Inter-Domain Traffic Correlations: Random Matrix Theory Approach

Monitoring of Link Traffic Patterns Based on Random Matrix Theory

Intrusion Detection using Spatial-Temporal features based on Riemannian Manifold

Network Volume Anomaly Detection and Identification in Large-Scale Networks Based on Online Time-Structured Traffic Tensor Tracking

Statistical Traffic State Analysis in Large-scale Transportation Networks Using Locality-Preserving Non-negative Matrix Factorization