Abstract:The Active Traffic Management (ATM) system has been widely used in the United States and the European countries to improve the traffic safety of urban expressways. The accurate real-time crash risk prediction is fundamental to the system running well. Crash data are characterized by small probability, which poses a typical Imbalanced Data Classification problem. Most previous studies mainly improved the prediction methods only in data level or algorithm level, which may be inadequate to predict the crash risk accurately especially in a continuous real-time traffic data environment. The comprehensive imbalanced classification algorithm was examined in this research to build more accurate real-time traffic crash risk prediction model. At the output level, the Youden index method has been proved to be of the best ability to divide the prediction results and Probability Calibration Method was proposed to optimize the prediction results in further. At the data level, Under-sampling and Synthetic Minority Oversampling Technique(SMOTE) methods were compared to solve the imbalanced data classification problem by changing the data distribution. At the algorithm level, the cost-sensitive MLP algorithm and Adaboost algorithm were examined and finally the random sampling cost-sensitive MLP model(RCSMLP) and Rusboost model were constructed by synthesizing the optimization methods from three levels. The sensitivity of the RCSMLP model reached 78.10 % and the specificity of the model reached 81.44 %. The AUC and sensitivity of the Rusboost model reached 0.892 and 0.842 while the specificity of the model reached 0.816, which shows the better performance in dealing with the imbalanced traffic crash risk prediction problem compared to existed prediction models. The proposed method of improving prediction accuracy in this study is universal and can be applied to many other prediction models to predict real-time traffic crash risk.

Study of Internet Traffic Classification Method Based on Bootstrapping

Imbalanced Data Sets Classification Method Based on Over-Sampling Technique

A Comparison of Improving Multi-Class Imbalance for Internet Traffic Classification

Classifying Imbalanced Internet Traffic Based PCDD

BalancedBoost: A hybrid approach for real-time network traffic classification

Internet Traffic Classification Using Machine Learning: A Token-based Approach

Internet traffic prediction by w-boost: classification and regression

Internet Traffic Classification Based on Decision Tree

Online Internet Traffic Identification Algorithm Based on Multistage Classifier

SmoteAdaNL: a learning method for network traffic classification

Accurate Classification of the Internet Traffic Based on the SVM Method

A Novel Imbalanced Data Classification Method Based on Weakly Supervised Learning for Fault Diagnosis

A new re-sampling method for network traffic classification using SML

A Statistical-Feature-based Approach to Internet Traffic Classification Using Machine Learning.

Internet Traffic Classification Based on Random Forest

Study on Internet Traffic Classification Using Machine Learning

Examining imbalanced classification algorithms in predicting real-time traffic crash risk

Internet traffic classification using DBSCAN

Machine Learning Algorithms for Classifying the Imbalanced Protocol Flows: Evaluation and Comparison

Hybrid approach with Membership-density based oversampling for handling multi-class imbalance in internet traffic identification with overlapping and noise

A New Feature Selection Method For Internet Traffic Classification Using Ml