Abstract:Sampling bias and class imbalance are important parts of model uncertainty that have a significant impact on the predictive probability of classification models. This study analyzed the influences of sampling bias and class imbalance on the performance of four common methods used in 10 models for seismic liquefactionBayesian network (BN), artificial neural network (ANN), logistic regression (LR), and support vector machine (SVM)using controlled experiments based on penetration test (SPT) data from 350 standard case histories. The data are divided into two data sets with class distributions of 150:150 and 200:100, which are separately stratified and sampled to obtain 11 different cases of distributions (10:90, 20:80, 25:75, 33:67, 40:60, 50:50, 60:40, 67:33, 75:25, 80:20, and 90:10) to quantify the predictive performance of the four models using statistical model validation metrics, such as overall accuracy, area under the receiver operating characteristic curve, precision, recall, and F-score. The experiments show that the best distribution of liquefaction samples for training is not a fixed point but, rather, a range. The authors suggest that the best range of sample distribution is from 1 to 1.5 (liquefaction/nonliquefaction) for the BN method, from 0.67 to 1 for the ANN method, approximately 0.5 for the LR model, and from 0.5 to 1 for the SVM method. Furthermore, oversampling technology was used to try to improve the predictive capability of the four models for two samples (10:90 and 90:10) with bad class imbalance and sampling bias. The predictive performance of the oversampled sample considerably improved over the original samples with bad class imbalance and sampling bias for the LR model and the SVM polynomial (SVM-Pol) model rather than for the BN maximum likelihood estimation (BN-MLE) model and the ANN radial basis function (ANN-RBF) model. In addition, in the fields with unknown real distribution of classes in the population, when a training sample contains severe class imbalance or sampling bias, the authors recommend that researchers choose an oversampled sample that has the same class distribution as the population of the collected data to ensure optimal performance.

Prediction of probability of seismic-induced liquefaction based on Bayesian network

A Bayesian Network Approach for Predicting Seismic Liquefaction Based on Interpretive Structural Modeling

Assessment of Seismic Liquefaction Potential Based on Bayesian Network Constructed from Domain Knowledge and History Data

Assessment of Liquefaction-Induced Hazards Using Bayesian Networks Based on Standard Penetration Test Data

Probabilistic Evaluation of Earthquake-Induced Liquefaction Using Bayesian Network Based on A Side-by-Side SPT-CPT Database

A continuous Bayesian network regression model for estimating seismic liquefaction‐induced settlement of the free‐field ground

Evaluating Seismic Soil Liquefaction Potential Using Bayesian Belief Network and C4.5 Decision Tree Approaches

Probabilistic evaluation of CPT-based seismic soil liquefaction potential: towards the integration of interpretive structural modeling and bayesian belief network

Evaluation of Liquefaction-Induced Lateral Displacement Using Bayesian Belief Networks

A Hybrid Approach for Evaluating CPT-based Seismic Soil Liquefaction Potential Using Bayesian Belief Networks

Prediction of liquefaction of gravelly soils based on a cost-sensitive Bayesian network combined with rough set weighting

Application of machine learning algorithms for the evaluation of seismic soil liquefaction potential

Analysis of the Influences of Sampling Bias and Class Imbalance on Performances of Probabilistic Liquefaction Models

A Step Forward Towards a Comprehensive Framework for Assessing Liquefaction Land Damage Vulnerability: Exploration from Historical Data

LLDV-a Comprehensive Framework for Assessing the Effects of Liquefaction Land Damage Potential

Bayesian network for characterizing model uncertainty of liquefaction potential evaluation models

Bayesian Prediction of Earthquake Network Based on Space–time Influence Domain

Bayes discriminant analysis model for seismic sand liquefaction

Probabilistic Estimation of Sand Liquefaction Based on Neural Network Model of Radial Basis Function

Study of Data-Driven Methods for Predicting Soil Liquefaction-Induced Lateral Displacement

A Constrained Neural Network Model for Soil Liquefaction Assessment with Global Applicability