Abstract:Machine learning (ML) algorithms have been widely applied to analyze geotechnical engineering problems due to recent advances in data science. However, flexible ML models trained with limited data can exhibit unexpected behaviors, leading to low interpretability and physical inconsistency, thus, reducing the reliability and robustness of ML models for risk forecasting and engineering applications. As input features for geotechnical engineering applications often represent physical parameters following intrinsic and often monotonic relationships, incorporating monotonicity into ML models can help ensure the physical realism of model outputs. In this study, monotonicity was introduced as a soft constraint into artificial neural network (ANN) models, and their results were compared with several benchmark ML models. During the training process, data augmentation and point-wise gradient were used to evaluate the monotonicity of model predictions, and monotonicity violations were minimized through a modified loss function. A compilation of slope stability case histories from the literature was used for model development, benchmarking their performance, and evaluating the effects of monotonicity constraints. Cross-validation procedures were used for all model performance evaluations to reduce bias in sample selections. Results showed that unconstrained ML models produced predictions that violate monotonicity in many parts of the input space. However, by adding monotonicity constraints into ANN models, monotonicity violations were effectively reduced while maintaining relatively high performance, thus providing a more robust and interpretable prediction. Using slope stability prediction as a proxy, the methods developed in this study to incorporate monotonicity constraints into ML models can be applied to many geotechnical engineering applications. The proposed approach enhances the reliability and interpretability of ML models, resulting in more accurate and consistent outcomes for real-world applications.

Local Generalization Error Based Monotonic Classification Extreme Learning Machine

Monotonic classification extreme learning machine.

Multiple-kernel-learning-based Extreme Learning Machine for Classification Design

Genetic Ensemble of Extreme Learning Machine

Extreme Learning Machine Based Transfer Learning for Data Classification.

Large-margin Feature Selection for Monotonic Classification

Training an Extreme Learning Machine by Localized Generalization Error Model

Monotone Learning

Feature Selection for Monotonic Classification Via Maximizing Monotonic Dependency

Feature Selection for Monotonic Classification

Improved Adaptive Incremental Error-Minimization-Based Extreme Learning Machine With Localized Generalization Error Model

Laplacian Generalized Eigenvalues Extreme Learning Machine

Machine Learning with Monotonic Constraint for Geotechnical Engineering Applications: an Example of Slope Stability Prediction

Metric learning for monotonic classification: turning the space up to the limits of monotonicity

Discriminative Globality-Locality Preserving Extreme Learning Machine for Image Classification.

A new regularization classification method based on extreme learning machine in network data

Extreme Learning Machine Based on Adaptive Matrix Iteration.

Class-weighted Neural Network for Monotonic Imbalanced Classification

Induction of Monotonic Decision Trees

Globality-Locality Preserving Maximum Variance Extreme Learning Machine

Monotonic Learning with Hypothesis Evolution