Abstract:Machine learning (ML) algorithms have been widely applied to analyze geotechnical engineering problems due to recent advances in data science. However, flexible ML models trained with limited data can exhibit unexpected behaviors, leading to low interpretability and physical inconsistency, thus, reducing the reliability and robustness of ML models for risk forecasting and engineering applications. As input features for geotechnical engineering applications often represent physical parameters following intrinsic and often monotonic relationships, incorporating monotonicity into ML models can help ensure the physical realism of model outputs. In this study, monotonicity was introduced as a soft constraint into artificial neural network (ANN) models, and their results were compared with several benchmark ML models. During the training process, data augmentation and point-wise gradient were used to evaluate the monotonicity of model predictions, and monotonicity violations were minimized through a modified loss function. A compilation of slope stability case histories from the literature was used for model development, benchmarking their performance, and evaluating the effects of monotonicity constraints. Cross-validation procedures were used for all model performance evaluations to reduce bias in sample selections. Results showed that unconstrained ML models produced predictions that violate monotonicity in many parts of the input space. However, by adding monotonicity constraints into ANN models, monotonicity violations were effectively reduced while maintaining relatively high performance, thus providing a more robust and interpretable prediction. Using slope stability prediction as a proxy, the methods developed in this study to incorporate monotonicity constraints into ML models can be applied to many geotechnical engineering applications. The proposed approach enhances the reliability and interpretability of ML models, resulting in more accurate and consistent outcomes for real-world applications.

Nonparametric and semiparametric regressions subject to monotonicity constraints: Estimation and forecasting

Forecasting Equity Premium: Global Historical Average Versus Local Historical Average and Constraints

Testing Regression Monotonicity in Econometric Models

Partially linear monotone methods with automatic variable selection and monotonicity direction discovery

Approach to Testing Nonlinear Time Series Models

A UNIFIED STUDY OF NONPARAMETRIC INFERENCE FOR MONOTONE FUNCTIONS

Estimating high dimensional monotone index models by iterative convex optimization

An Improved Generalized Spectral Test for Conditional Mean Models in Time Series with Conditional Heteroskedasticity of Unknown Form

Robustify Financial Time Series Forecasting with Bagging

Electronic structure study by means of X-ray spectroscopy and theoretical calculations of the "ferric star" single molecule magnet

Validating Forecasts of the Joint Probability Density of Bond Yields: Can Affine Models Beat Random Walk?

Adaptive Inference in Multivariate Nonparametric Regression Models Under Monotonicity

Generalized Spectral Tests for Conditional Mean Models in Time Series with Conditional Heteroscedasticity of Unknown Form

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

A joint estimation approach for monotonic regression functions in general dimensions

Specification Testing for Nonparametric Structural Models with Monotonicity in Unobservables

Better the devil you know: Improved forecasts from imperfect models

Estimation and Forecasting of Dynamic Conditional Covariance: A Semiparametric Multivariate Model

Confidence intervals in monotone regression

Simultaneously Reconciled Quantile Forecasting of Hierarchically Related Time Series

Machine Learning with Monotonic Constraint for Geotechnical Engineering Applications: an Example of Slope Stability Prediction