Abstract:Machine learning (ML) algorithms have been widely applied to analyze geotechnical engineering problems due to recent advances in data science. However, flexible ML models trained with limited data can exhibit unexpected behaviors, leading to low interpretability and physical inconsistency, thus, reducing the reliability and robustness of ML models for risk forecasting and engineering applications. As input features for geotechnical engineering applications often represent physical parameters following intrinsic and often monotonic relationships, incorporating monotonicity into ML models can help ensure the physical realism of model outputs. In this study, monotonicity was introduced as a soft constraint into artificial neural network (ANN) models, and their results were compared with several benchmark ML models. During the training process, data augmentation and point-wise gradient were used to evaluate the monotonicity of model predictions, and monotonicity violations were minimized through a modified loss function. A compilation of slope stability case histories from the literature was used for model development, benchmarking their performance, and evaluating the effects of monotonicity constraints. Cross-validation procedures were used for all model performance evaluations to reduce bias in sample selections. Results showed that unconstrained ML models produced predictions that violate monotonicity in many parts of the input space. However, by adding monotonicity constraints into ANN models, monotonicity violations were effectively reduced while maintaining relatively high performance, thus providing a more robust and interpretable prediction. Using slope stability prediction as a proxy, the methods developed in this study to incorporate monotonicity constraints into ML models can be applied to many geotechnical engineering applications. The proposed approach enhances the reliability and interpretability of ML models, resulting in more accurate and consistent outcomes for real-world applications.

Monotonic Learning with Hypothesis Evolution

Monotone Learning

How to address monotonicity for model risk management?

Machine Learning with Monotonic Constraint for Geotechnical Engineering Applications: an Example of Slope Stability Prediction

Expressive Monotonic Neural Networks

Metric learning for monotonic classification: turning the space up to the limits of monotonicity

Continual Prototype Evolution: Learning Online from Non-Stationary Data Streams

Monotonicity for AI ethics and society: An empirical study of the monotonic neural additive model in criminology, education, health care, and finance

Evolutionary Learning: Advances in Theories and Algorithms

Online continual learning through unsupervised mutual information maximization

An alternative approach to train neural networks using monotone variational inequality

Variance-Reduced Gradient Estimation via Noise-Reuse in Online Evolution Strategies

Smooth Min-Max Monotonic Networks

Deep Isotonic Embedding Network: A flexible Monotonic Neural Network

Partially linear monotone methods with automatic variable selection and monotonicity direction discovery

Monotonic classification: an overview on algorithms, performance measures and data sets

Can I Trust the Explanations? Investigating Explainable Machine Learning Methods for Monotonic Models

Incremental Majorization-Minimization Optimization with Application to Large-Scale Machine Learning

Brain-Inspired Constructive Learning Algorithms with Evolutionally Additive Nonlinear Neurons

Easy Monotonic Policy Iteration

Monotonic Neural Additive Models: Pursuing Regulated Machine Learning Models for Credit Scoring