Abstract:Machine learning (ML) algorithms have been widely applied to analyze geotechnical engineering problems due to recent advances in data science. However, flexible ML models trained with limited data can exhibit unexpected behaviors, leading to low interpretability and physical inconsistency, thus, reducing the reliability and robustness of ML models for risk forecasting and engineering applications. As input features for geotechnical engineering applications often represent physical parameters following intrinsic and often monotonic relationships, incorporating monotonicity into ML models can help ensure the physical realism of model outputs. In this study, monotonicity was introduced as a soft constraint into artificial neural network (ANN) models, and their results were compared with several benchmark ML models. During the training process, data augmentation and point-wise gradient were used to evaluate the monotonicity of model predictions, and monotonicity violations were minimized through a modified loss function. A compilation of slope stability case histories from the literature was used for model development, benchmarking their performance, and evaluating the effects of monotonicity constraints. Cross-validation procedures were used for all model performance evaluations to reduce bias in sample selections. Results showed that unconstrained ML models produced predictions that violate monotonicity in many parts of the input space. However, by adding monotonicity constraints into ANN models, monotonicity violations were effectively reduced while maintaining relatively high performance, thus providing a more robust and interpretable prediction. Using slope stability prediction as a proxy, the methods developed in this study to incorporate monotonicity constraints into ML models can be applied to many geotechnical engineering applications. The proposed approach enhances the reliability and interpretability of ML models, resulting in more accurate and consistent outcomes for real-world applications.

Long Short-term Memory modeling method with monotonicity analysis as constraints base on Spearman coefficient

Hybrid Deep Learning Model for Prediction of Monotonic and Cyclic Responses of Sand

RNN algorithm optimization based on extended unsaturated region

Power Load Prediction Model Based on Long Short Term Memory and Sparrow Search Algorithm

Modeling Task Relationships in Multivariate Soft Sensor with Balanced Mixture-of-Experts

Machine Learning with Monotonic Constraint for Geotechnical Engineering Applications: an Example of Slope Stability Prediction

Expressive Monotonic Neural Networks

Major–Minor Long Short-Term Memory for Word-Level Language Model

Partially linear monotone methods with automatic variable selection and monotonicity direction discovery

Encourage or Inhibit Monosemanticity? Revisit Monosemanticity from a Feature Decorrelation Perspective

How to address monotonicity for model risk management?

Improving the Generalization Ability in Essay Coherence Evaluation through Monotonic Constraints

Research on Highway Slope Monitoring Data Prediction Based on Long Short-term Memory Network

Monotonic Neural Additive Models: Pursuing Regulated Machine Learning Models for Credit Scoring

Improve Long-term Memory Learning Through Rescaling the Error Temporally

Smooth Min-Max Monotonic Networks

A Hybrid Spiking Neurons Embedded LSTM Network for Multivariate Time Series Learning under Concept-Drift Environment

A new latent semantic analysis language model

Multi-View Lstm Language Model With Word-Synchronized Auxiliary Feature For Lvcsr

Monotonic Alignments for Summarization

Memory-Enhanced Latent Semantic Model: Short Text Understanding for Sentiment Analysis.