Abstract:Accurate landslide displacement prediction is crucial for effective early warning systems to mitigate hazards. The importance of historical information varies with time during prediction due to the underlying landslide deformation mechanism. Despite advances in dynamic machine learning models like Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), they struggle to fully capture and interpret the varying importance of historical information during prediction, resulting in decreased accuracy and limited understanding of landslide physical mechanisms. Additionally, these approaches rely on manual feature selection, which is independent of the learning process and therefore is prone to estimation errors. To address these challenges, we propose LiteTransNet, a Lightweighted Transformer Network tailored for landslide displacement prediction. Built on the revolutionary Transformer model for sequential data, LiteTransNet leverages localized self-attention to selectively focus on relevant timestamps and provides interpretable results through its attention heatmap. Furthermore, LiteTransNet performs end-to-end time series modeling without extensive feature engineering. We validate LiteTransNet on two landslides in China's Three Gorges Reservoir Area and demonstrate its improved accuracy over recurrent baselines utilizing feature selection methods. Notably, the attention heatmap generated by LiteTransNet provides interpretable insights into the model's temporal dependency learning. It uncovers the varying importance of historical information at different timestamps, showcasing how LiteTransNet's attention aligns with specific periods of the external environment that cause significant disruptions in the landslide system. Our findings reveal that these disruptions continuously impact displacement prediction until their effects fade or are replaced by subsequent intense disturbances, which traditional recurrent methods are unable to capture. Further experiment shows that LiteTransNet enhances efficiency through its streamlined architecture and its parallelization capability. Overall, LiteTransNet innovates landslide prediction by providing accuracy, interpretability, and efficiency, enhancing understanding of deformation mechanisms to facilitate effective early warning systems.

Spatiotemporal prediction of landslide displacement using deep learning approaches based on monitored time-series displacement data: a case in the Huanglianshu landslide

Spatio-temporal probability prediction of rainfall-induced landslides based on deep learning under climate change

A Data‐driven Intelligent Model for Landslide Displacement Prediction

A Novel Hybrid LMD-ETS-TCN Approach for Predicting Landslide Displacement Based on GPS Time Series Analysis

Time series analysis and gated recurrent neural network model for predicting landslide displacements

Using time series analysis and dual-stage attention-based recurrent neural network to predict landslide displacement

Data Driven Models: Introduction

LiteTransNet: an Interpretable Approach for Landslide Displacement Prediction Using Transformer Model with Attention Mechanism

Landslide Displacement Prediction With Gated Recurrent Unit and Spatial-Temporal Correlation

Data Mining and Deep Learning for Predicting the Displacement of "Step-like" Landslides

Landslide displacement forecasting using deep learning and monitoring data across selected sites

Landslide Displacement Prediction Based on Multi-source Time Series

A novel data-driven hybrid intelligent prediction model for reservoir landslide displacement

Landslide Displacement Prediction Based on Time Series Analysis and Double-BiLSTM Model

Combining Numerical Simulation and Deep Learning for Landslide Displacement Prediction: An Attempt to Expand the Deep Learning Dataset

Landslide Deformation Prediction Based on a GNSS Time Series Analysis and Recurrent Neural Network Model

Prediction of landslide displacement with dynamic features using intelligent approaches

Algorithms for Intelligent Prediction of Landslide Displacements

A Novel Approach for Displacement Interval Forecasting of Landslides with Step-Like Displacement Pattern

A Graph Convolutional Incorporating GRU Network for Landslide Displacement Forecasting Based on Spatiotemporal Analysis of GNSS Observations

Displacement Prediction of the Muyubao Landslide Based on a GPS Time-Series Analysis and Temporal Convolutional Network Model