Abstract:Accurate landslide displacement prediction is crucial for effective early warning systems to mitigate hazards. The importance of historical information varies with time during prediction due to the underlying landslide deformation mechanism. Despite advances in dynamic machine learning models like Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), they struggle to fully capture and interpret the varying importance of historical information during prediction, resulting in decreased accuracy and limited understanding of landslide physical mechanisms. Additionally, these approaches rely on manual feature selection, which is independent of the learning process and therefore is prone to estimation errors. To address these challenges, we propose LiteTransNet, a Lightweighted Transformer Network tailored for landslide displacement prediction. Built on the revolutionary Transformer model for sequential data, LiteTransNet leverages localized self-attention to selectively focus on relevant timestamps and provides interpretable results through its attention heatmap. Furthermore, LiteTransNet performs end-to-end time series modeling without extensive feature engineering. We validate LiteTransNet on two landslides in China's Three Gorges Reservoir Area and demonstrate its improved accuracy over recurrent baselines utilizing feature selection methods. Notably, the attention heatmap generated by LiteTransNet provides interpretable insights into the model's temporal dependency learning. It uncovers the varying importance of historical information at different timestamps, showcasing how LiteTransNet's attention aligns with specific periods of the external environment that cause significant disruptions in the landslide system. Our findings reveal that these disruptions continuously impact displacement prediction until their effects fade or are replaced by subsequent intense disturbances, which traditional recurrent methods are unable to capture. Further experiment shows that LiteTransNet enhances efficiency through its streamlined architecture and its parallelization capability. Overall, LiteTransNet innovates landslide prediction by providing accuracy, interpretability, and efficiency, enhancing understanding of deformation mechanisms to facilitate effective early warning systems.

Study on Prediction of Zinc Grade by Transformer Model with De-Stationary Mechanism

Grade prediction of zinc tailings using an encoder-decoder model in froth flotation

Unsupervised Domain Adaptation for Grade Prediction of Froth Flotation Based on Wasserstein Distance and Transformer

Grouped Time Series Networks for Grade Monitoring of Zinc Tailings With Multisource Features

Exploring Time-Series Transformers for Spatio-Temporal Prediction of Microstructural Evolution of Polycrystalline Grain

ES-net: An Integration Model Based on Encoder–Decoder and Siamese Time Series Difference Network for Grade Monitoring of Zinc Tailings and Concentrate

Long short-term memory-based grade monitoring in froth flotation using a froth video sequence

Prediction of X-ray Fluorescence Copper Grade Using Regularized Stochastic Configuration Networks

Mat-Transformer-Based State Prediction Method for Information Equipment

Non-stationary Transformers: Exploring the Stationarity in Time Series Forecasting

MsFfTsGP: Multi-source features-fused two-stage grade prediction of zinc tailings in lead-zinc flotation process via multi-stream 3D convolution with attention mechanism

LiteTransNet: an Interpretable Approach for Landslide Displacement Prediction Using Transformer Model with Attention Mechanism

Evaluating a Coupled Discrete Wavelet Transform and Support Vector Regression for Daily and Monthly Streamflow Forecasting

Dynamic Real-Time Prediction of Reclaimed Water Volumes Using the Improved Transformer Model and Decomposition Integration Technology

Long-Term Prediction of Sea Surface Temperature by Temporal Embedding Transformer With Attention Distilling and Partial Stacked Connection

Non-stationary Transformers: Rethinking the Stationarity in Time Series Forecasting

A Ladder Water Level Prediction Model for the Yangtze River Based on Transfer Learning and Transformer

Stock Price Prediction Based on Non-Stationary Transformers Model

A Transformer Based Method with Wide Attention Range for Enhanced Short-term Load Forecasting

An ensemble model for accurate prediction of key water quality parameters in river based on deep learning methods

Prediction of multi-stage froth flotation efficiency of complex lead–zinc sulfide ore using an integrated ensemble neural network–random forest model