Abstract:Accurate landslide displacement prediction is crucial for effective early warning systems to mitigate hazards. The importance of historical information varies with time during prediction due to the underlying landslide deformation mechanism. Despite advances in dynamic machine learning models like Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), they struggle to fully capture and interpret the varying importance of historical information during prediction, resulting in decreased accuracy and limited understanding of landslide physical mechanisms. Additionally, these approaches rely on manual feature selection, which is independent of the learning process and therefore is prone to estimation errors. To address these challenges, we propose LiteTransNet, a Lightweighted Transformer Network tailored for landslide displacement prediction. Built on the revolutionary Transformer model for sequential data, LiteTransNet leverages localized self-attention to selectively focus on relevant timestamps and provides interpretable results through its attention heatmap. Furthermore, LiteTransNet performs end-to-end time series modeling without extensive feature engineering. We validate LiteTransNet on two landslides in China's Three Gorges Reservoir Area and demonstrate its improved accuracy over recurrent baselines utilizing feature selection methods. Notably, the attention heatmap generated by LiteTransNet provides interpretable insights into the model's temporal dependency learning. It uncovers the varying importance of historical information at different timestamps, showcasing how LiteTransNet's attention aligns with specific periods of the external environment that cause significant disruptions in the landslide system. Our findings reveal that these disruptions continuously impact displacement prediction until their effects fade or are replaced by subsequent intense disturbances, which traditional recurrent methods are unable to capture. Further experiment shows that LiteTransNet enhances efficiency through its streamlined architecture and its parallelization capability. Overall, LiteTransNet innovates landslide prediction by providing accuracy, interpretability, and efficiency, enhancing understanding of deformation mechanisms to facilitate effective early warning systems.

Transformer-based Structural Seismic Response Prediction

Time Series Estimation Based on Deep Learning for Structural Dynamic Nonlinear Prediction

Structural Surrogate Model and Dynamic Response Prediction with Consideration of Temporal and Spatial Evolution: an Encoder–Decoder ConvLSTM Network

TransFrameNet: A Transformer-Based Approach for Generalized Seismic Performance Prediction of Building Structures

A Novel Sequence-to-Sequence-Based Deep Learning Model for Multistep Load Forecasting.

LSTM, WaveNet, and 2D CNN for nonlinear time history prediction of seismic responses

A nonlinear structural pulse-like seismic response prediction method based on pulse-like identification and decomposition learning

Combination of physics‐based and data‐driven modeling for nonlinear structural seismic response prediction through deep residual learning

A Multi-channel Input Framework for Structure Displacement Response Prediction Using Convolutional Neural Network

LiteTransNet: an Interpretable Approach for Landslide Displacement Prediction Using Transformer Model with Attention Mechanism

MLA-TCN: Multioutput Prediction of Dam Displacement Based on Temporal Convolutional Network with Attention Mechanism

Seismic response prediction method of train-bridge coupled system based on convolutional neural network-bidirectional long short-term memory-attention modeling

SeisGPT: A Physics-Informed Data-Driven Large Model for Real-Time Seismic Response Prediction

Time history seismic response prediction of multiple homogeneous building structures using only one deep learning‐based Structure Temporal Fusion Network

Pulse-type seismic response prediction for uncertain structures based on the attention mechanism and wavelet decomposition augmented decomposition learning

Structural seismic response prediction based on convolutional neural networks

A feature decomposition-based deep transfer learning framework for concrete dam deformation prediction with observational insufficiency

A Deep Learning Prediction Model for Structural Deformation Based on Temporal Convolutional Networks

Advanced hybrid LSTM-transformer architecture for real-time multi-task prediction in engineering systems

A Deep Learning-Based Integration Method for Hybrid Seismic Analysis of Building Structures: Numerical Validation

Probabilistic Seismic Response Prediction of Three-Dimensional Structures Based on Bayesian Convolutional Neural Network