Abstract:Accurate landslide displacement prediction is crucial for effective early warning systems to mitigate hazards. The importance of historical information varies with time during prediction due to the underlying landslide deformation mechanism. Despite advances in dynamic machine learning models like Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), they struggle to fully capture and interpret the varying importance of historical information during prediction, resulting in decreased accuracy and limited understanding of landslide physical mechanisms. Additionally, these approaches rely on manual feature selection, which is independent of the learning process and therefore is prone to estimation errors. To address these challenges, we propose LiteTransNet, a Lightweighted Transformer Network tailored for landslide displacement prediction. Built on the revolutionary Transformer model for sequential data, LiteTransNet leverages localized self-attention to selectively focus on relevant timestamps and provides interpretable results through its attention heatmap. Furthermore, LiteTransNet performs end-to-end time series modeling without extensive feature engineering. We validate LiteTransNet on two landslides in China's Three Gorges Reservoir Area and demonstrate its improved accuracy over recurrent baselines utilizing feature selection methods. Notably, the attention heatmap generated by LiteTransNet provides interpretable insights into the model's temporal dependency learning. It uncovers the varying importance of historical information at different timestamps, showcasing how LiteTransNet's attention aligns with specific periods of the external environment that cause significant disruptions in the landslide system. Our findings reveal that these disruptions continuously impact displacement prediction until their effects fade or are replaced by subsequent intense disturbances, which traditional recurrent methods are unable to capture. Further experiment shows that LiteTransNet enhances efficiency through its streamlined architecture and its parallelization capability. Overall, LiteTransNet innovates landslide prediction by providing accuracy, interpretability, and efficiency, enhancing understanding of deformation mechanisms to facilitate effective early warning systems.

Identification of strong motion record baseline drift based on Bayesian-optimized Transformer network

TraceNet: An Effective Deep-Learning-Based Method for Baseline Correction of Near-Field Acceleration Records

A new way of permanent displacement identification

Baseline Correction of Acceleration Data Based on a Hybrid EMD-DNN Method

LiteTransNet: an Interpretable Approach for Landslide Displacement Prediction Using Transformer Model with Attention Mechanism

Automated Seismic Event Detection Considering Faulty Data Interference Using Deep Learning and Bayesian Fusion

Predictions of Deep Excavation Responses Considering Model Uncertainty: Integrating BiLSTM Neural Networks with Bayesian Updating

SeisT: A foundational deep learning model for earthquake monitoring tasks

Parkinsonian Tremor Detection with Compact Convolutional Transformer from Bispectrum Representation of tri-Axial Accelerometer Signals

Rapid Earthquake Magnitude Estimation Using Deep Learning.

Seismogram Transformer: A Generic Deep Learning Backbone Network for Multiple Earthquake Monitoring Tasks

Bizarre Waveforms in Strong Motion Records

SeisT: A Foundational Deep-Learning Model for Earthquake Monitoring Tasks

An Automatic Scheme for Baseline Correction of Strong-Motion Records in Coseismic Deformation Determination

Study on Geomagnetic Observations Associated With Three Major Earthquakes in Southwest China Through a Novel Deep Learning Framework

Preliminary analysis on bizarre waveforms in strong motion records

Earthquake magnitude and location estimation from real time seismic waveforms with a transformer network

A New Method for Transformer Fault Prediction Based on Multifeature Enhancement and Refined Long Short-Term Memory

Predicting microseismic sensitive feature data using variational mode decomposition and transformer

Towards advancing the earthquake forecasting by machine learning of satellite data

OBSTransformer: A Deep-Learning Seismic Phase Picker for OBS Data Using Automated Labelling and Transfer Learning