Abstract:Accurate landslide displacement prediction is crucial for effective early warning systems to mitigate hazards. The importance of historical information varies with time during prediction due to the underlying landslide deformation mechanism. Despite advances in dynamic machine learning models like Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), they struggle to fully capture and interpret the varying importance of historical information during prediction, resulting in decreased accuracy and limited understanding of landslide physical mechanisms. Additionally, these approaches rely on manual feature selection, which is independent of the learning process and therefore is prone to estimation errors. To address these challenges, we propose LiteTransNet, a Lightweighted Transformer Network tailored for landslide displacement prediction. Built on the revolutionary Transformer model for sequential data, LiteTransNet leverages localized self-attention to selectively focus on relevant timestamps and provides interpretable results through its attention heatmap. Furthermore, LiteTransNet performs end-to-end time series modeling without extensive feature engineering. We validate LiteTransNet on two landslides in China's Three Gorges Reservoir Area and demonstrate its improved accuracy over recurrent baselines utilizing feature selection methods. Notably, the attention heatmap generated by LiteTransNet provides interpretable insights into the model's temporal dependency learning. It uncovers the varying importance of historical information at different timestamps, showcasing how LiteTransNet's attention aligns with specific periods of the external environment that cause significant disruptions in the landslide system. Our findings reveal that these disruptions continuously impact displacement prediction until their effects fade or are replaced by subsequent intense disturbances, which traditional recurrent methods are unable to capture. Further experiment shows that LiteTransNet enhances efficiency through its streamlined architecture and its parallelization capability. Overall, LiteTransNet innovates landslide prediction by providing accuracy, interpretability, and efficiency, enhancing understanding of deformation mechanisms to facilitate effective early warning systems.

Research on transformer and long short-term memory neural network car-following model considering data loss

Car-Following Modeling Incorporating Driving Memory Based on Autoencoder and Long Short-Term Memory Neural Networks

Short-Term Speed Forecasting of Large-Scale Urban Road Network Based on Transformer

TransFollower: Long-Sequence Car-Following Trajectory Prediction through Transformer

A CNN-LSTM Car-Following Model Considering Generalization Ability

LiteTransNet: an Interpretable Approach for Landslide Displacement Prediction Using Transformer Model with Attention Mechanism

IDM-Follower: A Model-Informed Deep Learning Method for Long-Sequence Car-Following Trajectory Prediction

Real-Time Crash Risk Prediction using Long Short-Term Memory Recurrent Neural Network

On the Impact of Prior Experiences in Car-Following Models: Model Development, Computational Efficiency, Comparative Analyses, and Extensive Applications

Platoon Trajectories Generation: A Unidirectional Interconnected LSTM-Based Car-Following Model

Backpropagation Through Simulation: A Training Method for Neural Network-based Car-following.

A Car-Following Model Based on Trajectory Data for Connected and Automated Vehicles to Predict Trajectory of Human-Driven Vehicles

Driver Car-Following Behavior Modeling Using Neural Network Based on Real Traffic Experimental Data

An Attention-Based Car-Following Model Based on Fused data

Crossfusor: A Cross-Attention Transformer Enhanced Conditional Diffusion Model for Car-Following Trajectory Prediction

A sequence to sequence learning based car-following model for multi-step predictions considering reaction delay

Traffic Transformer: Transformer-based framework for temporal traffic accident prediction

A Car-Following Driver Model Capable of Retaining Naturalistic Driving Styles

Long Short-Term Memory-Based Human-Driven Vehicle Longitudinal Trajectory Prediction in a Connected and Autonomous Vehicle Environment

Advancing Traffic Simulation Precision and Scalability: A Data-Driven Approach Utilizing Deep Neural Networks

Hybrid-Driven Car-Following Model Based on Improved Composite Network and IDM