Abstract:Accurate landslide displacement prediction is crucial for effective early warning systems to mitigate hazards. The importance of historical information varies with time during prediction due to the underlying landslide deformation mechanism. Despite advances in dynamic machine learning models like Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), they struggle to fully capture and interpret the varying importance of historical information during prediction, resulting in decreased accuracy and limited understanding of landslide physical mechanisms. Additionally, these approaches rely on manual feature selection, which is independent of the learning process and therefore is prone to estimation errors. To address these challenges, we propose LiteTransNet, a Lightweighted Transformer Network tailored for landslide displacement prediction. Built on the revolutionary Transformer model for sequential data, LiteTransNet leverages localized self-attention to selectively focus on relevant timestamps and provides interpretable results through its attention heatmap. Furthermore, LiteTransNet performs end-to-end time series modeling without extensive feature engineering. We validate LiteTransNet on two landslides in China's Three Gorges Reservoir Area and demonstrate its improved accuracy over recurrent baselines utilizing feature selection methods. Notably, the attention heatmap generated by LiteTransNet provides interpretable insights into the model's temporal dependency learning. It uncovers the varying importance of historical information at different timestamps, showcasing how LiteTransNet's attention aligns with specific periods of the external environment that cause significant disruptions in the landslide system. Our findings reveal that these disruptions continuously impact displacement prediction until their effects fade or are replaced by subsequent intense disturbances, which traditional recurrent methods are unable to capture. Further experiment shows that LiteTransNet enhances efficiency through its streamlined architecture and its parallelization capability. Overall, LiteTransNet innovates landslide prediction by providing accuracy, interpretability, and efficiency, enhancing understanding of deformation mechanisms to facilitate effective early warning systems.

Transformer neural networks for interpretable flood forecasting

Real-time flood maps forecasting for dam-break scenarios with a transformer-based deep learning model

Prediction of Urban Groundwater Level Based on CNN-Transformer

Graph Transformer Network for Flood Forecasting with Heterogeneous Covariates

Deep neural networks of transformer architecture in problems of hydrological forecasts

A Transformer variant for multi-step forecasting of water level and hydrometeorological sensitivity analysis based on explainable artificial intelligence technology

Behavior of LSTM and transformer deep learning models in flood simulation considering South Asian tropical climate

Enhancing hydrological modeling with transformers: a case study for 24-h streamflow prediction

Probing the limit of hydrologic predictability with the Transformer network

Advancing climate-resilient flood mitigation: Utilizing transformer-LSTM for water level forecasting at pumping stations

Advanced streamflow forecasting for Central European Rivers: The Cutting-Edge Kolmogorov-Arnold networks compared to Transformers

Deep learning models to predict flood events in fast-flowing watersheds

Transformer-based Flood Scene Segmentation for Developing Countries

Flood forecasting based on an artificial neural network scheme

Transformer Versus LSTM: A Comparison of Deep Learning Models for Karst Spring Discharge Forecasting

Towards Generalized Hydrological Forecasting using Transformer Models for 120-Hour Streamflow Prediction

LiteTransNet: an Interpretable Approach for Landslide Displacement Prediction Using Transformer Model with Attention Mechanism

Hypertuned temporal fusion transformer for multi-horizon time series forecasting of dam level in hydroelectric power plants

A Ladder Water Level Prediction Model for the Yangtze River Based on Transfer Learning and Transformer

Rapid Flood Inundation Forecast Using Fourier Neural Operator

Flood prediction based on feature selection and a hybrid deep learning network