Abstract:Accurate landslide displacement prediction is crucial for effective early warning systems to mitigate hazards. The importance of historical information varies with time during prediction due to the underlying landslide deformation mechanism. Despite advances in dynamic machine learning models like Long Short-Term Memory (LSTM) and Gated Recurrent Unit (GRU), they struggle to fully capture and interpret the varying importance of historical information during prediction, resulting in decreased accuracy and limited understanding of landslide physical mechanisms. Additionally, these approaches rely on manual feature selection, which is independent of the learning process and therefore is prone to estimation errors. To address these challenges, we propose LiteTransNet, a Lightweighted Transformer Network tailored for landslide displacement prediction. Built on the revolutionary Transformer model for sequential data, LiteTransNet leverages localized self-attention to selectively focus on relevant timestamps and provides interpretable results through its attention heatmap. Furthermore, LiteTransNet performs end-to-end time series modeling without extensive feature engineering. We validate LiteTransNet on two landslides in China's Three Gorges Reservoir Area and demonstrate its improved accuracy over recurrent baselines utilizing feature selection methods. Notably, the attention heatmap generated by LiteTransNet provides interpretable insights into the model's temporal dependency learning. It uncovers the varying importance of historical information at different timestamps, showcasing how LiteTransNet's attention aligns with specific periods of the external environment that cause significant disruptions in the landslide system. Our findings reveal that these disruptions continuously impact displacement prediction until their effects fade or are replaced by subsequent intense disturbances, which traditional recurrent methods are unable to capture. Further experiment shows that LiteTransNet enhances efficiency through its streamlined architecture and its parallelization capability. Overall, LiteTransNet innovates landslide prediction by providing accuracy, interpretability, and efficiency, enhancing understanding of deformation mechanisms to facilitate effective early warning systems.

A Lightweight Transformer With Multigranularity Tokens and Connected Component Loss for Land Cover Classification

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

A Novel Transformer Network with a CNN-Enhanced Cross-Attention Mechanism for Hyperspectral Image Classification

A Lightweight Transformer Network for Hyperspectral Image Classification

Cross-Resolution Land Cover Classification Using Outdated Products and Transformers

A Lightweight CNN–Transformer Network With Laplacian Loss for Low-Altitude UAV Imagery Semantic Segmentation

VisionTwinNet: Gated Clarity Enhancement Paired With Light-Robust CD Transformers

Vision Transformer for Multispectral Satellite Imagery: Advancing Landcover Classification*

LiteTransNet: an Interpretable Approach for Landslide Displacement Prediction Using Transformer Model with Attention Mechanism

Lite Vision Transformer with Enhanced Self-Attention

MKANet: A Lightweight Network with Sobel Boundary Loss for Efficient Land-cover Classification of Satellite Remote Sensing Imagery

Converging Channel Attention Mechanisms with Multilayer Perceptron Parallel Networks for Land Cover Classification

Unsupervised remote sensing image classification with differentiable feature clustering by coupled transformer

Transformer-based land use and land cover classification with explainability using satellite imagery

CloudViT: A Lightweight Vision Transformer Network for Remote Sensing Cloud Detection

Local feature acquisition and global context understanding network for very high-resolution land cover classification

CITNet: Convolution Interaction Transformer Network for Hyperspectral and LiDAR Image Classification

Compact Convolutional Transformer for Landslide Susceptibility Mapping

Category attention guided network for semantic segmentation of Fine-Resolution remote sensing images

Joint Classification of Hyperspectral and LiDAR Data Based on Adaptive Gating Mechanism and Learnable Transformer