The Outcome of the 2022 Landslide4Sense Competition: Advanced Landslide Detection from Multi-Source Satellite Imagery

Omid Ghorbanzadeh,Yonghao Xu,Hengwei Zhao,Junjue Wang,Yanfei Zhong,Dong Zhao,Qi Zang,Shuang Wang,Fahong Zhang,Yilei Shi,Xiao Xiang Zhu,Lin Bai,Weile Li,Weihang Peng,Pedram Ghamisi
DOI: https://doi.org/10.48550/arXiv.2209.02556
2022-09-12
Abstract:The scientific outcomes of the 2022 Landslide4Sense (L4S) competition organized by the Institute of Advanced Research in Artificial Intelligence (IARAI) are presented here. The objective of the competition is to automatically detect landslides based on large-scale multiple sources of satellite imagery collected globally. The 2022 L4S aims to foster interdisciplinary research on recent developments in deep learning (DL) models for the semantic segmentation task using satellite imagery. In the past few years, DL-based models have achieved performance that meets expectations on image interpretation, due to the development of convolutional neural networks (CNNs). The main objective of this article is to present the details and the best-performing algorithms featured in this competition. The winning solutions are elaborated with state-of-the-art models like the Swin Transformer, SegFormer, and U-Net. Advanced machine learning techniques and strategies such as hard example mining, self-training, and mix-up data augmentation are also considered. Moreover, we describe the L4S benchmark data set in order to facilitate further comparisons, and report the results of the accuracy assessment online. The data is accessible on \textit{Future Development Leaderboard} for future evaluation at \url{<a class="link-external link-https" href="https://www.iarai.ac.at/landslide4sense/challenge/" rel="external noopener nofollow">this https URL</a>}, and researchers are invited to submit more prediction results, evaluate the accuracy of their methods, compare them with those of other users, and, ideally, improve the landslide detection results reported in this article.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the automatic detection of landslide disasters on a global scale. Specifically, the paper focuses on the technical challenges of large - scale landslide detection using multi - source satellite images. The paper presents the scientific achievements of the Landslide4Sense (L4S) competition in 2022, which was organized by the Institute for Advanced Research in Artificial Intelligence (IARAI) and aimed to promote the development of automatic landslide detection techniques through deep learning (DL) models. The goal of the competition was to automatically detect landslides based on large - scale multi - source satellite images collected globally, while promoting interdisciplinary research, especially research on semantic segmentation tasks using deep learning models. ### Main Problems and Goals of the Paper 1. **Automatic Landslide Detection**: - Automatically detect landslides using multi - source satellite images to improve the accuracy and efficiency of detection. - Solve the problems of small targets and class imbalance in landslide detection. - Deal with the inconsistent distribution problem between images collected in different geographical regions and at different times. 2. **Promote Interdisciplinary Research**: - Promote interdisciplinary research in the fields of computer vision, artificial intelligence, and remote sensing image analysis. - Evaluate and improve the performance of existing deep learning models in landslide detection tasks. 3. **Provide Benchmark Datasets**: - Provide a benchmark dataset containing global multi - source satellite images so that researchers can evaluate and compare different deep learning algorithms. - Promote future research and method improvement. ### Main Technical Challenges 1. **Small Targets and Class Imbalance**: - Landslides usually appear as small targets in remote sensing images and account for an extremely low proportion of pixels in the images, which increases the difficulty of detection. - The class imbalance problem makes the model tend to be biased towards the background class during the training process, affecting the recall rate of landslide detection. 2. **Inconsistent Distribution**: - Images collected in different geographical regions and at different times have significant differences in radiation values or pixel values, resulting in poor generalization performance of the model on different datasets. ### Solutions 1. **Progressive Label Refinement and Distribution Adaptation Framework**: - Solve the above challenges through the progressive label refinement and distribution adaptation framework. - Use steps such as data pre - processing, model integration, model training, model inference, and pseudo - label refinement to gradually improve the detection performance of the model. 2. **Advanced Deep Learning Models**: - Use advanced models such as Swin Transformer, SegFormer, and U - Net, combined with multi - scale fusion and self - attention mechanisms, to improve the accuracy of landslide detection. - Introduce soft cross - entropy loss, Lovasz loss, and online hard example mining strategies to solve the problems of class imbalance and noisy labels. 3. **Data Augmentation and Normalization**: - Improve the robustness and generalization ability of the model through data augmentation (such as random flipping, rotation, and color perturbation) and separate normalization. ### Experimental Results - **Validation Phase**: - The effectiveness of each module was verified through experiments. Especially in solving the inconsistent distribution problem, separate normalization achieved significant improvement. - As the number of label refinement rounds increased, the overall performance gradually improved. Finally, after combining multiple advanced models, the F1 score reached 80.41%. - **Test Phase**: - On the test leaderboard, the best model had an F1 score of 74.54%, which was a significant improvement compared to the baseline model. In conclusion, through organizing competitions and proposing advanced deep learning frameworks, this paper effectively solves the technical challenges in landslide detection and provides important technical support for future landslide monitoring and disaster prevention.