An Integrated Neighborhood and Scale Information Network for Open-Pit Mine Change Detection in High-Resolution Remote Sensing Images

Zilin Xie,Kangning Li,Jinbao Jiang,Jinzhong Yang,Xiaojun Qiao,Deshuai Yuan,Cheng Nie

2024-03-22

Abstract:Open-pit mine change detection (CD) in high-resolution (HR) remote sensing images plays a crucial role in mineral development and environmental protection. Significant progress has been made in this field in recent years, largely due to the advancement of deep learning techniques. However, existing deep-learning-based CD methods encounter challenges in effectively integrating neighborhood and scale information, resulting in suboptimal performance. Therefore, by exploring the influence patterns of neighborhood and scale information, this paper proposes an Integrated Neighborhood and Scale Information Network (INSINet) for open-pit mine CD in HR remote sensing images. Specifically, INSINet introduces 8-neighborhood-image information to acquire a larger receptive field, improving the recognition of center image boundary regions. Drawing on techniques of skip connection, deep supervision, and attention mechanism, the multi-path deep supervised attention (MDSA) module is designed to enhance multi-scale information fusion and change feature extraction. Experimental analysis reveals that incorporating neighborhood and scale information enhances the F1 score of INSINet by 6.40%, with improvements of 3.08% and 3.32% respectively. INSINet outperforms existing methods with an Overall Accuracy of 97.69%, Intersection over Union of 71.26%, and F1 score of 83.22%. INSINet shows significance for open-pit mine CD in HR remote sensing images.

Computer Vision and Pattern Recognition

What problem does this paper attempt to address?

This paper focuses on the problem of change detection in open-pit mining areas in high-resolution remote sensing images. In recent years, although deep learning techniques have made significant progress in this field, existing methods still face challenges in effectively integrating neighborhood information and scale information, resulting in poor performance. Therefore, this paper proposes a new method named "Integrated Neighborhood and Scale Information Network" (INSINet) to improve change detection in high-resolution remote sensing images of open-pit mining areas.

INSINet enlarges the receptive field and improves the recognition ability of the boundary region of the center image by introducing 8-neighborhood image information. It uses the Multi-Path Deep Supervised Attention (MDSA) module, which combines skip connections, deep supervision, and attention mechanisms to enhance multi-scale information fusion and change feature extraction. Experimental results show that the integration of neighborhood and scale information can improve the F1 score of INSINet by 6.40%, increasing by 3.08% and 3.32%, respectively. Compared with other existing methods, INSINet performs well in overall accuracy, intersection over union, and F1 score.

The paper points out that mineral resources are crucial for social development, but mining activities cause serious environmental damage. Therefore, change detection is necessary for sustainable utilization. Although high-resolution remote sensing images provide a wide range of monitoring means, current methods still have limitations in dealing with complexity and diversity. INSINet proposed in this paper addresses these issues, especially in recognizing image boundary regions and handling different scale information, providing a new solution for change detection in high-resolution remote sensing images of open-pit mining areas.