Road Extraction from Remote Sensing Imagery with Spatial Attention Based on Swin Transformer

Xianhong Zhu,Xiaohui Huang,Weijia Cao,Xiaofei Yang,Yunfei Zhou,Shaokai Wang

DOI: https://doi.org/10.3390/rs16071183

IF: 5

2024-03-29

Remote Sensing

Abstract:Road extraction is a crucial aspect of remote sensing imagery processing that plays a significant role in various remote sensing applications, including automatic driving, urban planning, and path navigation. However, accurate road extraction is a challenging task due to factors such as high road density, building occlusion, and complex traffic environments. In this study, a Spatial Attention Swin Transformer (SASwin Transformer) architecture is proposed to create a robust encoder capable of extracting roads from remote sensing imagery. In this architecture, we have developed a spatial self-attention (SSA) module that captures efficient and rich spatial information through spatial self-attention to reconstruct the feature map. Following this, the module performs residual connections with the input, which helps reduce interference from unrelated regions. Additionally, we designed a Spatial MLP (SMLP) module to aggregate spatial feature information from multiple branches while simultaneously reducing computational complexity. Two public road datasets, the Massachusetts dataset and the DeepGlobe dataset, were used for extensive experiments. The results show that our proposed model has an improved overall performance compared to several state-of-the-art algorithms. In particular, on the two datasets, our model outperforms D-LinkNet with an increase in Intersection over Union (IoU) metrics of 1.88% and 1.84%, respectively.

environmental sciences,imaging science & photographic technology,remote sensing,geosciences, multidisciplinary

What problem does this paper attempt to address?

### Problems Addressed by the Paper

This paper aims to address the issue of road extraction in remote sensing images. Specifically, the study proposes a Spatial Attention Swin Transformer (SASwin Transformer) to improve the accuracy and robustness of road extraction.

#### Main Contributions:
1. **Proposed SASwin Transformer Network**: This network combines the advantages of Swin Transformer and ResNet, enhancing road segmentation by jointly learning global and local feature information.
2. **Designed SMLP Module**: This module aggregates rich spatial context information through linear transformations in three dimensions of the image, reducing computational complexity compared to the original MLP module.
3. **Developed SSA Module**: This module is used to extract effective spatial context information, reducing unnecessary computations and avoiding interference from irrelevant regions compared to the original Multi-Head Self-Attention (MSA) module.
4. **Performance Improvement**: Compared to existing advanced methods, this method significantly improves segmentation accuracy on two public datasets (Massachusetts dataset and DeepGlobe dataset), with an increase of 1.88% and 1.84% in Intersection over Union (IoU) metrics, respectively.

### Summary
The main goal of this paper is to improve the accuracy and robustness of road extraction in remote sensing images using an improved Swin Transformer architecture, particularly in high-density road areas, occlusions by buildings, and complex traffic environments. By introducing new modules and optimizing algorithms, this method achieves significant performance improvements on multiple public datasets.