SE2Net: Semantic Segmentation of Remote Sensing Images Based on Self-Attention and Edge Enhancement Modules

Songlin Liu,Kai Gao,Jinchun Qin,Hui Gong,Haiyan Wang,Li Zhang,Danchao Gong
DOI: https://doi.org/10.1117/1.jrs.15.026512
IF: 1.568
2021-01-01
Journal of Applied Remote Sensing
Abstract:The semantic segmentation of optical satellite remote sensing images is more challenging than that of natural images, owing to the considerable differences in the texture, shape, topology, and scale of ground features in different areas and the coexistence of dense and sparse arrangements. To alleviate these difficulties and ensure a high accuracy, a semantic segmentation framework named the self-attention and edge enhancement network (SE(2)Net) is constructed considering two aspects. First, because the self-attention mechanism can capture more useful semantic information by modeling large neighborhood correlations, we embed a self-attention module known as spatial expectation maximization attention (SEMA) in the considered network. Second, the Laplace operator is adopted to explore the significant edge information to design an edge enhancement module (EEM). Finally, both SEMA and EEM are embedded in the proposed SE(2)Net, thereby forming an end-to-end network. To validate the performance of the proposed approach, we construct a semantic segmentation dataset (SSD) using Tian-Hui 1 satellite images and conduct extensive experiments on both the SSD and the gaofen image dataset (GID). The results demonstrate the superiority of the proposed method over other state-of-the-art approaches and the effectiveness of the constructed SSD. (C) 2021 Society of Photo-Optical Instrumentation Engineers (SPIE)
What problem does this paper attempt to address?