Enhanced shuffle attention network based on visual working mechanism for high-resolution remote sensing image classification
Ming Cong,Jianjun Cui,Siliang Chen,Yihui Wang,Ling Han,Jiangbo Xi,Junkai Gu,Qingfang Zhang,Yiting Tao,Zhiye Wang,Miaozhong Xu,Hong Deng
DOI: https://doi.org/10.1080/10106049.2022.2143912
IF: 3.45
2022-11-30
Geocarto International
Abstract:High-resolution remote sensing images provide complete and detailed ground scenes. However, these complex and diverse details make it difficult to interpret large area objects and their small area details at a single granularity. Therefore, the method proposed in this paper refers to the principles of visual working memory, visual attention and visual reasoning, independently analyse the ground objects of different granularities, and integrates the recognition results of the different granularity ground objects to form accurate classification results. This multi-granularity classification strategy suppresses noise interference, protects typical edges, and highlights clear details. Experimental results with dataset of real land use survey projects, including images of different time, multiple perspectives, and different altitudes, The results show that the idea of combining unsupervised edge detection with neural network classification can greatly enhance the generalization ability and edge cognitive ability, making the classification accuracy reach 80% on average, with an improvement of about 5%. An ESA classification network for high-resolution remote sensing images based on visual working memory, visual attention, and visual reasoning was proposed A classification strategy for identifying large-granularity features and small-granularity details separately was adopted to enable the network to effectively choose the classification granularity A simple, convenient, and effective attention shuffle structure was also adopted. The ESA network structure maintained a stable and reliable classification accuracy with good regional consistency and detail description. In terms of single granularity, the neural network architecture used in this paper had better generalization ability and stronger learning ability than mature machine learning classification methods.
geosciences, multidisciplinary,environmental sciences,remote sensing,imaging science & photographic technology