A Multi-branch Hierarchical Feature Extraction Network Combining Sentinel-1 and Sentinel-2 for Yellow River Delta Wetlands Classification

Xinhao Li,Mingwei Liu,Qingwen Dou,Mingming Xu,Shanwei Liu,Hui Sheng
DOI: https://doi.org/10.1007/978-981-97-1568-8_8
2024-01-01
Abstract:The classification of wetlands in the Yellow River Delta is important for the monitoring of vegetation dynamics, rational resource utilization, and ecosystem protection. In this paper, the multi-temporal Sentinel-1 and Sentinel-2 data from 2021 are used to extract 168 features about spectral, index, texture, and polarization scattering. And based on the multi-source features, a novel multi-branch hierarchical feature extraction network (MHFE) is designed to classify the wetlands in the Yellow River Delta. By virtue of the multi-branch characteristics, the proposed MHFE can target the processing data with different features. The network includes the attention convolution module and fuzzy information module designed according to the characteristics of the data. The results show that the overall accuracy of multi-source features can reach 87.55% when classifying collaboratively, which is significantly higher than that of single-source features, and the fusion of multi-source data helps to improve the accuracy of wetland classification. Comparing with a variety of advanced deep learning classifiers, the proposed MHFE has the highest overall accuracy, which verifies that the application of this model to classify the wetlands in the Yellow River Delta has validity.
What problem does this paper attempt to address?