MHANet: A Multiscale Hierarchical Pansharpening Method With Adaptive Optimization
Dajiang Lei,Jin Huang,Liping Zhang,Weisheng Li
DOI: https://doi.org/10.1109/tgrs.2022.3191660
IF: 8.2
2022-08-02
IEEE Transactions on Geoscience and Remote Sensing
Abstract:In recent years, the powerful nonlinear modeling capability of convolutional neural networks (CNN) has led to an increasing number of researchers focusing on deep-learning-based pansharpening methods. However, due to the diversity of remote sensing image features and the limitations of the convolution operation, the existing methods are still inadequate in restoring the spatial details of complex remote sensing scenes. Therefore, in this article, we propose a simple and effective network for pansharpening methods. Specifically, in our hierarchical feature integration architecture, a multiscale grouping dilated block is designed to adequately capture fine-grained representations of multilevel scale features. At the same time, we propose a spatially self-attention block to adaptively improve the feature extraction process by establishing associations between features. The above blocks are connected in a hierarchical design, with selective reuse of features between layers and a good ability to explore new levels of features while reusing low-level features. Our experiments with the GaoFen-2 satellite dataset, WorldView-2 satellite dataset, and WorldView-3 satellite dataset show that our proposed method is highly competitive with the existing excellent methods in both objective indicator evaluation and subjective visual evaluation.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics