Center Weighted Convolution and GraphSAGE Cooperative Network for Hyperspectral Image Classification.

Ying Cui,Chao Shao,Li Luo,Liguo Wang,Shan Gao,Liwei Chen
DOI: https://doi.org/10.1109/tgrs.2023.3264653
IF: 8.2
2023-01-01
IEEE Transactions on Geoscience and Remote Sensing
Abstract:Hyperspectral image (HSI) classification is one of the basic tasks of remote sensing image processing, which is to predict the label of each HSI pixel. Convolutional neural network (CNN) and graph convolution neural network (GCN) have become the current research focus due to their outstanding performance in the field of HSI classification in recent years. However, GCN is a transductive learning method, which needs all nodes to participate in the training process to get the node embedding. Graph sample and aggregate (GraphSAGE) is an important branch of graph neural network, which can flexibly aggregate new neighbor nodes in non-Euclidean data of any structure and capture long-range contextual relationships. Superpixel-based GraphSAGE can not only integrate the global spatial relationship of data but also further reduce its computing cost. CNN can extract pixel-level features in a small area, and our center attention module (CAM) and center weighted convolution (CW-Conv) can also improve the feature extraction ability of CNN by enhancing the dominant position of target pixels. In order to make full use of the advantages of CNN and GraphSAGE, we propose a center weighted convolution and GraphSAGE (CW-SAGE) cooperative network for HSI classification. Specifically, graph simple and aggregate branch is constructed by superpixel-based encoder and decoder modules, and then, pixel-level features are extracted by a central attention CNN. Finally, the features of the two branches are spliced together for feature fusion. We conduct experiments on three hyperspectral datasets and compare the results with other current state-of-the-art methods. A series of experiments demonstrates the advantages of our method.
What problem does this paper attempt to address?