Abstract:To read the final version please go to IEEE TGRS on IEEE Xplore. Convolutional neural networks (CNNs) have been attracting increasing attention in hyperspectral (HS) image classification, owing to their ability to capture spatial-spectral feature representations. Nevertheless, their ability in modeling relations between samples remains limited. Beyond the limitations of grid sampling, graph convolutional networks (GCNs) have been recently proposed and successfully applied in irregular (or non-grid) data representation and analysis. In this paper, we thoroughly investigate CNNs and GCNs (qualitatively and quantitatively) in terms of HS image classification. Due to the construction of the adjacency matrix on all the data, traditional GCNs usually suffer from a huge computational cost, particularly in large-scale remote sensing (RS) problems. To this end, we develop a new mini-batch GCN (called miniGCN hereinafter) which allows to train large-scale GCNs in a mini-batch fashion. More significantly, our miniGCN is capable of inferring out-of-sample data without re-training networks and improving classification performance. Furthermore, as CNNs and GCNs can extract different types of HS features, an intuitive solution to break the performance bottleneck of a single model is to fuse them. Since miniGCNs can perform batch-wise network training (enabling the combination of CNNs and GCNs) we explore three fusion strategies: additive fusion, element-wise multiplicative fusion, and concatenation fusion to measure the obtained performance gain. Extensive experiments, conducted on three HS datasets, demonstrate the advantages of miniGCNs over GCNs and the superiority of the tested fusion strategies with regards to the single CNN or GCN models. The codes of this work will be available at <a class="link-external link-https" href="https://github.com/danfenghong/IEEE_TGRS_GCN" rel="external noopener nofollow">this https URL</a> for the sake of reproducibility.

Small-scale Convolutional Neural Networks with Learnable Gabor Filter for Image Classifications

Research on Image Classification Method of Features of Combinatorial Convolution

LPNet: A Remote Sensing Scene Classification Method Based on Large Kernel Convolution and Parameter Fusion

Naive Gabor Networks for Hyperspectral Image Classification

Large-Scale Learnable Graph Convolutional Networks

GaborNet: Gabor filters with learnable parameters in deep convolutional neural networks

Gabor-Modulated Grouped Separable Convolutional Network for Hyperspectral Image Classification

Gabor-CNN for object detection based on small samples

Coarse-to-fine Trained Multi-Scale Convolutional Neural Networks for Image Classification.

Training Interpretable Convolutional Neural Networks by Differentiating Class-specific Filters

Learnable three-dimensional Gabor convolutional network with global affinity attention for hyperspectral image classification

Cascade Network for Hyperspectral Image Classification

Graph Convolutional Networks for Hyperspectral Image Classification

Channel-Layer-Oriented Lightweight Spectral–Spatial Network for Hyperspectral Image Classification

Learning Structure and Strength of CNN Filters for Small Sample Size Training

Learning Filter Scale and Orientation In CNNs

Research on Image Classification of Lightweight Convolutional Neural Network

Learning Efficient Convolutional Networks Through Network Slimming.

Simple convolutional neural network on image classification

ChannelNets: Compact and Efficient Convolutional Neural Networks via Channel-Wise Convolutions