Abstract:In hyperspectral image (HSI) classification, convolutional neural networks (CNNs) have exhibited exceptional performance, owing to their hierarchical nonlinear modeling. However, their fixed square receptive field constrains their ability to effectively handle irregular image regions. Graph convolutional networks (GCNs) have been introduced to learn irregular regions through correlations between adjacent pixels modeled as superpixel-based nodes, yet they lack pixel-level information. We propose a novel approach Pixel-level with Covariance Pooling feature and Superpixel-level feature Fusion for HSI Classification (PiCovS). Our method harnesses complementary spectral-spatial features at both pixel-level and superpixel-level to capture characteristics of both small-scale regular and large-scale irregular regions. We introduce a hybrid network that integrates and propagates features between image-level pixels and graph-level nodes using a graph encoder-decoder, effectively reconciling the differences between regular CNN and irregular GCN data representations. To enhance superpixel boundary learning, we modify the manifold simple linear iterative clustering (M-SLIC) algorithm by incorporating texture feature information, resulting in refined superpixel representations. In addition, we propose a novel covariance pooling mechanism with an attention mechanism within the CNN branch, enabling the capturing and utilization of holistic HSI information along spectral and spatial dimensions by exploiting second-order statistics throughout the network. Our comprehensive experiments showcase the efficiency and robustness of the proposed framework, achieving an impressive overall accuracy of 99.84%, 99.97%, 99.98%, and 81.96% on the Indian Pines, University of Pavia, Salinas, and Houston University datasets, respectively. Remarkably, PiCovS excels even with limited training samples, outperforming other state-of-the-art methods in accuracy.

Pixel Saliency Based Encoding for Fine-Grained Image Classification.

Efficient Classification Using Salient Regions

Attention cutting and padding learning for fine-grained image recognition

Fine-Grained Image Classification Via Spatial Saliency Extraction.

Coarse-to-fine Salient Object Detection Based on Deep Convolutional Neural Networks

Accurate salient object detection via dense recurrent connections and residual-based hierarchical feature integration.

AP-CNN: Weakly Supervised Attention Pyramid Convolutional Neural Network for Fine-Grained Visual Classification

Pixel-wise binary classification network for salient object detection

A Saliency-based Weakly-supervised Network for Fine-Grained Image Categorization

Combining Spatial Attention and Cross-Layer Bilinear Pooling for Fine-Grained Image Classification

Improve Neural Network Using Saliency.

An Encoder–Decoder Convolution Network With Fine-Grained Spatial Information for Hyperspectral Images Classification

Fcn And Unit-Linking Pcnn Based Image Saliency Detection

Object-centric Sampling for Fine-grained Image Classification

CNN for Saliency Detection with Low-Level Feature Integration.

Efficient Saliency Detection Using Convolutional Neural Networks with Feature Selection

PiCovS: Pixel-Level With Covariance Pooling Feature and Superpixel-Level Feature Fusion for Hyperspectral Image Classification

A Stagewise Refinement Model for Detecting Salient Objects in Images.

Image Classification Based on Saliency Coding with Category-Specific Codebooks

PGCA-Net: Progressively Aggregating Hierarchical Features with the Pyramid Guided Channel Attention for Saliency Detection

Attention Bilinear Pooling for Fine-Grained Classification