Abstract:Hyperspectral images (HSI) contain powerful spectral characterization capabilities and are widely used especially for classification applications. However, the rich spectrum contained in HSI also increases the difficulty of extracting useful information, which makes the feature extraction method significant as it enables effective expression and utilization of the spectrum. Traditional HSI feature extraction methods design spectral features manually, which is likely to be limited by the complex spectral information within HSI. Recently, data-driven methods, especially the use of convolutional neural networks (CNNs), have shown great improvements in performance when processing image data owing to their powerful automatic feature learning and extraction abilities and are also widely used for HSI feature extraction and classification. The CNN extracts features based on the convolution operation. Nevertheless, the local perception of the convolution operation makes CNN focus on the local spectral features (LSF) and weakens the description of features between long-distance spectral ranges, which will be referred to as global spectral features (GSF) in this study. LSF and GSF describe the spectral features from two different perspectives and are both essential for determining the spectrum. Thus, in this study, a local-global spectral feature (LGSF) extraction and optimization method is proposed to jointly consider the LSF and GSF for HSI classification. To increase the relationship between spectra and the possibility to obtain features with more forms, we first transformed the 1D spectral vector into a 2D spectral image. Based on the spectral image, the local spectral feature extraction module (LSFEM) and the global spectral feature extraction module (GSFEM) are proposed to automatically extract the LGSF. The loss function for spectral feature optimization is proposed to optimize the LGSF and obtain improved class separability inspired by contrastive learning. We further enhanced the LGSF by introducing spatial relation and designed a CNN constructed using dilated convolution for classification. The proposed method was evaluated on four widely used HSI datasets, and the results highlighted its comprehensive utilization of spectral information as well as its effectiveness in HSI classification.

Combining SIFT and global features for web image classification

Product Images Classification with Mul-tiple Features Combination

SIFT-Based Image Retrieval Combining the Distance Measure of Global Image and Sub-Image

Web Page Classification Based on Heterogeneous Features and a Combination of Multiple Classifiers.

Image Classification Method by Combining Multi-features and Sparse Coding

Efficient Classification Using Salient Regions

Research on Image Classification Method of Features of Combinatorial Convolution

Image classification based on support vector machine and the fusion of complementary features

Web Page and Image Semi-Supervised Classification with Heterogeneous Information Fusion

Combining Eye Movements for Semantic Image Classification

Locality Sensitive Hashing Based Service Classification

Learning Based Combining Different Features for Medical Image Retrieval

A Hybrid Multimodal Data Fusion-Based Method for Identifying Gambling Websites

Binary SIFT: towards efficient feature matching verification for image search

Local and Global Spectral Features for Hyperspectral Image Classification

Indexing and Integrating Multiple Features for WWW Images

Coupled Binary Embedding for Large-Scale Image Retrieval

SIFT Match Verification by Geometric Coding for Large-Scale Partial-Duplicate Web Image Search.

Multi-target Classification Method Based on the Fusion of HOG and SURF Features

Web Page Classification Based on Uncorrelated Semi-Supervised Intra-View and Inter-View Manifold Discriminant Feature Extraction

Boosting Image Classification with LDA-based Feature Combination for Digital Photograph Management