Abstract:Hyperspectral images (HSIs) contain spatially structured information and pixel−level sequential spectral attributes. The continuous spectral features contain hundreds of wavelength bands and the differences between spectra are essential for achieving fine−grained classification. Due to the limited receptive field of backbone networks, convolutional neural networks (CNNs)−based HSI classification methods show limitations in modeling spectral−wise long−range dependencies with fixed kernel size and a limited number of layers. Recently, the self−attention mechanism of transformer framework is introduced to compensate for the limitations of CNNs and to mine the long−term dependencies of spectral signatures. Therefore, many joint CNN and Transformer architectures for HSI classification have been proposed to obtain the merits of both networks. However, these architectures make it difficult to capture spatial–spectral correlation and CNNs distort the continuous nature of the spectral signature because of the over−focus on spatial information, which means that the transformer can easily encounter bottlenecks in modeling spectral−wise similarity and long−range dependencies. To address this problem, we propose a neighborhood enhancement hybrid transformer (NEHT) network. In particular, a simple 2D convolution module is adopted to achieve dimensionality reduction while minimizing the distortion of the original spectral distribution by stacked CNNs. Then, we extract group−wise spatial–spectral features in a parallel design to enhance the representation capability of each token. Furthermore, a feature fusion strategy is introduced to increase subtle discrepancies of spectra. Finally, the self−attention of transformer is employed to mine the long−term dependencies between the enhanced feature sequences. Extensive experiments are performed on three well−known datasets and the proposed NEHT network shows superiority over state−of−the−art (SOTA) methods. Specifically, our proposed method outperforms the SOTA method by 0.46%, 1.05% and 0.75% on average in overall accuracy, average accuracy and kappa coefficient metrics.

Target Detection with Spectral Graph Contrast Clustering Assignment and Spectral Graph Transformer in Hyperspectral Imagery

Iterative Autoencoder Coupling with Constrained Energy Minimization for Hyperspectral Target Detection

HTD-Mamba: Efficient Hyperspectral Target Detection with Pyramid State Space Model

Hyperspectral Target Detection via Spectral Aggregation and Separation Network With Target Band Random Mask

Transfer Learning of Spatial Features From High-Resolution RGB Images for Large-Scale and Robust Hyperspectral Remote Sensing Target Detection

Spatial-Spectral Contrastive Self-Supervised Learning With Dual Path Networks for Hyperspectral Target Detection

Target Detection in Hyperspectral Remote Sensing Image: Current Status and Challenges

Local Similarity Constraint-Based Sparse Algorithm for Hyperspectral Target Detection

Hyperspectral Image Classification Based on Multibranch Attention Transformer Networks

A Representation-Learning-Based Graph and Generative Network for Hyperspectral Small Target Detection

CS2DT: Cross Spatial–Spectral Dense Transformer for Hyperspectral Image Classification

Cognitive Fusion of Graph Neural Network and Convolutional Neural Network for Enhanced Hyperspectral Target Detection

Spectral-Spatial Center-Aware Bottleneck Transformer for Hyperspectral Image Classification

A Preprocessing Method for Hyperspectral Target Detection Based on Tensor Principal Component Analysis

A dual-branch siamese spatial-spectral transformer attention network for Hyperspectral Image Change Detection

GT-HAD: Gated Transformer for Hyperspectral Anomaly Detection

Hyperspectral Image Classification via Spectral Pooling and Hybrid Transformer

Expeditious Hyperspectral Image Classification With Inner and Outer Layered Transformer Using Feature Enhancement

Spectral–Spatial–Temporal Transformers for Hyperspectral Image Change Detection

Exploring Hyperspectral Anomaly Detection with Human Vision: A Small Target Aware Detector

Unsupervised Transfer Learning for Target Detection from Hyperspectral Images.