Abstract:Transformer-based methods have achieved significant success in hyperspectral image (HSI) classification, which attribute to the strong capability of capturing the global dependencies from the input. However, the existing Transformer-based HSI classification methods are challenged in retrieving sufficient abound local information using the linear projection modules. Moreover, they do not fully use the hierarchical representations extracted from the original hyperspectral images. To overcome these challenges, this paper proposes a novel transformer model, called Residual Densely Transformer Network (RDTN) to comprehensively exploit the multi-hierarchical features and the local–global dependencies along the spatial–spectral dimensions from the hyperspectral images. Specially, the proposed RDTN is built with two modules: a Cross-Scale Convolution Attention (CSCA) module to extract abundant local spatial–spectral features using the multiscale convolution attention layers, and a Local Residual Transformer Block (LRTB) to respectively capture the abundant global dependencies along the spatial–spectral dimensions. Additionally, LRTB uses a residual connection operation to make full use of the hierarchical representations of all the transformer encoder layers. After acquiring dense global representations, we introduce a Global Residual Connection (GRC) to jointly fuse the local features obtained by CSCA, and then feed the fusion representations into the final avg-pooling layer and a classifier to predict the category. Finally, we conduct the extensive experiments based on four public benchmarks datasets, whose results are demonstrated that the proposed RDTN outperforms the state-of-the-art methods. The codes of this work are available at https://github.com/xiachangxue/DeepHyperX .

DsTer: A dense spectral transformer for remote sensing spectral super-resolution

CSwT-SR: Conv-Swin Transformer for Blind Remote Sensing Image Super-Resolution with Amplitude-Phase Learning and Structural Detail Alternating Learning

Spectral-Enhanced Sparse Transformer Network for Hyperspectral Super-Resolution Reconstruction

A novel spatial and spectral transformer network for hyperspectral image super-resolution

Multi-scale spatial-spectral Transformer for spectral reconstruction from RGB images

RDTN: Residual Densely Transformer Network for hyperspectral image classification

Spectral Reconstruction From Satellite Multispectral Imagery Using Convolution and Transformer Joint Network

Combining global receptive field and spatial spectral information for single-image hyperspectral super-resolution

Hybrid-Scale Hierarchical Transformer for Remote Sensing Image Super-Resolution

A spectral and spatial transformer for hyperspectral remote sensing image super-resolution

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution

DTCNet: Transformer-CNN Distillation for Super-Resolution of Remote Sensing Image

DESAT: A Distance-Enhanced Strip Attention Transformer for Remote Sensing Image Super-Resolution

Weighted residual self-attention graph-based transformer for spectral–spatial hyperspectral image classification

TTST: A Top-k Token Selective Transformer for Remote Sensing Image Super-Resolution

Multiscale-Sparse Spatial-Spectral Transformer for Hyperspectral Image Denoising

Activated Sparsely Sub-Pixel Transformer for Remote Sensing Image Super-Resolution

Remote Sensing Hyperspectral Image Super-Resolution via Multidomain Spatial Information and Multiscale Spectral Information Fusion

Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction

Hyper-Restormer: A General Hyperspectral Image Restoration Transformer for Remote Sensing Imaging

Spectral Superresolution Using Transformer with Convolutional Spectral Self-Attention