Abstract:Hyperspectral image (HSI) classification has attracted significant interest among researchers owing to its diverse practical applications. Convolutional neural networks (CNNs) have been extensively utilized for HSI classification. However, the effectiveness of CNN-based approaches is constrained by the fixed size and structure of the convolutional kernels, as well as their incapacity to capture global features. Moreover, these networks are inadequate in modeling the sequential characteristics of data. Recently, a promising approach, window-based multi-head self-attention has emerged to address the limitations of CNNs and incorporate efficient sequence modeling capabilities. This paper introduces a novel method, multiscale 3D atrous convolution with a lightweight swin transformer (MACLST), that effectively combines the strengths of two networks to capture both local and global features at different scales in HSI classification. The MACLST is designed to process HSI cubes as input and employs a spectral–spatial features extraction module based on multiscale 3D atrous convolution. This module involves parallel branches of 3D layers with varying atrous rates, enabling the extraction of features at multiple scales and resolutions. The extracted spectral–spatial features are fused and passed to the lightweight Swin transformer module as linear embeddings. This module captures long-range dependencies and learns effective feature representations of HSI. To reduce computational complexity, the swin transformer module is simplified and consists of only two stages, offering a more efficient version of the original swin transformer. The proposed MACLST model is extensively evaluated on five widely used benchmark HSI datasets, and the experimental results validate its superiority over state-of-the-art approaches with an overall accuracy of 99.00%, 99.59%, 99.95%, 98.71%, and 94.98% on the Indian Pines, University of Pavia, Salinas Valley, Houston University 2013, and Houston University 2018 datasets, respectively.

SwinHCST: a deep learning network architecture for scene classification of remote sensing images based on improved CNN and Transformer

A Novel Transformer Network with a CNN-Enhanced Cross-Attention Mechanism for Hyperspectral Image Classification

Spectral Swin Transformer Network for Hyperspectral Image Classification

Swin Transformer with Multiscale 3D Atrous Convolution for Hyperspectral Image Classification

Remote sensing image scene classification based on transfer learning and Swin transformer mode

SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection

Hyperspectral Image Classification Based on Swin Transformer and 3D Residual Multilayer Fusion Network

SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detection

Hyperspectral Remote-Sensing Classification Combining Transformer and Multiscale Residual Mechanisms

Improved deep learning image classification algorithm based on Swin Transformer V2

When CNNs Meet Vision Transformer: A Joint Framework for Remote Sensing Scene Classification

Hyperspectral Image Classification Using Hierarchical Spatial-Spectral Transformer

A Lightweight Dual-Branch Swin Transformer for Remote Sensing Scene Classification

Class-Guided Swin Transformer for Semantic Segmentation of Remote Sensing Imagery

Swin-CFNet: An Attempt at Fine-Grained Urban Green Space Classification Using Swin Transformer and Convolutional Neural Network

P-Swin: Parallel Swin transformer multi-scale semantic segmentation network for land cover classification

An Improved Swin Transformer-Based Model for Remote Sensing Object Detection and Instance Segmentation

SwinTFNet: Dual-Stream Transformer With Cross Attention Fusion for Land Cover Classification

An Efficient Hybrid CNN-Transformer Approach for Remote Sensing Super-Resolution