Abstract:Satellite hyperspectral imagery is an important data source for large-scale refined land cover classification and mapping, but the high spatial heterogeneity and spectral variability at low spatial resolution and the high computation cost for massive data remain challenges in the research community. In recent years, convolutional neural network (CNN) models with the capability for feature extraction have been widely used in hyperspectral image classification. However, incomplete feature extraction, inappropriate feature fusion, and high time consumption are still the major problems for CNN applications in large-scale fine land cover mapping. In this study, a Spatial-Convolution Spectral-Transformer Interactive Network (SCSTIN) was proposed to integrate 2D-CNN and Transformer into a dual-branch network to enhance feature extraction capabilities by exploring spatial context information and spectral sequence signatures in a targeted manner. In addition, spatial-spectral interactive fusion (SSIF) units and category-adaptive weighting (CAW) as two feature fusion modules were also adopted between and after the two feature extraction branches to improve efficiency in feature fusion. The ZY1-02D hyperspectral imagery was collected to conduct the experiments in the study area of the eastern foothills of the Helan Mountains (EFHLM), covering an area of about 8800 km2, which is the largest hyperspectral dataset as far as we know. To explore the potential of the proposed network in terms of accuracy and efficiency, SCSTIN models with different depths (SCSTIN-4 and SCSTIN-2) were performed. The results suggest that compared with the previous eight advanced hyperspectral image classifiers, both SCSTIN models achieved satisfactory performance in accuracy and efficiency aspects with low complexity, where SCSTIN-4 achieved the highest accuracy and SCSTIN-2 obtained higher efficiency. Accordingly, the SCSTIN models are reliable for large-scale fast refined land cover classification and mapping. In addition, the spatial distribution pattern of diverse ground objects in EFHLM is also analyzed.

Dense connected convolution neural network for land cover classification

Three-dimensional Densely Connected Convolutional Network for Hyperspectral Remote Sensing Image Classification

Land-cover classification with hyperspectral remote sensing image using CNN and spectral band selection

Dense Fusion Classmate Network for Land Cover Classification

Dense Dilated Convolutions Merging Network for Land Cover Classification

A patch-based convolutional neural network for remote sensing image classification

Spectrally Segmented-Enhanced Neural Network for Precise Land Cover Object Classification in Hyperspectral Imagery

Integrated 1D, 2D, and 3D CNNs Enable Robust and Efficient Land Cover Classification from Hyperspectral Imagery

Cognitive Land Cover Mapping: A Three-Layer Deep Learning Architecture for Remote Sensing Data Classification

STRATEGIC OPTIMIZATION OF CONVOLUTIONAL NEURAL NETWORKS FOR HYPERSPECTRAL LAND COVER CLASSIFICATION

LCTCS: Low-Cost and Two-Channel Sparse Network for Hyperspectral Image Classification

Urban Land Cover Classification With Missing Data Modalities Using Deep Convolutional Neural Networks

Hyper-LGNet: Coupling Local and Global Features for Hyperspectral Image Classification

Hyperspectral Image Classification Based on Expansion Convolution Network

Enhancing Hyperspectral Image Classification for Land Use Land Cover With Dilated Neighborhood Attention Transformer and Crow Search Optimization

Land Use and Land Cover Classification with Hyperspectral Data: A comprehensive review of methods, challenges and future directions

Channel-Attention-Based DenseNet Network for Remote Sensing Image Scene Classification

Hyperspectral Image Classification with a Dense Multi-Scale Residual Network

Land cover classification from remote sensing images based on multi-scale fully convolutional network

Consolidated Convolutional Neural Network for Hyperspectral Image Classification

Spatial-Convolution Spectral-Transformer Interactive Network for Large-Scale Fast Refined Land Cover Classification and Mapping Based on ZY1-02D Satellite Hyperspectral Imagery