Abstract:Recursive neural networks and transformers have recently become dominant in hyperspectral (HS) image classification due to their ability to capture long-range dependencies in spectral sequences. Despite the success of these sequential architectures, mainstream deep learning methods primarily handle two-dimensional structured data. However, challenges such as the curse of dimensionality, spectral variability, and confounding factors in hyperspectral remote sensing images limit their effectiveness, especially in remote sensing applications. To address this issue, this paper proposes a novel land cover classification algorithm that integrates random forests with a spectral transformer network structure (RS-Net). Firstly, this paper presents a combination of the Gramian Angular Field (GASF) and Gramian Angular Difference Field (GADF) algorithms, which effectively maps the multidimensional time series constructed for each pixel onto two-dimensional image features, enabling precise extraction and recognition in the backend network algorithms and improving the classification accuracy of land cover types. Secondly, to capture the relationships between features at different scales, this paper proposes a SpectralFormer network architecture using the Context and Structure Encoding (CASE) module to effectively learn dependencies between channels. This architecture enhances important features and suppresses unimportant ones, thereby addressing the semantic gap and improving the recognition capability of land cover features. Finally, the final prediction results are determined by a voting mechanism from the Random Forest algorithm, which synthesizes predictions from multiple decision trees to enhance classification stability and accuracy. To better compare the performance of RS-Net, this paper conducted extensive experiments on three benchmark HS datasets obtained from satellite and airborne imagers, comparing various classic neural network models. Surprisingly, the RS-Net algorithm achieves high performance and efficiency, offering a new and effective tool for land cover classification.

Imagery Time Series Cloud Removal and Classification Using Long Short Term Memory Neural Networks

Very High Resolution Remote Sensing Imagery Classification Using a Fusion of Random Forest and Deep Learning Technique—Subtropical Area for Example

Land Cover Classification via Multi-temporal Spatial Data by Recurrent Neural Networks

Land Cover Classification of Remote Sensing Images Based on Hierarchical Convolutional Recurrent Neural Network

Cloud removal in Sentinel-2 imagery using a deep residual neural network and SAR-optical data fusion

Classification of land use/land cover using artificial intelligence (ANN-RF)

Improvement in Land Cover and Crop Classification based on Temporal Features Learning from Sentinel-2 Data Using Recurrent-Convolutional Neural Network (R-CNN)

Temporal Convolutional Neural Network for the Classification of Satellite Image Time Series

Thick Cloud Removal Under Land Cover Changes Using Multisource Satellite Imagery and a Spatiotemporal Attention Network

Seeing Through Clouds in Satellite Images

Semi-Supervised Convolutional Long Short-Term Memory Neural Networks for Time Series Land Cover Classification

Sentinel-2 Cloud Removal Considering Ground Changes by Fusing Multitemporal SAR and Optical Images

Thick Clouds Removing From Multitemporal Landsat Images Using Spatiotemporal Neural Networks

Land cover classification from multi-temporal, multi-spectral remotely sensed imagery using patch-based recurrent neural networks

Tree species classification at the pixel-level using deep learning and multispectral time series in an imbalanced context

Combining Sentinel-1 and Sentinel-2 Time Series via RNN for object-based land cover classification

RS-Net: Hyperspectral Image Land Cover Classification Based on Spectral Imager Combined with Random Forest Algorithm

Unsupervised Domain Factorization Network for Thick Cloud Removal of Multitemporal Remotely Sensed Images

Deep Neural Networks for automatic extraction of features in time series satellite images

Exploitation of Time Series Sentinel-2 Data and Different Machine Learning Algorithms for Detailed Tree Species Classification.

Using Long Short-Term Memory Recurrent Neural Network in Land Cover Classification on Landsat and Cropland Data Layer Time Series