Abstract:Abstract Automatic classification of remote sensing images using machine learning techniques is challenging due to the complex features of the images. The images are characterized by features such as multi-resolution, heterogeneous appearance and multi-spectral channels. Deep learning methods have achieved promising results in the analysis of remote sensing satellite images in the recent past. However, deep learning methods based on convolutional neural networks (CNN) experience difficulties in the analysis of intrinsic objects from satellite images. These techniques have not achieved optimum performance in the analysis of remote sensing satellite images due to their complex features, such as coarse resolution, cloud masking, varied sizes of embedded objects and appearance. The receptive fields in convolutional operations are not able to establish long-range dependencies and lack global contextual connectivity for effective feature extraction. To address this problem, we propose an improved deep learning-based vision transformer model for the efficient analysis of remote sensing images. The proposed model incorporates a multi-head local self-attention mechanism with patch shifting procedure to provide both local and global context for effective extraction of multi-scale and multi-resolution spatial features of remote sensing images. The proposed model is also enhanced by fine-tuning the hyper-parameters by introducing dropout modules and a decay linear learning rate scheduler. This approach leverages local self-attention for learning and extraction of the complex features in satellite images. Four distinct remote sensing image datasets, namely RSSCN, EuroSat, UC Merced (UCM) and SIRI-WHU, were subjected to experiments and analysis. The results show some improvement in the proposed vision transformer on the CNN-based methods.

Research and Implementation of Autonomous Learning Platform for Image Classification

SemiCVT: Semi-Supervised Convolutional Vision Transformer for Semantic Segmentation

Automated classification of remote sensing satellite images using deep learning based vision transformer

Vision Pair Learning: An Efficient Training Framework for Image Classification

Cross-Domain Hyperspectral Image Classification Based on Transformer

Aggregated Pyramid Vision Transformer: Split-transform-merge Strategy for Image Recognition without Convolutions

TCPSNet: Transformer and Cross-Pseudo-Siamese Learning Network for Classification of Multi-Source Remote Sensing Images

Training Object Detectors from Scratch: An Empirical Study in the Era of Vision Transformer

Vision Transformers for Remote Sensing Image Classification

Towards SAR Automatic Target Recognition MultiCategory SAR Image Classification Based on Light Weight Vision Transformer

AutoTaskFormer: Searching Vision Transformers for Multi-task Learning

Analyzing Vision Transformers for Image Classification in Class Embedding Space

AutoFormer: Searching Transformers for Visual Recognition

Deep Hierarchical Vision Transformer for Hyperspectral and LiDAR Data Classification

A Comprehensive Study of Vision Transformers in Image Classification Tasks

HSVLT: Hierarchical Scale-Aware Vision-Language Transformer for Multi-Label Image Classification

A New Perspective to Boost Vision Transformer for Medical Image Classification

Transformer-BLS: An efficient learning algorithm based on multi-head attention mechanism and incremental learning algorithms

From Plane to Hierarchy: Deformable Transformer for Remote Sensing Image Captioning

Unsupervised remote sensing image classification with differentiable feature clustering by coupled transformer