Abstract:Abstract Automatic classification of remote sensing images using machine learning techniques is challenging due to the complex features of the images. The images are characterized by features such as multi-resolution, heterogeneous appearance and multi-spectral channels. Deep learning methods have achieved promising results in the analysis of remote sensing satellite images in the recent past. However, deep learning methods based on convolutional neural networks (CNN) experience difficulties in the analysis of intrinsic objects from satellite images. These techniques have not achieved optimum performance in the analysis of remote sensing satellite images due to their complex features, such as coarse resolution, cloud masking, varied sizes of embedded objects and appearance. The receptive fields in convolutional operations are not able to establish long-range dependencies and lack global contextual connectivity for effective feature extraction. To address this problem, we propose an improved deep learning-based vision transformer model for the efficient analysis of remote sensing images. The proposed model incorporates a multi-head local self-attention mechanism with patch shifting procedure to provide both local and global context for effective extraction of multi-scale and multi-resolution spatial features of remote sensing images. The proposed model is also enhanced by fine-tuning the hyper-parameters by introducing dropout modules and a decay linear learning rate scheduler. This approach leverages local self-attention for learning and extraction of the complex features in satellite images. Four distinct remote sensing image datasets, namely RSSCN, EuroSat, UC Merced (UCM) and SIRI-WHU, were subjected to experiments and analysis. The results show some improvement in the proposed vision transformer on the CNN-based methods.

Strategies and best practice for neural network image classification

Remote Sensing Image Classification Based on Evidence Theory and Neural Networks

Pattern Recognition and Classification of Remotely Sensed Images by Artificial Neural Networks

A survey of image classification methods and techniques for improving classification performance

Review of deep learning methods for remote sensing satellite images classification: experimental survey and comparative analysis

Opening the black box of neural networks for remote sensing image classification

Image Classification Method Rationally Utilizing Spatial Information of the Image

An Analysis on Intelligent Systems for Remote Sensing Satellite Image Processing and Classification

Multi-Spectral Satellite Image Classification Using an Evolving Neural Network Approach

Remote Sensing Image Classification Based on Neural Networks Designed Using an Efficient Neural Architecture Search Methodology

A Study of Image Classification of Remote Sensing Based on Back-Propagation Neural Network with Extended Delta Bar Delta

Implementation of machine-learning classification in remote sensing: an applied review

Evaluation, Tuning and Interpretation of Neural Networks for Meteorological Applications

On classification of Sentinel-2 satellite images by a neural network ResNet-50

Conjugate Gradient Method Neural Network for Medium Resolution Remote Sensing Image Classification

STRATEGIC OPTIMIZATION OF CONVOLUTIONAL NEURAL NETWORKS FOR HYPERSPECTRAL LAND COVER CLASSIFICATION

Analysis of the hyperparameter optimisation of four machine learning satellite imagery classification methods

Pixel-Wise Classification Method For High Resolution Remote Sensing Imagery Using Deep Neural Networks

Automated classification of remote sensing satellite images using deep learning based vision transformer

Pattern Recognition in Multispectral Satellite Images Using Concurrent Self-Organizing Modular Neural Networks

Advancing Remote Sensing: A Unified Deep Learning Approach with Pretrained and Custom Architectures for High-Precision Classification