Abstract:Qualitative regularization consistently transforms remote sensing images (RSIs) from standard imaging conditions into non‐standard conditions. This substantial change in data distribution statistics within datasets reduces the accuracy of Vision Transformers (ViTs). This study introduces the quantitative regularization (QR) strategy, which effectively enhances the classification capabilities of open‐source ViTs for RSIs. Importantly, QR does not require any structural modifications to the models, thereby significantly lowering the entry barriers for geoscience researchers who aim to utilise ViT for RSI applications. Vision Transformers (ViTs) are exceptional at vision tasks. However, when applied to remote sensing images (RSIs), existing methods often necessitate extensive modifications of ViTs to rival convolutional neural networks (CNNs). This requirement significantly impedes the application of ViTs in geosciences, particularly for researchers who lack the time for comprehensive model redesign. To address this issue, we introduce the concept of quantitative regularization (QR), designed to enhance the performance of ViTs in RSI classification. QR represents an effective algorithm that adeptly manages domain discrepancies in RSIs and can be integrated with any ViTs in transfer learning. We evaluated the effectiveness of QR using three ViT architectures: vanilla ViT, Swin‐ViT and Next‐ViT, on four datasets: AID30, NWPU45, AFGR50 and UCM21. The results reveal that our Next‐ViT model surpasses 39 other advanced methods published in the past 3 years, maintaining robust performance even with a limited number of training samples. We also discovered that our ViT and Swin‐ViT achieve significantly higher accuracy and robustness compared to other methods using the same backbone. Our findings confirm that ViTs can be as effective as CNNs for RSI classification, regardless of the dataset size. Our approach exclusively employs open‐source ViTs and easily accessible training strategies. Consequently, we believe that our method can significantly lower the barriers for geoscience researchers intending to use ViT for RSI applications.

Recent advances in the application of vision transformers to remote sensing image scene classification

Transformers for Remote Sensing: A Systematic Review and Analysis

Transformers in Remote Sensing: A Survey

Vision Transformers for Remote Sensing Image Classification

SCViT: A Spatial-Channel Feature Preserving Vision Transformer for Remote Sensing Image Scene Classification

A Comprehensive Survey of Transformers for Computer Vision

Advancing Plain Vision Transformer Toward Remote Sensing Foundation Model

Recent Advances in Vision Transformer: A Survey and Outlook of Recent Work

Vision Transformers in Medical Computer Vision -- A Contemplative Retrospection

Vision Transformers for Mobile Applications: A Short Survey

Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Review

Vision Transformer for Multispectral Satellite Imagery: Advancing Landcover Classification*

Triple Attention Vision Transformers for Remote Sensing Image Classification

Automated classification of remote sensing satellite images using deep learning based vision transformer

Semantic Segmentation using Vision Transformers: A survey

Exploring Vision Transformers for Polarimetric SAR Image Classification

Quantitative regularization in robust vision transformer for remote sensing image classification

A Review of Transformer-Based Models for Computer Vision Tasks: Capturing Global Context and Spatial Relationships