Abstract:In unmanned systems, remote sensing is an approach that collects and analyzes data such as visual images, infrared thermal images, and LiDAR sensor data from a distance using a system that operates without human intervention. Recent advancements in deep learning enable the direct mapping of input images in remote sensing to desired outputs, making it possible to learn through imitation learning and for unmanned systems to learn by collecting and analyzing those images. In the case of autonomous cars, raw high-dimensional data are collected using sensors, which are mapped to the values of steering and throttle through a deep learning network to train imitation learning. Therefore, by imitation learning, the unmanned systems observe expert demonstrations and learn expert policies, even in complex environments. However, in imitation learning, collecting and analyzing a large number of images from the game environment incurs time and costs. Training with a limited dataset leads to a lack of understanding of the environment. There are some augmentation approaches that have the limitation of increasing the dataset because of considering only the locations of objects visited and estimated. Therefore, it is required to consider the diverse kinds of the location of objects not visited to solve the limitation. This paper proposes an enhanced model to augment the number of training images comprising a Preprocessor, an enhanced Swin Transformer model, and an Action model. Using the original network structure of the Swin Transformer model for image augmentation in imitation learning is challenging. Therefore, the internal structure of the Swin Transformer model is enhanced, and the Preprocessor and Action model are combined to augment training images. The proposed method was verified through an experimental process by learning from expert demonstrations and augmented images, which reduced the total loss from 1.24068 to 0.41616. Compared to expert demonstrations, the accuracy was approximately 86.4%, and the proposed method achieved 920 points and 1200 points more than the comparison model to verify generalization.

Remote sensing image scene classification based on transfer learning and Swin transformer mode

SwinHCST: a deep learning network architecture for scene classification of remote sensing images based on improved CNN and Transformer

A Lightweight Dual-Branch Swin Transformer for Remote Sensing Scene Classification

Hyperspectral Remote-Sensing Classification Combining Transformer and Multiscale Residual Mechanisms

Class-Guided Swin Transformer for Semantic Segmentation of Remote Sensing Imagery

A Semantic Segmentation Method for Remote Sensing Images Based on the Swin Transformer Fusion Gabor Filter

Remote Sensing Scene Classification by Gated Bidirectional Network

A Siamese Swin-Unet for image change detection

Scene Changes Understanding Framework Based on Graph Convolutional Networks and Swin Transformer Blocks for Monitoring LCLU Using High-Resolution Remote Sensing Images

Transferring CNN With Adaptive Learning for Remote Sensing Scene Classification

An Improved Swin Transformer-Based Model for Remote Sensing Object Detection and Instance Segmentation

Remote sensing object detection based on a combination of a CNN and the Swin transformer

Imitation Learning through Image Augmentation Using Enhanced Swin Transformer Model in Remote Sensing

Spectral Swin Transformer Network for Hyperspectral Image Classification

When Self-Supervised Learning Meets Scene Classification: Remote Sensing Scene Classification Based on a Multitask Learning Framework

Text guided zero-shot scene classification of high spatial resolution remote sensing images

Land cover classification in high-resolution remote sensing: using Swin Transformer deep learning with texture features

SwinSUNet: Pure Transformer Network for Remote Sensing Image Change Detection

Automated classification of remote sensing satellite images using deep learning based vision transformer