Abstract:In recent years, convolutional neural network (CNN)-based methods have been widely used for remote sensing (RS) scene classification tasks and have achieved excellent results. However, CNNs are not good at exploring contextual information, which is essential for fully understanding RS scenes. A new model named transformer attracts researchers' attention to address this problem, which is skilled in mining the latent contextual information in RS scenes. Nevertheless, since the contents of RS scenes are diverse in type and various in scale, the performance of the original transformer in RS scene classification cannot reach what we expect. In addition, due to the specific self-attention mechanism, the time costs of the transformer are high, which hinders its practicability in the RS community. To overcome the above limitations, we propose a new model named efficient multiscale transformer and cross-level attention learning (EMTCAL) for RS scene classification in this article. EMTCAL combines the advantages of CNN and transformer to mine information within RS scenes fully. First, it uses a multilayer feature extraction module (MFEM) to acquire global visual features and multilevel convolutional features from RS scenes. Second, a contextual information extraction module (CIEM) is proposed to capture rich contextual information from multilevel features. In CIEM, taking the characteristics of RS scenes and the computational complexity into account, we propose an efficient multiscale transformer (EMST). EMST can mine the abundant knowledge with various scales hidden in RS scenes and model their inherent relations at small time costs. Third, a cross-level attention module (CLAM) is developed to aggregate and explore correlations of multilevel features. Finally, a class score fusion module (CSFM) is designed to integrate the contributions of global and aggregated multilevel features for discriminative scene representations. Extensive experiments are conduct- d on three public RS scene datasets. The positive results demonstrate that our EMTCAL can achieve superior classification performance and outperform many state-of-the-art methods. Our source codes are available in https://github.com/TangXu-Group/Remote-Sensing-Images-Classification/tree/main/EMTCAL.

Evolutionary Multitasking Collaborative Neural Architecture Search for Scene Classification.

SceneNet: Remote Sensing Scene Classification Deep Learning Network Using Multi-Objective Neural Evolution Architecture Search

E2SCNet: Efficient Multiobjective Evolutionary Automatic Search for Remote Sensing Image Scene Classification Network Architecture

RSSM-Net: Remote Sensing Image Scene Classification Based on Multi-Objective Neural Architecture Search

Remote Sensing Scene Classification Based on Attention-Enabled Progressively Searching

Knowledge Guided Evolutionary Transformer for Remote Sensing Scene Classification

Mae-Net: A Micro Network Architecture Evolutionary Search Method for Remote Sensing Image Scene Classification.

Evolutionary Multitasking Via Artificial Neural Networks.

Attention-Aware Deep Feature Embedding for Remote Sensing Image Scene Classification

Toward Evolutionary Multitask Convolutional Neural Architecture Search

EMTCAL: Efficient Multiscale Transformer and Cross-Level Attention Learning for Remote Sensing Scene Classification

A Multiscale Attention Network for Remote Sensing Scene Images Classification

Cross-Domain Scene Classification Based on a Spatial Generalized Neural Architecture Search for High Spatial Resolution Remote Sensing Images

Collaborative Self-Supervised Evolution for Few-Shot Remote Sensing Scene Classification

A Dual-Model Architecture with Grouping-Attention-Fusion for Remote Sensing Scene Classification

A Multiscale Incremental Learning Network for Remote Sensing Scene Classification

EMT-NAS: Transferring Architectural Knowledge Between Tasks from Different Datasets

Knowledge transfer evolutionary search for lightweight neural architecture with dynamic inference

Lightweight Channel Attention and Multiscale Feature Fusion Discrimination for Remote Sensing Scene Classification

SEMSDNet: A Multiscale Dense Network with Attention for Remote Sensing Scene Classification

An Adaptive Migration Collaborative Network for Multimodal Image Classification.