Abstract:Data in the form of images are now generated at an unprecedented rate. A case in point is remote sensing images (RSI), now available in large-scale RSI archives, which have attracted a considerable amount of research on image classification within the remote sensing community. The basic task of single-target multi-class image classification considers the case where each image is assigned exactly one label from a predefined finite set of class labels. Recently, however, image annotations have become increasingly complex, with images labeled with several labels (instead of just one). In other words, the goal is to assign multiple semantic categories to an image, based on its high-level context. The corresponding machine learning tasks is called multi-label classification (MLC). The classification of RSI is currently predominantly addressed by deep neural network (DNN) approaches, especially convolutional neural networks (CNNs), which can be utilized as feature extractors as well as end-to-end methods. After only considering single-target classification for a long period, DNNs have recently emerged that address the task of MLC. On the other hand, trees and tree ensembles for MLC have a long tradition and are the best-performing class of MLC methods, but need predefined feature representations to operate on. In this work, we explore different strategies for model training based on the transfer learning paradigm, where we utilize different families of (pre-trained) CNN architectures, such as VGG, EfficientNet, and ResNet. The architectures are trained in an end-to-end manner and used in two different modes of operation, namely, as standalone models that directly perform the MLC task, and as feature extractors. In the latter case, the learned representations are used with tree ensemble methods for MLC, such as random forests and extremely randomized trees. We conduct an extensive experimental analysis of methods over several publicly available RSI datasets and evaluate their effectiveness in terms of standard MLC measures. Of these, ranking-based evaluation measures are most relevant, especially ranking loss. The results show that, for addressing the RSI-MLC task, it is favorable to use lightweight network architectures, such as EfficientNet-B2, which is the best performing end-to-end approach, as well as a feature extractor. Furthermore, in the datasets with a limited number of images, using traditional tree ensembles for MLC can yield better performance compared to end-to-end deep approaches.

GA-Based Weighted Ensemble Learning for Multi-Label Aerial Image Classification Using Convolutional Neural Networks and Vision Transformers

Multiscale 3-D-2-D Mixed CNN and Lightweight Attention-Free Transformer for Hyperspectral and LiDAR Classification

Label-Guided Cross-Modal Attention Network for Multi-Label Aerial Image Classification

Asymmetric Vision Transformers for Multi-Label Classification

Attention GANs: Unsupervised Deep Feature Learning for Aerial Scene Classification.

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

Multi-label remote sensing image classification with deformable convolutions and graph neural networks

Multiple Vision Architectures-Based Hybrid Network for Hyperspectral Image Classification

Multi-label remote sensing classification with self-supervised gated multi-modal transformers

Deep Network Architectures as Feature Extractors for Multi-Label Classification of Remote Sensing Images

A Lightweight Multi-Label Classification Method for Urban Green Space in High-Resolution Remote Sensing Imagery

S-MAT: Semantic-Driven Masked Attention Transformer for Multi-Label Aerial Image Classification.

Cross-Modal Feature Representation Learning and Label Graph Mining in a Residual Multi-Attentional CNN-LSTM Network for Multi-Label Aerial Scene Classification

Light Self-Gaussian-Attention Vision Transformer for Hyperspectral Image Classification.

Ensemble of Deep Learning-Based Multimodal Remote Sensing Image Classification Model on Unmanned Aerial Vehicle Networks

Multi-label Image Recognition with Attentive Transformer-Localizer Module

Incomplete Multi-View Multi-Label Learning via Label-Guided Masked View- and Category-Aware Transformers

Multi-scale and Discriminative Part Detectors Based Features for Multi-label Image Classification.

Gaussian Mixture Variational Autoencoder with Contrastive Learning for Multi-Label Classification

ConVaT: A Variational Generative Transformer With Momentum Contrastive Learning for Hyperspectral Image Classification

A Combination of Lie Group Machine Learning and Deep Learning for Remote Sensing Scene Classification Using Multi-Layer Heterogeneous Feature Extraction and Fusion