Abstract:Data in the form of images are now generated at an unprecedented rate. A case in point is remote sensing images (RSI), now available in large-scale RSI archives, which have attracted a considerable amount of research on image classification within the remote sensing community. The basic task of single-target multi-class image classification considers the case where each image is assigned exactly one label from a predefined finite set of class labels. Recently, however, image annotations have become increasingly complex, with images labeled with several labels (instead of just one). In other words, the goal is to assign multiple semantic categories to an image, based on its high-level context. The corresponding machine learning tasks is called multi-label classification (MLC). The classification of RSI is currently predominantly addressed by deep neural network (DNN) approaches, especially convolutional neural networks (CNNs), which can be utilized as feature extractors as well as end-to-end methods. After only considering single-target classification for a long period, DNNs have recently emerged that address the task of MLC. On the other hand, trees and tree ensembles for MLC have a long tradition and are the best-performing class of MLC methods, but need predefined feature representations to operate on. In this work, we explore different strategies for model training based on the transfer learning paradigm, where we utilize different families of (pre-trained) CNN architectures, such as VGG, EfficientNet, and ResNet. The architectures are trained in an end-to-end manner and used in two different modes of operation, namely, as standalone models that directly perform the MLC task, and as feature extractors. In the latter case, the learned representations are used with tree ensemble methods for MLC, such as random forests and extremely randomized trees. We conduct an extensive experimental analysis of methods over several publicly available RSI datasets and evaluate their effectiveness in terms of standard MLC measures. Of these, ranking-based evaluation measures are most relevant, especially ranking loss. The results show that, for addressing the RSI-MLC task, it is favorable to use lightweight network architectures, such as EfficientNet-B2, which is the best performing end-to-end approach, as well as a feature extractor. Furthermore, in the datasets with a limited number of images, using traditional tree ensembles for MLC can yield better performance compared to end-to-end deep approaches.

ForestDet: Large-Vocabulary Long-Tailed Object Detection and Instance Segmentation

Forest R-CNN: Large-Vocabulary Long-Tailed Object Detection and Instance Segmentation

Very High Resolution Remote Sensing Imagery Classification Using a Fusion of Random Forest and Deep Learning Technique—Subtropical Area for Example

Joint Feature-Level And Pixel-Level Domain Adaption For Object Detection In The Wild

Universal Object Detection with Large Vision Model

DIM: Long-tailed Object Detection and Instance Segmentation via Dynamic Instance Memory

Improvements in Forest Segmentation Accuracy Using a New Deep Learning Architecture and Data Augmentation Technique

3D-CNN with Multi-Scale Fusion for Tree Crown Segmentation and Species Classification

A Multi-Scale Convolution and Multi-Layer Fusion Network for Remote Sensing Forest Tree Species Recognition

Automatic Detection of Individual Trees in Forests Based on Airborne LiDAR Data with a Tree Region-Based Convolutional Neural Network (RCNN)

MHLDet: A Multi-Scale and High-Precision Lightweight Object Detector Based on Large Receptive Field and Attention Mechanism for Remote Sensing Images

Detection of Forestry Pests Based on Improved YOLOv5 and Transfer Learning

SegForest: A Segmentation Model for Remote Sensing Images

Few-Shot Object Detection in Remote-Sensing Images via Label-Consistent Classifier and Gradual Regression

MCDet: Multi-Content Collaboration Detector for Multiscale Remote Sensing Object

Adaptive Class Suppression Loss for Long-Tail Object Detection

M2fNet: Multi-modal Forest Monitoring Network on Large-scale Virtual Dataset

Large Selective Kernel Network for Remote Sensing Object Detection

Deep Regionlets: Blended Representation and Deep Learning for Generic Object Detection

Deep Network Architectures as Feature Extractors for Multi-Label Classification of Remote Sensing Images

LRSDet: Lightweight Remote Sensing Target Detection Network with Local-Global Information Awareness and Rapid Sample Assignment