Abstract:Given an aerial image, aerial scene parsing (ASP) targets to interpret the semantic structure of the image content, e.g., by assigning a semantic label to every pixel of the image. With the popularization of data-driven methods, the past decades have witnessed promising progress on ASP by approaching the problem with the schemes of tile-level scene classification or segmentation-based image analysis, when using high-resolution aerial images. However, the former scheme often produces results with tile-wise boundaries, while the latter one needs to handle the complex modeling process from pixels to semantics, which often requires large-scale and well-annotated image samples with pixel-wise semantic labels. In this paper, we address these issues in ASP, with perspectives from tile-level scene classification to pixel-wise semantic labeling. Specifically, we first revisit aerial image interpretation by a literature review. We then present a large-scale scene classification dataset that contains one million aerial images termed Million-AID. With the presented dataset, we also report benchmarking experiments using classical convolutional neural networks (CNNs). Finally, we perform ASP by unifying the tile-level scene classification and object-based image analysis to achieve pixel-wise semantic labeling. Intensive experiments show that Million-AID is a challenging yet useful dataset, which can serve as a benchmark for evaluating newly developed algorithms. When transferring knowledge from Million-AID, fine-tuning CNN models pretrained on Million-AID perform consistently better than those pretrained ImageNet for aerial scene classification. Moreover, our designed hierarchical multi-task learning method achieves the state-of-the-art pixel-wise classification on the challenging GID, bridging the tile-level scene classification toward pixel-wise semantic labeling for aerial image interpretation.

AID++: An Updated Version of AID on Scene Classification

AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classification

AID: A Benchmark Data Set for Performance Evaluation of Aerial Scene Classification

Aerial Scene Classification Via Multilevel Fusion Based on Deep Convolutional Neural Networks.

Dense Connectivity Based Two-Stream Deep Feature Fusion Framework for Aerial Scene Classification

Deep Feature Fusion for High-Resolution Aerial Scene Classification

Aerial Visible-to-Infrared Image Translation: Dataset, Evaluation, and Baseline

A Multiple-Instance Densely-Connected ConvNet for Aerial Scene Classification

iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Images

Aerial Images Categorization with Deep Learning

Scene Recognition Based on an Improved DenseNet with Attention Mechanism

Attention-Aware Deep Feature Embedding for Remote Sensing Image Scene Classification

Aerial Scene Parsing: From Tile-level Scene Classification to Pixel-wise Semantic Labeling

AIDCON: An Aerial Image Dataset and Benchmark for Construction Machinery

A Deep Neural Network Combined With Context Features for Remote Sensing Scene Classification

Multiple instance dense connected convolution neural network for aerial image scene classification

Scene Classification Of High Resolution Remote Sensing Images Using Convolutional Neural Networks

APDC-Net: Attention Pooling-Based Convolutional Network for Aerial Scene Classification

Accelerated Feature Extraction and Refinement for Improved Aerial Scene Categorization

A Two-Stream Deep Fusion Framework for High-Resolution Aerial Scene Classification

Aerial Scene Classification with Convolutional Neural Networks