Multispectral Semantic Land Cover Segmentation From Aerial Imagery With Deep Encoder–Decoder Network

Chengxin Liu,Shuaiyuan Du,Hao Lu,Dehui Li,Zhiguo Cao
DOI: https://doi.org/10.1109/lgrs.2020.3037976
IF: 5.343
2022-01-01
IEEE Geoscience and Remote Sensing Letters
Abstract:Developing accurate algorithms for agricultural pattern recognition from aerial imagery has become increasingly important due to the prevalence of unmanned aerial vehicles (UAVs). This letter introduces a deep encoder–decoder network for semantic land cover segmentation, where the goal is to classify six anomaly categories from multispectral aerial imagery. Since aerial imagery exhibits specific characteristics and visual challenges in this imaging domain, existing semantic segmentation models are not plug-and-play. Starting from a state-of-the-art segmentation model, we present a step-by-step analysis of key challenges and also reveal our observations in addressing these challenges. In particular, we investigate on how to exploit data prior knowledge, how to deal with sample imbalance, and how to encode global semantic and contextual information to improve segmentation. Experiments on a recent large-scale aerial land cover data set demonstrate that our method achieves compelling performance against other state-of-the-art approaches. Our results and insights can provide references for practitioners working in this field when dealing with similar segmentation problems.
imaging science & photographic technology,remote sensing,engineering, electrical & electronic,geochemistry & geophysics
What problem does this paper attempt to address?
This paper attempts to solve the problem of multi - spectral semantic land - cover segmentation from aerial images. Specifically, the researchers aim to develop a deep encoder - decoder network that can effectively classify six abnormal categories, which are identified from multi - spectral aerial images. Since aerial images have specific characteristics and visual challenges in this imaging field, existing semantic segmentation models cannot be directly applied. Therefore, by analyzing key challenges and exploring how to utilize data prior knowledge, handle sample imbalance, and encode global semantics and context information to improve segmentation performance, the paper designs an accurate and efficient model. The main contributions of the paper include: 1. Provide a step - by - step analysis of which key components are beneficial to improving semantic land - cover segmentation. 2. Based on the above analysis, introduce a deep encoder - decoder network to achieve accurate and efficient semantic land - cover segmentation. Through these methods, the paper not only solves the deficiencies of existing models on aerial images, but also provides valuable references for practitioners in this field.