Abstract:As a fundamental task for geographical information updating, 3D city modeling, and other critical applications, the automatic extraction of building footprints from high-resolution remote sensing images has been substan-tially explored and received increasing attention over recent years. Among different types of building extraction methods, the polygonal segmentation methods produce vector building polygons that are in a more realistic format compared with those obtained from pixel-wise semantic labeling and contour-based methods. However, existing polygonal building segmentation methods usually require a perfect segmentation map and a complex post-processing procedure to guarantee the polygonization quality, or produce inaccurate vertex prediction results that suffer from wrong vertex sequence, self-intersections, fixed vertex quantity, etc. In our previous work, we have proposed a method for polygonal building segmentation from remote sensing images that addresses the above limitations of existing methods. In this paper, we propose PolyCity, which further extends and improves our previous work in terms of the application scenario, methodology design, and experimental results. Our proposed PolyCity contains the following three components: (1) a pixel-wise multi-task network for learning the semantic and geometric information via three tasks, i.e., building segmentation, boundary prediction, and edge orientation prediction; (2) a simple but effective vertex selection module (VSM), which effectively bridges the gap between pixel-wise and graph-based models via transforming the segmentation map into valid polygon vertices; (3) a graph-based vertex refinement network (VRN) for automatically adjusting the coordinates of VSM-generated valid polygon vertices, producing the final building polygons with more precise vertices. Results on three large-scale building extraction datasets demonstrate that our proposed PolyCity generates vector building footprints with more accurate vertices, edges, shapes, etc., achieving significant vertex score improvements while maintaining high segmentation and boundary scores compared with the current state-of-the-art. The code of PolyCity will be released at https://github.com/liweijia/polycity.

An end-to-end shape modeling framework for vectorized building outline generation from aerial images

PolyR-CNN: R-CNN for end-to-end polygonal building outline extraction

Robust Extraction of Vectorized Buildings Via Bidirectional Tracing of Keypoints from Remotely Sensed Imagery.

BUILDING OUTLINE EXTRACTION FROM AERIAL IMAGERY AND DIGITAL SURFACE MODEL WITH A FRAME FIELD LEARNING FRAMEWORK

From lines to Polygons: Polygonal building contour extraction from High-Resolution remote sensing imagery

Vectorized Building Extraction from High-Resolution Remote Sensing Images Using Spatial Cognitive Graph Convolution Model

A Deep Learning-Based Framework for Automated Extraction of Building Footprint Polygons from Very High-Resolution Aerial Imagery

Enhancing Polygonal Building Segmentation via Oriented Corners

Joint semantic–geometric learning for polygonal building segmentation from high-resolution remote sensing images

Joint Semantic-geometric Learning for Polygonal Building Segmentation

Joint semantic-geometric learning for polygonal building segmentation from-resolution remote

A Building Shape Vectorization Hierarchy from VHR Remote Sensing Imagery Combined DCNNs-Based Edge Detection and PCA-Based Corner Extraction

Transbuilding: an End-to-End Polygonal Building Extraction with Transformers

BuildMapper: A Fully Learnable Framework for Vectorized Building Contour Extraction

Efficient High-Quality Vectorized Modeling of Large-Scale Scenes

PolyBuilding: Polygon Transformer for End-to-End Building Extraction

Polygonal Building Segmentation by Frame Field Learning

Polygonizer: An auto-regressive building delineator

Boundary Shape-Preserving Model for Building Mapping From High-Resolution Remote Sensing Images