Abstract:As a fundamental task for geographical information updating, 3D city modeling, and other critical applications, the automatic extraction of building footprints from high-resolution remote sensing images has been substan-tially explored and received increasing attention over recent years. Among different types of building extraction methods, the polygonal segmentation methods produce vector building polygons that are in a more realistic format compared with those obtained from pixel-wise semantic labeling and contour-based methods. However, existing polygonal building segmentation methods usually require a perfect segmentation map and a complex post-processing procedure to guarantee the polygonization quality, or produce inaccurate vertex prediction results that suffer from wrong vertex sequence, self-intersections, fixed vertex quantity, etc. In our previous work, we have proposed a method for polygonal building segmentation from remote sensing images that addresses the above limitations of existing methods. In this paper, we propose PolyCity, which further extends and improves our previous work in terms of the application scenario, methodology design, and experimental results. Our proposed PolyCity contains the following three components: (1) a pixel-wise multi-task network for learning the semantic and geometric information via three tasks, i.e., building segmentation, boundary prediction, and edge orientation prediction; (2) a simple but effective vertex selection module (VSM), which effectively bridges the gap between pixel-wise and graph-based models via transforming the segmentation map into valid polygon vertices; (3) a graph-based vertex refinement network (VRN) for automatically adjusting the coordinates of VSM-generated valid polygon vertices, producing the final building polygons with more precise vertices. Results on three large-scale building extraction datasets demonstrate that our proposed PolyCity generates vector building footprints with more accurate vertices, edges, shapes, etc., achieving significant vertex score improvements while maintaining high segmentation and boundary scores compared with the current state-of-the-art. The code of PolyCity will be released at https://github.com/liweijia/polycity.

Robust Extraction of Vectorized Buildings Via Bidirectional Tracing of Keypoints from Remotely Sensed Imagery.

From lines to Polygons: Polygonal building contour extraction from High-Resolution remote sensing imagery

Iterative Polygon Deformation for Building Extraction

PolyBuilding: Polygon transformer for building extraction

PolyBuilding: Polygon Transformer for End-to-End Building Extraction

An end-to-end shape modeling framework for vectorized building outline generation from aerial images

Transbuilding: an End-to-End Polygonal Building Extraction with Transformers

Joint semantic-geometric learning for polygonal building segmentation from-resolution remote

Joint semantic–geometric learning for polygonal building segmentation from high-resolution remote sensing images

Topological Building Extraction With Bidirectional Prediction From Remote Sensing Images

A Deep Learning-Based Framework for Automated Extraction of Building Footprint Polygons from Very High-Resolution Aerial Imagery

Vectorized Building Extraction from High-Resolution Remote Sensing Images Using Spatial Cognitive Graph Convolution Model

PolyR-CNN: R-CNN for end-to-end polygonal building outline extraction

Polygon-Based Building Extraction via Global Displacement and Local Refinement

BuildMapper: A Fully Learnable Framework for Vectorized Building Contour Extraction

Building Extraction from Satellite Imagery Based on Footprint Map and Bidirectional Connection Map

A Building Shape Vectorization Hierarchy from VHR Remote Sensing Imagery Combined DCNNs-Based Edge Detection and PCA-Based Corner Extraction

Building Extraction From Airborne Multi-Spectral Lidar Point Clouds Based On Graph Geometric Moments Convolutional Neural Networks

A Building Point Cloud Extraction Algorithm in Complex Scenes

Building Extraction From High Spatial Resolution Remote Sensing Images of Complex Scenes by Combining Region-Line Feature Fusion and OCNN