Abstract:As a fundamental task for geographical information updating, 3D city modeling, and other critical applications, the automatic extraction of building footprints from high-resolution remote sensing images has been substan-tially explored and received increasing attention over recent years. Among different types of building extraction methods, the polygonal segmentation methods produce vector building polygons that are in a more realistic format compared with those obtained from pixel-wise semantic labeling and contour-based methods. However, existing polygonal building segmentation methods usually require a perfect segmentation map and a complex post-processing procedure to guarantee the polygonization quality, or produce inaccurate vertex prediction results that suffer from wrong vertex sequence, self-intersections, fixed vertex quantity, etc. In our previous work, we have proposed a method for polygonal building segmentation from remote sensing images that addresses the above limitations of existing methods. In this paper, we propose PolyCity, which further extends and improves our previous work in terms of the application scenario, methodology design, and experimental results. Our proposed PolyCity contains the following three components: (1) a pixel-wise multi-task network for learning the semantic and geometric information via three tasks, i.e., building segmentation, boundary prediction, and edge orientation prediction; (2) a simple but effective vertex selection module (VSM), which effectively bridges the gap between pixel-wise and graph-based models via transforming the segmentation map into valid polygon vertices; (3) a graph-based vertex refinement network (VRN) for automatically adjusting the coordinates of VSM-generated valid polygon vertices, producing the final building polygons with more precise vertices. Results on three large-scale building extraction datasets demonstrate that our proposed PolyCity generates vector building footprints with more accurate vertices, edges, shapes, etc., achieving significant vertex score improvements while maintaining high segmentation and boundary scores compared with the current state-of-the-art. The code of PolyCity will be released at https://github.com/liweijia/polycity.

PolyGNN: Polyhedron-based Graph Neural Network for 3D Building Reconstruction from Point Clouds

Point2Building: Reconstructing Buildings from Airborne LiDAR Point Clouds

A Framework for Reconstructing Building Parametric Models with Hierarchical Relationships from Point Clouds.

Joint semantic-geometric learning for polygonal building segmentation from-resolution remote

Joint semantic–geometric learning for polygonal building segmentation from high-resolution remote sensing images

Extracting 3-D Structural Lines of Building from ALS Point Clouds using Graph Neural Network Embedded with Corner Information

PolyWorld: Polygonal Building Extraction with Graph Neural Networks in Satellite Images

RECONSTRUCTION OF 3D MODELS FROM POINT CLOUDS WITH HYBRID REPRESENTATION

Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloud

Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysis

PolyBuilding: Polygon Transformer for End-to-End Building Extraction

DSANet: Dynamic and Structure-Aware GCN for Sparse and Incomplete Point Cloud Learning

Adaptive Polygon Generation Algorithm for Automatic Building Extraction.

PolyR-CNN: R-CNN for end-to-end polygonal building outline extraction

PolyBuilding: Polygon transformer for building extraction

PolygonGNN: Representation Learning for Polygonal Geometries with Heterogeneous Visibility Graph

Point-Voxel Based Geometry-Adaptive Network for 3D Point Cloud Analysis

City3D: Large-Scale Building Reconstruction from Airborne LiDAR Point Clouds

GEOP-Net: Shape Reconstruction of Buildings from LiDAR Point Clouds

Geo GCN: Geometric-based Graph CNN for Learning on Point Cloud