Abstract:3-D building models play a vital role in numerous applications including urban planning and smart cities. Recent 3-D building modeling methods either rely heavily on available manually collected footprint references or hardly reach real automation on par with manual editing. To approach the automated extraction of instance-level 3-D buildings at level of detail 1 (LoD1), we introduce an innovative end-to-end 3-D building instance segmentation model. This model predicts accurate contours and heights of individual buildings simultaneously using ortho-rectified high-resolution remote sensing images and digital surface models (DSMs), getting rid of additional reference data and empirical parameter settings. First, we propose an anchor-free multihead (AFM) building extraction network tailored for extracting 2-D building contours. AFM incorporates a full-resolution, long-range correlation boosted global mask prediction branch along with anchor-free bounding box generation, as well as a newly developed online hard sample mining (OHSM) training procedure based on uncertainty analysis to emphasize error-prone positions in locating building contours. Subsequently, we incorporate a height prediction component to AFM in order to derive accurate building height information, thus creating the comprehensive 3-D building extraction model referred to as AFM-3D. The two-stage AFM-3D operates by initially predicting 3-D cube proposals, followed by generating refined 3-D prismatic models (LoD1 models) for each proposal. Thorough experimentation across different datasets demonstrates the superior performance of AFM and AFM-3D. A significant enhancement of 6.4% quality score is observed on the urban 3-D dataset in comparison to recent methods. In addition to the proposed novel methodology, we compare anchor-based and anchor-free bounding box generation mechanisms for remote sensing data, explore pixel-based and contour-based segmentation strategies, evaluate learning-based and empirical height estimation methods, and discuss the indispensability of DSM data in 3-D building instance extraction. These analyses yield valuable insights that contribute to the progression of 3-D building extraction research.

Building Extraction Using Local Surface Normal Angle Transformation

INTEGRATED METHOD OF BUILDING EXTRACTION FROM DIGITAL SURFACE MODEL AND IMAGERY

Building edge extraction based on DSM digital surface model and LIDAR point cloud data

An Automatic Building Extraction Method from High Resolution Satellite Image

A refined marker controlled watershed for building extraction from DSM and imagery

Building Detection in an Urban Area Using Lidar Data and QuickBird Imagery

Automatic building rooftop extraction using a digital surface model derived from aerial stereo images

Extraction of building roof edges from LiDAR data to optimize the digital surface model for true orthophoto generation

3-D Building Instance Extraction From High-Resolution Remote Sensing Images and DSM With an End-to-End Deep Neural Network

Automatic Building Extraction from Very High Resolution Satellite Imagery Using Line Segment Detector.

The Extraction of Buildings Elevation Information on UAV DSM.

A New Method of Building Extraction from High Resolution Remote Sensing Images Based on NSCT and PCNN

Fast Extraction of Building Dems in Urban Areas from Alos Prism Images

Individual High-Rise Building Extraction from Single High-Resolution SAR Image Based on Part Model

Automated 3d building geometrical modeling from dsm

Building Extraction from UAV Remote Sensing Data Based on Photogrammetry Method

Research on Building Outline Extraction Method from Airborne LiDAR Data

Spaceborne SAR Data for Regional Urban Mapping Using a Robust Building Extractor

Building Extraction from LiDAR Point Clouds Based on Revised RandLA-Net

SDSNet: Building Extraction in High-Resolution Remote Sensing Images Using a Deep Convolutional Network with Cross-Layer Feature Information Interaction Filtering

Object-Based Analysis of Airborne LiDAR Data for Building Change Detection