Abstract:3D building models are an established instance of geospatial information in the built environment, but their acquisition remains complex and topical. Approaches to reconstruct 3D building models often require existing building information (e.g.their footprints) and data such as point clouds, which are scarce and laborious to acquire, limiting their expansion. In parallel, street view imagery (SVI) has been gaining currency, driven by the rapid expansion in coverage and advances in computer vision (CV), but it has not been used much for generating 3D city models. Traditional approaches that can use SVI for reconstruction require multiple images, while in practice, often only few street-level images provide an unobstructed view of a building. We develop the reconstruction of 3D building models from a single street view image using image-to-mesh reconstruction techniques modified from the CV domain. We regard three scenarios: (1) standalone single-view reconstruction; (2) reconstruction aided by a top view delineating the footprint; and (3) refinement of existing 3D models, i.e.we examine the use of SVI to enhance the level of detail of block (LoD1) models, which are common. The results suggest that trained models supporting (2) and (3) are able to reconstruct the overall geometry of a building, while the first scenario may derive the approximate mass of the building, useful to infer the urban form of cities. We evaluate the results by demonstrating their usefulness for volume estimation, with mean errors of less than 10% for the last two scenarios. As SVI is now available in most countries worldwide, including many regions that do not have existing footprint and/or 3D building data, our method can derive rapidly and cost-effectively the 3D urban form from SVI without requiring any existing building information. Obtaining 3D building models in regions that hitherto did not have any, may enable a number of 3D geospatial analyses locally for the first time.

Building Usage Prediction in Complex Urban Scenes By Fusing Text and Facade Features from Street View Images Using Deep Learning

3D building reconstruction from single street view images using deep learning

Understanding urban landuse from the above and ground perspectives: A deep learning, multimodal solution

Fusion of Google Street View, LiDAR, and Orthophoto Classifications Using Ranking Classes Based on F1 Score for Building Land-Use Type Detection

Building Information Modeling and Classification by Visual Learning At A City Scale

BuildingView: Constructing Urban Building Exteriors Databases with Street View Imagery and Multimodal Large Language Mode

Fine-grained landuse characterization using ground-based pictures: a deep learning solution based on globally available data

Simultaneous Extraction of Spatial and Attributional Building Information Across Large-Scale Urban Landscapes from High-Resolution Satellite Imagery

Spatial context-aware method for urban land use classification using street view images

Automated Real-World Sustainability Data Generation from Images of Buildings

Comprehensive urban space representation with varying numbers of street-level images

Building instance classification using street view images

AUTOMATIC 3D BUILDING MODEL GENERATION USING DEEP LEARNING METHODS BASED ON CITYJSON AND 2D FLOOR PLANS

Learning visual features from figure-ground maps for urban morphology discovery

An Interpretable Machine Learning Framework for Measuring Urban Perceptions from Panoramic Street View Images

ELEV-VISION-SAM: Integrated Vision Language and Foundation Model for Automated Estimation of Building Lowest Floor Elevation

Predicting Multi-level Socioeconomic Indicators from Structural Urban Imagery

Classification of residential and non-residential buildings based on satellite data using deep learning

Inferring building function: A novel geo-aware neural network supporting building-level function classification

Zero-shot Building Attribute Extraction from Large-Scale Vision and Language Models

Bounding Boxes Are All We Need: Street View Image Classification via Context Encoding of Detected Buildings