Abstract:Urban feature extraction methods have presented multiple opportunities in the field of environmental building performance studies, and urban assessments. With reference to façade features, window size and position are key parameters that influence occupant perception and environmental performance of indoor spaces. A myriad of methods have been proposed to automatically detect façade window layouts from street view images yet it is still unclear how to assess the strengths and limitations of these methods or how they can be combined for higher detection performance. This paper aims to add clarity for those aiming to use computer vision techniques for facade layout extraction for urban level sustainability assessments. An automated pipeline to enable the extraction and detection of WWRs (Window to Wall ratios) is introduced that is based on two fundamentally different computational approaches; a grammar-based edge detection framework (Method 1) and a learning-based method (Method 2) that utilizes CNNs (Convolutional Neural Networks). The paper then compares the detection efficacy of both methods, focusing on WWR accuracy, in New York and Lisbon, including their ability to extract more detailed façade properties such as floor-to-floor heights. The study finds that the learning-based method shows lower error scores across the two cities. In Lisbon, 69% of conditions were detected within the 10% error range and 91% were within the 20% range under Method 1. Under Method 2, 82.5% of conditions were within the 10% error range and 95% were within the 20% range. In New York, 66% of conditions were within the 10% error range and 90% were within the 20% range under Method 1 while 77.5% of conditions were within the 10% error range and 93% were within the 20% range under Method 2. Finally, a hybrid method is proposed to leverage the strengths of the two models, and higher accuracies are obtained in both the New York and Lisbon dataset. In New York, 96.5% are now detected within the 20% error range and 81.5% within the 10% error range. In Lisbon, 96% are now detected within the 20% error range and 83.5 % within the 10% error range. With reference to the total building height extraction formulated under Method 2, the results show a relative error of 3.5% in height estimation in the sample set.

Automated Assessment of Wind Damage to Windows of Buildings at a City Scale Based on Oblique Photography, Deep Learning and CFD

Window Detection in Facades Using Heatmap Fusion

Building Information Extraction and Earthquake Damage Prediction in an Old Urban Area Based on UAV Oblique Photogrammetry

Multi‐view street view image fusion for city‐scale assessment of wind damage to building clusters

A room with a view: Automatic assessment of window views for high-rise high-density areas using City Information Models and deep transfer learning

Identification of Building Damage from UAV-Based Photogrammetric Point Clouds Using Supervoxel Segmentation and Latent Dirichlet Allocation Model

Determination of building flood risk maps from LiDAR mobile mapping data

Façade Feature Extraction for Urban Performance Assessments: Evaluating algorithm applicability across diverse building morphologies

Physics-inspired and data-driven two-stage deep learning approach for wind field reconstruction with experimental validation

A Computational Framework for the Simulation of Wind Effects on Buildings in a Cityscape

A NOVEL GAN-BASED METHOD FOR BUILDING SURFACE WIND PRESSURE PREDICTION

Estimating Omnidirectional Urban Vertical Wind Speed with Direction-Dependent Building Morphologies

Automatic identification of building structure types using unmanned aerial vehicle oblique images and deep learning considering facade prior knowledge

Post-earthquake assessment of building damage degree using LiDAR data and imagery

Automated Detection and Counting of Windows using UAV Imagery based Remote Sensing

Automated regional seismic damage assessment of buildings using an unmanned aerial vehicle and a convolutional neural network

Wind Turbine Surface Damage Detection by Deep Learning Aided Drone Inspection Analysis

Assessing Urban Morphology's Impact on Solar Potential of High-Rise Facades in Hong Kong Using Machine Learning: An Application for FIPV Optimization

Fast Prediction and Optimization of Building Wind Environment Using CFD and Deep Learning Method

Near real-time prediction of wind-induced tree damage at a city scale: Simulation framework and case study for Tsinghua University campus

Machine Learning for Real-Time Building Outdoor Wind Environment Prediction Framework in Preliminary Design: Taking Xinjiekou Area of Nanjing, China as the Case