Abstract:This project uses machine learning and computer vision techniques and a novel interactive visualization tool to provide street-level characterization of urban spaces such as safety and maintenance in urban neighborhoods. This is achieved by collecting and annotating street-view images, extracting objective metrics through computer vision techniques, and using crowdsourcing to statistically model the perception of subjective metrics such as safety and maintenance. For modeling human perception and scaling it up with a predictive algorithm, we evaluate perception predictions across two points in time separated by economic changes in the urban core of Raleigh, North Carolina, in the aftermath of the 2008 Great Recession. We hypothesize specific socioeconomic processes can be substantially reflected in the built environment of cities and, thus, render themselves visible at the street level. This paper describes the process of incorporating subjective visual ratings across two datasets of temporally separated street-view images, an algorithm, and a visualization tool. This work serves as a case study for utilizing AI and visualization techniques in a richer characterization of urban spaces that includes both objective metrics such as income (that operates at a broader scale) and subjective metrics such as perception of individuals (that operates at a narrower scale at specific locations). We outline an interdisciplinary methodology to test this hypothesis in streetscape data from Raleigh, NC, from 2008 to 2020. We describe the results of training algorithms that utilized image features with crowdsourced human perception ratings. We provide a comparison of the results with income data. The analysis and interpretation of this comparison provide insight into the challenges and opportunities for using AI technology in characterizing changes in urban environments. One challenge is the ability of human domain experts to interpret the output of algorithms through manipulation and to integrate these results into their workflow. This is addressed with a novel interface designed for interactive analysis and visualization. We conclude with a discussion of some of the benefits and limitations of integrating AI models in the human expert's decision-making process in the presence of both subjective and objective metrics.

Machine learning for buildings characterization and power-law recovery of urban metrics

Machine Learning Algorithms for Predicting Energy Consumption in Educational Buildings

Applying machine learning algorithms to group the energy performance of existing buildings by different granularity level of energy data

Urban building energy prediction at neighborhood scale

Learning from urban form to predict building heights

Data Driven Approaches for Prediction of Building Energy Consumption at Urban Level

Use of Machine Learning Techniques on Aerial Imagery for the Extraction of Photovoltaic Data within the Urban Morphology

Data-Driven Living Spaces’ Heating Dynamics Modeling in Smart Buildings using Machine Learning-Based Identification

Machine learning-based characterisation of urban morphology with the street pattern

Characterizing the perception of urban spaces from visual analytics of street-level imagery

Advanced Machine Learning Techniques for Energy Consumption Analysis and Optimization at UBC Campus: Correlations with Meteorological Variables

Building energy consumption prediction for residential buildings using deep learning and other machine learning techniques

Incorporating Machine Learning with Building Network Analysis to Predict Multi-Building Energy Use

An artificial intelligence framework for predicting operational energy consumption in office buildings

Accuracy analyses and model comparison of machine learning adopted in building energy consumption prediction

Automated National Urban Map Extraction

Power Management in Smart Residential Building with Deep Learning Model for Occupancy Detection by Usage Pattern of Electric Appliances

A relevant data selection method for energy consumption prediction of low energy building based on support vector machine

Prediction of an Efficient Energy-Consumption Model for Existing Residential Buildings in Lebanon Using an Artificial Neural Network as a Digital Twin in the Era of Climate Change

Encoding Urban Ecologies: Automated Building Archetype Generation through Self-Supervised Learning for Energy Modeling

A comparative study of machine learning and deep learning methods for energy balance prediction in a hybrid building-renewable energy system