Abstract:In recent years, many studies have applied machine learning (ML) in urban building energy models (UBEMs) to understand building energy issues in cities. However, previous studies had limited in-depth discussions on hyperparameter tuning, an essential aspect of model training. To address this gap, this study examines the impact of different hyperparameter tuning strategies on the development of ML-based UBEMs, specifically for residential buildings in Chicago. Utilizing a comprehensive dataset that encompasses building, urban, household, and energy management factors, and electricity usage across 2,078 residential block groups in Chicago for the year 2010, this study employs five widely used supervised machine learning (SML) algorithms. Through three experiments, the study found that gradient boosting decision trees generally outperform others. However, hyperparameter tuning can significantly enhance the performance of all tested SML models. The comparison of three tuning methods, grid search, random search, and Bayesian search, revealed that they have similar tuning performance, but random search stands out for its effectiveness, speed, and flexibility. Moreover, the study demonstrates that the suggested search space for hyperparameters yields better results compared to the conventional approaches in most cases. Interestingly, altering the search budget appeared to have minimal impact on the tuning effectiveness. Employing repeated cross-validation methods helped mitigate the issues associated with random data splits in the validation process, leading to more reliable tuning outcomes. Further investigations into the scalability of training datasets and the evaluation of models using alternative accuracy metrics and considerations of model inductive bias provided additional insights. These findings informed recommendations regarding hyperparameter tuning strategies, optimal sample sizes, and model evaluation techniques. Overall, this research contributes to a deeper understanding of the role of hyperparameter tuning in the development of ML-based UBEMs, offering valuable insights for energy-efficient urban planning and policymaking toward sustainable city development.

Comparing hyperparameter tuning methods in machine learning based urban building energy modeling: A study in Chicago

Ranking parameters in urban energy models for various building forms and climates using sensitivity analysis

A Comparative Analysis of Machine Learning-Based Energy Baseline Models across Multiple Building Types

Addressing uncertainty to achieve stability in urban building energy modeling: A comparative study of four possible approaches

Investigating the Performance of Machine Learning Models Combined with Different Feature Selection Methods to Estimate the Energy Consumption of Buildings

Interactive effects of hyperparameter optimization techniques and data characteristics on the performance of machine learning algorithms for building energy metamodeling

Evaluating Energy Retrofits of Historic Buildings in a University Campus Using an Urban Building Energy Model That Considers Uncertainties

Construction and Research of a Data-Driven Energy Consumption Evaluation Model for Urban Building Operation

Combining physical approaches with deep learning techniques for urban building energy modeling: A comprehensive review and future research prospects

Application of Machine Learning for Predicting Building Energy Use at Different Temporal and Spatial Resolution under Climate Change in USA

Predicting daily heating energy consumption in residential buildings through integration of random forest model and meta-heuristic algorithms

Multi-Agent-Based Model for the Urban Macro-Level Impact Factors of Building Energy Consumption on Different Types of Land

Accuracy analyses and model comparison of machine learning adopted in building energy consumption prediction

Using urban building energy modeling to quantify the energy performance of residential buildings under climate change

Forecasting the total building energy based on its architectural features using a combination of CatBoost and meta-heuristic algorithms

Integration of an energy– economy model with an urban energy model

Explaining Spatial Variations in Residential Energy Usage Intensity in Chicago: The Role of Urban Form and Geomorphometry

Investigating the impact of urban microclimate on building thermal performance: a case study of dense urban areas in Hong Kong

On the Benefits of Using Metaheuristics in the Hyperparameter Tuning of Deep Learning Models for Energy Load Forecasting

Application and evaluation of a pattern-based building energy model calibration method using public building datasets

UBEM calibration method by energy consumption disaggregation using a change-point model