Mastering building management systems data points tagging with minimal Examples: Unveiling the power of large language models

Zhiyu Zheng,Sylvain Marie,Elham Farazdaghi,Esma Yahia,Khal Makhoul,Théo Lagarde,Rani El Meouche,Fakhreddine Ababsa

DOI: https://doi.org/10.1016/j.enbuild.2024.115173

IF: 7.201

2024-12-15

Energy and Buildings

Abstract:The heterogeneity of metadata within Building Management Systems (BMS) poses substantial challenges for advanced analytics, including cross-building analysis. Over the past decade, metadata standard schemas such as Brick have been developed to address this challenge. Nevertheless, mapping BMS metadata with such standards accurately and efficiently continues to be a demanding task across both new and existing buildings. This work explores the application of Large Language Models (LLMs) to tag BMS data points, thus facilitating metadata standardization efforts. Manual or rule-based methods are not only labor-intensive but also error-prone. Similarly, supervised learning approaches using Machine Learning (ML) and Natural Language Processing ( NLP ) demand extensive labeled datasets, often making them laborious and inflexible to new BMS metadata types and tasks. We propose a novel three-step framework that enhances the tagging process by integrating a LLM with few-shot prompting and an embedding model. This approach not only improves result interpretability but also effectively mitigates hallucinations. This framework is further supported by analyses of the LLM's inherent capabilities, prompt-aided specific interpretation and output formatting, and evaluations of few-shot sizes. Tested across five different building datasets, our approach, leveraging few-shot examples, achieves performance comparable to state-of-the-art supervised learning methods that rely on large labeled datasets.

energy & fuels,construction & building technology,engineering, civil