Abstract:The rapid urbanization and increasing use of distributed renewable energy resources have imposed a significant burden on power networks. Smart buildings equipped with artificial intelligence technology can play a pivotal role in energy management, ultimately enhancing energy efficiency and voltage quality. However, ensuring voltage stability within large-scale smart building systems presents challenges due to the coexistence of diverse energy sources and the fluctuating nature of renewable energy. This paper proposes a safe multi-energy management framework achieved by online decentralized execution and centralized training for large scale smart buildings in distribution networks. The energy management problem is formulated as a safety-augmented Markov decision process, presenting intractability for dynamic programming due to its extensive continuous state space. To solve this issue and improve the convergence speed and training process stability, a safety-augmented constrained multi-agent reinforcement learning algorithm based on reward extrapolation is proposed. In this algorithm, hazard values are introduced to enhance non-safe multi-agent reinforcement learning algorithms and meet safety constraints. A novel reward network is designed by imitating expert underlying intentions to ensure the rationality of the reward function for multi-objective tasks. Additionally, the loss function for estimating the Q-network is redesigned during training process to guarantee effective convergence. Theoretical analysis is conducted to provide the convergence guarantee. Numerical case studies based on actual data are performed to validate the effectiveness and scalability of our approach, showing that smart buildings can achieve superior energy management performance while ensuring voltage safety for distribution networks. The source code of the proposed algorithm will be available at https://github.com/SYiyun/CMARL-EX.

Real-time implementation of an IoT-based intelligent source allocation system using machine learning technique in a commercial building

Deployment of IoT-Based Smart Demand-Side Management System with an Enhanced Degree of User Comfort at an Educational Institution

Optimal Energy Management System of IoT-Enabled Large Building Considering Electric Vehicle Scheduling, Distributed Resources, and Demand Response Schemes

Intelligent power management system for optimizing load strategies in renewable generation

IOT integrated smart grid management system for effective energy management

Energy Management Based on Safe Multi-Agent Reinforcement Learning for Smart Buildings in Distribution Networks

IoT for Green Building Management

A Novel Real-Time Electricity Scheduling for Home Energy Management System Using the Internet of Energy

A Smart Autonomous Time- and Frequency-Domain Analysis Current Sensor-Based Power Meter Prototype Developed over Fog-Cloud Analytics for Demand-Side Management

Design and Implementation of IoT Based Intelligent Energy Management Controller for PV/Wind/Battery System with Cost Minimization

Economic operation of residential load using IOT-based renewable energy management system

Implementation of a Real-Time IoT Based Energy Management System

An Intelligent Power Distribution Service Architecture Using Cloud Computing and Deep Learning Techniques

Design and implementation of smart home energy management system for Indian residential sector

Internet of Things for Residential Areas: Toward Personalized Energy Management Using Big Data

A hybrid evolutionary and machine learning approach for smart building: Sustainable building energy management design

Design and Implementation of a Smart Home Energy Management System Using IoT and Machine Learning

An efficient FBI‐iForest approach‐based home energy management system with RES under internet of things framework

Real-Time Machine Learning-based fault Detection, Classification, and locating in large scale solar Energy-Based Systems: Digital twin simulation

Quantum Computing-Inspired Optimal Power Allocation Mechanism in Edge Computing Environment

Artificial intelligence-powered energy community management for developing renewable energy systems in smart homes