Abstract:The control of modern buildings is a complex multi-loop problem due to the integration of renewable energy generation, storage devices, and electric vehicles (EVs). Additionally, it is a complex multi-criteria problem due to the need to optimize overall energy use while satisfying users’ comfort. Both conventional rule-based (RB) controllers, which are difficult to apply in multi-loop settings, and advanced model-based controllers, which require an accurate building model, cannot fulfil the requirements of the building automation industry to solve this problem optimally at low development and commissioning costs. This work presents a fully data-driven pipeline to obtain an optimal control policy from historical building and weather data, thus avoiding the need for complex physics-based modelling. We demonstrate the potential of this method by jointly controlling a room temperature and an EV to minimize the cost of electricity while retaining the comfort of the occupants. We model the room temperature with a recurrent neural network and use it as a simulation environment to learn a deep reinforcement learning (DRL) control policy. It achieves on average 17% energy savings and 19% better comfort satisfaction than a standard RB room temperature controller. When a bidirectional EV is connected additionally and a two-tariff electricity pricing is applied, it successfully leverages the battery and decreases the overall cost of electricity. Finally, we deployed it on a real building, where it achieved up to 30% energy savings while maintaining similar comfort levels compared to a conventional RB room temperature controller.

Scenario-based Thermal Management Parametrization Through Deep Reinforcement Learning

Autonomous Vehicle Control Through the Dynamics and Controller Learning

An Efficient and Flexible Learning Framework for Dynamic Power and Thermal Co-Management

Supervised-Learning-Based Optimal Thermal Management in an Electric Vehicle

Reinforcement learning based EV energy management for integrated traction and cabin thermal management considering battery aging

Real-Time Battery Thermal Management for Electric Vehicles Based on Deep Reinforcement Learning

Virtual Development of Advanced Thermal Management Functions Using Model-in-the-Loop Applications

A deep reinforcement learning based EMS for PHEV considering temperature equilibrium of battery modules

Intelligent control of electric vehicle air conditioning system based on deep reinforcement learning

Reinforcement learning-based thermal comfort control for vehicle cabins

optimization of a Thermal Management System for Battery Electric Vehicles

Deep reinforcement learning-based energy management of hybrid battery systems in electric vehicles

Integrated Thermal and Energy Management of Connected Hybrid Electric Vehicles Using Deep Reinforcement Learning

Data-driven control of room temperature and bidirectional EV charging using deep reinforcement learning: Simulations and experiments

Thermal and Energy Management Based on Bimodal Airflow-Temperature Sensing and Reinforcement Learning

Battery Health-Aware and Deep Reinforcement Learning-Based Energy Management for Naturalistic Data-Driven Driving Scenarios

Cloud-based Health-Conscious Energy Management of Hybrid Battery Systems in Electric Vehicles with Deep Reinforcement Learning

A Fast Thermal Simulation and Dynamic Feedback Control Framework for Lithium-Ion Batteries

The integration of Model Predictive Control and deep Reinforcement Learning for efficient thermal control in thermoforming processes

Data-driven modeling and supervisory control system optimization for plug-in hybrid electric vehicles

Integrated Thermal Management of Electric Vehicles Based on Model Predictive Control With Approximated Value Function