Soft Actor–Critic Algorithm Featured Residential Demand Response Strategic Bidding for Load Aggregators

Zhenyuan Zhang,Zihan Chen,Wei-Jen Lee

DOI: https://doi.org/10.1109/tia.2022.3172068

IF: 4.079

2022-07-19

IEEE Transactions on Industry Applications

Abstract:Load aggregators (LAs) gather regional demand response (DR) resources as a representative of regional users to transact with the grid. They achieve this by facilitating residential customers to flexibly participate in DR programs. This article proposes a residential DR strategic bidding approach for LAs to improve system reliability while maximizing their financial advantages. It is based on the deep reinforcement learning (DRL) algorithm and is capable of overcoming the computational limitations of conventional model-based strategy design. A probabilistic model considering the electricity usage habits and response willingness was developed to reliably quantify the uncertainty responsive behaviors. A DR bidding model considering bilateral interaction with declaration risk was developed to balance the contradictory relationship between subsidy prices with uncertain DR quantities. In addition, the soft actor-critic algorithm was implemented to optimize the decision-making process, and thereby, optimize the continuous-action-space problem of maximizing the profits of LAs by DR scheduling. The proposed approach demonstrated its effectiveness and superiority in diverse DR situations, compared with a conventional method and another DRL approach.

engineering, electrical & electronic, multidisciplinary