Pricing strategy of regional integrated energy system considering privacy protection based on deep reinforcement learning

Xiong Wu,Bingwen Liu,Shengqi Yuan,Binrui Cao,Ziyu Zhang,Yanhong Hu
DOI: https://doi.org/10.17775/CSEEJPES.2021.08300
IF: 6.014
2022-01-01
CSEE Journal of Power and Energy Systems
Abstract:With the deregulation of the energy market, the pricing strategy of energy sellers in a regional integrated energy system (RIES) can affect the interests of all participants in the market and the operation of the system. This paper proposes a pricing strategy for the integrated energy service providers in RIES based on the deep reinforcement learning (DRL) algorithm considering privacy protection. The transaction process between the integrated energy service provider (IESP) and user aggregators (UAs) in RIES is modeled as a Stackelberg game. IESP serves as the leader to make retail prices, and different UAs serve as followers to optimize their energy consumption strategies. Considering UAs' strategies are temporally coupled, a Markov decision process (MDP) is designed different from existing studies. The case studies demonstrate that the proposed method is accurate and stable when solving the Stackelberg equilibrium without privacy leakage. The obtained pricing strategy avoids unreasonable pricing and guarantees the revenue of IESP and the energy demand of UAs.
What problem does this paper attempt to address?