Abstract:Self-healing capability is a critical factor for a resilient distribution system, which requires intelligent agents to automatically perform service restoration online, including network reconfiguration and reactive power dispatch. The article proposes the imitation learning framework for training such an agent, where the agent will interact with an expert built based on the mixed-integer program to learn its optimal policy, and therefore significantly improve the training efficiency compared with exploration-dominant reinforcement learning (RL) methods. This significantly improved training efficiency makes the training problem under <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.115ex" height="2.343ex" style="vertical-align: -0.505ex;" viewBox="0 -791.3 2632.9 1008.6" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-4E" x="0" y="0"></use> <use xlink:href="#MJMAIN-2212" x="1110" y="0"></use> <use xlink:href="#MJMATHI-6B" x="2111" y="0"></use></g></svg></span> scenarios tractable. A hybrid policy network is proposed to handle tie-line operations and reactive power dispatch simultaneously to further improve the restoration performance. The 33-bus and 119-bus systems with <span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="6.115ex" height="2.343ex" style="vertical-align: -0.505ex;" viewBox="0 -791.3 2632.9 1008.6" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"> <use xlink:href="#MJMATHI-4E" x="0" y="0"></use> <use xlink:href="#MJMAIN-2212" x="1110" y="0"></use> <use xlink:href="#MJMATHI-6B" x="2111" y="0"></use></g></svg></span> disturbances are employed to conduct the training. The results indicate that the proposed method outperforms traditional RL algorithms such as the deep-Q network.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"><path stroke-width="1" id="MJMATHI-4E" d="M234 637Q231 637 226 637Q201 637 196 638T191 649Q191 676 202 682Q204 683 299 683Q376 683 387 683T401 677Q612 181 616 168L670 381Q723 592 723 606Q723 633 659 637Q635 637 635 648Q635 650 637 660Q641 676 643 679T653 683Q656 683 684 682T767 680Q817 680 843 681T873 682Q888 682 888 672Q888 650 880 642Q878 637 858 637Q787 633 769 597L620 7Q618 0 599 0Q585 0 582 2Q579 5 453 305L326 604L261 344Q196 88 196 79Q201 46 268 46H278Q284 41 284 38T282 19Q278 6 272 0H259Q228 2 151 2Q123 2 100 2T63 2T46 1Q31 1 31 10Q31 14 34 26T39 40Q41 46 62 46Q130 49 150 85Q154 91 221 362L289 634Q287 635 234 637Z"></path><path stroke-width="1" id="MJMAIN-2212" d="M84 237T84 250T98 270H679Q694 262 694 250T679 230H98Q84 237 84 250Z"></path><path stroke-width="1" id="MJMATHI-6B" d="M121 647Q121 657 125 670T137 683Q138 683 209 688T282 694Q294 694 294 686Q294 679 244 477Q194 279 194 272Q213 282 223 291Q247 309 292 354T362 415Q402 442 438 442Q468 442 485 423T503 369Q503 344 496 327T477 302T456 291T438 288Q418 288 406 299T394 328Q394 353 410 369T442 390L458 393Q446 405 434 405H430Q398 402 367 380T294 316T228 255Q230 254 243 252T267 246T293 238T320 224T342 206T359 180T365 147Q365 130 360 106T354 66Q354 26 381 26Q429 26 459 145Q461 153 479 153H483Q499 153 499 144Q499 139 496 130Q455 -11 378 -11Q333 -11 305 15T277 90Q277 108 280 121T283 145Q283 167 269 183T234 206T200 217T182 220H180Q168 178 159 139T145 81T136 44T129 20T122 7T111 -2Q98 -11 83 -11Q66 -11 57 -1T48 16Q48 26 85 176T158 471L195 616Q196 629 188 632T149 637H144Q134 637 131 637T124 640T121 647Z"></path></defs></svg>

Hybrid Imitation Learning for Real-Time Service Restoration in Resilient Distribution Systems

A Consensus-based Decentralized Algorithm for Service Restoration in Active Distribution Networks

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

Attention-Based Multi-Agent Graph Reinforcement Learning for Service Restoration

Multi-agent Deep Reinforcement Learning for Distributed Load Restoration

Two-Stage Self-Healing Restoration Strategy Considering Operating Performance

A Full Decentralized Multi-Agent Service Restoration for Distribution Network with DGs

Deep learning-based post-disaster energy management and faster network reconfiguration method for improvement of restoration time

Uncertainty-Aware Transient Stability-Constrained Preventive Redispatch: A Distributional Reinforcement Learning Approach

Coordinating Multiple Sources for Service Restoration to Enhance Resilience of Distribution Systems

Adaptive Robust Load Restoration via Coordinating Distribution Network Reconfiguration and Mobile Energy Storage

Real-time outage management in active distribution networks using reinforcement learning over graphs

Resilience-based post disaster recovery optimization for infrastructure system via Deep Reinforcement Learning

AC/DC hybrid distribution network reconfiguration with microgrid formation using multi-agent soft actor-critic

Multi-agent Deep Reinforcement Learning for Resilience-Driven Routing and Scheduling of Mobile Energy Storage Systems

Towards Microgrid Resilience Enhancement Via Mobile Power Sources and Repair Crews: A Multi-Agent Reinforcement Learning Approach

A Rolling Horizon Optimization Framework for Resilient Restoration of Active Distribution Systems

Enhancing Active Distribution Systems Resilience by Fully Distributed Self-Healing Strategy

Safe Imitation Learning-based Optimal Energy Storage Systems Dispatch in Distribution Networks

A multiagent system based optimal load restoration strategy in distribution systems

Resilient Service Restoration for Unbalanced Distribution Systems With Distributed Energy Resources by Leveraging Mobile Generators