Abstract:Power networks, responsible for transporting electricity across large geographical regions, are complex infrastructures on which modern life critically depend. Variations in demand and production profiles, with increasing renewable energy integration, as well as the high voltage network technology, constitute a real challenge for human operators when optimizing electricity transportation while avoiding blackouts. Motivated to investigate the potential of AI methods in enabling adaptability in power network operation, we have designed a L2RPN challenge to encourage the development of reinforcement learning solutions to key problems present in the next-generation power networks. The NeurIPS 2020 competition was well received by the international community attracting over 300 participants worldwide. The main contribution of this challenge is our proposed comprehensive 'Grid2Op' framework, and associated benchmark, which plays realistic sequential network operations scenarios. The Grid2Op framework, which is open-source and easily re-usable, allows users to define new environments with its companion GridAlive ecosystem. Grid2Op relies on existing non-linear physical power network simulators and let users create a series of perturbations and challenges that are representative of two important problems: a) the uncertainty resulting from the increased use of unpredictable renewable energy sources, and b) the robustness required with contingent line disconnections. In this paper, we give the competition highlights. We present the benchmark suite and analyse the winning solutions, including one super-human performance demonstration. We propose our organizational insights for a successful competition and conclude on open research avenues. Given the challenge success, we expect our work will foster research to create more sustainable solutions for power network operations.

Reinforcement Learning for Electricity Network Operation

Learning to run a Power Network Challenge: a Retrospective Analysis

Reinforcement learning for Energies of the future and carbon neutrality: a Challenge Design

Managing power grids through topology actions: A comparative study between advanced rule-based and reinforcement learning agents

PowRL: A Reinforcement Learning Framework for Robust Management of Power Networks

Hierarchical Reinforcement Learning for Power Network Topology Control

Reinforcement Learning for Efficient Power Systems Planning: A Review of Operational and Expansion Strategies

Reinforcement Learning for Resilient Power Grids

Reinforcement Learning Based Power Grid Day-Ahead Planning and AI-Assisted Control

Imitation Learning for Intra-Day Power Grid Operation through Topology Actions

Reinforcement Learning Enabled Microgrid Network Reconfiguration under Disruptive Events

Active power correction strategies based on deep reinforcement learning-part I: A simulation-driven solution for robustness

On-line Building Energy Optimization using Deep Reinforcement Learning

Efficient learning of power grid voltage control strategies via model-based deep reinforcement learning

On Training Effective Reinforcement Learning Agents for Real-time Power Grid Operation and Control

Application and Development of Reinforcement Learning Theory in Power Systems

Graph Reinforcement Learning for Power Grids: A Comprehensive Survey

Application of Reinforcement Learning to Power System Operation

Reinforcement Learning in Adaptive Control of Power System Generation

Decentralized Coordination of Distributed Energy Resources through Local Energy Markets and Deep Reinforcement Learning

Reinforcement Learning-Based Net Load Volatility Control of Active Distribution Power Networks