Abstract:The liberalization reform of the natural gas market has decoupled gas trading from storage and transportation services and introduced the new role, namely shippers. The shippers book network capacity from pipeline network operators (PNOs) by signing capacity contracts and nominate the gas of injection and withdraw in the day-ahead market. The PNOs then validate the feasibility of nominations and optimize the operation plan of gas network. How to efficient allocate the network capacity has become a new challenging subject due to the need to coordinate the interests of multiple market participants, including producers, merchants, local distribution companies and others. To address this issue, this paper established a bilevel optimization model for the optimal allocation of network capacity. Two approaches are proposed: (i) a single-level reformulation-based method (KKT reformulation), used as a benchmark, where a tailored outer approximation (OA) method is applied to handle the nonlinear constraints; (ii) a distributed method where a variant of Inexact-ADMM is proposed by exploiting the separable structure of coupling constraints. Case studies are performed on a real-life 352-node gas network. Initially, the proposed method is tested by a simplified 139-node gas network, showing that the solution speed of Inexact ADMM is 27.51 and 28.23 times faster than that of KKT-based method in two typical cases, while the objective value of the whole system only increased by 0.41% and 0.38%. Then, the Inexact-ADMM is successfully implemented in the whole size of the 352-node gas network by further decoupling the upper-level PNOs model into several sub-models. The maximal relative error of hydraulic was <0.4% in Case 1 and 0.7% in Case 2. This study demonstrates that the proposed ADMM-based distributed algorithm can guarantee the pipeline operation, safely and efficiently, by determining the suitable bookable capacities of the shippers.

Controlling Pressure of Gas Pipeline Network Based on Mixed Proximal Policy Optimization

Behavior Proximal Policy Optimization

Safe reinforcement learning method integrating process knowledge for real-time scheduling of gas supply network

Proximal Policy Optimization with Mixed Distributed Training

Proximal Policy Optimization Learning based Control of Congested Freeway Traffic

Truly Proximal Policy Optimization

Processing Network Controls via Deep Reinforcement Learning

A deep reinforcement learning-based method for predictive management of demand response in natural gas pipeline networks

Centralized Cooperation for Connected and Automated Vehicles at Intersections by Proximal Policy Optimization

Optimal Control for Scheduling and Pricing Intra-day Natural Gas Transport on Pipeline Networks

Authentic Boundary Proximal Policy Optimization

Pipe sharing: A bilevel optimization model for the optimal capacity allocation of natural gas network

RL-Driven MPPI: Accelerating Online Control Laws Calculation with Offline Policy

Fast Proximal Policy Optimization

Enhancing Sample Efficiency and Exploration in Reinforcement Learning through the Integration of Diffusion Models and Proximal Policy Optimization

Trust Region-Guided Proximal Policy Optimization

A systematic method for the optimization of gas supply reliability in natural gas pipeline network based on Bayesian networks and deep reinforcement learning

Proximal Policy Optimization Smoothed Algorithm

Design of Control System of Once-Through Steam Generator Based on Proximal Policy Optimization Algorithm

Reduced Policy Optimization for Continuous Control with Hard Constraints

Urban Traffic Control in Software Defined Internet of Things via a Multi-Agent Deep Reinforcement Learning Approach