Abstract:Global routing has been a historically challenging problem in electronic circuit design, where the challenge is to connect a large and arbitrary number of circuit components with wires without violating the design rules for the printed circuit boards or integrated circuits. Similar routing problems also exist in the design of complex hydraulic systems, pipe systems and logistic networks. Existing solutions typically consist of greedy algorithms and hard-coded heuristics. As such, existing approaches suffer from a lack of model flexibility and non-optimum solutions. As an alternative approach, this work presents a deep reinforcement learning method for solving the global routing problem in a simulated environment. At the heart of the proposed method is deep reinforcement learning that enables an agent to produce an optimal policy for routing based on the variety of problems it is presented with leveraging the conjoint optimization mechanism of deep reinforcement learning. Conjoint optimization mechanism is explained and demonstrated in details; the best network structure and the parameters of the learned model are explored. Based on the fine-tuned model, routing solutions and rewards are presented and analyzed. The results indicate that the approach can outperform the benchmark method of a sequential A* method, suggesting a promising potential for deep reinforcement learning for global routing and other routing or path planning problems in general. Another major contribution of this work is the development of a global routing problem sets generator with the ability to generate parameterized global routing problem sets with different size and constraints, enabling evaluation of different routing algorithms and the generation of training datasets for future data-driven routing approaches.

Tensor-Based Reinforcement Learning for Network Routing

Adaptive and Robust Network Routing Based on Deep Reinforcement Learning with Lyapunov Optimization.

Deep Reinforcement Learning for Router Selection in Network with Heavy Traffic

Toward Packet Routing With Fully Distributed Multiagent Deep Reinforcement Learning

Toward Packet Routing with Fully-distributed Multi-agent Deep Reinforcement Learning

Generative Adversarial Network-Based Transfer Reinforcement Learning for Routing With Prior Knowledge

GTD3-NET: A deep reinforcement learning-based routing optimization algorithm for wireless networks

Relational Deep Reinforcement Learning for Routing in Wireless Networks

TITE: A Transformer-Based Deep Reinforcement Learning Approach for Traffic Engineering in Hybrid SDN with Dynamic Traffic

Routing Optimization With Deep Reinforcement Learning in Knowledge Defined Networking

Improving the Scalability of Deep Reinforcement Learning-Based Routing with Control on Partial Nodes

A Deep Reinforcement Learning-based Routing Scheme with Two Modes for Dynamic Networks

A Novel Reinforcement Learning Framework for Adaptive Routing in Network-on-Chips

Packet Routing Against Network Congestion: A Deep Multi-agent Reinforcement Learning Approach

G-Routing: Graph Neural Networks-Based Flexible Online Routing

A Deep Reinforcement Learning Approach for Global Routing

Routing optimization with Monte Carlo Tree Search-based multi-agent reinforcement learning

Towards Real-Time Routing Optimization with Deep Reinforcement Learning: Open Challenges

Scalable Deep Reinforcement Learning for Routing and Spectrum Access in Physical Layer

Intelligent Routing Algorithm over SDN: Reusable Reinforcement Learning Approach

On Design and Implementation of Reinforcement Learning Based Cognitive Routing for Autonomous Networks