Abstract:Space layout design is a critical aspect of architectural design, influencing functionality and aesthetics. The inherent combinatorial nature of layout design poses challenges for traditional planning approaches; thus, it demands the exploration of novel methods. This paper presents a novel framework that leverages the potential of deep reinforcement learning (RL) algorithms to optimize space layouts. RL has demonstrated remarkable success in addressing complex decision-making problems, yet its application in the design process remains relatively unexplored. We argue that RL is particularly well-suited for the design process due to its ability to accommodate offline tasks and seamless integration with existing CAD software, effectively acting as a simulator for design exploration. Framing space layout design as an RL problem and employing RL methods allows for the automated exploration of the expansive design space, thereby enhancing the discovery of innovative solutions. This paper also elucidates the synergy between the design process and the RL problem, which opens new avenues for exploring the potential of RL algorithms in design. We aim to foster experimentation and collaboration within the RL and architecture communities. To facilitate our research, we have developed SpaceLayoutGym , an environment specifically designed for space layout design tasks. SpaceLayoutGym serves as a customizable environment that encapsulates the essential elements of the layout design process within an RL framework. To showcase the effectiveness of SpaceLayoutGym and the capabilities of RL as an artificial space layout designer, we employ the PPO algorithm to train the RL agent in selected design scenarios with both geometrical constraints and topological objectives. The study further extends to contrast the effectiveness of PPO agents with that of genetic algorithms, and also includes a comparative analysis with existing layouts. Our results demonstrate the potential of RL to optimize space layouts, offering a promising direction for the future of AI-aided design.

Generalizable Floorplanner Through Corner Block List Representation and Hypergraph Embedding

GoodFloorplan: Graph Convolutional Network and Reinforcement Learning-Based Floorplanning

Learning Placement Order for Constructive Floorplanning

Floorplanning with Edge-Aware Graph Attention Network and Hindsight Experience Replay

GraphPlanner: Floorplanning with Graph Neural Network.

Effective Analog ICs Floorplanning with Relational Graph Neural Networks and Reinforcement Learning

Chip Placement with Deep Reinforcement Learning

Hierarchical Graph Learning-Based Floorplanning with Dirichlet Boundary Conditions

Network planning with deep reinforcement learning

FPGA Divide-and-Conquer Placement using Deep Reinforcement Learning

Multi-objective optimization in fixed-outline floorplanning with reinforcement learning

Graph2Plan: Learning Floorplan Generation from Layout Graphs

A graph placement methodology for fast chip design

A Parallel Vlsi Floorplanning Algorithm Using Corner Block List Topological Representation

Reimagining space layout design through deep reinforcement learning

Hierarchical Reinforcement Learning for Chip-Macro Placement in Integrated Circuit

Corner block list representation and its application with boundary constraints

Deep Reinforcement Learning-based Large-scale Robot Exploration

Floorplanning with Graph Attention

A Non-Slicing Floorplanning Algorithm Using Corner Block List Topological Representation

On Joint Learning for Solving Placement and Routing in Chip Design