Abstract:This paper introduces the Structural Optimization gym (SOgym), a novel open-source Reinforcement Learning (RL) environment designed to advance machine learning in Topology Optimization (TO). SOgym enables RL agents to generate physically viable and structurally robust designs by integrating the physics of TO into the reward function. To enhance scalability, SOgym leverages feature-mapping methods as a mesh-independent interface between the environment and the agent, allowing efficient interaction with the design variables regardless of mesh resolution. Baseline results use a model-free Proximal Policy Optimization agent and a model-based DreamerV3 agent. Three observation space configurations were tested. The TopOpt game-inspired configuration, an interactive educational tool that improves students' intuition in designing structures to minimize compliance under volume constraints, performed best in terms of performance and sample efficiency. The 100M parameter version of DreamerV3 produced structures within 54% of the baseline compliance achieved by traditional optimization methods and a 0% disconnection rate, an improvement over supervised learning approaches that often struggle with disconnected load paths. When comparing the learning rates of the agents to those of engineering students from the TopOpt game experiment, the DreamerV3-100M model shows a learning rate approximately four orders of magnitude lower, an impressive feat for a policy trained from scratch through trial and error. These results suggest RL's potential to solve continuous TO problems and its capacity to explore and learn from diverse design solutions. SOgym provides a platform for developing RL agents for complex structural design challenges and is publicly available to support further research in the field.

A novel reinforcement learning-based method for structure optimization

Successive Convex Approximation Based Off-Policy Optimization for Constrained Reinforcement Learning

Dynamic Programming with Meta-Reinforcement Learning: a Novel Approach for Multi-Objective Optimization

Structural Design Through Reinforcement Learning

Meta-Learning-Based Deep Reinforcement Learning for Multiobjective Optimization Problems

A Deep Reinforcement Learning Approach to Efficient Distributed Optimization

A Deep Reinforcement Learning Method for Structural Dominant Failure Modes Searching Based on Self-Play Strategy

A reinforcement learning approach for dynamic multi-objective optimization

Deep Reinforcement Learning for Multiobjective Optimization

Optimal Policy for Structure Maintenance: A Deep Reinforcement Learning Framework

Learning to Optimize for Reinforcement Learning

Reinforcement Learning for Stand Structure Optimization of Pinus yunnanensis Secondary Forests in Southwest China

A multi-swarm optimizer with a reinforcement learning mechanism for large-scale optimization

Improved Monte Carlo tree search formulation with multiple root nodes for discrete sizing optimization of truss structures

Design Synthesis of Structural Systems as a Markov Decision Process Solved With Deep Reinforcement Learning

A Two-Stage Multi-Objective Deep Reinforcement Learning Framework.

Reinforcement Learning for Branch-and-Bound Optimisation using Retrospective Trajectories

A Novel Reinforcement Learning Based Heap-Based Optimizer

RLO: a Reinforcement Learning-Based Method for Join Optimization

Improvement of Reinforcement Learning With Supermodularity

RLEMMO: Evolutionary Multimodal Optimization Assisted By Deep Reinforcement Learning