Abstract:We have developed a reinforcement learning approach for in silico automatic structural determination of adsorbate interactions with substrates. The proposed RL method allows "transferring the learning" between different chemical systems or theoretical methods. The RL method was implemented in the RLMaterial software. Reinforcement learning (RL) methods have helped to define the state of the art in the field of modern artificial intelligence, mostly after the breakthrough involving AlphaGo and the discovery of novel algorithms. In this work, we present a RL method, based on Q‐learning, for the structural determination of adsorbate@substrate models in silico, where the minimization of the energy landscape resulting from adsorbate interactions with a substrate is made by actions on states (translations and rotations) chosen from an agent's policy. The proposed RL method is implemented in an early version of the reinforcement learning software for materials design and discovery (RLMaterial), developed in Python3.x. RLMaterial interfaces with deMon2k, DFTB+, ORCA, and Quantum Espresso codes to compute the adsorbate@substrate energies. The RL method was applied for the structural determination of (i) the amino acid glycine and (ii) 2‐amino‐acetaldehyde, both interacting with a boron nitride (BN) monolayer, (iii) host‐guest interactions between phenylboronic acid and β‐cyclodextrin and (iv) ammonia on naphthalene. Density functional tight binding calculations were used to build the complex search surfaces with a reasonably low computational cost for systems (i)–(iii) and DFT for system (iv). Artificial neural network and gradient boosting regression techniques were employed to approximate the Q‐matrix or Q‐table for better decision making (policy) on next actions. Finally, we have developed a transfer‐learning protocol within the RL framework that allows learning from one chemical system and transferring the experience to another, as well as from different DFT or DFTB levels.

Discovering mechanisms for materials microstructure optimization via reinforcement learning of a generative model

Deep Reinforcement Learning for Inverse Inorganic Materials Design

Designing Composites with Target Effective Young's Modulus using Reinforcement Learning

A Case Study of Deep Reinforcement Learning for Engineering Design: Application to Microfluidic Devices for Flow Sculpting

Learning in continuous action space for developing high dimensional potential energy models

Meta-modeling game for deriving theoretical-consistent, micro-structural-based traction-separation laws via deep reinforcement learning

Hierarchical Multiresolution Design of Bioinspired Structural Composites Using Progressive Reinforcement Learning

Generative Design by Reinforcement Learning: Enhancing the Diversity of Topology Optimization Designs

Compositional Design of Multicomponent Alloys using Reinforcement Learning

"Deep Reinforcement Learning for Engineering Design Through Topology Optimization of Elementally Discretized Design Domains"

Computational Discovery of Energy-Efficient Heat Treatment for Microstructure Design using Deep Reinforcement Learning

Self-supervised Learning and Prediction of Microstructure Evolution with Convolutional Recurrent Neural Networks

Reinforcement learning for in silico determination of adsorbate—substrate structures

Deep reinforcement learning methods for structure-guided processing path optimization

Enhancing Molecular Design through Graph-based Topological Reinforcement Learning

Deep reinforcement learning for microstructural optimisation of silica aerogels

Learning with Delayed Rewards -- A case study on inverse defect design in 2D materials

A novel reinforcement learning-based method for structure optimization

Scalable Fragment-Based 3D Molecular Design with Reinforcement Learning

Structural Design Through Reinforcement Learning

Design Synthesis of Structural Systems as a Markov Decision Process Solved With Deep Reinforcement Learning