Abstract:The discovery of novel therapeutic compounds through de novo drug design represents a critical challenge in the field of pharmaceutical research. Traditional drug discovery approaches are often resource intensive and time consuming, leading researchers to explore innovative methods that harness the power of deep learning and reinforcement learning techniques. Here, we introduce a novel drug design approach called drugAI that leverages the Encoder–Decoder Transformer architecture in tandem with Reinforcement Learning via a Monte Carlo Tree Search (RL-MCTS) to expedite the process of drug discovery while ensuring the production of valid small molecules with drug-like characteristics and strong binding affinities towards their targets. We successfully integrated the Encoder–Decoder Transformer architecture, which generates molecular structures (drugs) from scratch with the RL-MCTS, serving as a reinforcement learning framework. The RL-MCTS combines the exploitation and exploration capabilities of a Monte Carlo Tree Search with the machine translation of a transformer-based Encoder–Decoder model. This dynamic approach allows the model to iteratively refine its drug candidate generation process, ensuring that the generated molecules adhere to essential physicochemical and biological constraints and effectively bind to their targets. The results from drugAI showcase the effectiveness of the proposed approach across various benchmark datasets, demonstrating a significant improvement in both the validity and drug-likeness of the generated compounds, compared to two existing benchmark methods. Moreover, drugAI ensures that the generated molecules exhibit strong binding affinities to their respective targets. In summary, this research highlights the real-world applications of drugAI in drug discovery pipelines, potentially accelerating the identification of promising drug candidates for a wide range of diseases.

DrugEx: Deep Learning Models and Tools for Exploration of Drug-Like Chemical Space

A deep-learning view of chemical space designed to facilitate drug discovery

Advancing Drug Discovery with Deep Learning: Harnessing Reinforcement Learning and One-Shot Learning for Molecular Design in Low-Data Situations

Molecular Design in Synthetically Accessible Chemical Space via Deep Reinforcement Learning

REINVENT 2.0: An AI Tool for De Novo Drug Design

De Novo Drug Design Using Transformer-Based Machine Translation and Reinforcement Learning of an Adaptive Monte Carlo Tree Search

Utilizing Reinforcement Learning for de novo Drug Design

De novo drug design as GPT language modeling: large chemistry models with supervised and reinforcement learning

MolDesigner: Interactive Design of Efficacious Drugs with Deep Learning

Deep Learning Approaches for &lt;italic&gt;de Novo&lt;/italic&gt; Drug Design: an Overview

Status and Prospects of Research on Deep Learning-based De Novo Generation of Drug Molecules

Application advances of deep learning methods for de novo drug design and molecular dynamics simulation

De Novo Structure-Based Drug Design Using Deep Learning

De novo Drug Design using Reinforcement Learning with Multiple GPT Agents

DrugGen: Advancing Drug Discovery with Large Language Models and Reinforcement Learning Feedback

Unsupervised Learning in Drug Design from Self-Organization to Deep Chemistry

Assessing Methods and Obstacles in Chemical Space Exploration

Deep learning approaches for <i>de novo</i> drug design: An overview

De novo drug design by iterative multiobjective deep reinforcement learning with graph-based molecular quality assessment

Comprehensive assessment of deep generative architectures for de novo drug design