Abstract:The discovery of novel therapeutic compounds through de novo drug design represents a critical challenge in the field of pharmaceutical research. Traditional drug discovery approaches are often resource intensive and time consuming, leading researchers to explore innovative methods that harness the power of deep learning and reinforcement learning techniques. Here, we introduce a novel drug design approach called drugAI that leverages the Encoder–Decoder Transformer architecture in tandem with Reinforcement Learning via a Monte Carlo Tree Search (RL-MCTS) to expedite the process of drug discovery while ensuring the production of valid small molecules with drug-like characteristics and strong binding affinities towards their targets. We successfully integrated the Encoder–Decoder Transformer architecture, which generates molecular structures (drugs) from scratch with the RL-MCTS, serving as a reinforcement learning framework. The RL-MCTS combines the exploitation and exploration capabilities of a Monte Carlo Tree Search with the machine translation of a transformer-based Encoder–Decoder model. This dynamic approach allows the model to iteratively refine its drug candidate generation process, ensuring that the generated molecules adhere to essential physicochemical and biological constraints and effectively bind to their targets. The results from drugAI showcase the effectiveness of the proposed approach across various benchmark datasets, demonstrating a significant improvement in both the validity and drug-likeness of the generated compounds, compared to two existing benchmark methods. Moreover, drugAI ensures that the generated molecules exhibit strong binding affinities to their respective targets. In summary, this research highlights the real-world applications of drugAI in drug discovery pipelines, potentially accelerating the identification of promising drug candidates for a wide range of diseases.

Advances in De Novo Drug Design: From Conventional to Machine Learning Methods

Status and Prospects of Research on Deep Learning-based De Novo Generation of Drug Molecules

Application advances of deep learning methods for de novo drug design and molecular dynamics simulation

Artificial Intelligence in De novo Drug Design: Are We Still There?

Deep Learning Approaches for &lt;italic&gt;de Novo&lt;/italic&gt; Drug Design: an Overview

Deep learning approaches for <i>de novo</i> drug design: An overview

De Novo Structure-Based Drug Design Using Deep Learning

Recent Advances in Automated Structure-Based De Novo Drug Design

Deep learning approaches for de novo drug design: An overview

Deep Learning in Drug Design—Progress, Methods, and Challenges

De Novo Drug Design Using Transformer-Based Machine Translation and Reinforcement Learning of an Adaptive Monte Carlo Tree Search

Artificial intelligence in drug discovery: recent advances and future perspectives

Machine learning-aided generative molecular design

Artificial intelligence to deep learning: machine intelligence approach for drug discovery

Concepts of Artificial Intelligence for Computer-Assisted Drug Discovery

Advances and Challenges in De Novo Drug Design Using Three-Dimensional Deep Generative Models

A Review Of Deep Learning In Computer-Aided Drug Design

A Survey of Generative AI for de novo Drug Design: New Frontiers in Molecule and Protein Generation

A Systematic Review of Deep Learning Methodologies Used in the Drug Discovery Process with Emphasis on In Vivo Validation

De Novo Generation and Identification of Novel Compounds with Drug Efficacy Based on Machine Learning

Application of Deep Learning Neural Networks in Computer-aided Drug Discovery: A Review