Abstract:In polypharmacology, ideal drugs are required to bind to multiple specific targets to enhance efficacy or to reduce resistance formation. Although deep learning has achieved breakthrough in drug discovery, most of its applications only focus on a single drug target to generate drug-like active molecules in spite of the reality that drug molecules often interact with more than one target which can have desired (polypharmacology) or undesired (toxicity) effects. In a previous study we proposed a new method named DrugEx that integrates an exploration strategy into RNN-based reinforcement learning to improve the diversity of the generated molecules. Here, we extended our DrugEx algorithm with multi-objective optimization to generate drug molecules towards more than one specific target (two adenosine receptors, A 1 AR and A 2A AR, and the potassium ion channel hERG in this study). In our model, we applied an RNN as the agent and machine learning predictors as the environment , both of which were pre-trained in advance and then interplayed under the reinforcement learning framework. The concept of evolutionary algorithms was merged into our method such that crossover and mutation operations were implemented by the same deep learning model as the agent . During the training loop, the agent generates a batch of SMILES-based molecules. Subsequently scores for all objectives provided by the environment are used for constructing Pareto ranks of the generated molecules with non-dominated sorting and Tanimoto-based crowding distance algorithms. Here, we adopted GPU acceleration to speed up the process of Pareto optimization. The final reward of each molecule is calculated based on the Pareto ranking with the ranking selection algorithm. The agent is trained under the guidance of the reward to make sure it can generate more desired molecules after convergence of the training process. All in all we demonstrate generation of compounds with a diverse predicted selectivity profile toward multiple targets, offering the potential of high efficacy and lower toxicity.

De Novo Drug Design by Multi-Objective Path Consistency Learning with Beam A∗ Search

De novo drug design by iterative multiobjective deep reinforcement learning with graph-based molecular quality assessment

Molecular generation strategy and optimization based on A2C reinforcement learning in de novo drug design

DrugEx V2: De Novo Design of Drug Molecules by Pareto-based Multi-Objective Reinforcement Learning in Polypharmacology

De novo drug design based on Stack-RNN with multi-objective reward-weighted sum and reinforcement learning

Generation of Rational Drug-Like Molecular Structures Through a Multiple-Objective Reinforcement Learning Framework

Optimizing blood-brain barrier permeation through deep reinforcement learning for de novo drug design

Multi-objective molecular generation via clustered Pareto-based reinforcement learning

Utilizing reinforcement learning for de novo drug design

<i>De novo</i> generation of dual-target ligands using adversarial training and reinforcement learning

Multi-Objective De Novo Drug Design with Conditional Graph Generative Model

An Exploration Strategy Improves the Diversity of De Novo Ligands Using Deep Reinforcement Learning: a Case for the Adenosine A2A Receptor

De novo Drug Design using Reinforcement Learning with Multiple GPT Agents

Widely Used and Fast De Novo Drug Design by a Protein Sequence-Based Reinforcement Learning Model

De novo generation of dual-target ligands using adversarial training and reinforcement learning

LEADD: Lamarckian evolutionary algorithm for de novo drug design

Diversity-Aware Reinforcement Learning for de novo Drug Design

De novo drug design using reinforcement learning with graph-based deep generative models

AlphaDrug: Protein Target Specific De Novo Molecular Generation

Faster and more diverse de novo molecular optimization with double-loop reinforcement learning using augmented SMILES