Abstract:De novo molecular design is the process of learning knowledge from existing data to propose new chemical structures that satisfy the desired properties. By using de novo design to generate compounds in a directed manner, better solutions can be obtained in large chemical libraries with less comparison cost. But drug design needs to take multiple factors into consideration. For example, in polypharmacology, molecules that activate or inhibit multiple target proteins produce multiple pharmacological activities and are less susceptible to drug resistance. However, most existing molecular generation methods either focus only on affinity for a single target or fail to effectively balance the relationship between multiple targets, resulting in insufficient validity and desirability of the generated molecules. To address the problems, an approach called clustered Pareto-based reinforcement learning (CPRL) is proposed. In CPRL, a pre-trained model is constructed to grasp existing molecular knowledge in a supervised learning manner. In addition, the clustered Pareto optimization algorithm is presented to find the best solution between different objectives. The algorithm first extracts an update set from the sampled molecules through the designed aggregation-based molecular clustering. Then, the final reward is computed by constructing the Pareto frontier ranking of the molecules from the updated set. To explore the vast chemical space, a reinforcement learning agent is designed in CPRL that can be updated under the guidance of the final reward to balance multiple properties. Furthermore, to increase the internal diversity of the molecules, a fixed-parameter exploration model is used for sampling in conjunction with the agent. The experimental results demonstrate that CPRL is capable of balancing multiple properties of the molecule and has higher desirability and validity, reaching 0.9551 and 0.9923, respectively.

Multi-constraint molecular generation based on conditional transformer, knowledge distillation and reinforcement learning

A Unified Conditional Diffusion Framework for Dual Protein Targets Based Bioactive Molecule Generation

PrefixMol: Target- and Chemistry-aware Molecule Design Via Prefix Embedding

Evaluation of Reinforcement Learning in Transformer-based Molecular Design

Molecular Generation with Reduced Labeling through Constraint Architecture

Instruction Multi-Constraint Molecular Generation Using a Teacher-Student Large Language Model

Molecular Design in Synthetically Accessible Chemical Space via Deep Reinforcement Learning

Multi-objective molecular generation via clustered Pareto-based reinforcement learning

CMGN: a conditional molecular generation net to design target-specific molecules with desired properties

Molecule generation using transformers and policy gradient reinforcement learning

Bridging the Gap between Chemical Reaction Pretraining and Conditional Molecule Generation with a Unified Model

It Takes Two to Tango: Directly Optimizing for Constrained Synthesizability in Generative Molecular Design

Diversity oriented Deep Reinforcement Learning for targeted molecule generation

A Transformer-based Generative Model for De Novo Molecular Design

Multi-Objective De Novo Drug Design with Conditional Graph Generative Model

Molecular generation strategy and optimization based on A2C reinforcement learning in de novo drug design

Graph Diffusion Transformers for Multi-Conditional Molecular Generation

Training-free Multi-objective Diffusion Model for 3D Molecule Generation

Goal-directed molecule generation with fine-tuning by policy gradient

Probabilistic generative transformer language models for generative design of molecules

LLamol: A Dynamic Multi-Conditional Generative Transformer for De Novo Molecular Design