Curiosity as a Self-Supervised Method to Improve Exploration in De novo Drug Design

Mohamed-Amine Chadi,Hajar Mousannif,Ahmed Aamouche
DOI: https://doi.org/10.1109/ICITRI59340.2023.10249596
2023-09-24
Abstract:In recent years, deep learning has demonstrated promising results in de novo drug design. However, the proposed techniques still lack an efficient exploration of the large chemical space. Most of these methods explore a small fragment of the chemical space of known drugs, if the desired molecules were not found, the process ends. In this work, we introduce a curiosity-driven method to force the model to navigate many parts of the chemical space, therefore, achieving higher desirability and diversity as well. At first, we train a recurrent neural network-based general molecular generator (G), then we fine-tune G to maximize curiosity and desirability. We define curiosity as the Tanimoto similarity between two generated molecules, a first molecule generated by G, and a second one generated by a copy of G (Gcopy). We only backpropagate the loss through G while keeping Gcopy unchanged. We benchmarked our approach against two desirable chemical properties related to drug-likeness and showed that the discovered chemical space can be significantly expanded, thus, discovering a higher number of desirable molecules with more diversity and potentially easier to synthesize. All Code and data used in this paper are available at
Quantitative Methods,Machine Learning,Biomolecules
What problem does this paper attempt to address?
This paper proposes a solution to the problem of exploring the vast chemical space in drug design with low efficiency. The current deep learning methods in de novo drug design often limit the exploration to a small portion of the chemical space of known drugs. The researchers introduce a curiosity-driven reinforcement learning (RL) approach to encourage the model to explore multiple regions of the chemical space, thus improving the desirability and diversity of molecules. The paper first trains a general molecular generator (G) based on a recurrent neural network (RNN), and then adjusts G to maximize curiosity and desirability. Curiosity is defined here as the Tanimoto similarity between two molecules generated by G and Gcopy. Only the loss is backpropagated through G while keeping Gcopy unchanged. By comparing the chemical properties related to drug-likeness and synthetic ease, they demonstrate that this approach can significantly expand the discovered chemical space and find more desired molecules with diversity and ease of synthesis. The experimental results show that although curiosity-driven methods may reduce the number of desired molecules generated in a single experiment, it helps explore different parts of the chemical space and may discover better combinations of molecules. This provides new insights for the application of deep learning in drug design, allowing a wider range of molecular sets for laboratory testing and increasing the possibility of finding optimal drug candidates.