Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction

Xiaohua Lu,Liangxu Xie,Lei Xu,Rongzhi Mao,Shan Chang,Xiaojun Xu

DOI: https://doi.org/10.1016/j.csbj.2024.04.030

2024-09-13

Abstract:Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, the inherent limitation of mono-modal learning arises from relying solely on one modality of molecular representation, which restricts a comprehensive understanding of drug molecules and hampers their resilience against data noise. To overcome the limitations, we construct multimodal deep learning models to cover different molecular representations. We convert drug molecules into three molecular representations, SMILES-encoded vectors, ECFP fingerprints, and molecular graphs. To process the modal information, Transformer-Encoder, bi-directional gated recurrent units (BiGRU), and graph convolutional network (GCN) are utilized for feature learning respectively, which can enhance the model capability to acquire complementary and naturally occurring bioinformatics information. We evaluated our triple-modal model on six molecule datasets. Different from bi-modal learning models, we adopt five fusion methods to capture the specific features and leverage the contribution of each modal information better. Compared with mono-modal models, our multimodal fused deep learning (MMFDL) models outperform single models in accuracy, reliability, and resistance capability against noise. Moreover, we demonstrate its generalization ability in the prediction of binding constants for protein-ligand complex molecules in the refined set of PDBbind. The advantage of the multimodal model lies in its ability to process diverse sources of data using proper models and suitable fusion methods, which would enhance the noise resistance of the model while obtaining data diversity.

Machine Learning,Biological Physics,Biomolecules

What problem does this paper attempt to address?

The paper attempts to address the challenge of accurately predicting molecular properties in drug discovery. Specifically, the paper proposes a Multimodal Fusion Deep Learning (MMFDL) model, which aims to improve the accuracy of molecular property prediction by integrating different representations of chemical language and molecular graphs. Traditional unimodal learning methods are limited because they rely on a single molecular representation, failing to comprehensively understand drug molecules. Therefore, this study constructs a trimodal learning model that utilizes a Transformer-Encoder, Bidirectional Gated Recurrent Unit (BiGRU), and Graph Convolutional Network (GCN) to process SMILES encoded vectors, ECFP fingerprints, and molecular graphs, respectively, to obtain complementary information. Various fusion strategies are then employed to further enhance the model's performance. Experimental results show that the MMFDL model outperforms unimodal models across multiple datasets, with significant improvements in accuracy, generalization ability, and noise resistance.