Abstract:Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, mono-modal learning is inherently limited as it relies solely on a single modality of molecular representation, which restricts a comprehensive understanding of drug molecules. To overcome the limitations, we propose a multimodal fused deep learning (MMFDL) model to leverage information from different molecular representations. Specifically, we construct a triple-modal learning model by employing Transformer-Encoder, Bidirectional Gated Recurrent Unit (BiGRU), and graph convolutional network (GCN) to process three modalities of information from chemical language and molecular graph: SMILES-encoded vectors, ECFP fingerprints, and molecular graphs, respectively. We evaluate the proposed triple-modal model using five fusion approaches on six molecule datasets, including Delaney, Llinas2020, Lipophilicity, SAMPL, BACE, and pKa from DataWarrior. The results show that the MMFDL model achieves the highest Pearson coefficients, and stable distribution of Pearson coefficients in the random splitting test, outperforming mono-modal models in accuracy and reliability. Furthermore, we validate the generalization ability of our model in the prediction of binding constants for protein-ligand complex molecules, and assess the resilience capability against noise. Through analysis of feature distributions in chemical space and the assigned contribution of each modal model, we demonstrate that the MMFDL model shows the ability to acquire complementary information by using proper models and suitable fusion approaches. By leveraging diverse sources of bioinformatics information, multimodal deep learning models hold the potential for successful drug discovery.

A Novel Descriptor and Molecular Graph-Based Bimodal Contrastive Learning Framework for Drug Molecular Property Prediction.

Contrastive Dual-Interaction Graph Neural Network for Molecular Property Prediction

3D-Mol: A Novel Contrastive Learning Framework for Molecular Property Prediction with 3D Information

DIG-Mol: A Contrastive Dual-Interaction Graph Neural Network for Molecular Property Prediction

Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction

Multimodal fused deep learning for drug property prediction: Integrating chemical language and molecular graph

MultiModal-Learning for Predicting Molecular Properties: A Framework Based on Image and Graph Structures

Extracting Molecular Properties from Natural Language with Multimodal Contrastive Learning

GraphCL-DTA: a graph contrastive learning with molecular semantics for drug-target binding affinity prediction

Bi-level Contrastive Learning for Knowledge-Enhanced Molecule Representations

Attention-wise masked graph contrastive learning for predicting molecular property

Molecular contrastive learning of representations via graph neural networks

Graph Multi-Similarity Learning for Molecular Property Prediction

3D graph contrastive learning for molecular property prediction

A Novel Molecular Representation Learning for Molecular Property Prediction with a Multiple SMILES-Based Augmentation

Multimodal contrastive representation learning for drug-target binding affinity prediction

Dual-View Learning Based on Images and Sequences for Molecular Property Prediction

Multimodal Fusion with Relational Learning for Molecular Property Prediction

Chemical Property Relation Guided Few-Shot Molecular Property Prediction

An improved multi-modal representation-learning model based on fusion networks for property prediction in drug discovery