Abstract:Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, mono-modal learning is inherently limited as it relies solely on a single modality of molecular representation, which restricts a comprehensive understanding of drug molecules. To overcome the limitations, we propose a multimodal fused deep learning (MMFDL) model to leverage information from different molecular representations. Specifically, we construct a triple-modal learning model by employing Transformer-Encoder, Bidirectional Gated Recurrent Unit (BiGRU), and graph convolutional network (GCN) to process three modalities of information from chemical language and molecular graph: SMILES-encoded vectors, ECFP fingerprints, and molecular graphs, respectively. We evaluate the proposed triple-modal model using five fusion approaches on six molecule datasets, including Delaney, Llinas2020, Lipophilicity, SAMPL, BACE, and pKa from DataWarrior. The results show that the MMFDL model achieves the highest Pearson coefficients, and stable distribution of Pearson coefficients in the random splitting test, outperforming mono-modal models in accuracy and reliability. Furthermore, we validate the generalization ability of our model in the prediction of binding constants for protein-ligand complex molecules, and assess the resilience capability against noise. Through analysis of feature distributions in chemical space and the assigned contribution of each modal model, we demonstrate that the MMFDL model shows the ability to acquire complementary information by using proper models and suitable fusion approaches. By leveraging diverse sources of bioinformatics information, multimodal deep learning models hold the potential for successful drug discovery.

Structure to Property: Chemical Element Embeddings and a Deep Learning Approach for Accurate Prediction of Chemical Properties

Prediction of chemical compounds properties using a deep learning model

ElemNet: Deep Learning the Chemistry of Materials From Only Elemental Composition

Geometric deep learning for molecular property predictions with chemical accuracy across chemical space

Unsupervised Learning of Molecular Embeddings for Enhanced Clustering and Emergent Properties for Chemical Compounds

Large-scale chemical language representations capture molecular structure and properties

A merged molecular representation learning for molecular properties prediction with a web-based service

Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction

Accurate Physical Property Predictions via Deep Learning

Chemception: A Deep Neural Network with Minimal Chemistry Knowledge Matches the Performance of Expert-developed QSAR/QSPR Models

Material Property Prediction with Element Attribute Knowledge Graphs and Multimodal Representation Learning

Machine Learning of Molecular Electronic Properties in Chemical Compound Space

Interpretable and Physicochemical-Intuitive Deep Learning Approach for the Design of Thermal Resistance of Energetic Compounds

A Large Encoder-Decoder Family of Foundation Models For Chemical Language

PEMP: Leveraging Physics Properties to Enhance Molecular Property Prediction

Balancing Molecular Information and Empirical Data in the Prediction of Physico-Chemical Properties

Predicting materials properties without crystal structure: Deep representation learning from stoichiometry

Analyzing Learned Molecular Representations for Property Prediction

SMG-BERT: integrating stereoscopic information and chemical representation for molecular property prediction

Multimodal fused deep learning for drug property prediction: Integrating chemical language and molecular graph

DECIMER: towards deep learning for chemical image recognition