Abstract:Accurately predicting molecular properties is a challenging but essential task in drug discovery. Recently, many mono-modal deep learning methods have been successfully applied to molecular property prediction. However, mono-modal learning is inherently limited as it relies solely on a single modality of molecular representation, which restricts a comprehensive understanding of drug molecules. To overcome the limitations, we propose a multimodal fused deep learning (MMFDL) model to leverage information from different molecular representations. Specifically, we construct a triple-modal learning model by employing Transformer-Encoder, Bidirectional Gated Recurrent Unit (BiGRU), and graph convolutional network (GCN) to process three modalities of information from chemical language and molecular graph: SMILES-encoded vectors, ECFP fingerprints, and molecular graphs, respectively. We evaluate the proposed triple-modal model using five fusion approaches on six molecule datasets, including Delaney, Llinas2020, Lipophilicity, SAMPL, BACE, and pKa from DataWarrior. The results show that the MMFDL model achieves the highest Pearson coefficients, and stable distribution of Pearson coefficients in the random splitting test, outperforming mono-modal models in accuracy and reliability. Furthermore, we validate the generalization ability of our model in the prediction of binding constants for protein-ligand complex molecules, and assess the resilience capability against noise. Through analysis of feature distributions in chemical space and the assigned contribution of each modal model, we demonstrate that the MMFDL model shows the ability to acquire complementary information by using proper models and suitable fusion approaches. By leveraging diverse sources of bioinformatics information, multimodal deep learning models hold the potential for successful drug discovery.

EMPPNet: Enhancing Molecular Property Prediction via Cross-modal Information Flow and Hierarchical Attention

HimGNN: a novel hierarchical molecular graph representation learning framework for property prediction

Prompting Meta-Learned Hierarchical Graph Network for Molecular Property Prediction

Enhancing Molecular Property Prediction via Mixture of Collaborative Experts

HiGNN: Hierarchical Informative Graph Neural Networks for Molecular Property Prediction Equipped with Feature-Wise Attention

Understanding the Limitations of Deep Models for Molecular Property Prediction: Insights and Solutions.

Molecular Property Prediction Based on Graph Structure Learning

MultiModal-Learning for Predicting Molecular Properties: A Framework Based on Image and Graph Structures

Cross-dependent graph neural networks for molecular property prediction

Boosting the performance of molecular property prediction via graph–text alignment and multi-granularity representation enhancement

PEMP: Leveraging Physics Properties to Enhance Molecular Property Prediction

Adapting Differential Molecular Representation with Hierarchical Prompts for Multi-label Property Prediction

AEGNN-M:A 3D Graph-Spatial Co-Representation Model for Molecular Property Prediction

LSTM-GNN: A Multi-Channel Model for Molecular Properties Prediction

HiGNN: A Hierarchical Informative Graph Neural Network for Molecular Property Prediction Equipped with Feature-Wise Attention

Impact of Domain Knowledge and Multi-Modality on Intelligent Molecular Property Prediction: A Systematic Survey

Integrating Chemical Language and Molecular Graph in Multimodal Fused Deep Learning for Drug Property Prediction

Hierarchical Molecular Graph Self-Supervised Learning for property prediction

Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspective

Multi-Modal Representation Learning for Molecular Property Prediction: Sequence, Graph, Geometry

Multimodal fused deep learning for drug property prediction: Integrating chemical language and molecular graph