Abstract:Graph convolutional neural networks (GCNs) have been repeatedly shown to have robust capacities for modeling graph data such as small molecules. Message-passing neural networks (MPNNs), a group of GCN variants that can learn and aggregate local information of molecules through iterative message-passing iterations, have exhibited advancements in molecular modeling and property prediction. Moreover, given the merits of Transformers in multiple artificial intelligence domains, it is desirable to combine the self-attention mechanism with MPNNs for better molecular representation. We propose an atom-bond transformer-based message-passing neural network (ABT-MPNN), to improve the molecular representation embedding process for molecular property predictions. By designing corresponding attention mechanisms in the message-passing and readout phases of the MPNN, our method provides a novel architecture that integrates molecular representations at the bond, atom and molecule levels in an end-to-end way. The experimental results across nine datasets show that the proposed ABT-MPNN outperforms or is comparable to the state-of-the-art baseline models in quantitative structure–property relationship tasks. We provide case examples of Mycobacterium tuberculosis growth inhibitors and demonstrate that our model's visualization modality of attention at the atomic level could be an insightful way to investigate molecular atoms or functional groups associated with desired biological properties. The new model provides an innovative way to investigate the effect of self-attention on chemical substructures and functional groups in molecular representation learning, which increases the interpretability of the traditional MPNN and can serve as a valuable way to investigate the mechanism of action of drugs.

A Convolutional Neural Network Based on Self-Attention Mechanism for Molecular Property Prediction Using Molecular Hidden Fingerprints: An efficient molecular property prediction method.

Double-head transformer neural network for molecular property prediction

Dual Message Passing Neural Network for Molecular Property Prediction

MIFNN: Molecular Information Feature Extraction and Fusion Deep Neural Network for Screening Potential Drugs

Dual Self-attention Fusion Message Neural Network for Virtual Screening in Drug Discovery by Molecular Property Prediction

A New Fingerprint and Graph Hybrid Neural Network for Predicting Molecular Properties

ABT-MPNN: an atom-bond transformer-based message-passing neural network for molecular property prediction

A fingerprints based molecular property prediction method using the BERT model

DMPNN-Bert: a deep learning architecture for molecular property prediction.

Understanding the Limitations of Deep Models for Molecular Property Prediction: Insights and Solutions.

EMPPNet: Enhancing Molecular Property Prediction via Cross-modal Information Flow and Hierarchical Attention

Contrastive Dual-Interaction Graph Neural Network for Molecular Property Prediction

Insights into Deep Learning Framework for Molecular Property Prediction Based on Different Tokenization Algorithms

Many-Body Function Corrected Neural Network with Atomic Attention (Mbnn-Att) for Molecular Property Prediction.

Molecular Property Prediction: A Multilevel Quantum Interactions Modeling Perspective

Comparison Study on the Prediction of Multiple Molecular Properties by Various Neural Networks

FP-GNN: a versatile deep learning architecture for enhanced molecular property prediction

DIG-Mol: A Contrastive Dual-Interaction Graph Neural Network for Molecular Property Prediction

Advanced deep learning methods for molecular property prediction

HiGNN: Hierarchical Informative Graph Neural Networks for Molecular Property Prediction Equipped with Feature-Wise Attention

Directed graph attention neural network utilizing 3D coordinates for molecular property prediction