Abstract:Determining various properties of molecules is a critical step in drug discovery. Recently, with the improvement of large heterogeneous datasets and the development of deep learning approaches, more and more scientists have turned their attention to neural network-based virtual preliminary screening to reduce the time and monetary cost of drug discovery. However, the poor interpretability of deep learning masks causality, so models' conclusions are often beyond the comprehension of human users, which reduces the credibility of the model and makes it difficult for chemists to further narrow the huge chemical space based on models' results. Thus, this study develops a novel framework consisting of Graph Neural Networks for feature extraction, Curriculum-Based Learning Strategies for optimization, and a Learning Binary Neural Tree (LBNT) for prediction, to improve the performance of neural networks and reveal their decision-making process to chemists. The framework encodes molecular graph data with graph neural networks (GNNs), then retrains the encoder with curriculum-based learning strategies to reduce uncertainty and improve accuracy, and finally uses LBNT as the predictor, which joint retrains with the encoder after independently training, for prediction and visualization. The framework is validated on the public datasets and compared to single GNNs with normal training strategies as well as GNN encoders with common machine learning predictors instead of the LBNT predictor. The result reveals that the proposed framework enhances the point prediction accuracy of the completely trained GNN and reduces its uncertainty through curriculum-based learning, and further improves the accuracy by combining LBNT. Besides, compared with common machine learning tools, the LBNT predictor generally has the best performance because of joint retraining with the GNN encoder. The decision-making process of LBNT is also better and easier to explain than that of other models.

Neural Decision Tree Towards Fully Functional Neural Graph

Neural Trees for Learning on Graphs

Neural Decision Trees

On Neural Networks as Infinite Tree-Structured Probabilistic Graphical Models

A Survey of Neural Trees

Backpropagation Neural Tree

Neural Networks are Decision Trees

TREE-G: Decision Trees Contesting Graph Neural Networks

GraphAny: A Foundation Model for Node Classification on Any Graph

An Interpretability Algorithm of Neural Network Based on Neural Support Decision Tree

ChemXTree: A Feature-Enhanced Graph Neural Network-Neural Decision Tree Framework for ADMET Prediction

A Survey of Neural Trees: Co-Evolving Neural Networks and Decision Trees

Graph Neural Tree: A novel and interpretable deep learning-based framework for accurate molecular property predictions

Graph Neural Networks Inspired by Classical Iterative Algorithms

Graph Neural Networks with Node-wise Architecture

Convexification of Neural Graph.

Dendritic Neuron Model with Effective Learning Algorithms for Classification, Approximation, and Prediction

SONG: Self-Organizing Neural Graphs

Neural Approximation of Graph Topological Features

Design interpretable neural network trees through self-organized learning of features

Directed Acyclic Graph Neural Networks