Linear Graphlet Models for Accurate and Interpretable Cheminformatics

Michael Tynes,Michael G Taylor,Jan Janssen,Daniel J Burrill,Danny Perez,Ping Yang,Nicholas Lubbers

DOI: https://doi.org/10.26434/chemrxiv-2024-r81c8

2024-02-26

Abstract:Advances in machine learning have given rise to a plurality of data-driven methods for estimating chemical properties from molecular structure. For many decades, the cheminformatics field has relied heavily on structural fingerprinting, while in recent years much focus has shifted leveraging highly parameterized deep neural networks which usually maximize accuracy. Beyond accuracy, machine learning techniques need intuitive and useful explanations for the predictions of models and uncertainty quantification techniques so that a practitioner might know when a model is appropriate to apply to new data. Here we show that linear models built on unfolded molecular-graphlet-based fingerprints attain accuracy that is competitive with the state of the art while retaining an explainability advantage over black-box approaches. We show how to produce precise explanations of predictions by exploiting the relationships between molecular graphlets and show that these explanations are consistent with chemical intuition, experimental measurements, and theoretical calculations. Finally we show how to use the presence of unseen fragments in new molecules to adjust predictions and quantify uncertainty.

Chemistry

What problem does this paper attempt to address?

This paper discusses how to achieve accurate and interpretable predictions of molecular structures in chemoinformatics using a linear graph-based model. Traditional methods for predicting chemical properties rely on structural fingerprints, but in recent years, highly parameterized deep neural networks (DNNs) have been widely adopted to improve accuracy. However, these methods sacrifice model interpretability and uncertainty quantification.

The researchers propose a linear model based on unfolded molecular graph fingerprints, which combines comparable predictive accuracy to state-of-the-art black-box methods such as DNNs with improved interpretability. They demonstrate how to precisely interpret predictions based on the relationships between molecular graphs, and show that these interpretations align with chemical intuition, experimental measurements, and theoretical calculations. Additionally, they demonstrate how to adjust predictions and quantify uncertainty using the presence of unseen fragments in new molecules.

The paper highlights that while DNNs often provide the highest accuracy, their interpretability is poor, and some post-hoc interpretation methods have theoretical weaknesses. The researchers demonstrate that with careful design, interpretable models can rival the predictive capabilities of black-box models by building a linear model. They approximate molecular properties using a graph organized by atom arrays, similar to many-body expansions, and showcase the competitiveness of this approach in various structure-property prediction tasks.

The study also proposes local interpretations projected from molecular graphs that are associated with chemical intuition and theoretical calculations, and can estimate distribution variations through statistics of unseen fragments, thereby quantifying prediction uncertainty. Finally, the paper discusses data sources, implementation methods, and experimental results on multiple molecular datasets, providing evidence for the advantages of linear graph-based models in prediction performance, interpretability, and uncertainty quantification.