Abstract:Machine learning (ML) is increasingly being used to guide biological discovery in biomedicine such as prioritizing promising small molecules in drug discovery. In those applications, ML models are used to predict the properties of biological systems, and researchers use these predictions to prioritize candidates as new biological hypotheses for downstream experimental validations. However, when applied to unseen situations, these models can be overconfident and produce a large number of false positives. One solution to address this issue is to quantify the model's prediction uncertainty and provide a set of hypotheses with a controlled false discovery rate (FDR) pre-specified by researchers. We propose CPEC, an ML framework for FDR-controlled biological discovery. We demonstrate its effectiveness using enzyme function annotation as a case study, simulating the discovery process of identifying the functions of less-characterized enzymes. CPEC integrates a deep learning model with a statistical tool known as conformal prediction, providing accurate and FDR-controlled function predictions for a given protein enzyme. Conformal prediction provides rigorous statistical guarantees to the predictive model and ensures that the expected FDR will not exceed a user-specified level with high probability. Evaluation experiments show that CPEC achieves reliable FDR control, better or comparable prediction performance at a lower FDR than existing methods, and accurate predictions for enzymes under-represented in the training data. We expect CPEC to be a useful tool for biological discovery applications where a high yield rate in validation experiments is desired but the experimental budget is limited. Machine learning (ML) models are increasingly being applied as predictors to generate biological hypotheses and guide biological discovery. However, when applied to unseen situations, ML models can be overconfident and make enormous false positive predictions, resulting in the challenges for researchers to trade-off between high yield rates and limited budgets. One solution is to quantify the model's prediction uncertainty and generate predictions at a controlled false discovery rate (FDR) pre-specified by researchers. Here, we introduce CPEC, an ML framework designed for FDR-controlled biological discovery. Using enzyme function prediction as a case study, we simulate the process of function discovery for less-characterized enzymes. Leveraging a statistical framework, conformal prediction, CPEC provides rigorous statistical guarantees that the FDR of the model predictions will not surpass a user-specified level with high probability. Our results suggested that CPEC achieved reliable FDR control for enzymes under-represented in the training data. In the broader context of biological discovery applications, CPEC can be applied to generate high-confidence hypotheses and guide researchers to allocate experimental resources to the validation of hypotheses that are more likely to succeed.

CatPred: A comprehensive framework for deep learning in vitro enzyme kinetic parameters , and

Deep Learning Basedkcatprediction Enables Improved Enzyme Constrained Model Reconstruction

MPEK: a multitask deep learning framework based on pretrained language models for enzymatic reaction kinetic parameters prediction

DeepEnzyme: a robust deep learning model for improved enzyme turnover number prediction by utilizing features of protein 3D-structures

DLKcat cannot predict meaningful k cat values for mutants and unfamiliar enzymes

DLKcat cannot predict meaningful kcat values for mutants and unfamiliar enzymes

UniKP: a unified framework for the prediction of enzyme kinetic parameters

Evolutionary-Scale Enzymology Enables Biochemical Constant Prediction Across a Multi-Peaked Catalytic Landscape

DLTKcat: deep learning-based prediction of temperature-dependent enzyme turnover rates

A general model for predicting enzyme functions based on enzymatic reactions

Turnover number predictions for kinetically uncharacterized enzymes using machine and deep learning

Generation of connections between protein sequence space and chemical space to enable a predictive model for biocatalysis

Leveraging conformal prediction to annotate enzyme function space with limited false positives

Predicting novel substrates for enzymes with minimal experimental effort with active learning

GraphKM: machine and deep learning for KM prediction of wildtype and mutant enzymes

ALDELE: All-Purpose Deep Learning Toolkits for Predicting the Biocatalytic Activities of Enzymes

Deep learning allows genome-scale prediction of Michaelis constants from structural features

Autoregressive Enzyme Function Prediction with Multi-scale Multi-modality Fusion

Data‐Driven Protein Engineering for Improving Catalytic Activity and Selectivity

Machine learning modeling of family wide enzyme-substrate specificity screens

Exploration and Evaluation of Machine Learning-Based Models for Predicting Enzymatic Reactions