Abstract:Machine learning (ML) is increasingly being used to guide biological discovery in biomedicine such as prioritizing promising small molecules in drug discovery. In those applications, ML models are used to predict the properties of biological systems, and researchers use these predictions to prioritize candidates as new biological hypotheses for downstream experimental validations. However, when applied to unseen situations, these models can be overconfident and produce a large number of false positives. One solution to address this issue is to quantify the model's prediction uncertainty and provide a set of hypotheses with a controlled false discovery rate (FDR) pre-specified by researchers. We propose CPEC, an ML framework for FDR-controlled biological discovery. We demonstrate its effectiveness using enzyme function annotation as a case study, simulating the discovery process of identifying the functions of less-characterized enzymes. CPEC integrates a deep learning model with a statistical tool known as conformal prediction, providing accurate and FDR-controlled function predictions for a given protein enzyme. Conformal prediction provides rigorous statistical guarantees to the predictive model and ensures that the expected FDR will not exceed a user-specified level with high probability. Evaluation experiments show that CPEC achieves reliable FDR control, better or comparable prediction performance at a lower FDR than existing methods, and accurate predictions for enzymes under-represented in the training data. We expect CPEC to be a useful tool for biological discovery applications where a high yield rate in validation experiments is desired but the experimental budget is limited. Machine learning (ML) models are increasingly being applied as predictors to generate biological hypotheses and guide biological discovery. However, when applied to unseen situations, ML models can be overconfident and make enormous false positive predictions, resulting in the challenges for researchers to trade-off between high yield rates and limited budgets. One solution is to quantify the model's prediction uncertainty and generate predictions at a controlled false discovery rate (FDR) pre-specified by researchers. Here, we introduce CPEC, an ML framework designed for FDR-controlled biological discovery. Using enzyme function prediction as a case study, we simulate the process of function discovery for less-characterized enzymes. Leveraging a statistical framework, conformal prediction, CPEC provides rigorous statistical guarantees that the FDR of the model predictions will not surpass a user-specified level with high probability. Our results suggested that CPEC achieved reliable FDR control for enzymes under-represented in the training data. In the broader context of biological discovery applications, CPEC can be applied to generate high-confidence hypotheses and guide researchers to allocate experimental resources to the validation of hypotheses that are more likely to succeed.

PECB: prediction of enzyme catalytic residues based on Naive Bayes classification.

Case-Based Meta-Prediction for Bioinformatics.

Predicting Protein-Ligand Interactions Based on Bow-Pharmacological Space and Bayesian Additive Regression Trees

A general model for predicting enzyme functions based on enzymatic reactions

FEDKEA: Enzyme function prediction with a large pretrained protein language model and distance-weighted k-nearest neighbor

Prediction of Interaction Between Enzymes and Small Molecules in Metabolic Pathways Through Integrating Multiple Classifiers.

Accurate Prediction of Protein Catalytic Residues by Side Chain Orientation and Residue Contact Density.

Alignment-Free Method to Predict Enzyme Classes and Subclasses

Leveraging conformal prediction to annotate enzyme function space with limited false positives

Evidential deep learning for trustworthy prediction of enzyme commission number

Accurately predicting enzyme functions through geometric graph learning on ESMFold-predicted structures

ECRECer: Enzyme Commission Number Recommendation and Benchmarking based on Multiagent Dual-core Learning

EXIA2: Web Server of Accurate and Rapid Protein Catalytic Residue Prediction

Enzyme function prediction using contrastive learning

Efficient and Interpretable Prediction of Protein Functional Classes by Correspondence Analysis and Compact Set Relations.

Extensive telangiectases of the scalp: atypical presentation of primary cutaneous follicle centre lymphoma

SCREEN: a graph-based contrastive learning tool to infer catalytic residues and assess mutation tolerance in enzymes

NBA-Palm: prediction of palmitoylation site implemented in Naïve Bayes algorithm

Autoregressive Enzyme Function Prediction with Multi-scale Multi-modality Fusion

Biogeography of luminous marine ostracod driven irreversibly by the Japan current.

Prediction of Nepsilon-acetylation on internal lysines implemented in Bayesian Discriminant Method.