Abstract:Kinases play a central role in regulating cellular processes, making their study essential for understanding cellular function and disease mechanisms. To investigate the regulatory state of a kinase, numerous methods have been, and continue to be, developed to infer kinase activities from phosphoproteomics data. These methods usually rely on a set of kinase targets collected from various kinase-substrate libraries. However, only a small percentage of measured phosphorylation sites can usually be attributed to an upstream kinase in these libraries, limiting the scope of kinase activity inference. In addition, the inferred activities from different methods can vary making it crucial to evaluate them for accurate interpretation. Here, we present a comprehensive evaluation of kinase activity inference methods using multiple kinase-substrate libraries combined with different inference algorithms. Additionally, we try to overcome the coverage limitations for measured targets in kinase substrate libraries by adding predicted kinase-substrate interactions for activity inference. For the evaluation, in addition to classical cell-based perturbation experiments, we introduce a tumor-based benchmarking approach that utilizes multi-omics data to identify highly active or inactive kinases per tumor type. We show that while most computational algorithms perform comparably regardless of their complexity, the choice of kinase-substrate library can highly impact the inferred kinase activities. Hereby, manually curated libraries, particularly PhosphoSitePlus, demonstrate superior performance in recapitulating kinase activities from phosphoproteomics data. Additionally, in the tumor-based evaluation, adding predicted targets from NetworKIN further boosts the performance, while normalizing sites to host protein levels reduces kinase activity inference performance. We then showcase how kinase activity inference can help in characterizing the response to kinase inhibitors in different cell lines. Overall, the selection of reliable kinase activity inference methods is important in identifying deregulated kinases and novel drug targets. Finally, to facilitate the evaluation of novel methods in the future, we provide both benchmarking approaches in the R package benchmarKIN.

An atlas of substrate specificities for the human serine/threonine kinome

The intrinsic substrate specificity of the human tyrosine kinome

Phosphopredict: A Bioinformatics Tool for Prediction of Human Kinase-Specific Phosphorylation Substrates and Sites by Integrating Heterogeneous Feature Selection

A resource database for protein kinase substrate sequence-preference motifs based on large-scale mass spectrometry data

Phosphorylation-dependent substrate selectivity of protein kinase B (AKT1)

Systematic Analysis of Protein Phosphorylation Networks From Phosphoproteomic Data

High-throughput profiling of sequence recognition by tyrosine kinases and SH2 domains using bacterial peptide display

Determination of CK2 Specificity and Substrates by Proteome-Derived Peptide Libraries

Global Screening of CK2 Kinase Substrates by an Integrated Phosphoproteomics Workflow.

Molecular modeling and molecular dynamics simulation studies of the GSK3β/ATP/substrate complex: understanding the unique P+4 primed phosphorylation specificity for GSK3β substrates.

High‐accuracy Identification and Bioinformatic Analysis of in Vivo Protein Phosphorylation Sites in Yeast

Construction and Analysis of Human Phosphorylation Network

PhosPhAt goes kinases—searchable protein kinase target information in the plant phosphorylation site database PhosPhAt

Catalytic Specificity of Protein-Tyrosine Kinases is Critical for Selective Signalling

Phosphoproteomic analysis reveals interconnected system-wide responses to perturbations of kinases and phosphatases in yeast

One‐thousand‐and‐one substrates of protein kinase CK2?

Identifying Human Kinase-Specific Protein Phosphorylation Sites By Integrating Heterogeneous Information From Various Sources

Comprehensive evaluation of phosphoproteomic-based kinase activity inference

PSEA: Kinase-specific prediction and analysis of human phosphorylation substrates

Identification of Extracellular Signal-regulated Kinase 1 (ERK1) Direct Substrates using Stable Isotope Labeled Kinase Assay-Linked Phosphoproteomics

Global, In Vivo, and Site-Specific Phosphorylation Dynamics in Signaling Networks