Abstract:Structure-based methods for detecting protein-ligand binding sites play a crucial role in various domains, from fundamental research to biomedical applications. However, current prediction methodologies often rely on holo (ligand-bound) protein conformations for training and evaluation, overlooking the significance of the apo (ligand-free) states. This oversight is particularly problematic in the case of cryptic binding sites (CBSs) where holo-based assessment yields unrealistic performance expectations. To advance the development in this domain, we introduce CryptoBench, a benchmark dataset tailored for training and evaluating novel CBS prediction methodologies. CryptoBench is constructed upon a large collection of apo-holo protein pairs, grouped by UniProtID, clustered by sequence identity, and filtered to contain only structures with substantial structural change in the binding site. CryptoBench comprises 1,107 structures with predefined cross-validation splits, making it the most extensive CBS dataset to date. To establish a performance baseline, we measured the predictive power of sequence- and structure-based CBS residue prediction methods using the benchmark. We selected PocketMiner as the state-of-the-art representative of the structure-based methods for CBS detection, and P2Rank, a widely-used structure-based method for general binding site prediction that is not specifically tailored for cryptic sites. For sequence-based approaches, we trained a neural network to classify binding residues using protein language model embeddings. Our sequence-based approach outperformed PocketMiner and P2Rank across key metrics, including AUC, AUPRC, MCC, and F1 scores. These results provide baseline benchmark results for future CBS and potentially also non-CBS prediction endeavors, leveraging CryptoBench as the foundational platform for further advancements in the field.

CrypToth: Cryptic pocket detection through mixed-solvent molecular dynamics simulations based topological data analysis

Which cryptic sites are feasible drug targets?

Exploration of cryptic pockets using enhanced sampling along normal modes: A case study of KRAS G12D

Combined physics- and machine-learning-based method to identify druggable binding sites using SILCS-Hotspots

Exploring the Application of SiteMap and Site Finder for Focused Cryptic Pocket Identification

Identification of Cavities on Protein Surface Using Multiple Computational Approaches for Drug Binding Site Prediction

Identifying ligand binding sites and poses using GPU-accelerated Hamiltonian replica exchange molecular dynamics

Divide and Conquer. Pocket-Opening Mixed-Solvent Simulations in the Perspective of Docking Virtual Screening Applications for Drug Discovery

Chemical Proteomics-based Target Prioritization through a Residue Agnostic Ligandability Assessment Platform

Inhibition of striatal-enriched protein tyrosine phosphatase by targeting computationally revealed cryptic pockets

Molecular Dynamics of Outer Membrane-Embedded Polysaccharide Secretion Porins Reveals Closed Resting-State Surface Gates Targetable by Virtual Fragment Screening for Drug Hotspot Identification

CryptoBench: Cryptic protein-ligand binding sites dataset and benchmark

SWISH-X, an Expanded Approach to Detect Cryptic Pockets in Proteins and at Protein-Protein Interfaces

CrossBind: Collaborative Cross-Modal Identification of Protein Nucleic-Acid-Binding Residues

Comprehensive detection and characterization of human druggable pockets through binding site descriptors

Comprehensive detection and characterization of human druggable pockets through novel binding site descriptors

Mapping the path to Cryogenic Atom Probe Tomography Analysis of biomolecules

AAp-MSMD: Amino Acid Preference Mapping on Protein-Protein Interaction Surfaces Using Mixed-Solvent Molecular Dynamics

Quantitative analysis of protein dynamics using a deep learning technique combined with experimental cryo-EM density data and MD simulations

PointSite: A Point Cloud Segmentation Tool for Identification of Protein Ligand Binding Atoms

Accessibility to internal cavities and ligand binding sites monitored by protein crystallographic thermal factors