Abstract:A Summary: Identifying the protein-peptide binding residues is fundamentally important to understand the mechanisms of protein functions and explore drug discovery. Although several computational methods have been developed, most of them highly rely on third-party tools or complex data preprocessing for feature design, easily resulting in low computational efficacy and suffering from low predictive performance. To address the limitations, we propose PepBCL, a novel BERT (Bidirectional Encoder Representation from Transformers) -based contrastive learning framework to predict the protein-peptide binding residues based on protein sequences only. PepBCL is an end-to-end predictive model that is independent of feature engineering. Specifically, we introduce a well pre-trained protein language model that can automatically extract and learn high-latent representations of protein sequences relevant for protein structures and functions. Further, we design a novel contrastive learning module to optimize the feature representations of binding residues underlying the imbalanced dataset. We demonstrate that our proposed method significantly outperforms the state-of-the-art methods under benchmarking comparison, and achieves more robust performance. Moreover, we found that we further improve the performance via the integration of traditional features and our learnt features. Interestingly, the interpretable analysis of our model highlights the flexibility and adaptability of deep learning-based protein language model to capture both conserved and non-conserved sequential characteristics of peptide-binding residues. Finally, to facilitate the use of our method, we establish an online predictive platform as the implementation of the proposed PepBCL, which is now available at http://server.wei-group.net/PepBCL/.

NABP-BERT: NANOBODY®-antigen binding prediction based on bidirectional encoder representations from transformers (BERT) architecture

nanoBERT: A deep learning model for gene agnostic navigation of the nanobody mutational space

NanoBERTa-ASP: predicting nanobody paratope based on a pretrained RoBERTa model

Characterization of a nanobody-epitope tag interaction and its application for receptor engineering

Protein language models enable prediction of polyreactivity of monospecific, bispecific, and heavy-chain-only antibodies

Sequence-Based Nanobody-Antigen Binding Prediction

Deciphering the language of antibodies using self-supervised learning

Nanobody–antigen interaction prediction with ensemble deep learning and prompt-based protein language models

AbImmPred: An immunogenicity prediction method for therapeutic antibodies using AntiBERTy-based sequence features

Predicting Protein-Peptide Binding Residues Via Interpretable Deep Learning.

LBCE-XGB: A XGBoost Model for Predicting Linear B-Cell Epitopes Based on BERT Embeddings

Prediction of linear B-cell epitopes based on protein sequence features and BERT embeddings

AbAgIntPre: A Deep Learning Method for Predicting Antibody-Antigen Interactions Based on Sequence Information

NbX: Machine Learning-Guided Re-Ranking of Nanobody–Antigen Binding Poses

DeepANIS: Predicting antibody paratope from concatenated CDR sequences by integrating bidirectional long-short-term memory and transformer neural networks

On Pre-trained Language Models for Antibody

AI driven approaches in Nanobody Epitope Prediction: Are We There Yet?

FAD-BERT: Improved prediction of FAD binding sites using pre-training of deep bidirectional transformers

Accurate Prediction of Antibody Function and Structure Using Bio-Inspired Antibody Language Model