Abstract:Background: For the past decades, benefitting from the rapid growth of protein sequence data in public databases, a lot of machine learning methods have been developed to predict physicochemical properties or functions of proteins using amino acid sequence features. However, the prediction performance often suffers from the lack of labeled data. In recent years, pre-training methods have been widely studied to address the small-sample issue in computer vision and natural language processing fields, while specific pre-training techniques for protein sequences are few. Results: In this paper, we propose a pre-training platform for representing protein sequences, called ProtPlat, which uses the Pfam database to train a three-layer neural network, and then uses specific training data from downstream tasks to fine-tune the model. ProtPlat can learn good representations for amino acids, and at the same time achieve efficient classification. We conduct experiments on three protein classification tasks, including the identification of type III secreted effectors, the prediction of subcellular localization, and the recognition of signal peptides. The experimental results show that the pre-training can enhance model performance effectively and ProtPlat is competitive to the state-of-the-art predictors, especially for small datasets. We implement the ProtPlat platform as a web service ( https://compbio.sjtu.edu.cn/protplat ) that is accessible to the public. Conclusions: To enhance the feature representation of protein amino acid sequences and improve the performance of sequence-based classification tasks, we develop ProtPlat, a general platform for the pre-training of protein sequences, which is featured by a large-scale supervised training based on Pfam database and an efficient learning model, FastText. The experimental results of three downstream classification tasks demonstrate the efficacy of ProtPlat.

PLAPT: Protein-Ligand Binding Affinity Prediction Using Pretrained Transformers

On Machine Learning Approaches for Protein-Ligand Binding Affinity Prediction

Predicting target–ligand interactions with graph convolutional networks for interpretable pharmaceutical discovery

PeptideBERT: A Language Model based on Transformers for Peptide Property Prediction

Ensemble of local and global information for Protein-Ligand Binding Affinity Prediction

Does protein pretrained language model facilitate the prediction of protein–ligand interaction?

PLANET: A Multi-Objective Graph Neural Network Model for Protein–Ligand Binding Affinity Prediction

MGPLI: Exploring Multigranular Representations for Protein-Ligand Interaction Prediction

Multi-task bioassay pre-training for protein-ligand binding affinity prediction

Multimodal Protein-Ligand Contrastive Pretraining for Effective and Efficient Drug Discovery

Predicting Protein-Peptide Binding Residues Via Interpretable Deep Learning.

PIGNet2: A Versatile Deep Learning-based Protein-Ligand Interaction Prediction Model for Binding Affinity Scoring and Virtual Screening

A Point Cloud-Based Deep Learning Strategy for Protein-Ligand Binding Affinity Prediction

Protein-ligand binding representation learning from fine-grained interactions

Predicting Binding from Screening Assays with Transformer Network Embeddings

Predicting Drug-target Binding Affinity Based on Graph Isomorphism Network and iTransformer

Development and evaluation of a deep learning model for protein-ligand binding affinity prediction

ProtPlat: an efficient pre-training platform for protein classification based on FastText

State-specific protein-ligand complex structure prediction with a multi-scale deep generative model