Abstract:Protein solubility plays a crucial role in various biotechnological, industrial, and biomedical applications. With the reduction in sequencing and gene synthesis costs, the adoption of high-throughput experimental screening coupled with tailored bioinformatic prediction has witnessed a rapidly growing trend for the development of novel functional enzymes of interest (EOI). High protein solubility rates are essential in this process and accurate prediction of solubility is a challenging task. As deep learning technology continues to evolve, attention-based protein language models (PLMs) can extract intrinsic information from protein sequences to a greater extent. Leveraging these models along with the increasing availability of protein solubility data inferred from structural database like the Protein Data Bank holds great potential to enhance the prediction of protein solubility. In this study, we curated an Updated Escherichia coli protein Solubility DataSet (UESolDS) and employed a combination of multiple PLMs and classification layers to predict protein solubility. The resulting best-performing model, named Protein Language Model-based protein Solubility prediction model (PLM_Sol), demonstrated significant improvements over previous reported models, achieving a notable 6.4% increase in accuracy, 9.0% increase in F1_score, and 11.1% increase in Matthews correlation coefficient score on the independent test set. Moreover, additional evaluation utilizing our in-house synthesized protein resource as test data, encompassing diverse types of enzymes, also showcased the good performance of PLM_Sol. Overall, PLM_Sol exhibited consistent and promising performance across both independent test set and experimental set, thereby making it well suited for facilitating large-scale EOI studies. PLM_Sol is available as a standalone program and as an easy-to-use model at https://zenodo.org/doi/10.5281/zenodo.10675340.

Open-Source Protein Language Models for Function Prediction and Protein Design

InterPLM: Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders

PLM-interact: extending protein language models to predict protein-protein interactions

S-PLM: Structure-aware Protein Language Model via Contrastive Learning between Sequence and Structure

Exploring evolution-aware & -free protein language models as protein function predictors

Efficient Inference, Training, and Fine-tuning of Protein Language Models

Does protein pretrained language model facilitate the prediction of protein–ligand interaction?

Design Proteins Using Large Language Models: Enhancements and Comparative Analyses

Long-context Protein Language Model

Protein Language Model Supervised Precise and Efficient Protein Backbone Design Method

InstructPLM: Aligning Protein Language Models to Follow Protein Structure Instructions

PLM_Sol: predicting protein solubility by benchmarking multiple protein language models with the updated Escherichia coli protein solubility dataset

Structure-Infused Protein Language Models

Democratizing protein language models with parameter-efficient fine-tuning

PLM_Sol: predicting protein solubility by benchmarking multiple protein language models with the updated protein solubility dataset

Protein language models meet reduced amino acid alphabets

Leveraging protein language model embeddings and logistic regression for efficient and accurate in-silico acidophilic proteins classification

Reinforcement Learning for Sequence Design Leveraging Protein Language Models

Learning immune receptor representations with protein language models

ProLLaMA: A Protein Language Model for Multi-Task Protein Language Processing

ProtT3: Protein-to-Text Generation for Text-based Protein Understanding