Abstract:Advances in machine learning (ML) and the availability of protein sequences via high-throughput sequencing techniques have transformed the ability to design novel diagnostic and therapeutic proteins. ML allows protein engineers to capture complex trends hidden within protein sequences that would otherwise be difficult to identify in the context of the immense and rugged protein fitness landscape. Despite this potential, there persists a need for guidance during the training and evaluation of ML methods over sequencing data. Two key challenges for training discriminative models and evaluating their performance include handling severely imbalanced datasets (e.g., few high-fitness proteins among an abundance of non-functional proteins) and selecting appropriate protein sequence representations (numerical encodings). Here, we present a framework for applying ML over assay-labeled datasets to elucidate the capacity of sampling techniques and protein encoding methods to improve binding affinity and thermal stability prediction tasks. For protein sequence representations, we incorporate two widely used methods (One-Hot encoding and physiochemical encoding) and two language-based methods (next-token prediction, UniRep; masked-token prediction, ESM). Elaboration on performance is provided over protein fitness, protein size, and sampling techniques. In addition, an ensemble of protein representation methods is generated to discover the contribution of distinct representations and improve the final prediction score. We then implement multiple criteria decision analysis (MCDA; TOPSIS with entropy weighting), using multiple metrics well-suited for imbalanced data, to ensure statistical rigor in ranking our methods. Within the context of these datasets, the synthetic minority oversampling technique (SMOTE) outperformed undersampling while encoding sequences with One-Hot, UniRep, and ESM representations. Moreover, ensemble learning increased the predictive performance of the affinity-based dataset by 4% compared to the best single-encoding candidate (F1-score = 97%), while ESM alone was rigorous enough in stability prediction (F1-score = 92%).

DBA/2J (Mls‐1a) B‐cell differentiation in BALB.xid recipients

ProtSolM: Protein Solubility Prediction with Multi-modal Features

DeepSol: a deep learning framework for sequence‐based protein solubility prediction

PLM_Sol: predicting protein solubility by benchmarking multiple protein language models with the updated Escherichia coli protein solubility dataset

Protein–Sol: a web tool for predicting protein solubility from sequence

PLM_Sol: predicting protein solubility by benchmarking multiple protein language models with the updated protein solubility dataset

SoluProt: prediction of soluble protein expression in Escherichia coli

Prediction of protein solubility based on sequence physicochemical patterns and distributed representation information with DeepSoluE

Develop machine learning-based regression predictive models for engineering protein solubility

Hormone replacement therapy and cardiovascular risk: consistency of results and unreliable data.

Develop machine learning based predictive models for engineering protein solubility

GATSol, an enhanced predictor of protein solubility through the synergy of 3D structure graph and large language modeling

AlphaFold 2-based stacking model for protein solubility prediction and its transferability on seed storage proteins

Sequence-based prediction of the solubility of peptides containing non-natural amino acids

Sequence-based prediction of the intrinsic solubility of peptides containing non-natural amino acids

PON-Sol2: Prediction of Effects of Variants on Protein Solubility

ccSOL omics: a webserver for solubility prediction of endogenous and heterologous expression in Escherichia coli

Protein Fitness Prediction Is Impacted by the Interplay of Language Models, Ensemble Learning, and Sampling Methods

[Prediction of Protein Solvent Accessibility with Markov Chain Model].

Predicting Solubility with Residual Gated Graph Neural Network

Deep learning framework DNN with conditional WGAN for protein solubility prediction