Abstract:Understanding protein thermostability is essential for various biotechnological and biological applications. However, traditional experimental methods for assessing this property are time-consuming, expensive, and error-prone. Recently, the application of Deep Learning techniques from Natural Language Processing (NLP) was extended to the field of biology, with an emphasis on protein modeling. From a linguistic perspective, the primary sequence of proteins can be viewed as a string of amino acids that follow a physicochemical grammar. This study explores the potential of Deep Learning models trained on protein sequences to predict protein thermostability which provide improvements with respect to current approaches. We implemented TemBERTure, a Deep Learning framework to classify the thermal class (non-thermophilic or thermophilic) and predict and melting temperature of a protein, based on its primary sequence. Our findings highlight the critical role that data diversity plays on training robust models. Models trained on datasets with a wider range of sequences from various organisms exhibited superior performance compared to those with limited diversity. This emphasizes the need for a comprehensive data curation strategy that ensures a balanced representation of diverse species in the training data, to avoid the risk that the model focuses on recognizing the evolutionary lineage of the sequence rather than the intrinsic thermostability features. In order to gain more nuanced insights into protein thermostability, we propose leveraging attention scores within Deep Learning models to gain more nuanced insights into protein thermostability. We show that analyzing these scores alongside the 3D protein structure could offer a better understanding of the complex interplay between amino acid properties, their positioning, and the surrounding microenvironment, all crucial factors influencing protein thermostability. This work sheds light on the limitations of current protein thermostability prediction methods and introduces new avenues for exploration. By emphasizing data diversity and utilizing refined attention scores, future research can pave the way for more accurate and informative methods for predicting protein thermostability.

Prediction of protein biophysical traits from limited data: a case study on nanobody thermostability through NanoMelt

TEMPRO: nanobody melting temperature estimation model using protein embeddings

Convolution Neural Network-Based Prediction of Protein Thermostability.

Transfer learning to leverage larger datasets for improved prediction of protein stability changes

TemBERTure: Advancing protein thermostability prediction with Deep Learning and attention mechanisms

BayeStab: Predicting Effects of Mutations on Protein Stability with Uncertainty Quantification

High‐throughput system for the thermostability analysis of proteins

Predicting a Protein's Stability under a Million Mutations

Assessing the Performance of Computational Predictors for Estimating Protein Stability Changes Upon Missense Mutations

Sequence-Based Nanobody-Antigen Binding Prediction

A learnable transition from low temperature to high temperature proteins with neural machine translation

Superior protein thermophilicity prediction with protein language model embeddings

Thermodynamic versus kinetic basis for the high conformational stability of nanobodies for therapeutic applications

Improved prediction of stabilizing mutations in proteins by incorporation of mutational effects on ligand binding

AI driven approaches in Nanobody Epitope Prediction: Are We There Yet?

Predicting Protein Thermostability Upon Mutation Using Molecular Dynamics Timeseries Data

Protein Fitness Prediction Is Impacted by the Interplay of Language Models, Ensemble Learning, and Sampling Methods

Comparison and evaluation of data-driven protein stability prediction models

Designing of thermostable proteins with a desired melting temperature

Quantification of biases in predictions of protein–protein binding affinity changes upon mutations