Abstract:Understanding protein thermostability is essential for various biotechnological and biological applications. However, traditional experimental methods for assessing this property are time-consuming, expensive, and error-prone. Recently, the application of Deep Learning techniques from Natural Language Processing (NLP) was extended to the field of biology, with an emphasis on protein modeling. From a linguistic perspective, the primary sequence of proteins can be viewed as a string of amino acids that follow a physicochemical grammar. This study explores the potential of Deep Learning models trained on protein sequences to predict protein thermostability which provide improvements with respect to current approaches. We implemented TemBERTure, a Deep Learning framework to classify the thermal class (non-thermophilic or thermophilic) and predict and melting temperature of a protein, based on its primary sequence. Our findings highlight the critical role that data diversity plays on training robust models. Models trained on datasets with a wider range of sequences from various organisms exhibited superior performance compared to those with limited diversity. This emphasizes the need for a comprehensive data curation strategy that ensures a balanced representation of diverse species in the training data, to avoid the risk that the model focuses on recognizing the evolutionary lineage of the sequence rather than the intrinsic thermostability features. In order to gain more nuanced insights into protein thermostability, we propose leveraging attention scores within Deep Learning models to gain more nuanced insights into protein thermostability. We show that analyzing these scores alongside the 3D protein structure could offer a better understanding of the complex interplay between amino acid properties, their positioning, and the surrounding microenvironment, all crucial factors influencing protein thermostability. This work sheds light on the limitations of current protein thermostability prediction methods and introduces new avenues for exploration. By emphasizing data diversity and utilizing refined attention scores, future research can pave the way for more accurate and informative methods for predicting protein thermostability.

HyperMPNN ‒ A general strategy to design thermostable proteins learned from hyperthermophiles

Transfer learning to leverage larger datasets for improved prediction of protein stability changes

A learnable transition from low temperature to high temperature proteins with neural machine translation

Designing of thermostable proteins with a desired melting temperature

DeepTM: A deep learning algorithm for prediction of melting temperature of thermophilic proteins directly from sequences

Robust deep learning based protein sequence design using ProteinMPNN

Convolution Neural Network-Based Prediction of Protein Thermostability.

Thermostable Proteins : Structural Stability and Design

Superior protein thermophilicity prediction with protein language model embeddings

Heat‐induced structural and chemical changes to a computationally designed miniprotein

Zero-shot transfer of protein sequence likelihood models to thermostability prediction

High‐throughput system for the thermostability analysis of proteins

Improving Protein Expression, Stability, and Function with ProteinMPNN

A general temperature-guided language model to design proteins of enhanced stability and activity

Protein stability prediction by fine-tuning a protein language model on a mega-scale dataset

Unbiased Curriculum Learning Enhanced Global-Local Graph Neural Network for Protein Thermodynamic Stability Prediction

Design of a Protein with Improved Thermal Stability by an Evolution‐Based Generative Model

Predicting a Protein's Stability under a Million Mutations

TemStaPro: protein thermostability prediction using sequence representations from protein language models

TemBERTure: Advancing protein thermostability prediction with Deep Learning and attention mechanisms

Towards an accurate prediction of the thermal stability of homologous proteins