Abstract:Understanding protein thermostability is essential for various biotechnological and biological applications. However, traditional experimental methods for assessing this property are time-consuming, expensive, and error-prone. Recently, the application of Deep Learning techniques from Natural Language Processing (NLP) was extended to the field of biology, with an emphasis on protein modeling. From a linguistic perspective, the primary sequence of proteins can be viewed as a string of amino acids that follow a physicochemical grammar. This study explores the potential of Deep Learning models trained on protein sequences to predict protein thermostability which provide improvements with respect to current approaches. We implemented TemBERTure, a Deep Learning framework to classify the thermal class (non-thermophilic or thermophilic) and predict and melting temperature of a protein, based on its primary sequence. Our findings highlight the critical role that data diversity plays on training robust models. Models trained on datasets with a wider range of sequences from various organisms exhibited superior performance compared to those with limited diversity. This emphasizes the need for a comprehensive data curation strategy that ensures a balanced representation of diverse species in the training data, to avoid the risk that the model focuses on recognizing the evolutionary lineage of the sequence rather than the intrinsic thermostability features. In order to gain more nuanced insights into protein thermostability, we propose leveraging attention scores within Deep Learning models to gain more nuanced insights into protein thermostability. We show that analyzing these scores alongside the 3D protein structure could offer a better understanding of the complex interplay between amino acid properties, their positioning, and the surrounding microenvironment, all crucial factors influencing protein thermostability. This work sheds light on the limitations of current protein thermostability prediction methods and introduces new avenues for exploration. By emphasizing data diversity and utilizing refined attention scores, future research can pave the way for more accurate and informative methods for predicting protein thermostability.

DEVELOPMENT OF A MODEL FOR PREDICTING PROTEIN DENATURATION TEMPERATURE BY MACHINE LEARNING METHODS

Leveraging Multimodal Protein Representations to Predict Protein Melting Temperatures

TEMPRO: nanobody melting temperature estimation model using protein embeddings

Gene Prediction by the Noise-Assisted MEMD and Wavelet Transform for Identifying the Protein Coding Regions

An Accurate Prediction of Protein Melting Temperature Directly from Amino Acid Sequence

Designing of thermostable proteins with a desired melting temperature

DeepTM: A deep learning algorithm for prediction of melting temperature of thermophilic proteins directly from sequences

TemStaPro: protein thermostability prediction using sequence representations from protein language models

Prediction of Thermostability of Enzymes Based on the Amino Acid Index (AAindex) Database and Machine Learning

Cross-species vs species-specific models for protein melting temperature prediction

Superior protein thermophilicity prediction with protein language model embeddings

TemBERTure: Advancing protein thermostability prediction with Deep Learning and attention mechanisms

TemPL: A Novel Deep Learning Model for Zero-Shot Prediction of Protein Stability and Activity Based on Temperature-Guided Language Modeling

A learnable transition from low temperature to high temperature proteins with neural machine translation

An Efficient Method to Predict Protein Thermostability in Alanine Mutation

Enhancing Machine-Learning Prediction of Enzyme Catalytic Temperature Optima through Amino Acid Conservation Analysis

A melting temperature database and a neural network model for melting temperature prediction

Discrimination of psychrophilic enzymes using machine learning algorithms with amino acid composition descriptor

Prediction of thermophilic protein using 2-D general series correlation pseudo amino acid features

Transfer learning to leverage larger datasets for improved prediction of protein stability changes

Machine learning reveals hidden stability code in protein native fluorescence