Abstract:Motivation There are now 225 million sequences in the UniProtKB database, as of January 2022 and 451 million protein sequences in the NCBI non-redundant database. This huge sequence data is ripe for analysis and can be extremely informative about biological function when analyzed with the appropriate methods. Evolutionary information such as the relationship among protein sequences is key to performing sequence analyses. Since sequence matching is one of the primary ways that annotations are found, higher-quality sequence matches yield a larger number of identified homologs. Thus, there is an essential need for a faster and more accurate homolog detection method to process the huge amount of rapidly growing biological sequences. Method Recently, we have seen major improvements in various predictive computational tasks such as structure prediction from the ever-improving artificial intelligence methods. One such approach has been to use language models to represent proteins numerically in a representation matrix (embeddings) while retaining context-dependent biochemical, biophysical, and evolutionary information. Computational transformer architectures that utilize attention neural networks can generate these context-aware numerical representations in an unsupervised fashion. One such use for these protein embeddings is remote homolog detection. In this work, we utilize protein language models and then apply discrete cosine transforms to extract the essential part of these embeddings, resulting in a significantly smaller fixed-size matrix for each sequence. This allows us to numerically and efficiently calculate the distance between all pairs of proteins resulting in homolog detection. Results Our Protein LAnguage model Search Tool (PLAST) is significantly faster, with linear runtimes in the number of sequences within the query database. With only one CPU core, it can scan a million sequences in less than a second. It essentially removes the noise in the sequence data and leads to significant improvements. PLAST is more accurate in the benchmarks tested from the PFAM, SCOP, and CATH databases than other approaches. When benchmarked with the PFAM database, the increase in the area under the receiver operating characteristic curve (AUROC) 3.1% when compared with NCBI-BLAST. The number of remote homologs that are detectable now is significantly larger and pushes sequence matches deeply into the usual twilight zone. Compared with the state-of-the-art profile-based homology search tools like CSBLAST, the increase was still 2.0%. PLAST can find remote homologs for a significant number of proteins that had been thought to be unique due to homolog detection failure. These homologs that are found usually have less than 20% sequence identity making them indistinguishable from noise with most other sequence matching methods. Conclusion PLAST is an accurate and fast homolog detection tool essential for easy and rapid progress to utilize the vast amount of data generated by next-generation sequencing methods. Quantization of sequence embeddings into highly-compressed noise-free representations with the use of direct cosine transforms allows for the efficient and accurate detection of normal homologs and remote ones that are un-detectable by other sequence similarity methods. The PLAST web server is accessible from https://mesihk.github.io/plast .

Detection of circular permutations by Protein Language Models

Comprehensive Database of Circular Permutations: Systematic Detection and Analysis Using Deep Learning

InstructPLM: Aligning Protein Language Models to Follow Protein Structure Instructions

Protein language models meet reduced amino acid alphabets

Peptide Sequencing Via Protein Language Models

Bilingual Language Model for Protein Sequence and Structure

PLM-interact: extending protein language models to predict protein-protein interactions

Design Proteins Using Large Language Models: Enhancements and Comparative Analyses

Protein Language Model Performs Efficient Homology Detection

Exploring evolution-aware & -free protein language models as protein function predictors

Exploiting protein language model sequence representations for repeat detection

From PSSM to Pre-Trained Language Models

Modeling Protein Using Large-scale Pretrain Language Model

Protein Language Models and Structure Prediction: Connection and Progression

Protein language models learn evolutionary statistics of interacting sequence motifs

Protein language model powers accurate and fast sequence search for remote homology

Structure-Informed Protein Language Model

From a single sequence to evolutionary trajectories: protein language models capture the evolutionary potential of SARS-CoV-2 protein sequences

A PLMs based protein retrieval framework

Protein Language Model Fitness Is a Matter of Preference

wwLearning the language of proteins and predicting the impact of mutations