Abstract:Motivation There are now 225 million sequences in the UniProtKB database, as of January 2022 and 451 million protein sequences in the NCBI non-redundant database. This huge sequence data is ripe for analysis and can be extremely informative about biological function when analyzed with the appropriate methods. Evolutionary information such as the relationship among protein sequences is key to performing sequence analyses. Since sequence matching is one of the primary ways that annotations are found, higher-quality sequence matches yield a larger number of identified homologs. Thus, there is an essential need for a faster and more accurate homolog detection method to process the huge amount of rapidly growing biological sequences. Method Recently, we have seen major improvements in various predictive computational tasks such as structure prediction from the ever-improving artificial intelligence methods. One such approach has been to use language models to represent proteins numerically in a representation matrix (embeddings) while retaining context-dependent biochemical, biophysical, and evolutionary information. Computational transformer architectures that utilize attention neural networks can generate these context-aware numerical representations in an unsupervised fashion. One such use for these protein embeddings is remote homolog detection. In this work, we utilize protein language models and then apply discrete cosine transforms to extract the essential part of these embeddings, resulting in a significantly smaller fixed-size matrix for each sequence. This allows us to numerically and efficiently calculate the distance between all pairs of proteins resulting in homolog detection. Results Our Protein LAnguage model Search Tool (PLAST) is significantly faster, with linear runtimes in the number of sequences within the query database. With only one CPU core, it can scan a million sequences in less than a second. It essentially removes the noise in the sequence data and leads to significant improvements. PLAST is more accurate in the benchmarks tested from the PFAM, SCOP, and CATH databases than other approaches. When benchmarked with the PFAM database, the increase in the area under the receiver operating characteristic curve (AUROC) 3.1% when compared with NCBI-BLAST. The number of remote homologs that are detectable now is significantly larger and pushes sequence matches deeply into the usual twilight zone. Compared with the state-of-the-art profile-based homology search tools like CSBLAST, the increase was still 2.0%. PLAST can find remote homologs for a significant number of proteins that had been thought to be unique due to homolog detection failure. These homologs that are found usually have less than 20% sequence identity making them indistinguishable from noise with most other sequence matching methods. Conclusion PLAST is an accurate and fast homolog detection tool essential for easy and rapid progress to utilize the vast amount of data generated by next-generation sequencing methods. Quantization of sequence embeddings into highly-compressed noise-free representations with the use of direct cosine transforms allows for the efficient and accurate detection of normal homologs and remote ones that are un-detectable by other sequence similarity methods. The PLAST web server is accessible from https://mesihk.github.io/plast .

The Protein Language Visualizer: Sequence Similarity Networks for the Era of Language Models

InterPLM: Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders

ProtSpace: a tool for visualizing protein space

ProteinCLIP: enhancing protein language models with natural language

Exploring large protein sequence space through homology- and representation-based hierarchical clustering

Protein Language Model Performs Efficient Homology Detection

From a single sequence to evolutionary trajectories: protein language models capture the evolutionary potential of SARS-CoV-2 protein sequences

PEvoLM: Protein Sequence Evolutionary Information Language Model

Design Proteins Using Large Language Models: Enhancements and Comparative Analyses

Modeling the language of life – Deep Learning Protein Sequences

When Protein Structure Embedding Meets Large Language Models

Protein language model powers accurate and fast sequence search for remote homology

S-PLM: Structure-aware Protein Language Model via Contrastive Learning between Sequence and Structure

Structure-Infused Protein Language Models

Aggregating Residue-Level Protein Language Model Embeddings with Optimal Transport

Protein language models meet reduced amino acid alphabets

Decoding proteome functional information in model organisms using protein language models.

ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Texts

Modeling Protein Using Large-scale Pretrain Language Model

Neural Embeddings for Protein Graphs