Abstract:Protein language models, trained on millions of biologically observed sequences, generate feature-rich numerical representations of protein sequences. These representations, called sequence embeddings, can infer structure-functional properties, despite protein language models being trained on primary sequence alone. While sequence embeddings have been applied toward tasks such as structure and function prediction, applications toward alignment-free sequence classification have been hindered by the lack of studies to derive, quantify and evaluate relationships between protein sequence embeddings. Here, we develop workflows and visualization methods for the classification of protein families using sequence embedding derived from protein language models. A benchmark of manifold visualization methods reveals that Neighbor Joining (NJ) embedding trees are highly effective in capturing global structure while achieving similar performance in capturing local structure compared with popular dimensionality reduction techniques such as t-SNE and UMAP. The statistical significance of hierarchical clusters on a tree is evaluated by resampling embeddings using a variational autoencoder (VAE). We demonstrate the application of our methods in the classification of two well-studied enzyme superfamilies, phosphatases and protein kinases. Our embedding-based classifications remain consistent with and extend upon previously published sequence alignment-based classifications. We also propose a new hierarchical classification for the S-Adenosyl-L-Methionine (SAM) enzyme superfamily which has been difficult to classify using traditional alignment-based approaches. Beyond applications in sequence classification, our results further suggest NJ trees are a promising general method for visualizing high-dimensional data sets.

Exploring large protein sequence space through homology- and representation-based hierarchical clustering

ProteinInferencer: Confident protein identification and multiple experiment comparison for large scale proteomics projects

Tree visualizations of protein sequence embedding space enable improved functional clustering of diverse protein superfamilies

Clustering protein functional families at large scale with hierarchical approaches

The Protein Language Visualizer: Sequence Similarity Networks for the Era of Language Models

Latent Semantic Analysis-And Hierarchical Clustering-Based Method for Detecting Remote Protein Homology

Unveiling Conserved Allosteric Hot Spots in Protein Domains from Sequences

A Rapid Method for Characterization of Protein Relatedness Using Feature Vectors

Sensitive remote homology search by local alignment of small positional embeddings from protein language models

A Network of SCOP Hidden Markov Models and Its Analysis.

Towards Automatic Clustering of Protein Sequences

Protein Sequence Analysis Using the MPI Bioinformatics Toolkit

Interpolative Multidimensional Scaling Techniques for the Identification of Clusters in Very Large Sequence Sets

Combined alignments of sequences and domains characterize unknown proteins with remotely related protein search PSISearch2D

Guiding discovery of protein sequence-structure-function modeling

Combining Evolutionary Information Extracted From Frequency Profiles With Sequence-Based Kernels For Protein Remote Homology Detection

Large protein databases reveal structural complementarity and functional locality

A Network Filtration Protocol for Elucidating Relationships between Families in a Protein Similarity Network

A Novel Alignment-Free Vector Method to Cluster Protein Sequences

Mining Protein Sequence Motifs Representing Common 3D Structures.