Fine-tuning Protein Embeddings for Functional Similarity Evaluation

Andrew Dickson,Mohammad R K Mofrad
DOI: https://doi.org/10.1093/bioinformatics/btae445
IF: 5.8
2024-07-10
Bioinformatics
Abstract:Abstract Motivation Protein’s with unknown function are frequently compared to better characterized relatives, either using sequence similarity, or recently through similarity in a learned embedding space. Through comparison, protein sequence embeddings allow for interpretable and accurate annotation of proteins, as well as for downstream tasks such as clustering for unsupervised discovery of protein families. However, it’s unclear whether embeddings can be deliberately designed to improve their use in these downstream tasks. Results We find that for functional annotation of proteins, as represented by Gene Ontology (GO) terms, direct fine-tuning of language models on a simple classification loss has an immediate positive impact on protein embedding quality. Fine-tuned embeddings show stronger performance as representations for K-nearest neighbor classifiers, reaching stronger performance for GO annotation than even directly comparable fine-tuned classifiers, while maintaining interpretability through protein similarity comparisons. They also maintain their quality in related tasks, such as rediscovering protein families with clustering. Availability github.com/mofradlab/go_metric Supplementary information Supplementary data are available at Bioinformatics online.
biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
What problem does this paper attempt to address?