Abstract:The twenty-first century is presenting humankind with unprecedented environmental and medical challenges. The ability to design novel proteins tailored for specific purposes would potentially transform our ability to respond to these issues in a timely manner. Recent advances in the field of artificial intelligence are now setting the stage to make this goal achievable. Protein sequences are inherently similar to natural languages: amino acids arrange in a multitude of combinations to form structures that carry function, the same way as letters form words and sentences carry meaning. Accordingly, it is not surprising that, throughout the history of natural language processing (NLP), many of its techniques have been applied to protein research problems. In the past few years we have witnessed revolutionary breakthroughs in the field of NLP. The implementation of transformer pre-trained models has enabled text generation with human-like capabilities, including texts with specific properties such as style or subject. Motivated by its considerable success in NLP tasks, we expect dedicated transformers to dominate custom protein sequence generation in the near future. Fine-tuning pre-trained models on protein families will enable the extension of their repertoires with novel sequences that could be highly divergent but still potentially functional. The combination of control tags such as cellular compartment or function will further enable the controllable design of novel protein functions. Moreover, recent model interpretability methods will allow us to open the 'black box' and thus enhance our understanding of folding principles. Early initiatives show the enormous potential of generative language models to design functional sequences. We believe that using generative text models to create novel proteins is a promising and largely unexplored field, and we discuss its foreseeable impact on protein design.

Illuminating protein space with a programmable generative model

Global-Context Aware Generative Protein Design

Chroma is a generative model for protein design

Generative De Novo Protein Design with Global Context

A high-level programming language for generative protein design

Generating Novel, Designable, and Diverse Protein Structures by Equivariantly Diffusing Oriented Residue Clouds

Protein Language Model Supervised Precise and Efficient Protein Backbone Design Method

Out of Many, One: Designing and Scaffolding Proteins at the Scale of the Structural Universe with Genie 2

Protein Design with Guided Discrete Diffusion

Generating All-Atom Protein Structure from Sequence-Only Training Data

Protein generation with evolutionary diffusion: sequence is all you need

A Latent Diffusion Model for Protein Structure Generation

Multistate and functional protein design using RoseTTAFold sequence space diffusion

Current Progress, Challenges, and Future Perspectives of Language Models for Protein Representation and Protein Design

De novo design of protein structure and function with RFdiffusion

Scalable emulation of protein equilibrium ensembles with generative deep learning

Controllable protein design with language models

Deep generative modeling for protein design

Conditional generative modeling for de novo protein design with hierarchical functions

Generative artificial intelligence for de novo protein design

Unifying Sequences, Structures, and Descriptions for Any-to-Any Protein Generation with the Large Multimodal Model HelixProtX