Abstract:The twenty-first century is presenting humankind with unprecedented environmental and medical challenges. The ability to design novel proteins tailored for specific purposes would potentially transform our ability to respond to these issues in a timely manner. Recent advances in the field of artificial intelligence are now setting the stage to make this goal achievable. Protein sequences are inherently similar to natural languages: amino acids arrange in a multitude of combinations to form structures that carry function, the same way as letters form words and sentences carry meaning. Accordingly, it is not surprising that, throughout the history of natural language processing (NLP), many of its techniques have been applied to protein research problems. In the past few years we have witnessed revolutionary breakthroughs in the field of NLP. The implementation of transformer pre-trained models has enabled text generation with human-like capabilities, including texts with specific properties such as style or subject. Motivated by its considerable success in NLP tasks, we expect dedicated transformers to dominate custom protein sequence generation in the near future. Fine-tuning pre-trained models on protein families will enable the extension of their repertoires with novel sequences that could be highly divergent but still potentially functional. The combination of control tags such as cellular compartment or function will further enable the controllable design of novel protein functions. Moreover, recent model interpretability methods will allow us to open the 'black box' and thus enhance our understanding of folding principles. Early initiatives show the enormous potential of generative language models to design functional sequences. We believe that using generative text models to create novel proteins is a promising and largely unexplored field, and we discuss its foreseeable impact on protein design.

De novo protein design with a language model

Language models generalize beyond natural proteins

Designing proteins with language models

Generative artificial intelligence for de novo protein design

Generative De Novo Protein Design with Global Context

Controllable protein design with language models

Learning the protein language: Evolution, structure, and function

[De Novo Protein Design in the Age of Artificial Intelligence].

De novo protein design—From new structures to programmable functions

A high-level programming language for generative protein design

Large language models generate functional protein sequences across diverse families

Can AI design life?

Sonification based de novo protein design using artificial intelligence, structure prediction, and analysis using molecular modeling

Toward De Novo Protein Design from Natural Language

Atom-by-atom protein generation and beyond with language models

Artificial intelligence-aided protein engineering: from topological data analysis to deep protein language models

Current Progress, Challenges, and Future Perspectives of Language Models for Protein Representation and Protein Design

From sequence to function through structure: deep learning for protein design

Design in the DARK: Learning Deep Generative Models for De Novo Protein Design

Recent Progress Using De Novo Design to Study Protein Structure, Design and Binding Interactions