Abstract:Therapeutic antibodies have become one of the most influential therapeutics in modern medicine to fight against infectious pathogens, cancer, and many other diseases. However, experimental screening for highly efficacious targeting antibodies is labor-intensive and of high cost, which is exacerbated by evolving antigen targets under selective pressure such as fast-mutating viral variants. As a proof-of-concept, we developed a machine learning-assisted antibody generation pipeline AbGen that greatly accelerates the screening and re-design of immunoglobulins G (IgGs) against a broad spectrum of SARS-CoV-2 coronavirus variant strains. Our AbGen centers around a novel antibody language model (AbLM) that is pretrained on 12 million generic protein domain sequences and fine-tuned on 4,000+ paired VH-VL sequences, with IgG-specific CDR-masking and VH-VL cross-attention. AbLM provides a latent space of IgG sequence embeddings for AbGen, including (a) landscapes of IgGs' activities in neutralizing the wild-type virus are analyzed through structure prediction for IgG and IgG-antigen (viral protein spike's receptor binding domain, RBD) interactions; and (b) landscapes of IgGs' susceptibility in neutralizing variant viruses are predicted through Gaussian process regression, despite that as few as 14 clinical antibodies' responses to variants of concern are available. The AbGen pipeline was applied to over 1300 IgG sequences we collected from RBD-binding B cells of convalescent patients. With experimental validations, AbGen efficiently prioritized IgG candidates against a broad spectrum of viral variants (wildtype, Delta, and Omicron), preventing the infection of host cells in vitro and hACE2 transgenic mice in vivo. Compared to other existing protein language models that require 10-100 times more model parameters, AbLM improved the precision from around 50% to 75% to predict IgGs with low variant susceptibility. Furthermore, AbGen enables structure-based computational protein redesign for selected IgG clones with single amino acid substitutions at the RBD-binding interface that doubled the IgG blockade efficacy for one of the severe, therapy-resistant strains - Delta (B.1.617). Our work expedites applications of artificial intelligence in antibody screen and re-design combining data-driven protein language models and Kriging for antibody sequence analysis and activity prediction, in synergy with physics-driven protein docking and design for antibody-antigen interface analyses and functional optimization.

Addressing the antibody germline bias and its effect on language models for improved antibody design

Addressing the antibody germline bias and its effect on language models for improved antibody design

Large scale paired antibody language models

Learning the Language of Antibody Hypervariability

Novel antibody language model accelerates IgG screening and design for broad-spectrum antiviral therapy

Deciphering antibody affinity maturation with language models and weakly supervised learning

Reprogramming Pretrained Language Models for Antibody Sequence Infilling

Learning the heterogeneous hypermutation landscape of immunoglobulins from high-throughput repertoire data

Focused learning by antibody language models using preferential masking of non-templated regions

Pre-training Antibody Language Models for Antigen-Specific Computational Antibody Design

On Pre-trained Language Models for Antibody

Improving antibody language models with native pairing

Generation of antigen-specific paired heavy-light chain antibody sequences using large language models

AbGPT: De Novo Antibody Design via Generative Language Modeling

Linguistics-based Formalization of the Antibody Language As a Basis for Antibody Language Models

Antibody optimization enabled by artificial intelligence predictions of binding affinity and naturalness

Efficient evolution of human antibodies from general protein language models and sequence information alone

Generative Antibody Design for Complementary Chain Pairing Sequences through Encoder-Decoder Language Model

AlphaBind, a Domain-Specific Model to Predict and Optimize Antibody-Antigen Binding Affinity

Benchmarking Inverse Folding Models for Antibody CDR Sequence Design

Protein language models enable prediction of polyreactivity of monospecific, bispecific, and heavy-chain-only antibodies