Abstract:Therapeutic antibodies have become one of the most influential therapeutics in modern medicine to fight against infectious pathogens, cancer, and many other diseases. However, experimental screening for highly efficacious targeting antibodies is labor-intensive and of high cost, which is exacerbated by evolving antigen targets under selective pressure such as fast-mutating viral variants. As a proof-of-concept, we developed a machine learning-assisted antibody generation pipeline AbGen that greatly accelerates the screening and re-design of immunoglobulins G (IgGs) against a broad spectrum of SARS-CoV-2 coronavirus variant strains. Our AbGen centers around a novel antibody language model (AbLM) that is pretrained on 12 million generic protein domain sequences and fine-tuned on 4,000+ paired VH-VL sequences, with IgG-specific CDR-masking and VH-VL cross-attention. AbLM provides a latent space of IgG sequence embeddings for AbGen, including (a) landscapes of IgGs' activities in neutralizing the wild-type virus are analyzed through structure prediction for IgG and IgG-antigen (viral protein spike's receptor binding domain, RBD) interactions; and (b) landscapes of IgGs' susceptibility in neutralizing variant viruses are predicted through Gaussian process regression, despite that as few as 14 clinical antibodies' responses to variants of concern are available. The AbGen pipeline was applied to over 1300 IgG sequences we collected from RBD-binding B cells of convalescent patients. With experimental validations, AbGen efficiently prioritized IgG candidates against a broad spectrum of viral variants (wildtype, Delta, and Omicron), preventing the infection of host cells in vitro and hACE2 transgenic mice in vivo. Compared to other existing protein language models that require 10-100 times more model parameters, AbLM improved the precision from around 50% to 75% to predict IgGs with low variant susceptibility. Furthermore, AbGen enables structure-based computational protein redesign for selected IgG clones with single amino acid substitutions at the RBD-binding interface that doubled the IgG blockade efficacy for one of the severe, therapy-resistant strains - Delta (B.1.617). Our work expedites applications of artificial intelligence in antibody screen and re-design combining data-driven protein language models and Kriging for antibody sequence analysis and activity prediction, in synergy with physics-driven protein docking and design for antibody-antigen interface analyses and functional optimization.

DG-Affinity: predicting antigen–antibody affinity with language models from sequences

AntiFormer: graph enhanced large language model for binding affinity prediction

Deciphering antibody affinity maturation with language models and weakly supervised learning

AttABseq: an Attention-Based Deep Learning Prediction Method for Antigen-Antibody Binding Affinity Changes Based on Protein Sequences.

ImmunoLingo: Linguistics-based formalization of the antibody language

AbAgIntPre: A Deep Learning Method for Predicting Antibody-Antigen Interactions Based on Sequence Information

Machine learning prediction of Antibody-Antigen binding: dataset, method and testing

Large scale paired antibody language models

Antibody optimization enabled by artificial intelligence predictions of binding affinity and naturalness

MVSF-AB: Accurate antibody-antigen binding affinity prediction via multi-view sequence feature learning

Novel antibody language model accelerates IgG screening and design for broad-spectrum antiviral therapy

A Comparison of Antibody-Antigen Complex Sequence-to-Structure Prediction Methods and their Systematic Biases

Linguistics-based Formalization of the Antibody Language As a Basis for Antibody Language Models

Deep Geometric Framework to Predict Antibody-Antigen Binding Affinity

Accurate Prediction of Antibody Function and Structure Using Bio-Inspired Antibody Language Model

IgGM: A Generative Model for Functional Antibody and Nanobody Design

Learning the Language of Antibody Hypervariability

Sequence-based deep learning antibody design for in silico antibody affinity maturation

Addressing the antibody germline bias and its effect on language models for improved antibody design

Protein language models enable prediction of polyreactivity of monospecific, bispecific, and heavy-chain-only antibodies