Abstract:Therapeutic antibodies have become one of the most influential therapeutics in modern medicine to fight against infectious pathogens, cancer, and many other diseases. However, experimental screening for highly efficacious targeting antibodies is labor-intensive and of high cost, which is exacerbated by evolving antigen targets under selective pressure such as fast-mutating viral variants. As a proof-of-concept, we developed a machine learning-assisted antibody generation pipeline AbGen that greatly accelerates the screening and re-design of immunoglobulins G (IgGs) against a broad spectrum of SARS-CoV-2 coronavirus variant strains. Our AbGen centers around a novel antibody language model (AbLM) that is pretrained on 12 million generic protein domain sequences and fine-tuned on 4,000+ paired VH-VL sequences, with IgG-specific CDR-masking and VH-VL cross-attention. AbLM provides a latent space of IgG sequence embeddings for AbGen, including (a) landscapes of IgGs' activities in neutralizing the wild-type virus are analyzed through structure prediction for IgG and IgG-antigen (viral protein spike's receptor binding domain, RBD) interactions; and (b) landscapes of IgGs' susceptibility in neutralizing variant viruses are predicted through Gaussian process regression, despite that as few as 14 clinical antibodies' responses to variants of concern are available. The AbGen pipeline was applied to over 1300 IgG sequences we collected from RBD-binding B cells of convalescent patients. With experimental validations, AbGen efficiently prioritized IgG candidates against a broad spectrum of viral variants (wildtype, Delta, and Omicron), preventing the infection of host cells in vitro and hACE2 transgenic mice in vivo. Compared to other existing protein language models that require 10-100 times more model parameters, AbLM improved the precision from around 50% to 75% to predict IgGs with low variant susceptibility. Furthermore, AbGen enables structure-based computational protein redesign for selected IgG clones with single amino acid substitutions at the RBD-binding interface that doubled the IgG blockade efficacy for one of the severe, therapy-resistant strains - Delta (B.1.617). Our work expedites applications of artificial intelligence in antibody screen and re-design combining data-driven protein language models and Kriging for antibody sequence analysis and activity prediction, in synergy with physics-driven protein docking and design for antibody-antigen interface analyses and functional optimization.

Ab-Amy 2.0: Predicting light chain amyloidogenic risk of therapeutic antibodies based on antibody language model

AB-Amy: machine learning aided Amyloidogenic risk prediction of therapeutic antibody light chains

Accurate prediction of antibody deamidations by combining high-throughput automated peptide mapping and protein language model-based deep learning

The Accurate Prediction of Antibody Deamidations by Combining High-Throughput Automated Peptide Mapping and Protein Language Model-Based Deep Learning

Protein language models enable prediction of polyreactivity of monospecific, bispecific, and heavy-chain-only antibodies

AbImmPred: An immunogenicity prediction method for therapeutic antibodies using AntiBERTy-based sequence features

Novel antibody language model accelerates IgG screening and design for broad-spectrum antiviral therapy

ABTrans: A Transformer-based Model for Predicting Interaction between Anti-Aβ Antibodies and Peptides

Learning the Language of Antibody Hypervariability

Addressing the antibody germline bias and its effect on language models for improved antibody design

Re-Engineering Therapeutic Anti-Aβ Monoclonal Antibody to Target Amyloid Light Chain

SSH2.0: A Better Tool for Predicting the Hydrophobic Interaction Risk of Monoclonal Antibody

Accurate prediction of antibody function and structure using bio-inspired antibody language model

Machine learning prediction of antibody aggregation and viscosity for high concentration formulation development of protein therapeutics

AntiFormer: graph enhanced large language model for binding affinity prediction

iAmyP: A Multi-view Learning for Amyloidogenic Hexapeptides Identification Based on Sequence Least Squares Programming

AI-based IsAb2.0 for antibody design

Pre-training Antibody Language Models for Antigen-Specific Computational Antibody Design

PROPERMAB: an integrative framework for in silico prediction of antibody developability using machine learning