Vaccine efficacy: demystifying an epidemiological concept

Sorana Froda,Fabrice Larribe

DOI: https://doi.org/10.48550/arXiv.2107.12336

2021-07-22

Populations and Evolution

Abstract:The paper is an introduction to the concept of vaccine efficacy and its practical applications. We provide illustrative examples aimed at a wider audience.

What problem does this paper attempt to address?

Distinguishing immunological and behavioral effects of vaccination

Mats Stensrud,Daniel Nevo,Uri Obolski

DOI: https://doi.org/10.48550/arXiv.2311.08335

2023-11-14

Applications

Abstract:The interpretation of vaccine efficacy estimands is subtle, even in randomized trials designed to quantify immunological effects of vaccination. In this article, we introduce terminology to distinguish between different vaccine efficacy estimands and clarify their interpretations. This allows us to explicitly consider immunological and behavioural effects of vaccination, and establish that policy-relevant estimands can differ substantially from those commonly reported in vaccine trials. We further show that a conventional vaccine trial allows identification and estimation of different vaccine estimands under plausible conditions, if one additional post-treatment variable is measured. Specifically, we utilize a ``belief variable'' that indicates the treatment an individual believed they had received. The belief variable is similar to ``blinding assessment'' variables that are occasionally collected in placebo-controlled trials in other fields. We illustrate the relations between the different estimands, and their practical relevance, in numerical examples based on an influenza vaccine trial.
Lay understanding of vaccine efficacy.

Alison E. Butler,Gretchen B. Chapman

DOI: https://doi.org/10.1037/mac0000197

2024-10-19

Journal of Applied Research in Memory and Cognition

Abstract:Although perceived vaccine efficacy is strongly associated with vaccination behavior, little is known about how well laypeople understand what vaccine efficacy rates mean. Three experiments ( N = 3,402) explored errors in how laypeople process numerical information about vaccine efficacy rates and examined the effects of three tutorial interventions designed to bring lay perceptions in line with normative efficacy calculations. Findings indicate that responses to questions about efficacy rate tend to align with normatively correct calculations, whereas responses to questions about the rate of infections indicate an incorrect calculation whereby the postvaccination risk of infection is assumed to be the efficacy rate subtracted from 100%. Both quantitative and conceptual tutorial interventions helped participants calculate efficacy rates that were more aligned with the normatively correct values and infection rates that were less aligned with the incorrect values, particularly when participants had higher numeracy levels or responded with numeric inputs rather than choices between options. (PsycInfo Database Record (c) 2024 APA, all rights reserved)

psychology, experimental
Distinguishing Immunologic and Behavioral Effects of Vaccination

Mats J. Stensrud,Daniel Nevo,Uri Obolski

DOI: https://doi.org/10.1097/ede.0000000000001699

2024-01-31

Epidemiology

Abstract:The interpretation of vaccine efficacy estimands is subtle, even in randomized trials designed to quantify the immunologic effects of vaccination. In this article, we introduce terminology to distinguish between different vaccine efficacy estimands and clarify their interpretations. This allows us to explicitly consider the immunologic and behavioral effects of vaccination, and establish that policy-relevant estimands can differ substantially from those commonly reported in vaccine trials. We further show that a conventional vaccine trial allows the identification and estimation of different vaccine estimands under plausible conditions if one additional post-treatment variable is measured. Specifically, we utilize a "belief variable" that indicates the treatment an individual believed they had received. The belief variable is similar to "blinding assessment" variables that are occasionally collected in placebo-controlled trials in other fields. We illustrate the relations between the different estimands, and their practical relevance, in numerical examples based on an influenza vaccine trial.

public, environmental & occupational health
Elucidating vaccine efficacy using a correlate of protection, demographics, and logistic regression

Julie Dudášová,Zdeněk Valenta,Jeffrey R. Sachs

DOI: https://doi.org/10.1186/s12874-024-02197-3

2024-05-01

BMC Medical Research Methodology

Abstract:Vaccine efficacy (VE) assessed in a randomized controlled clinical trial can be affected by demographic, clinical, and other subject-specific characteristics evaluated as baseline covariates. Understanding the effect of covariates on efficacy is key to decisions by vaccine developers and public health authorities.

health care sciences & services
A guide to vaccinology: from basic principles to new developments

Andrew J. Pollard,Else M. Bijker

DOI: https://doi.org/10.1038/s41577-020-00479-7

IF: 108.555

2020-12-22

Nature Reviews Immunology

Abstract:Immunization is a cornerstone of public health policy and is demonstrably highly cost-effective when used to protect child health. Although it could be argued that immunology has not thus far contributed much to vaccine development, in that most of the vaccines we use today were developed and tested empirically, it is clear that there are major challenges ahead to develop new vaccines for difficult-to-target pathogens, for which we urgently need a better understanding of protective immunity. Moreover, recognition of the huge potential and challenges for vaccines to control disease outbreaks and protect the older population, together with the availability of an array of new technologies, make it the perfect time for immunologists to be involved in designing the next generation of powerful immunogens. This Review provides an introductory overview of vaccines, immunization and related issues and thereby aims to inform a broad scientific audience about the underlying immunological concepts.

immunology
Evaluation of Vaccine Immunogenicity—Correlates to Real-World Protection: Influenza

Csaba Laszlofy,Gyorgy Fazekas,Zoltan Barath,Zoltan Vajo

DOI: https://doi.org/10.3390/v16030441

2024-03-12

Viruses

Abstract:Recent events highlighted that, despite decades of studying vaccine immunogenicity and efforts toward finding correlates of protection, evaluating real-world vaccine efficacy as well as establishing meaningful licensing criteria still represents a significant challenge. In this paper, we review all aspects of influenza vaccine immunogenicity, including animal and human challenge studies, humoral and cellular immunity parameters, and their potential correlation with real-life protection from disease.

virology
Improved Methods for Vaccine Effectiveness Studies

George N Okoli,Benjamin J Cowling

DOI: https://doi.org/10.1093/infdis/jiae510

2024-10-15

The Journal of Infectious Diseases

Abstract:Evaluating the impact of public health investments in vaccination programs is crucial for ensuring their efficiency and effectiveness. Vaccine effectiveness (VE) studies, such as those using the test-negative design (TND), are commonly used to confirm the impact of vaccines and to guide future improvements. The TND, favored for its simplicity and cost efficiency, mitigates biases common in other epidemiological study designs. However, its validity can be compromised by inconsistent symptom definitions and retrospective data application. Here we summarize recent findings that highlight the need to address correlated vaccination behaviors when estimating VE, that suggest using negative control variables to reduce confounding, and that recommend accounting for prior infection history in VE studies to improve accuracy and reliability. These insights are important for refining VE estimation methods.

immunology,infectious diseases,microbiology
The broader benefits of vaccines: methodologies for inclusion in economic evaluation

Steven Simoens,Sandy Tubeuf,Nicolas Dauby,Olivier Ethgen,Sophie Marbaix,Marjan Willaert,Jeroen Luyten

DOI: https://doi.org/10.1080/14760584.2024.2387599

Abstract:Background: As the societal value of vaccines is increasingly recognized, there is a need to examine methodological approaches that could be used to integrate these various benefits in the economic evaluation of a vaccine. Research design and methods: A literature review and two expert panel meetings explored methodologies to value herd immunity, health spillover effects (beyond herd immunity), impact on antimicrobial resistance, productivity, and equity implications of vaccines. Results: The consideration of broader benefits of vaccines in economic evaluation is complicated and necessitates technical expertise. Whereas methodologies to account for herd immunity and work productivity are relatively well established, approaches to investigate equity implications are developing and less frequently applied. Modeling the potential impact on antimicrobial resistance not only depends on the multi-faceted causal relationship between vaccination and resistance but also on data availability. Conclusions: Different methods are available to value the broad impact of vaccines, and it is important that analysts are aware of their strengths and limitations and justify their choice of method. In the future, we expect that an increasing number of economic evaluations will consider the broader benefits of vaccines as part of their base-case analysis or in sensitivity analyses.
Reverse development of vaccines against antimicrobial-resistant pathogens

Fabio Bagnoli,Ilaria Galgani,V. Kumaran Vadivelu,Sanjay Phogat

DOI: https://doi.org/10.1038/s41541-024-00858-4

2024-04-04

npj Vaccines

Abstract:Vaccine R&D is typically a lengthy process taking >10 years. However, vaccines still fail in clinical development because of unreliable animal models or absent immunological correlates of protection. Without a correlate of protection, phase-1 and -2 studies of safety and immunogenicity can fail to predict phase-3 efficacy. Indeed, the history of vaccine development is replete with promising phase-1 and -2 results and failed phase-3 efficacy trials. To avoid this misfortune, we present Reverse Vaccine Development for vaccines against antimicrobial-resistant (AMR) pathogens. In this approach, instead of evaluating efficacy in phase 3, proof-of-principle efficacy is evaluated as early as possible in a population with a high incidence of disease, which may differ from the population intended for registration, and can be a controlled human infection population. To identify a correlate of protection in these populations, the vaccine-elicited immune response is compared between protected and unprotected subjects. If a correlate is identified, it can help to refine the vaccine dosage, schedule, and formulation, and facilitate the assessment of vaccine efficacy in other populations with different attack rates, subject characteristics, and disease manifestations. This may be the only way to provide life-saving vaccines to populations affected by AMR-pathogen diseases at incidences that are typically low and unsuited to phase-3 efficacy trials. The availability of a correlate of protection early in clinical development can potentially prevent failures of large phase-3 trials and unnecessary exposures of populations to inefficacious vaccines that have resulted in disinvestment in the development of vaccines against AMR pathogens.

immunology,medicine, research & experimental
Vaccine hesitancy, misinformation in the era of Covid-19: Lessons from the past

D Orsini,R Bianucci,F M Galassi,D Lippi,M Martini

DOI: https://doi.org/10.1016/j.jemep.2022.100812

Abstract:Background: As the world has challenged/argued with the Covid-19 pandemic over the last two years, there has been an increase in vaccine misinformation. Although immunity against Covid-19 infection is limited to 4-6 months and requires at least three doses of vaccine to be maximally effective, the current vaccination campaign in industrialized countries shows that vaccinated citizens experience greater immunological protection against severe forms of the disease than unvaccinated citizens. Methodology: A perusal of the literature was performed in order to reconstruct the communication methods applied in the managing of the Covid-19 pandemic; the management of the current pandemic was compared with the management of another scourge of the past: poliomyelitis. Results/discussion: In order to raise public awareness on public health issues, it is essential that governments and institutions communicate scientific data to all sections of the population in an unambiguous way. In this sense, it is essential to apply "prebunking", which is a layered defense system available to society that prevents misinformation before it is spread. This is to avoid the subsequent debunking of false information, which generates insecurity and fuels fears. Belief in medical misinformation represents a meaningful problem for public health efforts to fight Covid-19 through vaccination. Conclusion/perspectives: In this sense an example of proper management of one of the many epidemics of the recent past, poliomyelitis, should make us reflect on the effectiveness of past approaches. This testimony from the past can provide us with food for thought regarding how to face the present Covid-19 pandemic and to prepare for the future. Certainly, it shows us how the awful pandemics/epidemics from the past was handled and finally overcome, despite perceived risk and vaccine hesitancy.
Estimating vaccine efficacy during open-label follow-up of COVID-19 vaccine trials based on population-level surveillance data

Mia Moore,Yifan Zhu,Ian Hirsch,Tom White,Robert C. Reiner,Ryan M. Barber,David Pigott,James K. Collins,Serena Santoni,Magdalena E. Sobieszczyk,Holly Janes

DOI: https://doi.org/10.1016/j.epidem.2024.100768

IF: 5.324

2024-04-16

Epidemics

Abstract:While rapid development and roll out of COVID-19 vaccines is necessary in a pandemic, the process limits the ability of clinical trials to assess longer-term vaccine efficacy. We leveraged COVID-19 surveillance data in the U.S. to evaluate vaccine efficacy in U.S. Government-funded COVID-19 vaccine efficacy trials with a three-step estimation process. First, we used a compartmental epidemiological model informed by county-level surveillance data, a "population model", to estimate SARS-CoV-2 incidence among the unvaccinated. Second, a "cohort model" was used to adjust the population SARS-CoV-2 incidence to the vaccine trial cohort, taking into account individual participant characteristics and the difference between SARS-CoV-2 infection and COVID-19 disease. Third, we fit a regression model estimating the offset between the cohort-model-based COVID-19 incidence in the unvaccinated with the placebo-group COVID-19 incidence in the trial during blinded follow-up. Counterfactual placebo COVID-19 incidence was estimated during open-label follow-up by adjusting the cohort-model-based incidence rate by the estimated offset. Vaccine efficacy during open-label follow-up was estimated by contrasting the vaccine group COVID-19 incidence with the counterfactual placebo COVID-19 incidence. We documented good performance of the methodology in a simulation study. We also applied the methodology to estimate vaccine efficacy for the two-dose AZD1222 COVID-19 vaccine using data from the phase 3 U.S. trial (ClinicalTrials.gov # NCT04516746). We estimated AZD1222 vaccine efficacy of 59.1% (95% uncertainty interval (UI): 40.4%–74.3%) in April, 2021 (mean 106 days post-second dose), which reduced to 35.7% (95% UI: 15.0%–51.7%) in July, 2021 (mean 198 days post-second-dose). We developed and evaluated a methodology for estimating longer-term vaccine efficacy. This methodology could be applied to estimating counterfactual placebo incidence for future placebo-controlled vaccine efficacy trials of emerging pathogens with early termination of blinded follow-up, to active-controlled or uncontrolled COVID-19 vaccine efficacy trials, and to other clinical endpoints influenced by vaccination.

infectious diseases
Evolution of the data and methods in real-world COVID-19 vaccine effectiveness studies on mortality: a scoping review protocol

Paulina Stehlik,Caroline Dowsett,Ximena Camacho,Michael O Falster,Renly Lim,Sharifa Nasreen,Nicole L Pratt,Sallie-Anne Pearson,David Henry,Stehlik,P.,Dowsett,C.,Camacho,X.,Falster,M. O.,Lim,R.,Nasreen,S.,Pratt,N. L.,Pearson,S.-A.,Henry,D.

DOI: https://doi.org/10.1136/bmjopen-2023-079071

IF: 3.006

2024-03-20

BMJ Open

Abstract:Background Early evidence on COVID-19 vaccine efficacy came from randomised trials. Many important questions subsequently about vaccine effectiveness (VE) have been addressed using real-world studies (RWS) and have informed most vaccination policies globally. As the questions about VE have evolved during the pandemic so have data, study design, and analytical choices. This scoping review aims to characterise this evolution and provide insights for future pandemic planning—specifically, what kinds of questions are asked at different stages of a pandemic, and what data infrastructure and methods are used? Methods and analysis We will identify relevant studies in the Johns Hopkins Bloomberg School of Public Health VIEW-hub database, which curates both published and preprint VE RWS identified from PubMed, Embase, Scopus, Web of Science, the WHO COVID Database, MMWR, Eurosurveillance, medRxiv, bioRxiv, SSRN, Europe PMC, Research Square, Knowledge Hub, and Google. We will include RWS of COVID-19 VE that reported COVID-19-specific or all-cause mortality (coded as 'death' in the 'effectiveness studies' data set). Information on study characteristics; study context; data sources; design and analytic methods that address confounding will be extracted by single reviewer and checked for accuracy and discussed in a small group setting by methodological and analytic experts. A timeline mapping approach will be used to capture the evolution of this body of literature. By describing the evolution of RWS of VE through the COVID-19 pandemic, we will help identify options for VE studies and inform policy makers on the minimal data and analytic infrastructure needed to support rapid RWS of VE in future pandemics and of healthcare strategies more broadly. Ethics and dissemination As data is in the public domain, ethical approval is not required. Findings of this study will be disseminated through peer-reviewed publications, conference presentations, and working-papers to policy makers. Registration https://doi.org/10.17605/OSF.IO/ZHDKR

medicine, general & internal
Reverse vaccinology in the 21st century: improvements over the original design

Claudio Donati,Rino Rappuoli

DOI: https://doi.org/10.1111/nyas.12046

IF: 6.499

2013-03-25

Annals of the New York Academy of Sciences

Abstract:Reverse vaccinology (RV), the first application of genomic technologies in vaccine research, represented a major revolution in the process of discovering novel vaccines. By determining their entire antigenic repertoire, researchers could identify protective targets and design efficacious vaccines for pathogens where conventional approaches had failed. Bexsero, the first vaccine developed using RV, has recently received positive opinion from the European Medicines Agency. The use of RV initiated a cascade of changes that affected the entire vaccine development process, shifting the focus from the identification of a list of vaccine candidates to the definition of a set of high throughput screens to reduce the need for costly and labor intensive tests in animal models. It is now clear that a deep understanding of the epidemiology of vaccine candidates, and their regulation and role in host-pathogen interactions, must become an integral component of the screening workflow. Far from being outdated by technological advancements, RV still represents a paradigm of how high-throughput technologies and scientific insight can be integrated into biotechnology research.

multidisciplinary sciences
Vaccine Effects on Heterogeneity in Susceptibility and Implications for Population Health Management

Barbara J. Rutan,Nicholas A. Egan,BJ Rutan,M. Gomes,Pedro Sá-Guimarães,Min Sun Kim,Jessie R Viss,Kate e. Langwig,AR Wargo,G. Kurath,Marc Lipsitcha,KE Langwig,A. Wargo,Darbi R. Jones

DOI: https://doi.org/10.1128/mBio.00796-17

IF: 6.4

2017-11-21

mBio

Abstract:ABSTRACT Heterogeneity in host susceptibility is a key determinant of infectious disease dynamics but is rarely accounted for in assessment of disease control measures. Understanding how susceptibility is distributed in populations, and how control measures change this distribution, is integral to predicting the course of epidemics with and without interventions. Using multiple experimental and modeling approaches, we show that rainbow trout have relatively homogeneous susceptibility to infection with infectious hematopoietic necrosis virus and that vaccination increases heterogeneity in susceptibility in a nearly all-or-nothing fashion. In a simple transmission model with an R0 of 2, the highly heterogeneous vaccine protection would cause a 35 percentage-point reduction in outbreak size over an intervention inducing homogenous protection at the same mean level. More broadly, these findings provide validation of methodology that can help to reduce biases in predictions of vaccine impact in natural settings and provide insight into how vaccination shapes population susceptibility. IMPORTANCE Differences among individuals influence transmission and spread of infectious diseases as well as the effectiveness of control measures. Control measures, such as vaccines, may provide leaky protection, protecting all hosts to an identical degree, or all-or-nothing protection, protecting some hosts completely while leaving others completely unprotected. This distinction can have a dramatic influence on disease dynamics, yet this distribution of protection is frequently unaccounted for in epidemiological models and estimates of vaccine efficacy. Here, we apply new methodology to experimentally examine host heterogeneity in susceptibility and mode of vaccine action as distinct components influencing disease outcome. Through multiple experiments and new modeling approaches, we show that the distribution of vaccine effects can be robustly estimated. These results offer new experimental and inferential methodology that can improve predictions of vaccine effectiveness and have broad applicability to human, wildlife, and ecosystem health. IMPORTANCE Differences among individuals influence transmission and spread of infectious diseases as well as the effectiveness of control measures. Control measures, such as vaccines, may provide leaky protection, protecting all hosts to an identical degree, or all-or-nothing protection, protecting some hosts completely while leaving others completely unprotected. This distinction can have a dramatic influence on disease dynamics, yet this distribution of protection is frequently unaccounted for in epidemiological models and estimates of vaccine efficacy. Here, we apply new methodology to experimentally examine host heterogeneity in susceptibility and mode of vaccine action as distinct components influencing disease outcome. Through multiple experiments and new modeling approaches, we show that the distribution of vaccine effects can be robustly estimated. These results offer new experimental and inferential methodology that can improve predictions of vaccine effectiveness and have broad applicability to human, wildlife, and ecosystem health.

Environmental Science,Medicine
Improving precision of vaccine efficacy evaluation using immune correlate data in time-to-event models

Julie Dudášová,Zdeněk Valenta,Jeffrey R. Sachs

DOI: https://doi.org/10.1038/s41541-024-00937-6

2024-11-13

npj Vaccines

Abstract:Understanding potential differences in vaccine-induced protection between demographic subgroups is key for vaccine development. Vaccine efficacy evaluation across these subgroups in phase 2b or 3 clinical trials presents challenges due to lack of precision: such trials are typically designed to demonstrate overall efficacy rather than to differentiate its value between subgroups. This study proposes a method for estimating vaccine efficacy using immunogenicity (instead of vaccination status) as a predictor in time-to-event models. The method is applied to two datasets from immunogenicity sub-studies of vaccine phase 3 clinical trials for zoster and dengue vaccines. Results show that using immunogenicity-based estimation of efficacy in subgroups using time-to-event models is more precise than the standard estimation. Incorporating immune correlate data in time-to-event models improves precision in estimating efficacy (i.e., yields narrower confidence intervals), which can assist vaccine developers and public health authorities in making informed decisions.

immunology,medicine, research & experimental
Vaccine efficacy for binary post-infection outcomes under misclassification without monotonicity

Rob Trangucci,Yang Chen,Jon Zelner

2024-09-20

Abstract:In order to meet regulatory approval, pharmaceutical companies often must demonstrate that new vaccines reduce the total risk of a post-infection outcome like transmission, symptomatic disease, severe illness, or death in randomized, placebo-controlled trials. Given that infection is a necessary precondition for a post-infection outcome, one can use principal stratification to partition the total causal effect of vaccination into two causal effects: vaccine efficacy against infection, and the principal effect of vaccine efficacy against a post-infection outcome in the patients that would be infected under both placebo and vaccination. Despite the importance of such principal effects to policymakers, these estimands are generally unidentifiable, even under strong assumptions that are rarely satisfied in real-world trials. We develop a novel method to nonparametrically point identify these principal effects while eliminating the monotonicity assumption and allowing for measurement error. Furthermore, our results allow for multiple treatments, and are general enough to be applicable outside of vaccine efficacy. Our method relies on the fact that many vaccine trials are run at geographically disparate health centers, and measure biologically-relevant categorical pretreatment covariates. We show that our method can be applied to a variety of clinical trial settings where vaccine efficacy against infection and a post-infection outcome can be jointly inferred. This can yield new insights from existing vaccine efficacy trial data and will aid researchers in designing new multi-arm clinical trials.

Methodology,Statistics Theory,Applications
Reverse engineering protection: A comprehensive survey of reverse vaccinology-based vaccines targeting viral pathogens

Saravanaraman Ponne,Rajender Kumar,S.M. Vanmathi,Raimunda Sâmia Nogueira Brilhante,Chinnadurai Raj Kumar

DOI: https://doi.org/10.1016/j.vaccine.2024.02.087

IF: 4.169

2024-03-25

Vaccine

Abstract:Vaccines have significantly reduced the impact of numerous deadly viral infections. However, there is an increasing need to expedite vaccine development in light of the recurrent pandemics and epidemics. Also, identifying vaccines against certain viruses is challenging due to various factors, notably the inability to culture certain viruses in cell cultures and the wide-ranging diversity of MHC profiles in humans. Fortunately, reverse vaccinology (RV) efficiently overcomes these limitations and has simplified the identification of epitopes from antigenic proteins across the entire proteome, streamlining the vaccine development process. Furthermore, it enables the creation of multiepitope vaccines that can effectively account for the variations in MHC profiles within the human population. The RV approach offers numerous advantages in developing precise and effective vaccines against viral pathogens, including extensive proteome coverage, accurate epitope identification, cross-protection capabilities, and MHC compatibility. With the introduction of RV, there is a growing emphasis among researchers on creating multiepitope-based vaccines aiming to stimulate the host's immune responses against multiple serotypes, as opposed to single-component monovalent alternatives. Regardless of how promising the RV-based vaccine candidates may appear, they must undergo experimental validation to probe their protection efficacy for real-world applications. The time, effort, and resources allocated to the laborious epitope identification process can now be redirected toward validating vaccine candidates identified through the RV approach. However, to overcome failures in the RV-based approach, efforts must be made to incorporate immunological principles and consider targeting the epitope regions involved in disease pathogenesis, immune responses, and neutralizing antibody maturation. Integrating multi-omics and incorporating artificial intelligence and machine learning-based tools and techniques in RV would increase the chances of developing an effective vaccine. This review thoroughly explains the RV approach, ideal RV-based vaccine construct components, RV-based vaccines designed to combat viral pathogens, its challenges, and future perspectives.

immunology,medicine, research & experimental
Estimating Waning of Vaccine Effectiveness: a Simulation Study

Ariel Nikas,Hasan Ahmed,Veronika I Zarnitsyna

DOI: https://doi.org/10.1093/cid/ciac725

IF: 20.999

2022-09-04

Clinical Infectious Diseases

Abstract:Developing accurate and reliable methods to estimate vaccine protection is a key goal in immunology and public health. While several statistical methods have been proposed, their potential inaccuracy in capturing fast intra-seasonal waning of vaccine-induced protection needs to be rigorously investigated. To compare statistical methods for vaccine effectiveness (VE) estimation, we generated simulated data using a multiscale agent-based model of an epidemic with an acute viral infection and differing extents of VE waning. We apply a previously proposed framework for VE measures based on the observational data richness to assess changes of vaccine-induced protection over time. While VE measures based on hard-to-collect information (e.g. the exact timing of exposures) were accurate, usually VE studies rely on time-to-infection data and the Cox proportional hazard model. We found that its extension utilizing scaled Schoenfeld residuals, previously proposed for capturing VE waning, was unreliable in capturing both the degree of waning and its functional form and identified the mathematical factors contributing to this unreliability. We showed that partitioning time and including a time-vaccine interaction term in the Cox model significantly improved estimation of VE waning, even in the case of dramatic, rapid waning. We also proposed how to optimize the partitioning scheme. While appropriate for rejecting the null hypothesis of no waning, scaled Schoenfeld residuals are unreliable for estimating the degree of waning. We propose a Cox-model-based method with a time-vaccine interaction term and further optimization of partitioning time. These findings may guide future analysis of VE waning data.

immunology,infectious diseases,microbiology
Competing Heterogeneities in Vaccine Effectiveness Estimation

Ariel Nikas,Hasan Ahmed,Veronika I. Zarnitsyna

DOI: https://doi.org/10.3390/vaccines11081312

2023-05-13

Abstract:Understanding waning of vaccine-induced protection is important for both immunology and public health. Population heterogeneities in underlying (pre-vaccination) susceptibility and vaccine response can cause measured vaccine effectiveness (mVE) to change over time even in the absence of pathogen evolution and any actual waning of immune responses. We use a multi-scale agent-based models parameterized using epidemiological and immunological data, to investigate the effect of these heterogeneities on mVE as measured by the hazard ratio. Based on our previous work, we consider waning of antibodies according to a power law and link it to protection in two ways: 1) motivated by correlates of risk data and 2) using a within-host model of stochastic viral extinction. The effect of the heterogeneities is given by concise and understandable formulas, one of which is essentially a generalization of Fisher's fundamental theorem of natural selection to include higher derivatives. Heterogeneity in underlying susceptibility accelerates apparent waning, whereas heterogeneity in vaccine response slows down apparent waning. Our models suggest that heterogeneity in underlying susceptibility is likely to dominate. However, heterogeneity in vaccine response offsets <10% to >100% (median of 29%) of this effect in our simulations. Our methodology and results may be helpful in understanding competing heterogeneities and waning of immunity and vaccine-induced protection. Our study suggests heterogeneity is more likely to 'bias' mVE downwards towards faster waning of immunity but a subtle bias in the opposite direction is also plausible.

Populations and Evolution
Efficient nonparametric inference on the effects of stochastic interventions under two-phase sampling, with applications to vaccine efficacy trials

Nima S. Hejazi,Mark J. van der Laan,Holly E. Janes,Peter B. Gilbert,David C. Benkeser

DOI: https://doi.org/10.1111/biom.13375

2020-04-04

Abstract:The advent and subsequent widespread availability of preventive vaccines has altered the course of public health over the past century. Despite this success, effective vaccines to prevent many high-burden diseases, including HIV, have been slow to develop. Vaccine development can be aided by the identification of immune response markers that serve as effective surrogates for clinically significant infection or disease endpoints. However, measuring immune response marker activity is often costly, which has motivated the usage of two-phase sampling for immune response evaluation in clinical trials of preventive vaccines. In such trials, the measurement of immunological markers is performed on a subset of trial participants, where enrollment in this second phase is potentially contingent on the observed study outcome and other participant-level information. We propose nonparametric methodology for efficiently estimating a counterfactual parameter that quantifies the impact of a given immune response marker on the subsequent probability of infection. Along the way, we fill in theoretical gaps pertaining to the asymptotic behavior of nonparametric efficient estimators in the context of two-phase sampling, including a multiple robustness property enjoyed by our estimators. Techniques for constructing confidence intervals and hypothesis tests are presented, and an open source software implementation of the methodology, the txshift R package, is introduced. We illustrate the proposed techniques using data from a recent preventive HIV vaccine efficacy trial.

Methodology

Vaccine efficacy: demystifying an epidemiological concept

Distinguishing immunological and behavioral effects of vaccination

Lay understanding of vaccine efficacy.

Distinguishing Immunologic and Behavioral Effects of Vaccination

Elucidating vaccine efficacy using a correlate of protection, demographics, and logistic regression

A guide to vaccinology: from basic principles to new developments

Evaluation of Vaccine Immunogenicity—Correlates to Real-World Protection: Influenza

Improved Methods for Vaccine Effectiveness Studies

The broader benefits of vaccines: methodologies for inclusion in economic evaluation

Reverse development of vaccines against antimicrobial-resistant pathogens

Vaccine hesitancy, misinformation in the era of Covid-19: Lessons from the past

Estimating vaccine efficacy during open-label follow-up of COVID-19 vaccine trials based on population-level surveillance data

Evolution of the data and methods in real-world COVID-19 vaccine effectiveness studies on mortality: a scoping review protocol

Reverse vaccinology in the 21st century: improvements over the original design

Vaccine Effects on Heterogeneity in Susceptibility and Implications for Population Health Management

Improving precision of vaccine efficacy evaluation using immune correlate data in time-to-event models

Vaccine efficacy for binary post-infection outcomes under misclassification without monotonicity

Reverse engineering protection: A comprehensive survey of reverse vaccinology-based vaccines targeting viral pathogens

Estimating Waning of Vaccine Effectiveness: a Simulation Study

Competing Heterogeneities in Vaccine Effectiveness Estimation

Efficient nonparametric inference on the effects of stochastic interventions under two-phase sampling, with applications to vaccine efficacy trials