Test performance evaluation of SARS-CoV-2 serological assays
Jeffrey D. Whitman,Joseph Hiatt,Cody T. Mowery,Brian R. Shy,Ruby Yu,Tori N. Yamamoto,Ujjwal Rathore,Gregory M. Goldgof,Caroline Whitty,Jonathan M. Woo,Antonia E. Gallman,Tyler E. Miller,Andrew G. Levine,David N. Nguyen,Sagar P. Bapat,Joanna Balcerek,Sophia A. Bylsma,Ana M. Lyons,Stacy Li,Allison Wai-yi Wong,Eva Mae Gillis-Buck,Zachary B. Steinhart,Youjin Lee,Ryan Apathy,Mitchell J. Lipke,Jennifer Anne Smith,Tina Zheng,Ian C. Boothby,Erin Isaza,Jackie Chan,Dante D. Acenas,Jinwoo Lee,Trisha A. Macrae,Than S. Kyaw,David Wu,Dianna L. Ng,Wei Gu,Vanessa A. York,Haig Alexander Eskandarian,Perri C. Callaway,Lakshmi Warrier,Mary E. Moreno,Justine Levan,Leonel Torres,Lila A. Farrington,Rita Loudermilk,Kanishka Koshal,Kelsey C. Zorn,Wilfredo F. Garcia-Beltran,Diane Yang,Michael G. Astudillo,Bradley E. Bernstein,Jeffrey A. Gelfand,Edward T. Ryan,Richelle C. Charles,A. John Iafrate,Jochen K. Lennerz,Steve Miller,Charles Y. Chiu,Susan L. Stramer,Michael R. Wilson,Aashish Manglik,Chun Jimmie Ye,Nevan J. Krogan,Mark S. Anderson,Jason G. Cyster,Joel D. Ernst,Alan H. B. Wu,Kara L. Lynch,Caryn Bern,Patrick D. Hsu,Alexander Marson
DOI: https://doi.org/10.1101/2020.04.25.20074856
2020-04-29
Abstract:ABSTRACT Background Serological tests are crucial tools for assessments of SARS-CoV-2 exposure, infection and potential immunity. Their appropriate use and interpretation require accurate assay performance data. Method We conducted an evaluation of 10 lateral flow assays (LFAs) and two ELISAs to detect anti-SARS-CoV-2 antibodies. The specimen set comprised 128 plasma or serum samples from 79 symptomatic SARS-CoV-2 RT-PCR-positive individuals; 108 pre-COVID-19 negative controls; and 52 recent samples from individuals who underwent respiratory viral testing but were not diagnosed with Coronavirus Disease 2019 (COVID-19). Samples were blinded and LFA results were interpreted by two independent readers, using a standardized intensity scoring system. Results Among specimens from SARS-CoV-2 RT-PCR-positive individuals, the percent seropositive increased with time interval, peaking at 81.8-100.0% in samples taken >20 days after symptom onset. Test specificity ranged from 84.3-100.0% in pre-COVID-19 specimens. Specificity was higher when weak LFA bands were considered negative, but this decreased sensitivity. IgM detection was more variable than IgG, and detection was highest when IgM and IgG results were combined. Agreement between ELISAs and LFAs ranged from 75.7-94.8%. No consistent cross-reactivity was observed. Conclusion Our evaluation showed heterogeneous assay performance. Reader training is key to reliable LFA performance, and can be tailored for survey goals. Informed use of serology will require evaluations covering the full spectrum of SARS-CoV-2 infections, from asymptomatic and mild infection to severe disease, and later convalescence. Well-designed studies to elucidate the mechanisms and serological correlates of protective immunity will be crucial to guide rational clinical and public health policies.