key: cord-0754586-1s2unych authors: Nedelcu, Iulia; Jipa, Raluca; Vasilescu, Roxana; Băicuș, Cristian; Popescu, Costin-Ioan; Manea, Eliza; Stoichițoiu, Laura E.; Pinte, Larisa; Damalan, Anca; Simulescu, Oana; Stoica, Irina; Stoica, Madalina; Hristea, Adriana title: Long-Term Longitudinal Evaluation of Six Commercial Immunoassays for the Detection of IgM and IgG Antibodies against SARS CoV-2 date: 2021-06-26 journal: Viruses DOI: 10.3390/v13071244 sha: 9042b634d439729fea4963077d8d338e820d5573 doc_id: 754586 cord_uid: 1s2unych The number of serological assays for SARS-CoV-2 has skyrocketed in the past year. Concerns have been raised regarding their performance characteristics, depending on the disease severity and the time of the analysis post-symptom onset (PSO). Thus, independent validations using an unbiased sample selection are required for meaningful serology data interpretation. We aimed to assess the clinical performance of six commercially available assays, the seroconversion, and the dynamics of the humoral response to SARS-CoV-2 infection. The study included 528 serum samples from 156 patients with follow-up visits up to six months PSO and 161 serum samples from healthy people. The IgG/total antibodies positive percentage increased and remained above 95% after six months when chemiluminescent immunoassay (CLIA) IgG antiS1/S2 and electro-chemiluminescent assay (ECLIA) total antiNP were used. At early time points PSO, chemiluminescent microparticle immunoassay (CMIA) IgM antiS achieved the best sensitivity. IgM and IgG appear simultaneously in most circumstances, and when performed in parallel the sensitivity increases. The severe and the moderate clinical forms were significantly associated with higher seropositivity percentage and antibody levels. High specificity was found in all evaluated assays, but the sensitivity was variable depending on the time PSO, severity of disease, detection method and targeted antigen. Since the WHO declared the COVID-19 outbreak a pandemic, an increasing amount of data regarding the immune response in SARS-CoV-2 infection has become available. However, the immunity remains incompletely elucidated; therefore, research on this subject is ongoing and evolving [1] . Serological assays might be relevant not only for epidemiological and vaccine studies but also for the management of the patients presenting with late complications of the disease, when RT-PCR may be falsely negative and externally validated SARS-CoV-2 serologic assays are needed. The currently available serological assays are variable regarding the format: enzymelinked immunosorbent assay (ELISA), chemiluminescent immunoassay (CLIA), gold im-We performed a prospective multicenter study conducted in two hospitals, both from Bucharest, Romania: the National Institute of Infectious Diseases "Prof. Dr. Matei Bals" and Colentina Clinical Hospital. The study was approved by the local ethics committee of the two hospitals. In order to assess the sensitivity, we collected sera from adult patients with COVID-19 confirmed by at least two positive reverse transcription polymerase chain reaction tests (RT-PCR) from nasopharyngeal swabs. We collected 528 serum samples from 156 patients, each of whom reported the day of the symptoms' onset. From 128 patients admitted for evaluation, we aimed to collect serum samples obtained at admission, and at follow-up visits on day 7, 14, 28, and 84. We also used serum samples from 28 patients from whom we had only one sample with known time post-symptom onset (PSO). Specimens were stored at 4 • C for up to 5 days. They were then centrifuged, and serum samples were aliquoted and frozen at −20 • C until analysis/before being processed. Informed consent was obtained from all included patients. We recorded demographic characteristics (age and gender), the date of symptoms onset, the clinical form of the disease (mild, moderate severe/critical) according to the WHO criteria, and the comorbidities [8] . The specificity was evaluated using serum samples as negative controls, collected in October 2019 from 161 healthy people within a seroprevalence study, upon the consent of the investigators in this study. In order to confirm SARS-CoV-2 infection, nasopharyngeal swabs were collected on viral transport media (VTM) (Copan, Brescia, Italy), and these were further tested for SARS-CoV-2 RNA using Allplex™ SARS-CoV-2 Assay (Seegene, Seoul, Korea) and CFX96 Real-Time PCR Detection System (Bio-Rad, Hercules, CA, USA). We tested serum samples for SARS-CoV-2-specific antibodies using six commercially available assays: Elecsys ® anti-SARS-CoV-2 assay (Roche, Basel, Switzerland), LIAISON ® SARS-CoV-2 S1/S2 IgG (DiaSorin, Saluggia, Italy), SARS-CoV-2 IgG and SARS-CoV-2 IgM (Abbott, Chicago, IL, USA), and ELISA kits KT-1032 EDI™ IgG and KT-1033 EDI™ IgM (Epitope, San Diego, CA, USA). Three assays targeted the nucleocapsid protein (Abbott IgG, Roche total antibody and Epitope IgG and IgM) and two had S protein-based targets (DiaSorin and Abbott IgM). The Elecsys ® anti-SARS-CoV-2 assay is an automated electrochemiuminescent assay (ECLIA) using a recombinant protein representing the N protein of SARS-CoV-2. This is a sandwich immunoassay whose output is a cutoff index (COI) used in a qualitative manner to determine whether a sample is positive or negative for antibodies. According to the manufacturer, a COI < 1 is considered "negative" or "not detected". The LIAISON ® SARS-CoV-2 S1/S2 IgG uses an indirect CLIA technology for the quantitative determination of IgG antibodies against specific recombinant S1 and S2 antigens. The analyzer automatically calculates SARS-CoV-2 S1/S2 IgG antibody concentrations expressed as arbitrary units (AU/mL); sample results should be interpreted as positive if AU/mL ≥ 15.0, equivocal if 12.0 ≤ AU/mL < 15.0, and negative if AU/mL < 12.0. SARS-CoV-2 IgG (Abbott) is a chemiluminescent microparticle immunoassay (CMIA) used for the qualitative detection of IgG antibodies to the N protein of SARS-CoV-2. The cutoff is 1.4 index (S/C). SARS-CoV-2 IgM (Abbott) assay is designed to detect IgM antibodies that bind the S RBD antigen of SARS-CoV-2. The cutoff is 1.00 index (S/C). The ELISA kits KT-1032 EDI™ IgG and KT-1033 EDI™ IgM are designed for the qualitative measurement of the human anti-COVID-19 IgG and IgM antibody against NP in serum, using a microplate-based enzyme immunoassay technique. The cutoffs were calculated for each working series using the formula PCO = 1.1 × (m NC + 0.18) for positive cutoff and NCO = 0.9 × (m NC + 0.18) for negative cutoff. Measured values ≤ NCO were interpreted as negative, measured values ≥ PCO were interpreted as positive, and measured values >NCO but 20 days). Contrarily, the sensitivity of ELISA IgM in our study was much lower (from 10% at 1-5 days to 40% at >20 days) than that reported by Whitman et al. in which the sensitivity varied from 17.9% at 1-5 days to 81.8% at >20 days [22] . The differences between our findings and the results of Whitman et al., who analyzed moderate and severe hospitalized patients, might be related to the sample size and patients' characteristics, since we included 221 samples from 62 (39.7%) patients with mild disease. In our study, the IgG assays positivity at more than 15 days (85.6%-93.1%) was lower than the positivity rate reported by the manufacturers (95%-100%) . The apparent discrepancy may be most likely explained by the low IgG titer of samples in the selection. Indeed, Lagerqvist et al. showed that the sensitivities of different serology assays decrease for low IgG titer samples. This is the case for samples from early post symptom onset, in the late convalescent phase, in asymptomatic or mild infections, which are largely represented in our selection [23] . The sensitivities at 16-20 days by CMIA IgG antiNP (Abbott), CLIA IgG antiS1/S2 (DiaSorin), and ECLIA total antiNP (Roche) (88.3%-93.5%) were similar to the sensitivity of 88.2% reported at 15-21 days in a Cochrane review of SARS-CoV-2 antibody testing, which included 54 cohort studies with 15,976 samples, published in November 2020. Likewise, the sensitivity of CMIA IgM antiS (Abbott) was similar in the first week with the sensitivity reported in this systematic review (23%), but at 16-21 days, was better in our study (96.1% versus 75.4%) [24] . After four weeks, the sensitivity of the assays detecting IgM decreased across multiple studies, including ours. Another study evaluating ECLIA total antiNP (Roche) and CLIA IgG antiS1/S2 (DiaSorin) found higher sensitivities than in our study after two weeks from symptom onset (92% and 88%, respectively) but comparable sensitivities after 30 days after symptom onset (100% and 97.5%, respectively) [25] . The overall sensitivity in our study was also similar with the results of a study in which the authors determined the antibody response against SARS-CoV-2 proteins using CMIA antiNP IgG (Abbott), CLIA IgG antiS1/S2 (DiaSorin), and ECLIA total antiNP (Roche), and found the sensitivity of 70.9%, 63.2% and 71.8%, respectively. Nevertheless, with all three assays, the 100% sensitivity was reached three weeks after the positive RT-PCR. This study analyzed the antibody response by reporting their length after the positive RT-PCR and not the duration of symptoms; besides, the subjects were hospitalized patients, most probably severe patients, with one-third of them requiring admission in an intensive care unit [26] . Moreover, in another study, the reported positivity rates by CMIA antiNP IgG (Abbott), CLIA IgG antiS1/S2 (DiaSorin), and ECLIA total antiNP (Roche) were 92.7%, 95.7%, and 96.8%, respectively at >14 days [27] . A possible explanation for the lower sensitivity found in our study could be the high percentage of patients with mild forms of COVID-19 who are known to develop fewer antibodies. There are studies with an extended follow-up of the antibody response (up to five months), with CMIA antiNP IgG, which showed a significant decrease in sensitivity, as we found in our study [21, 28, 29] . However, the antibody response against NP antigen using ECLIA total antiNP antibodies was found to be persistent in several studies, similar with our findings [28, 29] . A hypothesis for the sustained antibody response with an assay detecting total antibodies (ECLIA, Roche) compared with IgG assays is that an additional response of non-IgG antibodies isotypes may appear [20] . Studies with a longer follow-up are, however, still scarce in the literature. For the samples that we collected between 90 and 271 days, we found a similar sensitivity with the ones reported in two studies that used multiple commercial assays (including ECLIA total antiNP antibodies) for the evaluation of antibodies' long-term persistence. In one study, 58 persons with asymptomatic or mildly symptomatic SARS-CoV-2 infection were followedup to 8 months, and in another study, 84 individuals were followed-up to 10 months; the seropositivities were 90% and 94%, respectively [20, 30] . Likewise, antibodies detected by CLIA IgG antiS1/S2 (DiaSorin) persisted in 95% of our study population. For public health policies, the durability of the humoral immune response following the symptoms' onset is still a matter of debate of major importance. Thus, robust serological assays with long-term high sensitivity post infection are needed. Sensitive qualitative tests may be useful for seroprevalence studies in population. Our study indicates that ECLIA total antiNP Roche anti-SARS-CoV-2 assay for the qualitative detection of anti-SARS-CoV-2 NP antibodies might be used for this purpose, for at least six months post-disease. A long-term evaluation of the sensitivity of different assays, may help prioritize the serology tests that should be used to determine the correlates of protection either after SARS-CoV-2 infection or after vaccination. Thus, sensitive and quantitative determination of antiS IgG antibodies will be required to monitor the protection status. We evaluated only one method for antiS IgG determination and it seems suitable to monitor antiS IgG levels for at least six months. Our study underscores the importance of evaluating multiple assays in an unbiased sample selection before concluding on the durability of the immune response. Thus, antiNP and antiS antibodies are present at least six months after symptoms onset. Our study showed that ELISA IgG antiNP (Epitopes) is not appropriate for serological evaluation at late time points PSO due to decreased sensitivity. The drop in sensitivity six months PSO is due most likely to the high number of samples from patients with mild form of disease, as it was recently reported [31] . In order to have a better view of the immune status of the COVID-19 convalescent patients, the binding assays should be complemented by sera neutralization assays, which are currently performed for our cohort. We will perform further investigations, including a neutralization test, which might assist a better understanding of the antibodies' dynamics, as well as the discrepancies between the assays. The specificity was very good for all assays, for all targeted antibodies, with narrow confidence intervals. However, we did not include in our study sera from patients with different infections, but only from healthy people. Prior studies on the prevalence of antibodies against commonly circulating coronaviruses showed that over 90% of individuals over the age of 50 have specific antibodies, potentially responsible for cross reactivity [32] . However, not only the accuracy of a test itself, but also the pre-test probability, which can vary widely, should be considered when interpreting the serological test results [33] . Considering both sensitivity and specificity, ECLIA total antiNP (Roche) and CLIA IgG antiS1/S2 (DiaSorin) had the best diagnostic performance after one month PSO. Overall, more studies found that the sensitivity, the antibody levels, and earlier seroconversion are positively associated with the disease severity [6, 9, 11, 34, 35] . Our results agreed with the data from a review published by Mackey et al., which found in 17/25 studies an association between the disease severity and higher levels of antibodies [16] . We found that the disease severity was associated with an earlier seroconversion in IgG antibodies, detected by all methods targeting IgG. Maximum follow-up in other studies published until March 2021 was up to 120 days [16] . Data beyond three months of follow-up are limited, and the long-term follow-up (with 71 samples collected at more than 90 days) is one of the strengths of our study, together with a large sample size, including more than 200 samples from patients with mild disease. So far, sensitivity has mostly been evaluated in hospitalized patients with moderate and severe forms, and it was unclear whether tests are able to detect lower antibody levels, mainly associated with mild or asymptomatic forms. Like many other studies, we included only patients with COVID-19 confirmed by a RT-PCR. Nevertheless, COVID-19-positive cases who are RT-PCR-negative should be included in order to assess the utility of serological tests in clinical practice. Regarding the specificity, we did not include in our study sera from patients with different infections but only those from healthy people. However, probably, most of these patients had common viral infections (including coronavirus) during the three months before blood sampling; therefore, they may have developed antibodies against these infections, which did not interfere with the studied assays for SARS-CoV-2 (rate of false positives less than 3%). In summary, the assays evaluated have a high specificity, but the sensitivity is variable, depending not only on the time of symptoms onset and the severity of illness, but also on the method and the antigen targeted. Therefore, the results of serological testing should be carefully interpreted in the context of the clinical findings. Nevertheless, testing for combined IgM and IgG might improve their performance, including in acute infection, but more important, in patients with late presentation of COVID-19, atypical symptoms, or prolonged symptoms. Supplementary Materials: The following are available online at https://www.mdpi.com/article/ 10.3390/v13071244/s1, Table S1 : Samples used to assess the variation in antibody kinetics (timing and duration) by disease severity. SARS-CoV-2 pandemic: An overview Performance Characteristics of Four High-Throughput Immunoassays for Detection of IgG Antibodies against SARS-CoV-2 IgG and IgM antibody formation to spike and nucleocapsid proteins in COVID-19 characterized by multiplex immunoblot assays Serological assays for emerging coronaviruses: Challenges and pitfalls Diagnostic performance of COVID-19 serological assays during early infection: A systematic review and meta-analysis of 11 516 samples COVID-19-neutralizing antibodies predict disease severity and survival Towards effective diagnostic assays for COVID-19: A review Coronavirus Disease (COVID19) Pandemic. Available online Antibody Responses to SARS-CoV-2 in Patients with Novel Coronavirus Disease Virological assessment of hospitalized patients with COVID-2019 Antibody responses to SARS-CoV-2 in patients with COVID-19 Diagnostic value and dynamic variance of serum antibody in coronavirus disease 2019 Comparison of SARS-CoV-2 IgM and IgG seroconversion profiles among hospitalized patients in two US cities SARS-CoV-2 seroprevalence and neutralizing activity in donor and patient blood from the San Francisco Bay Area Antibody Response Following SARS-CoV-2 Infection and Implications for Immunity: A Rapid Living Review Temporal Course of SARS-CoV-2 Antibody Positivity in Patients with COVID-19 following the First Clinical Presentation Anti-nucleocapsid and Neutralizing Antibodies in SARS-CoV-2 Inpatients and Asymptomatic Individuals. Front. Microbiol. 2020, 11, 2468 Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: An observational cohort study Antibodies Depends on the Analytical Kit: A Report for Up to 10 Months after Infection. Microorganisms 2021 Longitudinal analysis of clinical serology assay performance and neutralising antibody levels in COVID19 convalescents Evaluation of SARS-CoV-2 serology assays reveals a range of test performance Evaluation of 11 SARS-CoV-2 antibody tests by using samples from patients with defined IgG antibody titers Antibody tests for identification of current and past infection with SARS-CoV-2. Cochrane Database Syst Clinical performance of three fully automated anti-SARS-CoV-2 immunoassays targeting the nucleocapsid or spike proteins Antibody response against SARS-CoV-2 spike protein and nucleoprotein evaluated by four automated immunoassays and three ELISAs Performance characteristics of five immunoassays for SARS-CoV-2: A head-to-head benchmark comparison Humoral Immune Response to SARS-CoV-2 in Iceland Kinetics of SARS-CoV-2 specific IgM and IgG responses in COVID-19 patients Antibody Responses 8 Months after Asymptomatic or Mild SARS-CoV-2 Infection SARS-CoV-2 antibody magnitude and detectability are driven by disease severity, timing, and assay Prevalence of antibodies to four human coronaviruses is lower in nasal secretions than in serum Testing for SARS-CoV-2 antibodies Antibody Profiles According to Mild or Severe SARS-CoV-2 Infection Novel Coronavirus Outbreak Research team. Viral dynamics and immune correlates of COVID-19 disease severity Data Availability Statement: For data supporting reported results please contact the correspondent author. The authors declare no conflict of interests.