key: cord-0933812-7l4m7o13 authors: Lim, Ho-Jae; Park, Jung-Eun; Park, Min-Young; Baek, Joo-Hwan; Jung, Sunkyung; Sung, Nackmoon; Yang, Jae-Hyun; Lee, Min-Woo; Lee, Sun-Hwa; Yang, Yong-Jin title: Assay System for Simultaneous Detection of SARS-CoV-2 and Other Respiratory Viruses date: 2021-06-13 journal: Diagnostics (Basel) DOI: 10.3390/diagnostics11061084 sha: 8bca8949d7b54d35fcdec6af14b2e4a9b23ca399 doc_id: 933812 cord_uid: 7l4m7o13 Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) triggers disease with nonspecific symptoms that overlap those of infections caused by other seasonal respiratory viruses (RVs), such as the influenza virus (Flu) or respiratory syncytial virus (RSV). A molecular assay for accurate and rapid detection of RV and SARS-CoV-2 is crucial to manage these infections. Here, we compared the analytical performance and clinical reliability of Allplex™ SARS-CoV-2/FluA/FluB/RSV (SC2FabR; Seegene Inc., Seoul, South Korea) kit with those of four commercially available RV detection kits. Upon testing five target viral strains (SARS-CoV-2, FluA, FluB, RSV A, and RSV B), the analytical performance of SC2FabR was similar to that of the other kits, with no significant difference (p ≥ 0.78) in z-scores. The efficiency of SC2FabR (E-value, 81–104%) enabled reliable SARS-CoV-2 and seasonal RV detection in 888 nasopharyngeal swab specimens processed using a fully automated nucleic acid extraction platform. Bland–Altman analyses revealed an agreement value of 95.4% (SD ± 1.96) for the kits, indicating statistically similar results for all five. In conclusion, SC2FabR is a rapid and accurate diagnostic tool for both SARS-CoV-2 and seasonal RV detection, allowing for high-throughput RV analysis with efficiency comparable to that of commercially available kits. This can be used to help manage respiratory infections in patients during and after the coronavirus disease 2019 pandemic. Viruses are the most common cause of respiratory infections, which often lead to comorbidity and mortality in children and adults [1, 2] . The early detection of respiratory viruses (RVs) is essential for reducing the risks associated with infection, nosocomial transmission, and inappropriate treatment [3, 4] . Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), a positive-sense single-stranded RNA virus, causes coronavirus disease 2019 [5, 6] . This virus emerged in the human population in the final months of 2019 and then spread worldwide, with 105 million confirmed cases and approximately 2.3 million deaths as of 9 February 2021 [7] . SARS-CoV-2, influenza virus (Flu), and respiratory syncytial virus (RSV) are major pathogens that primarily target the human respiratory system [8, 9] . SARS-CoV-2 causes fairly nonspecific symptoms, and the onset of disease coincides with the active Flu and RSV season [10, 11] . The non-specific symptoms and scarce clinical knowledge of the SARS-CoV-2 infection can mislead patient diagnoses [12] . Considering the difficulty in diagnosing simultaneous infection with SARS-CoV-2 and Flu A, it is currently difficult to analyze the overlapping clinical symptoms or frequency of these two viral infections [13] . Approximately 3% of RV infections occur simultaneously with SARS-CoV-2 infection, with RSV being the most common, followed by the Flu [14] . Since co-infection leads to more severe symptoms than infection caused by a single virus [15] , a pressing clinical need exists for broad and accurate tools to detect co-infection [16, 17] . The US Food and Drug Administration has approved some commercial kits for emergency use for coronavirus detection [18] . Further, the Allplex™ respiratory panel 1 (RP1) and Advansure™ RV-plus (RV-plus) kits are well established for Flu and RSV detection, respectively [19, 20] . However, the option for the simultaneous detection of all three viruses is limited. Recently, the Allplex™ SARS-CoV-2/FluA/FluB/RSV (SC2FabR) assay was released on the market for the simultaneous detection of SARS-CoV-2, Flu, and RSV. In the current study, we compared the efficiency and molecular diagnostic performance of SC2FabR for the detection of simultaneous RV co-infection with those of four commercially available kits, the Allplex™ 2019-nCoV kit, Standard M n-CoV Real-Time Detection kit, Allplex™ Respiratory panel 1 kit, and Advansure™ RV-plus Real-Time RT-PCR kit, using 870 clinical samples. Anonymized residual nasopharyngeal swab (NPS) specimens (888) were obtained and preserved from February to September 2020, as part of the routine procedure for SARS-CoV-2 testing, and from March 2017 and December 2019, for seasonal RV testing for the presence of Flu A, Flu B, RSV A, or RSV B. All procedures were approved by the institutional review boards at the Seegene Medical Foundation (SMF-IRB-2020-012). Among the NPS specimens, 380 were classified as positive or negative for SARS-CoV-2, and 490 were classified as positive or negative for Flu A, Flu B, RSV A, or RSV B. Additionally, 18 samples were used to evaluate clinical performance of SC2FabR for simultaneous detection of co-infection. All samples were processed using an automated nucleic acid extraction system, MagNA PURE 96 (Roche, Basel, Switzerland), according to the manufacturer's protocol [21] . Nucleic acids were extracted from 200 µL of each specimen. Nucleic acids were eluted in 100 µL elution buffer and stored at −80 • C until use. SARS-CoV-2, Flu, and RSV were simultaneously detected using the Allplex™ SARS-CoV-2/FluA/FluB/RSV (SC2FabR) kit (Seegene Inc., Seoul, South Korea). The Allplex™ 2019-nCoV kit (Seegene Inc., Seoul, South Korea) was used for the detection of genes encoding the SARS-CoV-2 envelope protein (E), RNA-dependent RNA polymerase (RdRp), and nucleocapsid protein (N). The Standard M n-CoV Real-Time Detection kit (SD BIOSENSOR Inc., Suwon, South Korea) was used for the detection of E and RdRp genes of SARS-CoV-2. The Allplex™ Respiratory Panel 1 kit (RP1; Seegene Inc., Seoul, Korea) was used for the detection of Flu A (subtype H1, H1 pdm09, and H3), Flu B, RSV A, and RSV B. The Ad-vansure™ RV-plus real-time RT-PCR kit (RV-plus; LG Chem Ltd., Seoul, South Korea) was used for the detection of Flu A, Flu B, RSV A, RSV B, human enterovirus, bocavirus, and human coronavirus OC43. All assays were performed following the manufacturers' protocols. The main characteristics of the kits compared in the current study, such as the manufacturer, release year, specimens, platform, running time, target information, maximum capacity for 96-well plate, and turnaround time, are shown in Table 1 . Any discrepancies in test outcomes were further assessed using the Allplex™ II RV16 Detection kit (RV-16; Seegene Inc., Seoul, South Korea). The test results were regarded as true positives if more than two assays gave a positive reading. The following RV strains were used for determining the analytical sensitivity of the assayed kits: SARS-CoV-2 (KRISS 111-10-506), from the Korea Research Institute of Standards and Science (KRISS; Daejeon, South Korea); (NCCP 43381-43387), from National Culture Collection for pathogens (NCCP; Cheongju, South Korea); and Twist Bioscience (79683; San Francisco, CA, USA); Flu A (VR-810), Flu B (VR-1735), RSV A (VR-41) and RSV B (VR-955), from the American Type Culture collection (ATCC; Manassas, VA, USA). As SARS-CoV-2 from KRISS does not harbor the gene encoding the spike protein, PCR efficiency was determined using a specimen positive for this gene. SARS-CoV-2 particles from the original sample were diluted to 7 × 10 4 copies/µL, and the concentrations of the Flu and RSV strains were set to 0.5 ng/µL. The samples were then serially diluted 10-fold from 10 4 to 1 for PCR optimization. All statistical analyses were performed using SPSS (v25.0, IBM Corp, Armonk, NY, USA) for Windows. Density plots were generated using ggplot2 packages in R (v4.1.0, R studio Inc., Boston, MA, USA). The kit performance efficiency was calculated from the linear regression slope using the following formula: E value = 100 × (−1 + 10 −1/slope ) [5] . Raw cycle threshold (Ct) values for each experiment were transformed to z-scores for performance evaluation. The z-scores were calculated by subtracting the mean positive Ct values from the raw Ct values and then dividing this by the standard deviation (SD) of positive Ct values, according to the following formula: z-score = (Ct value − mean Ct value)/SD [22] . When three assays yielded a consistent result, that result was considered likely true. The statistical significance of z-score differences was calculated using a Student's t-test or the analysis of variance with a Bonferroni post-hoc test for two groups or three groups, respectively. Bland-Altman analysis was performed for positive matched datasets for each variable. The presence of proportional bias was calculated by testing the slope of the regression line fitted to the Bland-Altman plot [23] . We evaluated the PCR efficiency of each target assay by analyzing 10-fold serial dilutions of viral RNA samples of SARS-CoV-2 ( Figure 1 ), as well as Flu and RSV ( Figure 2 ). As shown in Figures 1 and 2 , the E and R 2 values of the five analyses were >80% and 0.991, respectively. To evaluate the test performance, we then calculated the z-sores from the mean values of normalized Ct values (Figures 3 and 4) . No significant differences (p ≥ 0.78) in the z-scores between the analysis systems were apparent (Figures 3 and 4) , indicating that the PCR efficiency of the SC2FabR kit is high and similar to that of the commercially available SARS-CoV-2 and RV analysis systems. -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 -4 0 -2 -1 -3 We analyzed 870 NPS specimens in the current study. Of these, 380 specimens were classified using the 2019-nCoV assay as SARS-CoV-2-positive (180) or SARS-CoV-2-negative (200). The remaining 490 specimens were sorted based on the RP1 assay as RV-positive or RV-negative. For the former, 265 specimens were positive for at least one respiratory virus; 251 were positive for one virus and 14 were positive for two viruses. As shown in Table 2 , based on the SC2FabR assay, 180 of 380 NPS samples were positive for SARS-CoV-2. The sensitivity and specificity of the SC2FabR assay were as high as those of the 2019-nCoV and the Standard M assays, with the ability to distinguish samples that were positive or negative for SARS-CoV-2, consistent with those of the two assays ( Table 2 ). The diagnostic accuracy of the SC2FabR assay was very high, at > We analyzed 870 NPS specimens in the current study. Of these, 380 specimens were classified using the 2019-nCoV assay as SARS-CoV-2-positive (180) or SARS-CoV-2-negative (200). The remaining 490 specimens were sorted based on the RP1 assay as RV-positive or RV-negative. For the former, 265 specimens were positive for at least one respiratory virus; 251 were positive for one virus and 14 were positive for two viruses. As shown in Table 2 , based on the SC2FabR assay, 180 of 380 NPS samples were positive for SARS-CoV-2. The sensitivity and specificity of the SC2FabR assay were as high as those of the 2019-nCoV and the Standard M assays, with the ability to distinguish samples that were positive or negative for SARS-CoV-2, consistent with those of the two assays ( SC2FabR kit can be used to simultaneously detect SARS-CoV-2, Flu, and RSV, with very high accuracy. To evaluate the error rate of the SC2FabR kit, we analyzed 13 discrepant samples using the RP1, RV-plus, and RV-16 analysis systems and compared the results with those obtained with the SC2FabR kit ( Table 3 ). The SC2FabR test results for 11 samples were confirmed and every sample was assigned following SC2FabR results (Table 3 ). These observations suggest that the error rate of SC2FabR for SARS-CoV-2, Flu, and RSV is equal to zero. We then performed the Bland-Altman analysis to assess the level of agreement of test results obtained with the SC2FabR and 2019-nCoV kits ( Figure 5A ,C) or the SC2FabR and Standard M kits ( Figure 5B ) Figure 5H-K) . More than 95.4% of samples tested using the different assays fell between the set SD boundaries, indicating an exceptionally high correlation between the SC2FabR data and those of the well-established assays. mens demonstrated an exceptional degree of agreement between the SC2FabR and 2019-nCoV assays, specifically 96.1% (172/179) consistency for RdRp gene detection and 96.6% (173/179) consistency for N gene detection. Likewise, a comparison with the Standard M data revealed 94.9% (170/179) consistency for RdRp gene detection. Further, testing of 259 Flu-or RSV-positive clinical specimens demonstrated a comparable level of agreement between the SC2FabR and RP1 assays, with 93.9% (92/98), 92.3% (84/91), 97.1% (33/34), and 94.4% (34/36) consistency for Flu A, Flu B, RSV A, and RSV B detection, respectively ( Figure 5D-G) . Furthermore, the SC2FabR and RV-plus assays showed 96.9% (95/98), 96.7% (88/91), 91.2% (31/34), and 94.4% (34/36) consistency for Flu A, Flu B, RSV A, and RSV B detection, respectively ( Figure 5H-K) . More than 95.4% of samples tested using the different assays fell between the set SD boundaries, indicating an exceptionally high correlation between the SC2FabR data and those of the well-established assays. The global coronavirus pandemic has been affecting the human population since 2019 [24] . The disease is transmitted via aerosols during close unprotected contact with infected individuals [25] . Great efforts are continuously being devoted to help contain viral respiratory infections by developing rapid and accurate infection diagnosis and analysis systems [17, 26] . The rapid, broad, and accurate diagnosis of the SARS-CoV-2 infection is crucial for effective management and control of the spread of the disease in the population [16, 27] . In the current study, we compared the analytical performance of the SC2FabR platform with that of four other commercial analytical platforms. The five platforms tested herein (SC2FabR, 2019-nCoV, Standard M, RP1, and RV-plus) showed high PCR efficiency (Figures 1-4) and similar clinical performance (Table 2 and Figure 5 ) when used to detect SARS-CoV-2, Flu, and RSV. The analytical performance of the SC2FabR assay was consistent regardless of SARS-CoV-2 lineages (Supplementary Table S1 ). For SARS-CoV-2-containing samples, during the collection period, there was no issue regarding the SARS-CoV-2 variant in Korea. Therefore, the SARS-CoV-2 samples supposed to belong to the Wuhan-Hu-1 viral strain (NCBI accession number NC_045512.2). The clinical performance of the SC2FabR assay showed 100% diagnostic accuracy, and the assay results were consistent with those of the reference platforms (2019-nCoV or Standard M assays) ( Table 2 ). In addition, the clinical performance of the SC2FabR kit for the analysis of seasonal RVs showed 98.4-100% diagnostic accuracy (Table 2) , and the simultaneous detection of co-infection with SARS-CoV-2 presented 100% reliability for Flu A and RSV (Supplementary Table S2 ), which is similar to the results of previous studies [28] . Thirteen samples that yielded inconsistent results frequently gave "weakly positive" reactions in the SC2FabR assay, with the target amplification detected in the "gray" region [29] , with Ct values of 36 to 40 (Figures 3 and 4) . Re-analysis using four other commercial kits revealed that every sample was assigned following SC2FabR results (Table 3) . Several factors, such as target gene type, primers used, and assay sensitivity, might contribute to assay discrepancies [30, 31] . A correlation of results of clinical evaluation across different platforms is the most important factor in disease diagnosis [32] . Therefore, in the current study, we converted the Ct values obtained using the five systems to z-scores to analyze the correlation between the platforms ( Figure 5 ). We observed that the SC2FabR results showed a very high correlation (above 95.4%) with those of other platforms for SARS-CoV-2, Flu, and RSV analysis ( Figure 5 ). These observations suggest that the SC2FabR kit can be employed as a useful analysis platform for the detection of simultaneous RV and SARS-CoV-2 infections. SC2FabR was also optimized using saliva samples that are collected non-invasively compared to NPS, which is indeed an advantage over other system. In summary, we here evaluated the accuracy, efficiency, and clinical utility of the SC2FabR assay. Simultaneous viral detection using the SC2FabR assay, comparable with that of other well-established assays, suggests the possibility of improving assay efficiency for the individual detection of SARS-CoV-2, Flu, and RSV viruses. To our knowledge, this is the first study to compare the performance of the SC2FabR assay with that of four other well-established molecular assays. It is also the first study that reports normalized Ct value comparisons of z-scores for five molecular detection methods with a large number of samples analyzed. Taking into account the results of SC2FabR, we consider that it is high-throughput, labor-and cost-saving, and can be used to facilitate the simultaneous diagnosis of SARS-CoV-2 and other RVs during and even after the COVID-19 pandemic. Informed Consent Statement: Patient consent was waived as according to Article 16 Clause 3 of the Bioethics and Safety Act, research projects may be exempted from obtaining written consent of a human subject of research, subject to approval from the competent IRB that includes the present cases. Law abidance of this study was reviewed and approved by the Institutional Review Board of the Seegene Medical Foundation. Comparison of the Panther Fusion and Allplex assays for the detection of respiratory viruses in clinical samples Comparison of three multiplex PCR assays for the detection of respiratory viral infections: Evaluation of xTAG respiratory virus panel fast assay, RespiFinder 19 assay and RespiFinder SMART 22 assay The rapid diagnosis of viral respiratory tract infections and its impact on antimicrobial stewardship programs Impact of rapid molecular respiratory virus testing on real-time decision making in a pediatric emergency department Comparison of seven commercial RT-PCR diagnostic kits for COVID-19 Mitochondria targeted viral replication and survival strategies-prospective on SARS-CoV-2 Weekly Epidemiological Update-9 Comparative Review of SARS-CoV-2, SARS-CoV, MERS-CoV, and Influenza A Respiratory Viruses. Front Cognitive impact of COVID-19: Looking beyond the short term Comparison of four molecular in vitro diagnostic assays for the detection of SARS-CoV-2 in nasopharyngeal specimens Expert Team. Report of the WHO-China Joint Mission on Coronavirus Disease Immunopathological similarities between COVID-19 and influenza: Investigating the consequences of co-infection Coinfection with influenza A virus enhances SARS-CoV-2 infectivity Co-infections in people with COVID-19: A systematic review and meta-analysis The epidemiology and clinical characteristics of co-infection of SARS-CoV-2 and influenza viruses in patients during COVID-19 outbreak Co-infection with SARS-CoV-2 and influenza A virus in patient with pneumonia High prevalence of SARS-CoV-2 and influenza A virus (H1N1) coinfection in dead patients in Northeastern Iran Evaluation of four commercial kits for SARS-CoV-2 real-time reverse-transcription polymerase chain reaction approved by emergency-use-authorization in Korea Performance evaluation of Allplex respiratory panels 1, 2, and 3 for detection of respiratory viruses and influenza A virus subtypes Comparison of the Luminex xTAG respiratory viral panel fast v2 assay with Anyplex II RV16 detection kit and AdvanSure RV real-time RT-PCR assay for the detection of respiratory viruses Prospective evaluation of a new automated nucleic acid extraction system using routine clinical respiratory specimens Analysis of microarray data using Z score transformation Comparison of the new fully automated extraction platform eMAG to the MagNA PURE 96 and the well-established easyMAG for detection of common human respiratory viruses Evaluation of the xpert xpress SARS-CoV-2/Flu/RSV assay for simultaneous detection of SARS-CoV-2, influenza A and B viruses, and respiratory syncytial virus in nasopharyngeal specimens Transmissibility and transmission of respiratory viruses COVID-19 and healthcare system in China: Challenges and progression for a sustainable future Should RT-PCR be considered a gold standard in the diagnosis of COVID-19? Coinfections with respiratory pathogens among COVID-19 patients in Korea. Can Novel one-step single-tube nested quantitative real-time PCR assay for highly sensitive detection of SARS-CoV-2 Silico PCR primer designing and validation Polymerase chain reaction (PCR) amplification of GC-rich templates Molecular detection of tyrosinase transcripts in peripheral blood from patients with malignant melanoma: Correlation of PCR sensitivity threshold with clinical and pathologic disease characteristics Data Availability Statement: All data are available within the article. The authors declare no conflict of interest.