key: cord-0993562-4jd2ro7w authors: Mak, Gannon C.K.; Lau, Stephen S.Y.; Wong, Kitty K.Y.; Chow, Nancy L.S.; Lau, C.S.; Lam, Edman T.K.; Chan, Rickjason C.W.; Tsang, Dominic N.C. title: Evaluation of rapid antigen detection kit from the WHO Emergency Use List for detecting SARS-CoV-2 date: 2020-12-04 journal: J Clin Virol DOI: 10.1016/j.jcv.2020.104712 sha: 16a477b3a64ba91fa92125181b600d9316cb827a doc_id: 993562 cord_uid: 4jd2ro7w BACKGROUND: Currently, there are two rapid antigen detection (RAD) kits from the WHO Emergency Use List for detecting SARS-CoV-2. OBJECTIVE: The Panbio COVID-19 Ag Rapid Test Device was selected to evaluate the performance for detecting SARS-CoV-2. STUDY DESIGN: Analytical sensitivity for the detection of SARS-CoV-2 virus was determined by limit of detection (LOD) using PCR as a reference method. Clinical sensitivity was evaluated by using respiratory samples collected from confirmed COVID-19 patients. RESULTS: The LOD results showed that the RAD kit was 100 fold less sensitive than RTPCR. Clinical sensitivity of the RAD kit was 68.6% for detecting samples from COVID-19 patients. CONCLUSIONS: The RAD kit evaluated in the present study shared similar performance with another kit from the WHO Emergency Use List, the Standard Q COVID-19 Ag. Understanding the clinical characteristics of RAD kits can guide us to decide different testing strategies in different settings. RT-PCR is the gold standard for detection of SARS-CoV-2 virus. The application of a rapid antigen detection (RAD) kits is limited by its sensitivity [1] . However, among the currently available RAD kits, lateral flow antigen assay is fast, low cost, and can be performed by healthcare professional without intensive training and specialized instrument. The principle is based on the movement of a liquid sample [2] . RAD kits would be helpful for the diagnosis of COVID-19 either as mass-screening or first aid tests at the emergency room who are most likely to be in the early and contagious phase of the illness [3, 4] . A few minutes to results have the potential to satisfy the demand for an early SARS-CoV-2 infection diagnosis [5] . for these two kits respectively. We have evaluated different RAD kits before October 2020 and found that the Standard Q kit might satisfy the demand for an early SARS-CoV-2 infection diagnosis [7, 8] . The Panbio kit was commercially available in Hong Kong at the end of October 2020. We are interested to know if the Panbio kit showed comparable performance with the Standard Q kit. The intended use for the Panbio kit is for the detection of SARS-CoV-2 virus in nasopharyngeal swabs. As our specimens were placed in viral transport media or phosphate-buffered saline, a fixed amount of specimen was mixed with the extraction buffer. The subsequent procedures were carried out according to the manufacturer's instructions. We evaluated two specimen volumes, 100μL and 350μL. In an effort to compare the performance of these two specimen volumes, limit of detection (LOD) was determined using a serial tenfold dilution of a nasopharyngeal The Standard Q kit was also tested as a reference method simultaneously. The kit was gifted by Roche. Virus concentrations in each dilution were estimated from cycle threshold (Ct) value as described [7] . From April 3, 2020 to October 20, 2020, respiratory specimens from COVID-19 patients collected by the Public Health Laboratory Services Branch in Hong Kong were retrieved for this evaluation. All of the specimens were confirmed with SARS-CoV-2 infection by RT-PCR as described [7] . The types of specimens selected and the total number tested were identical to the previous study [8] . Since the nasopharyngeal aspirate and throat swab (NPA & TS) were used up in our previous evaluations, this type of specimen cannot be included in the present study. In brief, three types of specimens were selected: 'normal viral load' [8] . Of the 105 specimens tested, 24, 54 and 27 specimens were classified as 'high viral load', 'normal viral load' and 'low viral load' specimens respectively. This viral load distribution was similar to the previous study [8] . To evaluate the cross-reactivity of the RAD kit, 13 non-SARS-CoV-2 respiratory virus isolates were tested. They were influenza A (H1pdm09), influenza A(H3), influenza B, adenovirus, coronavirus type OC43, coronavirus type 229E, parainfluenza virus type 1, parainfluenza virus type 2, parainfluenza virus type 3, parainfluenza virus type 4, respiratory syncytial virus, rhinovirus and enterovirus. The LOD of the Panbio kit was 10 -4 . There were no marked differences when using 100μL and 350μL specimen volumes. However, the test bands were more intense J o u r n a l P r e -p r o o f 6 when using 350μL specimen volume. Since the specimen volume utilized for the Standard Q kit was also 350μL, this specimen volume was selected for accessing clinical sensitivity of the Panbio kit. The reference Standard Q kit shared the same LOD with the Panbio kit, both of them were 10 -4 ( Table 1 ). The LOD of the Standard Q kit was 100 fold less sensitive than RT-PCR which was concordant to our previous study [8] . Of the 105 specimens tested, the Panbio kit showed high sensitivity for both high viral load and normal viral load specimens (83.3 %-100 %) but low sensitivity for low viral load specimens (0-11.1 %) ( Table 2 ). The corresponding Ct values for the specimens tested by Panbio kit were shown in Fig. S1 . In the cross-reactivity test using virus isolates, all were tested negative by the Panbio kit. In this study, we determined the performance characteristics of the Panbio kit for detecting SARS-CoV-2 virus. Clinical sensitivity was 68.6% (72/105) for detecting specimens from COVID-19 patients. Although archived specimens were tested in the present study, our results were in-line with other studies using in-field nasopharyngeal swabs. The overall sensitivity of the Panbio kit ranged from 73.3% to 75.5% [9-11]. The main objective of this study is to see if the Panbio kit showed comparable performance with the Standard Q kit that we performed previously [8] . Parallel comparison between these two kits has not been performed. It is difficult to compare RAD kits due to the number of confounding factors that can affect the reliability of results, these include: site of testing, type of specimen processed, volume of specimen input, viral load distribution among specimens selected, variation of method to quantify viral load. In the present study, a more controlled method was employed to limit these confounding factors. In terms of analytical sensitivity, the Panbio kit shared the same LOD with the Standard Q kit, both of them were 100 fold less sensitive than RT-PCR. In terms of clinical sensitivity, both kits shared similar sensitivity for detecting specimens from COVID-19 patients, Panbio kit: 68.6%; Standard Q kit: 65.7-71.4% (Table S1 ). In our previous study, we recommended specimens obtained within 7 days after symptom onset for use with the Standard Q based on the prevalence of specimens of certain viral load. Since both Panbio kit and Standard Q kit shared similar clinical characteristics, the recommendation of testing J o u r n a l P r e -p r o o f 8 specimens obtained within 7 days after symptom onset was also valid for the Panbio kit. Our observation was also concordant to the recent study that 'Panbio antigen rapid test is reliable to diagnose SARS-CoV-2 infection in the first 7 days after the onset of symptoms' [9]. In conclusion, understanding the performance of RAD kits can guide us to implement the test appropriately. During the pandemic, it is not known whether the increased demand for an early SARS-CoV-2 infection diagnosis will lead to the limited availability of test kits. Alternatives have to be sought for test kits shared similar operating procedures and similar performance. Our information can provide implementation guidance when deciding different testing strategies in different settings [12]. None. J o u r n a l P r e -p r o o f Antigen-detection in the diagnosis of SARS-CoV-2 infection using rapid immunoassays. Interim guidance Lateral flow assays Urgent need of rapid tests for SARS CoV-2 antigen detection: Evaluation of the SD-Biosensor antigen test for SARS-CoV-2 SARS CoV-2 Surveillance and Exposure in the Perioperative Setting with Universal testing and Personal Protective Equipment (PPE) Policies Performance of a novel diagnostic assay for rapid SARS-CoV-2 antigen detection in nasopharynx samples WHO. WHO Emergency Use Listing for In vitro diagnostics (IVDs) Detecting SARS-CoV-2 Evaluation of rapid antigen test for detection of SARS-CoV-2 virus Analytical sensitivity and clinical sensitivity Evaluation of the Panbio Covid-19 rapid antigen detection test device for the screening of patients with Covid-19 Real-life validation of the Panbio COVID-19 Antigen Rapid Test (Abbott) in community-dwelling subjects with symptoms of potential SARS-CoV-2 infection SARS-CoV-2 Antigen detecting rapid diagnostic test implementation projects