key: cord-1033119-0lwt82mk authors: Roger, Steven; Lefeuvre, Caroline; Pivert, Adeline; Ducancelle, Alexandra; Savary, Dominique; Bouthry, Élise; Le Guillou‐Guillemette, Hélène title: What is the true place of the SARS‐CoV‐2 rapid point‐of‐care antigen test in the hospital setting? Lessons learned from real life date: 2021-12-13 journal: J Med Virol DOI: 10.1002/jmv.27505 sha: 711aabb9aaf9c0d4328f2521d4fb3c667a9734a5 doc_id: 1033119 cord_uid: 0lwt82mk To assist in the clinical management of patients and to support infection control, we tested the use of the severe acute respiratory syndrome coronavirus 2 (SARS‐CoV‐2) point‐of‐care antigen test (AgPOC) for unplanned hospitalization, coupled with a nucleic acid amplification test (NAAT) using specimens collected at the same time upon arrival. The aim of this study was to assess the performance of the AgPOC in this specific use compared to NAAT for SARS‐CoV‐2 diagnosis, in the context of the low prevalence of infection. For 5 months (between two peaks in France of the SARS‐CoV‐2 pandemic), all patients admitted who undertook the AgPOC/NAAT paired tests were included in the study. AgPOC performances were determined considering the clinical status and the delay of symptoms onset. NAAT and AgPOC results were available for 4425 subjects. AgPOC results showed a homogeneous specificity (>97%) but a low sensitivity at 45.8%. Considering the national guidelines, sensitivity dropped to 32.5% in cases of symptomatic patients with symptoms older than 5 days or more. This study shows the poor performance of AgPOC for entry screening of patients in hospitals. AgPOC may represent a useful tool in the hospital setting only if the use is restricted to patients with consistent symptoms less than 4 days old. depending on the evaluation settings and the study design. 2, 3 In light of this weakness, AgPOC are mainly used for large-scale screening in different community settings (schools, nursing homes, and community screening centers). There is a lack of data on the performance of the AgPOC test in hospital settings, thus raising a critical question: is the AgPOC a useful diagnostic tool in managing the SARS-CoV-2 pandemic crisis in the overcrowded hospital and in the context of a low prevalence of SARS-CoV-2 infection? As suggested by the French national health authority, the AgPOC could be used in emergency care units when a rapid result is needed. 2 To help in the clinical management of patients and to support infection control, the use of the PanBio™ COVID-19 Ag (Abbott diagnostics, France) for unplanned hospitalization, coupled with a NAAT assay (as a gold standard) is now performed at arrival at our hospital. To evaluate the performance of the PanBio™ COVID-19 Ag in this specific use, we performed a monocentric diagnostic cross-sectional retrospective study. All patients admitted at the University Hospital of Angers from November 21, 2020 to February 28, 2021 and benefitting from AgPOC/NAAT paired tests were included in the study. During this period, we were between two peaks of the SARS-CoV-2 pandemic in France (incidence ranging from 78 to 180,3 confirmed cases/100 000 individuals). 4 Clinical data were collected from the medical records. Symptoms suggestive of COVID-19 disease were: fever; respiratory signs like a cough and shortness of breath; headaches; muscle ache and unusual tiredness; anosmia and loss of taste; and altered states of consciousness. Nasopharyngeal paired swabs were obtained from a single nostril of patients (one swab by nostril) by trained healthcare workers using universal transport media (UTM). The first swab was placed into a vial of 3 ml of UTM and immediately transferred to the laboratory of Virology to perform NAAT. The second swab was used to perform the AgPOC immediately in the care unit. At the time of our study, we considered the national guidelines of the Haute autorité de Santéthe French National Health Authorityon the use of testing in community settings. 2 According to these guidelines, AgPOC should be used for the benefit of all symptomatic patients whatever their profile and within 4 days of the onset of symptoms (DAOS), and for all contact cases for the asymptomatic patient. After 5 DAOS, the NAAT should be used as the first line. We classified the symptomatic patients into two categories: ≤4 DAOS; and >5 DAOS). The Aptima ® SARS-CoV-2 assay on the platform Panther ® (Hologic), which targets two virus sequences located on the ORF1ab gene, was performed following the manufacturer's instructions and uses TMA to detect SARS-CoV-2. A volume of 500 µl UTM was manually placed in the appropriate specimen lysis tube containing 710 µl of lysis buffer; 360 µl of this mix was then used for the lysis, capture, and amplification of nucleic acids. The Panbio™ assay was performed according to the manufacturer's instructions. Briefly, the swab was rotated five times against the nasal wall; the procedure was repeated with the same swab into the second nostril. It was then deposited in the extraction tube. Five drops of each extracted specimen were dispensed into the specimen well and the timer was started. The result was read after 15 min and recorded immediately in the patient's medical file. Patients with missing clinical data, NAAT, or AgPOC were excluded from the analysis. Analytical performances of the Panbio™ COVID-19 Ag were determined, using the Aptima ® SARS-CoV-2 assay as the reference, with Graphpad Prism software 9.1. For each clinical condition (i.e., overall, asymptomatic, symptomatic, national guidelines, and >5 DAOS), sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NVP) were determined, and confidence intervals were calculated with the Wilson-Brown method. For each parameter, data are presented with 95% confidence intervals (CI). The study was carried out in accordance with the Declaration of Helsinki. This study was a non-interventional study, with no alterations of the usual sampling procedures. Biological material and clinical data were obtained only for standard viral diagnosis following physicians' prescriptions (no specific sampling, no modification of the sampling protocol). Data analyses were carried out using an anonymized database. A total of 4425 patients with results of both AgPOC and NAAT and were included in the study. These paired samples mainly originated from Emergency units, followed by the Medical units, Intensive care unit, Gynecological Emergency Unit, and Surgery Unit, as described in AgPOC results showed a homogeneous specificity (more than 97%) just above the required performance by the World Health Organization (WHO) 5 as described in Table 1 . Overall, we observed a low sensitivity (45.8%). Sensitivity for symptomatic and asymptomatic subgroups were 48.8% and 28.6%, respectively. Considering the national guidelines, that is, using Ag-POC for all symptomatic patients within 4 DAOS, sensitivity increased substantially (65%). In cases of symptomatic patients with symptoms older than 5 days or more, sensitivity was 32.5%. NPV were good for all subgroups (more than 90%, except for >5 DAOS). PPV was also good for symptomatic, national guidelines, and >5 DAOS subgroups. However, PPV for overall patients was 72.3% and dropped to 33.3% in the asymptomatic subgroup. The significance of using the SARS-CoV-2 AgPOC in hospitals remains unclear. It seems to be a useful tool for quickly identifying infected patients and it may improve the clinical management of the patient and prevent the spread of the infection within the hospital. But our study questioned the place that it has been accorded in the medical diagnostic landscape when performed at hospitals. The present work is one of the first studies conducted in a hospital setting that focuses on patients who need to be hospitalized but are not restricted to the emergency unit. A major strength of our study is that more than 4400 patients were included, representing one of the largest studies to date in a hospital setting within a low prevalence context. Moreover, the study was performed in real-life conditions; it involved highly experienced testing personnel, and the well-functioning logistics and standardized procedures enabled us to adequately evaluate AgPOC performance. As reported in a number of studies covering a variety of study populations, we also reported a high specificity of the Panbio™ assay when compared with NAAT. In contrast to other studies, however, the overall sensitivity was low just at 45.8%. 6, 7 It was weaker than reported in most published studies 2,3,8,9 and below the required performance level, 5 which is unacceptable especially in a hospital setting. However, data on the sensitivity were extracted from studies that vary in design, population, sample type, and especially prevalence (ranging from 5% to 100%). 2, 3 In contrast to our work, in most studies AgPOC tests are collected on nasal swabs by nontrained people or self-collection, which perform considerably worse than nasopharyngeal taken by trained healthcare workers as underlined by Lee et al. 10 (around 15% of difference in the percentage positive detection rate between NP vs. nasal swab). This suggests that our sensitivity is even better than expected if the study was carried out with nasopharyngeal molecular methods vs AgPOC with nasal. A similarly low sensitivity was observed regarding symptomatic and asymptomatic subgroups in our study. The low sensitivity in the asymptomatic subgroup was also observed in other studies 3,11-14 and this lack of sensitivity of rapid antigen diagnostic tests has been known for many years for the influenza virus. 15 The high NPV and low PPV observed in the asymptomatic subgroup can be explained by the low prevalence as previously highlighted. 7 | 1725 sensitivity close to 80%) 11 and the early symptomatic phases of the disease (within the first week after symptom onset), 6, 17 but not beyond that time because of an unacceptable sensitivity. 11, 18 We, therefore, considered the French national guidelines to assess whether they improve the performance of AgPOC in hospital settings. Even if sensitivity increased substantially to 65% in symptomatic patients with a symptom duration ≤4 days, this level remains low and below WHO requirements. 5 Moreover, in cases of symptomatic patients with symptoms older than 5 days or more, sensitivity dropped drastically to 32.5% with a significant number of false-negative results. Caramello et al. also found that false-negative patients were tested later after the symptom onset with a median of 6 days 16 and a recent meta-analysis showed the usefulness of these tests when they are used for patients within 5 days of symptom onset. 3 A novel coronavirus from patients with pneumonia in China Revue rapide sur les tests de détection antigénique du virus SARS-CoV-2 Comparing the diagnostic accuracy of rapid antigen detection tests to real time polymerase chain reaction in the diagnosis of SARS-CoV-2 infection: a systematic review and meta-analysis Coronavirus: chiffres clés et évolution de la COVID-19 en France et dans le Monde. 2021 Antigen-detection in the diagnosis of SARS-CoV-2 infection using rapid immunoassays Low performance of rapid antigen detection test as frontline testing for COVID-19 diagnosis Evaluation of two rapid antigen tests to detect SARS-CoV-2 in a hospital setting Field evaluation of a rapid antigen test (Panbio™ COVID-19 Ag Rapid Test Device) for COVID-19 diagnosis in primary healthcare centres The challenge of using an antigen test as a screening tool for SARS-CoV-2 infection in an emergency department: experience of a tertiary care hospital in Southern Italy Performance of saliva, oropharyngeal swabs, and nasal swabs for SARS-CoV-2 molecular detection: a systematic review and metaanalysis Évaluation de la performance diagnostique des tests rapides d'orientation diagnostique antigéniques COVID-19 Accuracy of COVID-19 rapid antigenic tests compared to RT-PCR in a student population: the StudyCov study Evaluation of an antigenbased test for hospital point-of-care diagnosis of SARS-CoV-2 infection Clinical application of a rapid antigen test for the detection of SARS-CoV-2 infection in symptomatic and asymptomatic patients evaluated in the emergency department: A preliminary report Rapid antigen tests for influenza: rationale and significance of the FDA reclassification Are antigenic tests useful for detecting SARS-CoV-2 infections in patients accessing to emergency departments? Results from a North-West Italy hospital Development and potential usefulness of the COVID-19 Ag Respi-Strip diagnostic assay in a pandemic context Panbio antigen rapid test is reliable to diagnose SARS-CoV-2 infection in the first 7 days after the onset of symptoms Can we test our way out of the COVID-19 pandemic? The authors declare that there are no conflict of interests. The data that support the findings of this study are available from the corresponding author upon reasonable request.