key: cord-0761024-m03nm7js authors: Møller, Ida Johanne B.; Utke, Amalie R.; Rysgaard, Ulla K.; Østergaard, Lars J.; Jespersen, Sanne title: Diagnostic performance, user acceptability, and safety of unsupervised SARS-CoV-2 rapid antigen detecting tests performed at home date: 2022-01-14 journal: Int J Infect Dis DOI: 10.1016/j.ijid.2022.01.019 sha: 989b77ec5fbca8f2962b042b969da5b1b0d808d2 doc_id: 761024 cord_uid: m03nm7js Background One strategy for reducing spread of COVID-19 is to contain the infection with broad screening, isolate infected individuals, and trace contacts. This strategy requires widely available, reliable SARS-CoV-2 testing. To increase testing, rapid antigen detection tests (RADTs) were developed for self-sampling, self-testing, and self-interpretation. This study examined diagnostic performance, user acceptability, and safety of nasal self-RADTs, compared to PCR testing. Methods Self-RADT kits were distributed at a public COVID-19 test center in Aarhus, Denmark or delivered to participants. Participants reported test results and test preferences. During enrollment, participants reported occurrence and duration of symptoms consistent with COVID-19. Sensitivity and specificity of self-RADT, relative to oropharyngeal PCR testing, were calculated. Results Among 827 participants, 102 showed positive PCR test results. Sensitivities of the self-RADTs were 65.7% (95% CI: 49.2–79.2; DNA Diagnostic) and 62.1% (95% CI: 50.1–72.9; Hangzhou), and specificities were 100% (95% CI: 99.0–100; DNA Diagnostic) and 100% (95% CI: 98.9–100; Hangzhou). The sensitivities of both self-RADTs appeared higher in symptomatic participants than in asymptomatic participants. Two out of every three participants preferred self-RADT over PCR test. Conclusion Self-performed RADTs were reliable, user acceptable, and safe among laypeople as supplement to professionally collected oropharyngeal PCR testing. Rapid antigen detection tests (RADTs) that can be used to self-test for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infections are available in several countries. However, few studies have examined the self-test application of RADTs. Self-tests require the individual to collect a specimen, conduct a RADT protocol, and interpret the result without assistance (Foundation for Innovative New Diagnostics, 2021). Currently, the gold-standard testing method for SARS-CoV-2 is a nasopharyngeal swab or a combined nasopharyngeal/oropharyngeal swab, followed by a reverse transcriptase polymerase chain reaction (RT-PCR) analysis. The standard SARS-CoV-2 test method in Denmark is a swab from the oropharynx, performed by a trained health care worker, and an RT-PCR analysis (Statens Serum Institut, 2021) . The disadvantages of this approach are the high cost of the RT-PCR analysis, the long response time, the need for personnel to operate the COVID-19 test centers, and the risk of virus transmission to health care workers and other citizens at the test centers. RADTs have a short response time and require little equipment and reagents for analysis. On the other hand, RADTs have lower sensitivities and specificities than the RT-PCR analysis. Nevertheless, the sensitivity of RADTs appears to correlate with the viral load (Corman et al., 2021; Krüger et al., 2020; Osmanodja et al., 2021) . The viral load is estimated to be highest 2-3 days after symptom onset and is probably the timepoint when most infectious (Ejima et al. 2021) . Nasopharyngeal swabs and self-swabs from the anterior nasal region have comparable sensitivities, when performed by professionals, particularly when the viral load is high (Hanson et al., 2020; Kojima et al., 2020; Lindner et al., 2021a Lindner et al., , 2021b McCulloch et al., 2020; Tsang et al., 2021; Tu et al., 2020) . From a public health perspective, self-tests can offer advantages, when used to complement professionally administered PCR tests or RADTs. Self-tests can improve accessibility to testing, support early detection of infectious cases, and reduce further community transmission. Therefore, self-testing could enhance disease control, with prompt identification and isolation of infectious individuals (European Centre for Disease Prevention and Control, 2021) . The present study aimed to evaluate the sensitivity, specificity, user acceptability, and safety of two different nasal RADTs, when performed at home by participants, compared to an oropharyngeal swab performed by a trained health care worker and analyzed with RT-PCR. This study was a manufacturer-independent prospective study. We evaluated the diagnostic accuracy, user acceptability, and safety of two RADTs, when performed unsupervised by participants at home. For comparison, the participants underwent an oropharyngeal swab, performed by a health care worker at the ambulatory public COVID-19 test center of Aarhus University Hospital, Denmark, and the sample was analyzed with RT-PCR. In addition, some participants that were recruited onsite were tested with a nasopharyngeal RADT performed by a health care worker. Participants were eligible for inclusion, when they were ≥18 years old, had made an appointment for PCR testing at the public test center, were able to conduct the RADT within 72 hours (h) after their PCR test at the test center, and were able to understand written and spoken Danish. Participants were not eligible for inclusion if they had had a nose-bleed within 24 h prior to the RADT performance, any nose operation within four weeks prior to the execution of the RADT, or a previous infection with SARS-CoV-2. Previous infected individuals were not included because the PCR analysis can detect the virus weeks after an infection (Mallett et al., 2020) . The primary tests evaluated in this study were two nasal RADTs: the COVID-19 Antigen Detection Kit (DNA Diagnostic A/S, Risskov, Denmark) and the SARS-CoV-2 Antigen Rapid Test (Hangzhou Immuno Biotech Co. Ltd, Hangzhou, China) . In addition, we evaluated a nasopharyngeal RADT, known as the COVID-19 Antigen Rapid Test Device (Abbott Rapid Diagnostic Jena GmbH, Jena, Germany). The participants swabbed themselves in each nostril for 5 seconds. Hereafter the swab was mixed with buffer. Buffer with specimen was added to a test plate. For the test to be conclusive a line should appear after 10 min in the control area of the test plate. If a line appeared in the test area the test was positive, and no line indicated a negative result. Weak lines in the test area were also considered positive results. Both tests were validated prior to this study and were CE-marked. Study participants were recruited either onsite, at the COVID-19 test center of Aarhus University Hospital, Denmark (onsite participants) or by telephone (offsite participants). Onsite participants had come to the test center for SARS-CoV-2 testing and expressed a willingness to try a self-test at home. These participants signed a written informed consent form at the center and were given a RADT kit to be performed at home. Offsite participants were recruited after they contacted the project group subsequent to receiving a positive result on a PCR test performed at the test center. These participants received a RADT kit delivered to their address with a written informed consent form, which they signed and returned digitally to the project group. Participants were enrolled during four periods. Onsite participants were enrolled from 21 January to 25 January, 2021, for both the DNA Diagnostic RADT and the Abbott RADT; and from 25 March to 4 April, 2021, for the Hangzhou RADT. Offsite participants were enrolled from 16 February, to 10 March, 2021, for the DNA Diagnostic RADT; and from 10 March to 31 March, 2021, for the Hangzhou RADT. All test kits contained a written, illustrated instruction pamphlet and a link to an online instruction video for self-sampling and self-testing. All instructions were translated into Danish from the manufacturers' instruction pamphlets. The RADT results were self-interpreted by participants and the interpretation was confirmed by the project team, based on photographs of the test plates that were sent by e-mail from the participants to the project inbox. Study participants were provided with a telephone number and a secure e-mail address for returning study-relevant material and for technical support. In case of a positive or inconclusive self-RADT result, participants were advised to call in for further instructions. Samples for RT-PCR testing were obtained with oropharyngeal swabs. All PCR analyses for detecting SARS-CoV-2 RNA were performed by ISO standard accredited laboratories at the Department of Clinical Microbiology, Aarhus University Hospital or at the national reference laboratory at the Statens Serum Institute. Internationally approved PCR platforms were used. The result from the RT-PCR analysis was self-reported by each participant; however, consent was given for the project group to obtain the result from the laboratory, when necessary. At the time of participant enrollment, all citizens could make appointments for free PCR tests, and the response time was less than 48 h. The Danish government recommended that citizens should get a PCR test when they had been in close contact with a person infected with SARS-CoV-2, when they had experienced symptoms consistent with COVID-19, and when they were about to undergo hospitalization or medical procedures etc. In Denmark, RADTs were recommended for routine testing for all individuals in populations with a particularly high incidence of SARS-CoV-2 and for individuals that received a notification from the COVID-19 app "SmitteStop" (Sundhedsstyrelsen, 2021) . During enrollment, participants were asked to describe the reason for making an appointment for PCR testing, their symptoms, and the symptom duration. Additionally, participants were asked about the number of COVID-19 vaccine injections they had received and whether they had a health professional background. When reporting their self-RADT results, participants were asked which test they preferred and why. Besides, 355 participants were asked whether performing the RADT caused nose bleeding. Data were collected and managed with Research Electronic Data Capture (REDCap) tools. Statistical analyses were performed in Stata/MP 17.0. Sensitivity and specificity, with 95% confidence intervals (95% CIs), were calculated for self-RADTs with the Wilson test. Those results were compared to the sensitivity and specificity of the reference standard PCR test. Inconclusive RADT or PCR test results were not included in the statistical analysis of sensitivity and specificity. Descriptive statistics were used to evaluate participant characteristics, user acceptability, and safety. The regional Scientific Ethics Committee of the Central Denmark Region concluded that this quality assurance study did not require scientific ethical approval (reference number 1-10-72-1-20). The Danish Medicines Agency concluded that the study did not require approval from them. Data collected from the participants of this study were treated according to the General Data Protection Regulation. All participants received oral and written information about the study, and all participants consented to participate. The participant inclusion process is shown in Figure 1 . Four participants were excluded from the study because they failed to return a signed consent form, and 59 participants were excluded because the test results were not reported, were inadequately reported, or they performed the self-RADT more than 72 h after their PCR test. A total of 827 participants were included in the data analysis of self-RADTs, of these, 102 (12.3%) showed positive results on the PCR test. The clinical and demographic participant characteristics are shown in Table 1 , for the overall cohort and for the two self-RADT groups. The mean age of the participants was 42 years, ranging from 18 to 81 years, and 50.5% were female. Of the 827 participants, 119 (14.6%) had a health professional background. Most participants had undergone PCR testing, when routine tests were required before entering work or educational institution (40.9%) or when a test was taken as a precautionary measure (22.8%). In the Aarhus municipality, PCR tests were performed for 11-16% of the population per week, at the time this study was executed. The percentage of positive test results was low, ranging from 0.1% to 0.6%, which translated to an incidence of 12 to 63 per 100,000 inhabitants (Aarhus Kommune, 2021) . In this study, a COVID-19 diagnosis was solely based on the result of a single positive PCR test result. The sensitivities for the DNA Diagnostic RADT and the Hangzhou RADT were similar, 65.7% (95% CI: 49.2-79.2) and 62.1% (95% CI: 50.1-72.9), respectively ( Table 2) . No participants enrolled onsite that underwent the professionally administrated Abbott RADT had a positive PCR test result, hence the sensitivity could not be estimated. Only one presumable false positive test was detected in this study, which resulted in a high specificity for all three types of RADTs examined. Six tests had no control line and were considered inconclusive. When participants were stratified into symptomatic and asymptomatic groups, the sensitivities were tending to be higher in the symptomatic group compared to the asymptomatic group ( Of the 388 participants that underwent the PCR test, the nasopharyngeal RADT, and the self-RADT, 222 (57.2%) preferred the self-RADT, 128 (33.0%) preferred the PCR test, 9 (2.3%) preferred the nasopharyngeal RADT, and 29 (7.5%) had no test preference. Of the 439 participants that underwent the PCR test and the self-RADT, 280 (63.8%) preferred the self-RADT, 124 (28.2%) preferred the PCR test, and 35 (8.0%) had no test preference. The main reason that the self-RADT was preferred was that it obviated a trip to the test center for testing ( Figure 2) . Furthermore, participants thought that the self-RADT was the most pleasant test, they favored the shorter response time, and they found the self-RADT easy to perform. Participants that preferred the PCR test argued that the PCR test provided the most valid result, and that throat sampling was more comfortable than nose sampling. Some participants mentioned that they felt more comfortable with a health care worker performing the test. Among the 355 participants interviewed about safety issues, 12 (3.4%) reported nose bleeding. One participant had to interrupt the self-test, due to nose bleeding, but no medical help was required. No other safety problems were reported. This study found that two anterior nasal self-RADTs had sensitivities of 65.7 % and 62.1%, and specificities of 100%, compared to PCR test results, among all participants, regardless of symptoms. Among individuals with symptoms, the sensitivities appeared higher than among individuals without symptoms for both self-RADTs compared to the reference PCR test. Nevertheless, two out of every three participants preferred the self-performed RADT compared to the PCR test and the professionally administered nasopharyngeal RADT. The main study strength was that the participants were highly representative of the intended target populations for RADTs. Therefore, the study results reflected what could be achieved in a routine setting at an educational institution or at work, without preselecting a specific population, such as symptomatic individuals. Another strength of this study was the large number of participants enrolled, and in particular, the large number of participants with positive PCR test results. One of the major weaknesses of the study was the inaccurate nature of self-reporting. The sensitivities may have increased with a professional read-out of the lateral flow RADT device. Furthermore, the participants were not observed performing the self-sampling procedure. A study examining self-sampling made by Gertler et al. associated sampling procedure mistakes with false negative results . To which extent the participants followed the instructions is unknown and inaccurate performance of the self-sampling may have caused false negative results in this study. On the other hand, our study aimed to assess the effectiveness of self-tests, which entailed a real-life situation, including self-assessments of test results. Another limitation of this study was the time interval (1 to 3 days) between the PCR test and the self-RADT for participants enrolled offsite (Table 1) . Time delays may have reduced the sensitivity of the antigen tests since the viral load may had decreased since the timepoint of PCR testing. The viral load is estimated to be highest 2-3 days after symptom onset, however viral antigens can be detected with PCR testing several weeks after the initial infection (Ejima et al., 2021; Mallett et al., 2020) . At the time of the PCR testing 50 participants had had symptom onset within 2 days and at the time of the self-RADT performance 35 participants had had symptom onset within 2 days (Table 1) . Our findings support the findings from previous studies, which showed no significant difference in diagnostic performance between samples collected by health care workers and those collected by participants. The sensitivities of self-RADTs observed in other studies ranged from 49 to 96%, and the specificities ranged from 82 to 100% (Callahan et al., 2021; Tsang et al., 2021) . The lowest sensitivity (49%) was observed among individuals with low viral loads. In that same study, the sensitivity was 80% for individuals with high viral loads (Callahan et al., 2021) . In the present study, viral load measurements were not available, but that could have been valuable information for evaluations and comparisons with the self-RADT results. The WHO performance criterion for RADTs is a minimum sensitivity performance of >80% (Worlds Health Organization, 2020). Other studies on self-RADTs that observed sensitivities above that level primarily included participants with COVID-19 symptoms or participants that had been in close contact with patients with COVID-19 (Hanson et al., 2020; Klein et al., 2021; Kojima et al., 2020; McCulloch et al., 2020; Osmanodja et al., 2021; Tu et al., 2020) . A meta-study of RADTs that differentiated between participants with and without symptoms found RADT sensitivities of 72.0%, in symptomatic patients, and 58.1% in asymptomatic patients (Dinnes J et al., 2021) . Those findings were comparable to the results obtained in the present study with estimated sensitivities for asymptomatic participants of 43.8% and 40.0% for the Hangzhou RADT and the DNA Diagnostic RADT respectively. However, it is debatable if these sensitivities are acceptable for the target population for who RADTs are recommended. In a study similar to the present study, Lindner and colleagues found a sensitivity of 82.5% which was comparable to the sensitivities calculated in this study (Lindner et al., 2021b) . In this study, the self-RADT results were compared to results from RT-PCR analyses of oropharyngeal swab samples. However, in most other studies, RADTs were compared to RT-PCR analyses of nasopharyngeal or combined oropharyngeal/nasopharyngeal swab samples, which are more sensitive tests (Callahan et al., 2021; Klein et al., 2021; Kojima et al., 2020; Lindner et al., 2021a Lindner et al., , 2021b McCulloch et al., 2020; Osmanodja et al., 2021; Tsang et al., 2021; Tu et al., 2020) . Thus, we might have overestimated the sensitivity of RADTs, because our reference test had a lower sensitivity than the reference tests used in other studies. In this study, we evaluated two types of self-RADTs for analyzing anterior nasal swab samples. Among all symptomatic and asymptomatic participants, the self-RADT sensitivities were 65.7% and 62.1%, and their specificities were 100% for both, compared to PCR testing. In Denmark, several RADTs are currently available and approved for use as a self- RADT, under supervision, at schools and other educational institutions (Laegemiddelstyrelsen, 2021) . The WHO has recommended that RADTs should meet the minimum performance of >80% sensitivity and 97-100% specificity (World Health Organization, 2020). However, recent studies have argued that the testing frequency may be more important than test sensitivity for detecting SARS-CoV-2 (Larremore et al., 2021; Paltiel et al., 2021) . A modeling study suggested that rapid testing and contact tracing are important factors in stopping virus transmission (Kretzschmar et al., 2020) . Compared to the PCR test, a self-RADT would significantly reduce the time delay between the test performance and an available result. Additionally, self-RADTs are cheap and easy to up-and down scale to meet the actual testing needs. These observations support the relevance of implementing self-RADTs as a supplement to professionally administered RADTs and PCR tests. Nevertheless, sufficient information should be provided to minimize the sense of false security among the individuals tested falsely negative with the RADTs. At present, no SARS-CoV-2 vaccine has been approved for small children. Thus, we may need to continue testing children for SARS-CoV-2. More studies are warranted that focus on self-tests or parental-administered tests for children. Further work is required to obtain more precise estimates of the sensitivities and specificities of the RADTs examined in this study. Future studies should investigate populations with higher COVID-19 incidences than the population studied here. Additionally, user acceptability of self-RADTs should be surveyed in the populations for which they are intended. More studies on self-RADT implementation are urgently needed. This study has contributed new knowledge to our understanding of user feasibility and acceptability of self-RADTs among laypeople. The two RADTs evaluated tended to have higher sensitivities among symptomatic participants than among asymptomatic participants. Two thirds of our participants preferred the self-RADT over the PCR test or a professionally administered nasopharyngeal RADT. In conclusion, this study showed that self-RADTs for analyzing nasal swab samples was a reliable, user acceptable, safe complementary test to PCR analyses of professionally collected oropharyngeal swab samples. This research did not receive any specific grant from funding agencies in the public, commercial or not-for-profit sectors the Aarhus University Hospital test center. Offsite enrollment: participants enrolled subsequent to a positive PCR test, and the self-RADT was delivered to their home. *Participants failed to return a signed consent form, did not perform and/or report test results, or performed the self-RADT later than 72 h after their PCR test. Positive, negative, and inconclusive: self-RADT results. 1 Six participants were included onsite during the offsite inclusion period, and subsequently showed a positive PCR test result. However, in the data analysis, they were included in the offsite group that used the Hangzhou RADT. They are referred to as offsite-enrolled participants in the remainder of the article. 2 One participant was enrolled onsite at the test center at the time of offsite inclusion and was due to a positive PCR test analyzed with the offsite enrolled DNA Diagnostic participants. This participant is referred to as an offsite-enrolled participant in the remainder of the article. A) Participants were first tested with a standard PCR test, then a professional nasopharyngeal (NP) RADT, and later they performed a self-RADT at home. B) Participants were tested with a standard PCR test, and later they performed a self-RADT at home. No preference indicates none preferred or more than one preferred test. Nasal Swab Performance by Collection Timing, Procedure, and Method of Transport for Patients with SARS-CoV-2 Comparison of seven commercial SARS-CoV-2 rapid point-of-care antigen tests: a single-centre laboratory evaluation study COVID-19 antigen test til selvtest Rapid, point-of-care antigen and molecular-based tests for diagnosis of SARS-CoV-2 infection Estimation of the incubation period of COVID-19 using viral load data European Centre for Disease Prevention and Control Considerations on the use of self-tests for COVID-19 in the EU/EEA Foundation for Innovative New Diagnostics SARS-CoV-2 diagnostic pipeline Self-collected oral, nasal and saliva samples yield sensitivity comparable to professionally collected oro-nasopharyngeal swabs in SARS-CoV-2 diagnosis among symptomatic outpatients Self-Collected Anterior Nasal and Saliva Specimens versus Health Care Worker-Collected Nasopharyngeal Swabs for the Molecular Detection of SARS-CoV-2 Head-to-head performance comparison of self-collected nasal versus professional-collected nasopharyngeal swab for a WHO-listed SARS-CoV-2 antigen-detecting rapid diagnostic test Self-Collected Oral Fluid and Nasal Swab Specimens Demonstrate Comparable Sensitivity to Clinician-Collected Nasopharyngeal Swab Specimens for the Detection of SARS-CoV-2 Impact of delays on effectiveness of contact tracing strategies for COVID-19: a modelling study Evaluation of the accuracy, ease of use and limit of detection of novel, rapid, antigen-detecting point-of-care diagnostics for SARS-CoV-2 Test sensitivity is secondary to frequency and turnaround time for COVID-19 screening Head-to-head comparison of SARS-CoV-2 antigen-detecting rapid test with self-collected nasal swab versus professionalcollected nasopharyngeal swab Diagnostic accuracy and feasibility of patient self-testing with a SARS-CoV-2 antigen-detecting rapid test At what times during infection is SARS-CoV-2 detectable and no longer detectable using RT-PCR-based tests? A systematic review of individual participant data Comparison of Unsupervised Home Self-collected Midnasal Swabs With Clinician-Collected Nasopharyngeal Swabs for Detection of SARS-CoV-2 Infection Accuracy of a Novel SARS-CoV-2 Antigen-Detecting Rapid Diagnostic Test from Standardized Self-Collected Anterior Nasal Swabs Clinical and Economic Impact of Widespread Rapid Testing to Decrease SARS-CoV-2 Transmission. Infectious Diseases (except HIV/AIDS) Hvornår du skal testes Diagnostic performance of different sampling approaches for SARS-CoV-2 RT-PCR testing: a systematic review and meta-analysis Swabs Collected by Patients or Health Care Workers for SARS-CoV-2 Testing Table 3 Sensitivities of self-RADTs in participants with positive PCR test results We thank all members of the staff at the test center of Aarhus University Hospital for their help in testing and recruiting participants throughout this study. We declare no conflict.