key: cord-0854592-cn9fq6c0
authors: Lippi, Giuseppe; Henry, Brandon M.; Plebani, Mario
title: LumiraDX SARS-CoV-2 Antigen Test for Diagnosing Acute SARS-CoV-2 Infection: Critical Literature Review and Meta-Analysis
date: 2022-04-11
journal: Diagnostics (Basel)
DOI: 10.3390/diagnostics12040947
sha: 20e7194a289f8b577e6d5167702c2aa7a527cbbc
doc_id: 854592
cord_uid: cn9fq6c0

We present here a critical literature review and meta-analysis on the accuracy of the LumiraDX SARS-CoV-2 Antigen Test for diagnosing acute SARS-CoV-2 infection. An electronic search was conducted in the Scopus and Medline databases using the keywords “LumiraDX” AND “COVID-19” OR “SARS-CoV-2”, without date (i.e., up to 1 February 2022) or language restrictions, for detecting clinical studies where the diagnostic accuracy of the LumiraDX SARS-CoV-2 Antigen Test was compared with reference molecular diagnostic methods. All studies where the rates of true positive, true negative, false positive and false negative cases were available for constructing a 2 × 2 table and providing pooled estimates of diagnostic sensitivity, specificity and accuracy were included in a pooled analysis. The study was conducted in accordance with the PRISMA (preferred reporting items for systematic reviews and meta-analyses) reporting checklist. Eleven studies (n = 8527 samples) could be included in our pooled analysis, while five additional documents provided diagnostic accuracy data but could not be extracted for construction of a 2 × 2 table. The pooled diagnostic sensitivity and specificity were 0.86 (95%CI, 0.84–0.88) and 0.99 (95%CI, 0.98–0.99), respectively, while the area under the summary receiver operating characteristic curve was 0.974 (95%CI, 0.965–0.983) and the agreement was 96.8% (95%CI, 96.4–97.1%), with kappa statistics of 0.87 (95%CI, 0.85–0.88). In conclusion, the diagnostic performance of the LumiraDX SARS-CoV-2 Antigen Test would allow the conclusion that it may be seen as a reliable alternative to molecular testing for the rapid preliminary screening of acute SARS-CoV-2 infections.

The dramatic and almost unpredictable clinical, social and economic burden caused by the ongoing coronavirus disease 2019 pandemic is disrupting the efficiency of most healthcare systems worldwide [1] , a situation that has recently become magnified by the continuous emergence of highly mutated lineages of the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) [2] . Although the use of a nucleic acid amplification test (NAAT) aimed at detecting SARS-CoV-2 RNA in a diagnostic (preferably upper or lower respiratory tract) sample remains the gold standard for diagnosing an acute SARS-CoV-2 infection [3] , the intrinsic characteristics of most molecular testing assays (i.e., low throughput, long turnaround time and the need for skilled personnel and dedicated laboratory instrumentation) prohibit providing a valid and timely result due to the enormous volume of tests that almost every laboratory is now facing, which is also associated with a paramount economic burden. This paves the way to the urgent need of identifying potential diagnostic alternatives suited for the purpose of combining high-volume and rapid testing.

An enormous number of rapid diagnostic tests aimed at detecting SARS-CoV-2 antigens (RDT-Ag) in upper respiratory tract specimens have been developed and commercialized (a detailed list can be found in the FIND database) [4] . Nonetheless, real-time evaluation and validation of many manual rapid immunoassays revealed a cumulatively low diagnostic accuracy, namely, an insufficient diagnostic sensitivity (i.e., around 70%) [5] , which remains far below the minimum diagnostic sensitivity (i.e., ≥80%) required by the World Health Organization (WHO) [6] and the Task Force on COVID-19 of the International Federation of Clinical Chemistry and Laboratory Medicine (IFCC) [7] . Besides manual lateral flow (first-and second-generation) assays and laboratory-based chemiluminescent (fourth-generation) immunoassays [8] , some intriguing and potentially valid alternatives are emerging, i.e., the so-called third-generation microfluidic assays, of which the Lumi-raDx SARS-CoV-2 Ag test represents the prototype for rapidity, handiness and potential availability as a decentralized testing device. Therefore, this article aims to present a critical literature review and meta-analysis of this innovative test in the diagnosis of acute SARS-CoV-2 infection. The following article is presented in accordance with the PRISMA (preferred reporting items for systematic reviews and meta-analyses) reporting checklist.

The LumiraDx SARS-CoV-2 Ag Test (LumiraDx Ltd., Alloa, UK) is a microfluidic immunofluorescence assay for the direct and qualitative detection of SARS-CoV-2 antigens in nasal swab (NS) and nasopharyngeal swab (NPS) specimens from individuals with suspected COVID-19 or asymptomatic individuals. The test is meant to be used with the LumiraDx platform as a rapid point-of-care (POC) diagnostic assay. This particleparticle sandwich immunoassay is based on specific monoclonal antibodies coated on fluorescent latex nanoparticles and magnetic beads, which are directed against the SARS-CoV-2 nucleocapsid (N) protein. One drop of specimen collected within an extraction buffer is added to the reactive strip containing the dried reagents. The anti-SARS-CoV-2 antibodies coated on latex nanoparticles and magnetic beads react with the N antigen that is eventually present in the test sample to generate a sandwich immunocomplex. Microfluidic filtration eliminates free nanobeads but retains antigen-bridged immunocomplexes, which generate a fluorescent reaction whose intensity is proportional to the amount of analyte present in the sample. The results are then displayed on the touchscreen of the analyzer in less than 12 min. According to manufacturer's specifications, the limit of detection (LoD) of this test is 32 median tissue culture infectious dose (TCID 50 )/mL and is linear up to 1.4 × 105 TCID 50 /mL. Both the test strips and analyzer contain quality control checks to ensure that the test is properly functioning.

The search strategy used in this study is summarized in Table 1 . Briefly, the electronic search was conducted in the two scientific databases Scopus and Medline (on the PubMed interface) based on the keywords "LumiraDX" and "COVID-19" or "SARS-CoV-2" within the search fields "TITLE" and "ABSTRACT" and "KEYWORDS", with no date (i.e., up to 1 February 2022) or language restrictions, aimed at detecting potential documents that reported the diagnostic accuracy of the LumiraDX SARS-CoV-2 Antigen Test compared with reference molecular diagnostic methods. 

Date All references of these selected articles were also assessed for identifying other potentially includible studies. A pooled analysis based on the Mantel-Haenszel approach was finally conducted, aiming to estimate diagnostic sensitivity, specificity and accuracy (estimated as the summary receiver operating characteristic curve (SROC), agreement and Kappa statistics), with a 95% confidence interval (95%CI) and using a random effects model. Within study heterogeneity was calculated using the χ2 test and I 2 statistic [9] . The statistical analysis was performed with Meta-DiSc 1.4 (Unit of Clinical Biostatistics team of the Ramón y Cajal Hospital, Madrid, Spain) [10] .

This pooled analysis was conducted according to the preferred reporting items for systematic reviews and meta-analyses (PRISMA Checklist available as Supplementary File S1), in accordance with the Declaration of Helsinki and within the terms of local legislation. No ethical committee approval was necessary, as this is a critical literature review.

The electronic search according to the predefined criteria allowed the identification of 26 publications once between-database duplicates were eliminated. Ten of these documents could not be included since no information on LumiraDx SARS-CoV-2 Ag Test for diagnosing acute SARS-CoV-2 infection was provided (n = 1), the article did not present diagnostic accuracy data (n = 2) or the document was a critical literature review (n = 4), a commentary (n = 2) or an erratum (n = 1). Five additional documents provided diagnostic accuracy data but not in such way to be included within a cumulative 2 × 2 table. Therefore, 11 studies (n = 8527 samples) could be included in our pooled analysis [11] [12] [13] [14] [15] [16] [17] [18] [19] [20] [21] . The main characteristics of these eleven studies are shown in Table 2 . Four studies were conducted in Italy, three in Germany, two in the US and one each in Spain and Senegal. Most studies used NPS (n = 7), while NS and oropharyngeal swabs (OPS) were used in five and one study (alone or in combination), respectively. The sample size ranged from 46 to 4146. Two studies were carried out in children and adult populations, four in adult populations and one study in only children, while in four studies the demographical characteristics of the population were not provided in the published resources ( Table 2) .

The diagnostic accuracy of the LumiraDx SARS-CoV-2 Ag Test compared to reference molecular biology assays is summarized in Figure 1 .

The pooled diagnostic sensitivity and specificity of this test were as high as 0.86 (95%CI, 0.84-0.88; I2, 89.3%) and 0.99 (95%CI, 0.98-0.99; I2, 96.1%), respectively, while its high diagnostic accuracy was mirrored by an area under the SROC of 0.974 (95%CI, 0.965-0.983), an accuracy of 96.8% (95%CI, 96.4-97.1%) and a kappa statistic of 0.87 (95%CI, 0.85-0.88), thus reflecting an almost perfect agreement with the reference NAATs [22] . Notably, although three studies accounted for over 70% of the samples, with one accounting for slightly less than 50%, their exclusion did not substantially modify the outcome of our analysis.

The description of the five studies [23] [24] [25] [26] [27] that did not provide sufficient information for constructing a 2 × 2 table is provided in Table 3 (sample size, n = 4073), showing that the cumulative diagnostic sensitivity ranged between 0.60-0.99 and the diagnostic specificity was between 0.99-1.00, respectively, thus closely mirroring the figures obtained in our pooled analysis (Figure 1 ). In the two studies that explored the concordance with molecular biology techniques, the agreement was as high as 96.3% and 96.9%.

Unfortunately, the data reported in the selected studies did not allow for the construction of a 2 × 2 table for samples with high viral load, and, hence, a sub-analysis of the diagnostic accuracy of the LumiraDX SARS-CoV-2 Antigen Test in those specimens could not be conducted. Nonetheless, the information on the diagnostic sensitivity in high-viral-load samples was provided in some of the studies, as follows: 0.91 (95%CI, 0.86-0.95) in NPS samples with Ct values ≤29 according to Cento et al. [12] , 1.00 in both NS (95%CI, 0.94-1.00) and NPS (95%CI, 0.91-1.00) specimens with Ct values ≤33 according to Drain et al. [15] , 0.93 (95%CI, 0.86-0.96) [15] in NPS samples with Ct values <25 according to Krüger et al. [19] 

Due to the rapid and extreme surge in COVID-19 cases recorded all around the world connected to emergence of the new SARS-CoV-2 Omicron variant [28] , which appears to be much more infective and resistant to natural and vaccine-induced immunity compared to the former lineages [29] , the pressure on clinical laboratories has grown enormously to such a limit that many facilities are collapsing under the enormous volume of samples received [30] . This aspect has not only caused a substantial backlog of several days (or even weeks) for analyzing collected samples, but is also dramatically impairing the capacity to provide rapid test results for appropriate management of symptomatic COVID-19 cases, as well as for enabling reliable contact tracing with timely isolation of asymptomatic cases, which are still responsible for a substantial number of infections, especially those sustained by the new Omicron lineages [31] .

In this extremely challenging and troublesome scenario, the use of rapid and accurate tests that may be able to support reference molecular assays for screening or even diagnosing acute SARS-CoV-2 infections appears to be the most suitable strategy. Although a kaleidoscope of RDT-Ags have been developed and commercialized so far, the vast majority of these do not reach such a sufficient level of diagnostic sensitivity to be used in routine clinical practice, with diagnostic sensitivities frequently below 50% [32] [33] [34] . Even those tests that would meet the criteria of minimum diagnostic sensitivity (i.e., ≥80%) [6, 7] carry some additional drawbacks, such as being biased by arbitrary visual interpretation and providing mostly qualitative test results (which are hence unsuitable for longitudinal monitoring of viral load), along with the impossibility of being connected to the laboratory information system (LIS) for widespread and long-term data availability. In this perspective, the LumiraDx SARS-CoV-2 Ag Test represents a valuable opportunity, in that its diagnostic performance is aligned to those of the most sensitive SARS-CoV-2 antigen (lab-based) chemiluminescent immunoassays commercialized by DiaSorin, Roche, Ortho and Fujirebio (i.e., diagnostic sensitivity and specificity are comparable or even higher) [35] [36] [37] [38] , but it also comes as rapid POC instrumentation, thus enabling its usage outside the laboratory environment for purposes of mass (population) screening in various circumstances (e.g., crowded public places, schools, airports, social mass gatherings and so forth). Even within a hospital environment, the LumiraDx SARS-CoV-2 Ag Test may provide important benefits, such as rapid (i.e., within 12 min) patient screening in short-stay units (e.g., emergency room), longitudinal bedside monitoring of viral load in sub-intensive and intensive care wards or even widespread healthcare staff and patient testing for the rapid identification of infective clusters. Notably, the already optimal performance of the assay is likely magnified in upper respiratory tract specimens with high viral load, thus representing an ideal and versatile test for identifying the so-called "super-carriers" who, incidentally, are also "super-spreaders" of the virus [39] .

The diagnostic performance of the LumiraDX SARS-CoV-2 Antigen Test would allow the conclusion that it may be considered a cost-effective, much handier alternative, with only a slightly less reliable outcome than molecular testing for rapid preliminary screening of acute SARS-CoV-2 infections, especially in clinical specimens bearing high viral loads. Notably, a careful Bayesian-oriented approach should always be carried out, discouraging the deployment of these tests in contexts where the prevalence of COVID-19 is low and there are no reported contacts with positive cases. In such cases, the use of molecular assays is still almost unavoidable. 

The study was conducted in accordance with the Declaration of Helsinki. No ethical committee approval was necessary, as this is a critical literature review.

Coronavirus disease 2019 (COVID-19): The portrait of a perfect storm

Updated picture of SARS-CoV-2 variants and mutations

IFCC Interim Guidelines on Molecular Testing of SARS-CoV-2 Infection

SARS-CoV-2 Diagnostic Pipeline

Accuracy of novel antigen rapid diagnostics for SARS-CoV-2: A living systematic review and meta-analysis

Antigen-Detection in the Diagnosis of SARS-CoV-2 Infection-Interim Guidance

IFCC interim guidelines on rapid point-of-care antigen testing for SARS-CoV-2 detection in asymptomatic and symptomatic individuals

Editorial and Executive Summary: IFCC Interim Guidelines on Clinical Laboratory testing during the COVID-19 Pandemic

Statistics in diagnostic medicine

Meta-DiSc: A software for meta-analysis of test accuracy data

Evaluation of an antigen-based test for hospital point-of-care diagnosis of SARS-CoV-2 infection

Frontline Screening for SARS-CoV-2 Infection at Emergency Department Admission by Third Generation Rapid Antigen Test: Can We Spare RT-qPCR? Viruses

Can we trust in SARS-CoV-2 rapid antigen testing? Preliminary results from a paediatric cohort in the emergency department

Diagnosing SARS-CoV-2 with Antigen Testing, Transcription-Mediated Amplification and Real-Time PCR

Performance of the LumiraDx Microfluidic Immunofluorescence Point-of-Care SARS-CoV-2 Antigen Test in Asymptomatic Adults and Children

High-Sensitivity SARS-CoV-2 Nucleocapsid Immunoassay to Aid Diagnosis of Acute COVID-19 at the Point of Care: A Clinical Performance Study

Utilidad del test de antígenos SARS-CoV-2 de LumiraDX™ en centros residenciales [Usefulness of the LumiraDX ™ SARS-CoV-2 antigen test in nursing home

2021; epub ahead of print

The Comparative Clinical Performance of Four SARS-CoV-2 Rapid Antigen Tests and Their Correlation to Infectivity In Vitro

Evaluation of accuracy, exclusivity, limit-of-detection and ease-of-use of LumiraDx™: An antigen-detecting point-of-care device for SARS-CoV-2

Evaluation of the LumiraDx SARS-CoV-2 antigen assay for large-scale population testing in Senegal

Point of care testing using rapid automated antigen testing for SARS-CoV-2 in care homes-An exploratory safety, usability and diagnostic agreement evaluation

The measurement of observer agreement for categorical data

SARS-CoV-2 microfluidic antigen point-of-care testing in Emergency Room patients during COVID-19 pandemic

Urgent care study of the LumiraDx SARS-CoV-2 Ag Test for rapid diagnosis of COVID-19

Multicenter Technical Validation of 30 Rapid Antigen Tests for the Detection of SARS-CoV-2 (VALIDATE). Microorganisms

Analytical Sensitivity and Specificity of Four Point of Care Rapid Antigen Diagnostic Tests for SARS-CoV-2 Using Real-Time Quantitative PCR

Comparative sensitivity evaluation for 122 CE-marked rapid diagnostic tests for SARS-CoV-2 antigen

Omicron variant of SARS-CoV-2: Genomics, transmissibility, and responses to current COVID-19 vaccines

Neutralizing potency of COVID-19 vaccines against the SARS-CoV-2 Omicron (B.1.1.529) variant

American Association of Clinical Chemistry

OMICRON (B.1.1.529): A new SARS-CoV-2 variant of concern mounting worldwide fear

Aziah, I. Performance of Rapid Antigen Tests for COVID-19 Diagnosis: A Systematic Review and Meta-Analysis

Diagnostic accuracy of rapid point-of-care tests for diagnosis of current SARS-CoV-2 infections in children: A systematic review and meta-analysis

Diagnostic Accuracy of SARS-CoV-2 Antigen Tests for Community Transmission Screening: A Systematic Review and Meta-Analysis

Clinical Assessment of the DiaSorin LIAISON SARS-CoV-2 Ag Chemiluminescence Immunoassay

Diagnostic performance of the fully automated Roche Elecsys SARS-CoV-2 antigen electrochemiluminescence immunoassay: A pooled analysis

Evaluation of a high volume antigen test for detection of SARS-CoV-2

Comparative analysis of antigen and molecular tests for the detection of SARS-CoV-2 and related variants: A study on 4266 samples

Characterizing superspreading events and age-specific infectiousness of SARS-CoV-2 transmission in Georgia, USA

Data Availability Statement: Data will be available upon reasonable request to the corresponding author.

The authors declare no conflict of interest.