key: cord-271469-lozvq3y6
authors: Shaikh, Faiq; Anderson, Michael; Sohail, M. Rizwan; Mulero, Francisca; Awan, Omer; Dupont-Roettger, Diana; Kubassova, Olga; Dehmsehki, Jamshid; Bisdas, Sotirios
title: Current landscape of Imaging and the potential role for Artificial intelligence in the management of COVID-19
date: 2020-06-27
journal: Curr Probl Diagn Radiol
DOI: 10.1067/j.cpradiol.2020.06.009
sha: 
doc_id: 271469
cord_uid: lozvq3y6

The clinical management of COVID-19 is challenging. Medical imaging plays a critical role in the early detection, clinical monitoring and outcomes assessment of this disease. Chest x-ray radiography (CXR) and computed tomography (CT) are the standard imaging modalities used for the structural assessment of the disease status, while functional imaging (namely, positron emission tomography) has had limited application. Artificial intelligence (AI) can enhance the predictive power and utilization of these imaging approaches and new approaches focusing on detection, stratification and prognostication are showing encouraging results. We review the current landscape of these imaging modalities and AI approaches as applied in COVID-19 management.

The clinical management of COVID-19 is challenging. Medical imaging plays a critical role in the early detection, clinical monitoring and outcomes assessment of this disease. Chest x-ray radiography (CXR) and computed tomography (CT) are the standard imaging modalities used for the structural assessment of the disease status, while functional imaging (namely, positron emission tomography) has had limited application. Artificial intelligence (AI) can enhance the predictive power and utilization of these imaging approaches and new approaches focusing on detection, stratification and prognostication are showing encouraging results. We review the current landscape of these imaging modalities and AI approaches as applied in COVID-19 management.

The clinical presentation of COVID-19 COVID-19 is primarily a respiratory tract infection caused by the SARS-CoV2 virus. Infection spreads from human to human via small droplets and potentially aerosol [1] . The incubation period for COVID-19 ranges from 2-14 days, averaging 5.2 days [2] . During this time, an asymptomatic patient can transmit the virus to other people, making it a highly contagious infection [2] . The typical symptoms include cough, sneezing, fever, malaise, body aches, and shortness of breath [2] . The virus initially infects and replicates in upper airways with subsequent spread involving the lung parenchyma (the alveolar sacs). However, some patients present solely with digestive symptoms and the virus is only isolated in stool samples, without symptomatic involvement of the airways. Thus, fecal-oral transmission has been purported [2] . The diagnosis is based on reverse polymerase chain reaction (rPCR) testing of nasopharyngeal swab, although newer and faster tests are becoming available, including the one performed on saliva [3] .

SARS-CoV2 may infect any individual, but elderly, immunocompromised, and those with pre-existing cardiovascular and pulmonary conditions are at a higher risk of severe disease and death [4] . Most of the morbidity due to COVID-19 results from involvement of the respiratory tract. However, although infrequent, there is an increasing concern for neurologic manifestations of COVID-19, such as encephalitis and myopathy occurring in younger patients [5, 6] .

Some patients with COVID-19 may rapidly progress to develop acute respiratory distress syndrome (ARDS), which is characterized by rapid onset of widespread inflammation in the lungs, limiting the adequate air exchange. This is due to the diffuse injury to the alveolar cells caused both by the viral infection and the immune response to it. Clinically, these patients are typically dyspneic, tachypneic, and cyanotic [6] . With limited efficacy of direct anti-viral therapy, the management is primarily based on supportive care including mechanical ventilation, with severe cases requiring extracorporeal membrane oxygenation (ECMO) [7] , fluid and electrolyte management, and anti-coagulation in selected cases. The mortality rate of patients with ARDS ranges from 35 to 50% but can be as high as 80% in patients with COVID-19 [7] . A possible reason for the very high mortality rate in these patients could be an association with an increased risk of thromboembolic disease including pulmonary emboli. Recent data suggest an incidence up to 31% in the critically ill patients [8] .

SARS-CoV2 is a positive-sense, single-strand RNA, beta-coronavirus [9] . RNA viruses have a greater mutation rate than DNA viruses, which is one reason why SARS-CoV2 is highly adaptive and sustainable [10] . This virus comprises four main proteins: spike, membrane, envelope and nucleocapsid proteins [11] . SARS-Cov2 enters the host cells, which are primarily pneumocyte type II cells, using the Angiotensin-cell converting enzyme II (ACE-II) receptor [12] . Once the virus attaches and enters the host cell (through endocytosis), its single-stranded RNA replicates more copies of itself using the RNA-dependent RNA polymerase within the host cell cytoplasm. This viral progeny then acquires a new envelope from the cell membrane and exits the host cell [12] . The immune response that is elicited by the host against the virus results in damage to the lungs and is composed of both cellular and humoral components. The CD-4 T helper cells mediate an immune response to the viral infection. The CD8 T cytotoxic cells secrete perforin, granzyme, interferon-gamma, and a wide range of chemokines, including IL-1, IL-6, IL-8, IL-21, TNF-beta and MCP-1. These are implicated in orchestrating a "cytokine storm" that causes severe alveolar destruction and leads to acute respiratory distress syndrome (ARDS) [13] . The humoral arm of the immune system mediated by B cells releases antibodies specific to viral antigens (spike protein on the SARS-Cov2 envelope).

The role of medical imaging in the clinical management of COVID19 is evolving. At the frontline, chest x-ray (CXR), computed tomography (CT), and even ultrasonography (US) have been performed to complement the clinical diagnosis and monitor the clinical course of the disease (Table 1) . More recently, more articulated guidelines for CT imaging in COVID-19 patients have been released, including the Fleischner society guidelines, which posits that imaging is not indicated in asymptomatic individuals or even those with mild symptoms suspected to have COVID-19 [14] . It is primarily reserved for patients with moderate to severe features of COVID19 regardless of the test results as a means of medical triage and complimenting the diagnosis and may be limited to patients with functional impairment and/or hypoxemia after recovery from COVID-19 [14] .

CXR imaging can be negative for the first few days of symptomatic infection. When positive, it shows bilateral diffuse patchy opacities with some bibasilar sparing (Fig. 1 ) [13] . CT findings of COVID-19 typically include bilateral ground-glass, consolidative, or rounded opacities, showing a more peripheral pattern of distribution (Fig. 2) . In about 20% of the cases, there may be a crazy paving pattern (interlobular septal thickening superimposed on groundglass opacities) (Fig. 3 ) [16] . Serial CT imaging may be performed to assess the density and the pattern of these opacities to determine progression or regression of the disease [14] . Typically, there is no evidence of lung cavitation, discrete nodules, pleural effusion or lymphadenopathy. If these CT imaging features are present in a COVID-19 positive patient, it should raise the suspicion of super infection. There is, however, a growing number of cases that have associated pulmonary emboli [15] [16] [17] (Fig. 4) .

Though not broadly reflected on the population statistics with regards to the cardinal symptoms and outcomes of the present pandemic [18] , there was early concern of the neurological complications related to this specific virus [19] . It has been postulated that the neurologic symptoms are mostly observed in patients with severe ARDS [20] but soon the clinical manifestations (incl. headache, nausea, and vomiting, acute cerebrovascular events, impaired consciousness) were recognized also in patients without severe respiratory infection [21] . The SARS-CoV-2 infection linkage to a prothrombotic state causing venous and arterial thromboembolism and elevated D-dimer levels has been primarily implicated as a cause [22] . Abnormal coagulation parameters are associated with poor prognosis in patients with novel coronavirus pneumonia [22] . The secondary effects of the immunologic and inflammatory responses directed towards the nervous system are likely causative but the neuroinvasive propensity, demonstrated as a common feature of coronaviruses is also thought to hold true for the SARS-CoV2, which probably enters and affects the medullary neurons during the latency period due to its propensity for endothelial cells disruption. This possibly contributes to the acute respiratory failure in certain patients [23] . Finally, a subset of patients experience peripheral nervous system manifestations such anosmia and ageusia [24] .

Currently, the imaging features related to the neurologic complications of the virus are consistent with stroke related to large vessel occlusion and encephalopathy (Fig. 5) with reported leptomeningeal enhancement and cranial nerve palsies [25, 26] , which in the vast majority are seen in subjects with severe alternate manifestations of Covid-19 infection [27, 28] . It is occasionally quite difficult to distinguish the ischemic events related to the viral replication from pre-existing competing vascular risk factors and mechanisms and larger cohorts with well documented co-morbidities and clinical details are required. Nonetheless, the anecdotal experience suggests that in a significant amount of cases associated with diverse neurological signs, even when the imaging has been generally regarded as unrevealing or often normal.

Another functional imaging modality of interest in the context is the dual energy CT (DECT). By acquisition of two separate CT series at respectively high and low kilovolt peak (kVp), it is possible to calculate iodine density, average effective atomic number, or virtual mono energetic images [29] . DCET showing low iodine density suggests a decreased blood flow within the opacifications, which is in contrast with an increase in iodine density in the rim of these opacifications. This observed phenomenon may be explained by the hypoxemia possibly related to micro-emboli [30] .

Positron emission tomography (PET) is the hallmark of functional imaging. 18Ffluorodeoxyglucose (FDG) is the staple radiotracer that is used for the assessment of metabolic activity of disease processes, especially malignant diseases. Infectious/inflammatory processes can be intensely FDG-avid given the role of cytokines in the upregulation of glucose receptors leading to increased FDG uptake [31] . FDG-PET may be used for the assessment of the degree of infection or inflammatory response to it in infectious lung diseases. FDG-PET has been used in various infectious diseases, such as HIV/AIDS, toxoplasmosis, and osteomyelitis, among others [32] . PET scan is generally not used in the management of pneumonia but may offer the following benefits -(1) early identification of inflammatory processes which cannot be seen by CT scan alone, (2) quantifiable assessment of disease progression/regression based on the delta difference in the signal reflecting changes in the inflammatory/infectious process, and (3) early detection of sequelae such as pleuritis, abscess or sepsis [32] . Given that it has been shown to be useful for imaging lung infections, such as tuberculosis and atypical pneumonia [33] , its potential role in COVID19 management, albeit small may be extrapolated (Fig. 6) .

Few would argue that AI is causing a paradigm shift in health care and there might be value in the application of AI to the current COVID-19 outbreak. Applications of AI in COVID-19 range from predicting risk of infection to curation of health records and diagnostic imaging [34, 35] . There is a strong interest for AI applications in COVID-19 lung CT and X-ray imaging. A comprehensive review of this landscape is beyond the scope of this article, but we will highlight a few key areas of development. Almost all AI models being designed for COVID-19 have a clinical focus. There are several major competitions focusing on this domain, including the MIT -COVID-19 challenge and the Imaging COVID19 AI [36, 37] . Within structural imaging, the main areas where AI has been applied include detection of COVID-19 findings on CXR/CT [38] . There are several studies that have showcased AI models that differentiate imaging features of COVID-19 from those of community acquired pneumonia and have shown a variable rate of accuracy and predictive power [39] [40] [41] [42] [43] [44] [45] (Table 2) . Most recently, quantitative imaging approaches driven by machine learning, such as Radiomics have also been leveraged as a tool for automated diagnosis of COVID-19 [46] . While most of these studies show fairly sizeable training datasets and impressive accuracy rates, there is a tremendous opportunity to homogenize/standardize these models to create a unified platform for AI-based detection of COVID-19 on CXR/CT. Beyond that, AI-based approaches have been used for the quantification of disease progression for the purpose of severity assessment [47] . These models focus on the calculating the delta difference in the extent/spread of the patchy opacities in the lungs, and study other features such as hyperinflation/hyperlucency and vascular changes.

These AI methodologies can be considered as a "radiologist assistant" as a form of computer-aided diagnosis useful in settings where the expert radiologist is overburdened or unavailable. A more "automated" model may be useful to non-imaging physicians in more urgent settings. On the other hand, within a clinical trial setting, such models can assess qualitative changes and provide quantitative scores of pathophysiologic processes, such as fibrosis, hyperinflation, and changes in vascular flow; which can be used as secondary or surrogate diagnostic and prognostic biomarkers. A much more challenging task is to detect early signs (or "predict") neurological manifestations or complications of COVID-19. The scenario of new neurological impairment on a previously healthy subject with typical COVID-19 lab findings and respiratory symptoms is an ideal case for definite diagnosis; however, healthy otherwise subjects presenting with nonspecific headache and dizziness in absence of other COVID-19 related evidence may pose a diagnostic challenge. For instance, patients with slurred speech, unilateral weakness, nerve palsies, disorientation, hallucinations, and neuropsychiatric disorders in the background of existing neurological diseases [48] . Furthermore, patients on immunosuppressive medications for autoimmune diseases, such as multiple sclerosis, who may be at a higher risk for developing complications, pose extreme but real scenarios that will benefit from an AI-assisted diagnosis. So far, there has been no initiative undertaken for these patient groups and certainly nonspecific brain MRI features pose difficulties for an early diagnosis. However, a worthy goal is to create an algorithm that will combine "hidden" patterns in "rich" images as distinct from other diseases, taking into account clinical signs and laboratory findings to conduct risk assessment, possibly early diagnosis, and prediction of long-term effects. Additionally, predictive analytics can triage mildly or moderately ill patients in need of beds, and who can safely go home, with neurology hospital resources stretched thin, analogously to a recently published study for respiratory symptoms [49] .

The volume of evidence and experience with imaging for COVID-19 is growing exponentially. And AI is becoming increasingly employed to automate and/or improve the analysis and interpretation of these studies. As we enter what might be the later stages of the pandemic, hopefully, we are becoming more adept and nuanced in how we use imaging and AI to manage patients with COVID-19 better. These experiences, along with the trained AI models shall serve us to optimize imaging-based management of other infectious/inflammatory lung diseases in the future as well. 

Presumed Asymptomatic Carrier Transmission of COVID-19

High Prevalence of Concurrent Gastrointestinal Manifestations in Patients with SARS-CoV-2: Early Experience from California

COVID 19: Neuromuscular Manifestations

Viral Dynamics in Mild and Severe Cases of COVID-19

Treatment for Severe Acute Respiratory Distress Syndrome from COVID-19, The Lancet Respiratory Medicine

On the origin and continuing evolution of SARS-CoV-2. National Science Review

Confirmation of the high cumulative incidence of thrombotic complications in critically ill ICU patients with COVID-19: An updated analysis

Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2): An overview of viral structure and host response

Severe acute respiratory syndrome coronavirus pathogenesis, disease and vaccines: an update. The Pediatric infectious disease journal

SARS-CoV-2: a storm is raging. The Journal of Clinical Investigation

Imaging Profile of the COVID-19 Infection: Radiologic Findings and Literature Review

Frequency and distribution of chest radiographic findings in COVID-19 positive patients

Chest CT findings in coronavirus disease-19 (COVID-19): relationship to duration of infection

Findings of acute pulmonary embolism in COVID-19 patients. Available at SSRN 3548771

COVID-19 complicated by acute pulmonary embolism. Radiology: Cardiothoracic Imaging

Acute pulmonary embolism associated with COVID-19 pneumonia detected by pulmonary CT angiography

Deaths from Covid-19: Who are the forgotten victims?. medRxiv

Du Pasquier R. Two patients with acute meningo-encephalitis concomitant to SARS-CoV-2 infection. medRxiv

Neurologic features in severe SARS-CoV-2 infection

Neurologic manifestations of hospitalized patients with coronavirus disease

Abnormal coagulation parameters are associated with poor prognosis in patients with novel coronavirus pneumonia

The neuroinvasive potential of SARS-CoV2 may play a role in the respiratory failure of COVID-19 patients

COVID-19 presenting with ophthalmoparesis from cranial nerve palsy

Anosmia and ageusia: common findings in COVID-19 patients. The Laryngoscope

Neurologic features in severe SARS-CoV-2 infection

Large-Vessel Stroke as a Presenting Feature of Covid-19 in the Young

Characteristics of ischaemic stroke associated with COVID-19

Computerized transverse axial scanning (tomography): Part 1. Description of system. The British journal of radiology

Hypoxaemia related to COVID-19: vascular and perfusion abnormalities on dual-energy Ct. Min

FDG PET of infection and inflammation

FDG PET/CT in infection and inflammation-current and emerging clinical applications

FDG-PET imaging in Pneumocystis carinii pneumonia. Clinical nuclear medicine

Augmented Curation of Unstructured Clinical Notes from a Massive EHR System Reveals Specific Phenotypic Signature of Impending COVID-19 Diagnosis

Review of artificial intelligence techniques in imaging data acquisition, segmentation and diagnosis for covid-19

Artificial intelligence for rapid identification of the coronavirus disease 2019 (COVID-19). medRxiv

Review of artificial intelligence techniques in imaging data acquisition, segmentation and diagnosis for covid-19

Artificial intelligence distinguishes COVID-19 from community acquired pneumonia on chest CT

A tailored deep convolutional neural network design for detection of COVID-19 cases from chest radiography images

A deep learning algorithm using CT images to screen for Corona Virus Disease (COVID-19)

Covid-19: automatic detection from x-ray images utilizing transfer learning with convolutional neural networks. Physical and Engineering Sciences in Medicine

Automatic detection of coronavirus disease (covid-19) using xray images and deep convolutional neural networks

Covid-caps: A capsule network-based framework for identification of covid-19 cases from x-ray images

CT radiomics can help screen the coronavirus disease 2019 (COVID-19): a preliminary study

Severity assessment of coronavirus disease 2019 (COVID-19) using quantitative features from chest CT images

Neurologic features in severe SARS-CoV-2 infection

Towards an artificial intelligence framework for data-driven prediction of coronavirus clinical severity

Convolutional neural net. 80.5% and 67.1%, specificity of 84