key: cord-0732312-be1tybqd
authors: Lu, Weiping; Wei, Jianguo; Xu, Tingting; Ding, Miao; Li, Xiaoyan; He, Mengxue; Chen, Kai; Yang, Xiaodan; She, Huiyuan; Huang, Bingcang
title: Quantitative CT for detecting COVID‑19 pneumonia in suspected cases
date: 2021-08-19
journal: BMC Infect Dis
DOI: 10.1186/s12879-021-06556-z
sha: 619d232345d8daf06aefef53137866bcf31879c2
doc_id: 732312
cord_uid: be1tybqd

BACKGROUND: Corona Virus Disease 2019 (COVID-19) is currently a worldwide pandemic and has a huge impact on public health and socio-economic development. The purpose of this study is to explore the diagnostic value of the quantitative computed tomography (CT) method by using different threshold segmentation techniques to distinguish between patients with or without COVID-19 pneumonia. METHODS: A total of 47 patients with suspected COVID-19 were retrospectively analyzed, including nine patients with positive real-time fluorescence reverse transcription polymerase chain reaction (RT-PCR) test (confirmed case group) and 38 patients with negative RT-PCR test (excluded case group). An improved 3D convolutional neural network (VB-Net) was used to automatically extract lung lesions. Eight different threshold segmentation methods were used to define the ground glass opacity (GGO) and consolidation. The receiver operating characteristic (ROC) curves were used to compare the performance of various parameters with different thresholds for diagnosing COVID-19 pneumonia. RESULTS: The volume of GGO (VOGGO) and GGO percentage in the whole lung (GGOPITWL) were the most effective values for diagnosing COVID-19 at a threshold of − 300 HU, with areas under the curve (AUCs) of 0.769 and 0.769, sensitivity of 66.67 and 66.67%, specificity of 94.74 and 86.84%. Compared with VOGGO or GGOPITWL at a threshold of − 300 Hounsfield units (HU), the consolidation percentage in the whole lung (CPITWL) with thresholds at − 400 HU, − 350 HU, and − 250 HU were statistically different. There were statistical differences in the infection volume and percentage of the whole lung, right lung, and lobes between the two groups. VOGGO, GGOPITWL, and volume of consolidation (VOC) were also statistically different at the threshold of − 300 HU. CONCLUSIONS: Quantitative CT provides an image quantification method for the auxiliary diagnosis of COVID-19 and is expected to assist in confirming patients with COVID-19 pneumonia in suspected cases. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12879-021-06556-z.

Corona Virus Disease 2019 (COVID-19) is caused by severe acute respiratory syndrome coronavirus (SARS-CoV-2) [1] . It is currently a worldwide pandemic and has a huge impact on public health and socio-economic development. Real-time fluorescence reverse transcription polymerase chain reaction (RT-PCR) detection has widely been used for the diagnosis of COVID-19, but it is time consuming and its false negative rate is high [2, 3] . A lung computed tomography (CT), on the other hand, is easy to perform and has a high sensitivity when diagnosing patients suspected of having COVID-19 [4] , especially patients with COVID-19 who initially result negative to RT-PCR [5] . Although some radiology professional organizations and societies, including the Society of Thoracic Radiology (STR), the American College of Radiology (ACR), and the Radiological Society of North America (RSNA), have recommended against performing routine CT for screening and preliminary diagnosis of COVID-19 [6] , they play an important role in evaluating severe cases and monitoring disease progression [7] [8] [9] . Ground glass opacity (GGO) and consolidation are the most common CT signs of COVID-19 pneumonia [10] [11] [12] .

In addition, the artificial intelligence (AI) diagnostic system and quantitative evaluation-which is based on CT images-can help doctors quickly come up with a preliminary and differential diagnosis, assess the severity of the disease and predict clinical prognosis [13] [14] [15] [16] [17] [18] [19] .

The previous study has shown that deep learning-based segmentation systems are highly accurate in automatically delineating lesion regions (a average dice similarity coefficient of 91.6% between automatic and manual segmentations) and lesion percentage metrics (a mean estimation error of 0.3-0.8% on the validation dataset) [20] .

However, the definition of GGO and consolidation in conventional CT diagnosis is based on human visual assessment, which also serves as the gold standard for AI automatic delineation training [10] [11] [12] 17] . Human visual assessment is arbitrary and can change from person to person and between institutes. Even if some quantitative analysis uses a single CT threshold to segment GGO and consolidation, there is no universal standard [16, 21] . The study of using different CT thresholds to distinguish GGO and consolidation has been completed in pulmonary subsolid nodules [22, 23] , but has not yet been applied to COVID-19 pneumonia. The purpose of this study is to define GGO and consolidation based on the segmentation of different CT thresholds, and to apply a quantitative analysis to determine the best parameters for distinguishing between patients with or without COVID-19 pneumonia.

Data on patients suspected of having COVID-19 from January 2020 to March 2020 in Shanghai Pudong New Area Gongli Hospital was continuously collected. According to the "Diagnosis and Treatment Protocol for Novel Coronavirus Pneumonia (Trial Version 7)" by National Health Commission of China [2] , suspected cases needed to take into account epidemiological history and clinical manifestations (fever and/or respiratory symptoms, normal or decreased white blood cell and lymphocyte count). Inclusion criteria: chest imaging characteristics, including GGO and consolidation; epidemiological history plus any one clinical manifestation, or all two clinical manifestations (if no clear epidemiological history). Image datasets affected by respiratory artifacts in whom image processing and analysis could not be completed were excluded. If the RT-PCR detection resulted positive in coronavirus nucleic acid, it was considered a confirmed case (COVID-19 group). If two consecutive tests gave negative results (sampling time of at least 24 h apart) and the novel coronavirus-specific antibodies IgM and IgG were still negative after 7 days, the case was considered excluded (non-COVID-19 group).

Non-contrast enhanced CT examinations were acquired using a multidetector CT scanner with 64 detector rows (LightSpeed VCT, GE Healthcare, USA). The patients were placed in a supine position with their head entering the scanner first. They then inhaled and held their breath. Their lungs-from the entrance of the rib cage to the lower edges of the costal arches on both sides-were scanned all at once. Scanning parameters: tube voltage of 120 kV, tube current of automatic milliamp, collimation width of 40 mm, screw pitch of 0.984, tube rotation time of 0.6 s, layer thickness of 5 mm, layer spacing of 5 mm and matrix of 512 × 512. The high-resolution algorithm reconstructed lung window with 1.25 mm layer thickness, 1200 Hounsfield units (HU) window width and − 600 HU window level. The soft tissue algorithm reconstructed mediastinum window with 1.25 mm layer thickness, 350 HU window width and 40 HU window level.

The automatic identification and quantitative analysis of infection lesions (GGO and consolidation) were performed by an AI imaging diagnosis system (uAI Discover-2019nCoV, Shanghai United Imaging Intelligence Co., Ltd, China). The software used an improved 3D convolutional neural network (VB-Net) to segment the lung CT images, and used the human-in-the-loop (HITL) strategy to iteratively update the model. Specifically, the first segmentation network based on manually contoured CT data was used as an initial model, and then the initial model was applied to the next batch of infection areas, followed by manual correction. In this way of human-machine interaction, the training dataset was iteratively increased, and the final VB-Net model was built [20] . Two expert radiologists in consensus, blinded to clinical information and RT-PCR results, performed artificial contouring and correction. The software finally realised the automatic extraction of the lungs (five lung lobes and 18 lung segments) and the lesion area. It then calculated the parameters, such as the lung lobe segment volume, the infection volume, and the percentage of the infection volume in the lung lobe segment (infection percentage). The CT value distribution of infection lesions was divided into the following eight thresholds: -500 HU, -450 HU, -400 HU, -350 HU, -300 HU, -250 HU, -200 HU and − 160 HU [22, 23] . The part below the threshold was defined as GGO, the part above the threshold was defined as consolidation. The volume of GGO (VOGGO), GGO percentage in the whole lung (GGOPITWL), volume of consolidation (VOC), consolidation percentage in the whole lung (CPITWL) and GGO percentage in the total lesion (GGOPITTL) were calculated (Fig. 1 ).

Measurement data conforming to the normal distribution was described as Mean ± Standard Deviation (Mean ± SD); measurement data of the skew distribution was described as Median (Md) [Interquartile Range (IQR)]; and counting data was described as composition ratio. Receiver operating characteristic (ROC) curves were performed to evaluate the performance of quantitative parameters at different CT thresholds for diagnosing COVID-19 pneumonia. Using the VOGGO and GGOPITWL at a threshold of -300 HU as a reference, the DeLong test was used to compare the areas under the curve (AUCs). Baseline information, quantitative CT characteristics and quantitative parameters at a threshold of -300 HU between COVID-19 and non-COVID-19 groups were analysed using a Mann-Whitney U test for differences. All of the data was statistically analysed using the MedCalc 19.2 (MedCalc Software Ltd, Ostend, Belgium; https:// www. medca lc. org) software. A two-tailed p value of less than 0.05 was considered statistically significant.

A total of 47 cases-23 males and 24 females-aged from 13 to 81 years, with a median age of 41 years were considered. Among them, 38 cases were in the non-COVID-19 group with a median age of 39 (IQR 21.5) years, a female proportion of 50% and a median time of three (IQR 4.5) days from initial symptom onset to first CT scan. Nine cases were in the COVID-19 group with a median age of 67 (IQR 19) years, a female proportion of 55.56% and a median time of three (IQR 4) days from initial symptom onset to first CT scan. None of the patients had undergone any treatment until the first CT examination. There were statistical differences in age between the two groups, and no statistical differences in gender and time from initial symptom onset to first CT scan. See Table 1 for details.

In the COVID-19 group, the infection volume and percentage of the whole lung, right lung, right upper lobe (RUL), right middle lobe (RML), right lower lobe (RLL) were 208.70 (IQR 347.50) cm 3 and 6.40% (IQR 9.85%), 146.60 (IQR 208.25) cm 3 Table 1 for details.

The ROC curves of quantitative parameters VOGGO, GGOPITWL, VOC, CPITWL and GGOPITTL under eight different thresholds were drawn. An efficacy analysis of the diagnosis of COVID-19 was performed and the respective AUC values were obtained ( Table 2 ). The AUC values of VOGGO and GGOPITWL were higher than the other parameters, with the maximum value being found at the threshold of − 300 HU (Fig. 2) . The AUC value of VOGGO was 0.769 (p = 0.0124) with sensitivity of 66.67%, specificity of 94.74% and the best cutoff value of > 135.9 cm 3 ; the AUC value of GGOPITWL was 0.769 (p = 0.0147) with sensitivity of 66.67%, specificity of 86.84% and the best cutoff value of > 2.3% (Table 3 ; Fig. 3 ). The CPITWL at thresholds of − 400 HU, − 350 HU, and − 250 HU-compared to the AUC values of VOGGO or GGOPITWL at the threshold of − 300 HU-were statistically different, and there was no difference among others (Fig. 4) .

At a threshold of -300 HU, the differences of VOGGO (p = 0.013), GGOPITWL (p = 0.013) and VOC (p = 0.048) between the COVID-19 and non-COVID-19 group were statistically significant, while CPITWL (p = 0.096) and GGOPITTL (p = 0.417) had no statistical difference. See Table 4 for details and Additional file 1: Table S1 for other thresholds. 

A lung CT plays an important role in the screening, diagnosis, evaluation, monitoring and follow-up of COVID-19 patients [4, 5, 7, [24] [25] [26] . Our study defined GGO and consolidation by segmenting different CT thresholds, and concluded that the parameters VOGGO and GGO-PITWL had the highest diagnostic efficacy when the threshold was at -300 HU. To the best of our knowledge, this is the first study on quantitative CT analysis which uses different threshold segmentation methods to distinguish between COVID-19 and non-COVID-19 patients in suspected cases. We provide a quantitative method to help doctors diagnose COVID-19 pneumonia.

The study on the application of quantitative CT to COVID-19 pneumonia has been reported in many literatures. Shen et al. [18] believe that quantitative methods can accurately assess the severity and distribution of COVID-19 pneumonia lesions. Lyu et al. [7] also find that the combination of quantitative and qualitative methods can improve the feasibility of the disease severity assessment. Liu et al. [16] find that CT quantitative analysis of lesions can predict the progression to severe diseases at an early stage. In addition, Du et al. [26] applied AI software to quantitative analysis and found that GGO and fibrosis are the main CT features of COVID-19 patients who meet the discharge criteria, and will gradually regress during follow-up. Yu et al. [17] also used quantitative CT analysis to conclude that a large consolidation of the upper lung at admission is associated with a poor prognosis in COVID-19 patients. In contrast, quantitative CT analysis was used to distinguish between COVID-19 and non-COVID-19 patients based on the automatic identification of lesions by AI in our study. The results showed that the infection volume and percentage of the whole lung, right lung and lobes were statistically different between the COVID-19 and non-COVID-19 groups. In addition, at a threshold of -300 HU, the differences of VOGGO, GGOPITWL and VOC between the two groups were also statistically significant, and the AUC values of VOGGO and GGOPITWL were 0.769 and 0.769, with sensitivity (66.67%, 66.67%) and There is currently no universal standard for defining CT thresholds for GGO and consolidation. Scholten et al. [22] find that, compared with manual measurements, the semi-automatic measurement of solid components in pulmonary subsolid nodules at a threshold of -300 HU has very good sensitivity (90%) and specificity (88%). The study of Cohen et al. [23] shows that at a threshold of -350 HU, the solid components of pulmonary subsolid nodules that automatically segment have no obvious difference from a pathology. The two most effective parameters (VOGGO and GGOPITWL) for diagnosing COVID-19 pneumonia in this study are at a threshold of -300 HU, which is the same as the segmentation threshold studied by Scholten et al. This study has the following limitations: first, this is a small sample and single-center study, with age differences between COVID-19 and non-COVID-19 patients, which requires further proper validation in another large scale database; second, GGO and consolidation change with the progression of the disease course [8, 9] , but this study fails to carry out a stratified analysis based on the disease development; third, all quantitative analysis is performed on the basis of AI segmentation of lung CT images and automatic extraction of lesions. Therefore, a larger dataset training is required to improve the accuracy of AI.

Quantitative CT is a promising tool for detecting COVID-19 pneumonia in suspected cases, especially when the CT threshold is at -300 HU, the quantitative 

Clinical characteristics of Coronavirus Disease 2019 in China

Diagnosis and treatment protocol for novel coronavirus pneumonia (Trial Version 7)

Chest CT for typical coronavirus disease 2019 (COVID-19) pneumonia: relationship to negative RT-PCR testing

Correlation of chest CT and RT-PCR testing for coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases

Can chest CT features distinguish patients with negative from those with positive initial RT-PCR results for coronavirus disease (COVID-19)?

Radiological Society of North America Expert consensus statement on reporting chest CT findings related to COVID-19. Endorsed by the Society of Thoracic Radiology, the American College of Radiology, and RSNA-Secondary Publication

The performance of chest CT in evaluating the clinical severity of COVID-19 pneumonia: identifying critical cases based on CT characteristics

Time course of lung changes at chest CT during recovery from Coronavirus Disease 2019 (COVID-19)

Clinical and high-resolution CT features of the COVID-19 infection: comparison of the initial and follow-up changes

CT imaging features of 2019 novel coronavirus (2019-nCoV)

Radiological findings from 81 patients with COVID-19 pneumonia in Wuhan, China: a descriptive study

Interpretation of CT signs of 2019 novel coronavirus (COVID-19) pneumonia

Artificial intelligence augmentation of radiologist performance in distinguishing COVID-19 from pneumonia of other origin at chest CT

Using artificial intelligence to detect COVID-19 and community-acquired pneumonia based on pulmonary CT: evaluation of the diagnostic accuracy

Artificial intelligence-enabled rapid diagnosis of patients with COVID-19

CT quantification of pneumonia lesions in early days predicts progression to severe illness in a cohort of COVID-19 patients

Multicenter cohort study demonstrates more consolidation in upper lungs on initial CT increases the risk of adverse clinical outcome in COVID-19 patients

Quantitative computed tomography analysis for stratifying the severity of Coronavirus Disease

Clinically applicable AI system for accurate diagnosis, quantitative • fast, convenient online submission • thorough peer review by experienced researchers in your field • rapid publication on acceptance • support for research data, including large and complex data types • gold Open Access which fosters wider collaboration and increased citations maximum visibility for your research: over 100M website views per year submit your research ? Choose BMC and benefit from: ? Choose BMC and benefit from: measurements, and prognosis of COVID-19 pneumonia using computed tomography

Lung infection quantification of COVID-19 in

A novel deep learning-based quantification of serial chest computed tomography in Coronavirus Disease 2019 (COVID-19)

Detection and quantification of the solid component in pulmonary subsolid nodules by semiautomatic segmentation

Software performance in segmenting ground-glass and solid components of subsolid nodules in pulmonary adenocarcinomas

Clinical characteristics of 138 hospitalized patients with 2019 novel coronavirus-infected pneumonia in Wuhan

Chest CT findings in coronavirus disease-19 (COVID-19): relationship to duration of infection

Chest lesion CT radiological features and quantitative analysis in RT-PCR turned negative and clinical symptoms resolved COVID-19 patients

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

The authors are grateful to Dr. YW for reviewing this paper and for her helpful suggestions.

parameters VOGGO and GGOPITWL have a higher specificity in the diagnosis of COVID-19 pneumonia. 

The online version contains supplementary material available at https:// doi. org/ 10. 1186/ s12879-021-06556-z.Additional file 1: Table S1 . Comparison of quantitative parameters with different thresholds between COVID-19 and non-COVID-19.