key: cord-0160710-hae8xt8n authors: Akilan, Thangarajah title: CxSE: Chest X-ray Slow Encoding CNN forCOVID-19 Diagnosis date: 2021-06-23 journal: nan DOI: nan sha: 479312c0bdeae415a5c0196d13dc9dcff5477774 doc_id: 160710 cord_uid: hae8xt8n The coronavirus continues to disrupt our everyday lives as it spreads at an exponential rate. It needs to be detected quickly in order to quarantine positive patients so as to avoid further spread. This work proposes a new convolutional neural network (CNN) architecture called 'slow Encoding CNN. The proposed model's best performance wrt Sensitivity, Positive Predictive Value (PPV) found to be SP=0.67, PP=0.98, SN=0.96, and PN=0.52 on AI AGAINST COVID19 - Screening X-ray images for COVID-19 Infections competition's test data samples. SP and PP stand for the Sensitivity and PPV of the COVID-19 positive class, while PN and SN stand for the Sensitivity and PPV of the COVID-19 negative class. Coronavirus, also known as COVID-19 was discovered in Wuhan, China, in December of 2019 [1] . COVID-19 has many strains and can infect animals and humans. COVID-19 is hard to detect because it has common symptoms such as cold and flu. The symptoms also range in seriousness depending on the person's immune system. Symptoms can take up to 14 days to appear after exposure. Because of this, the public disregards them as everyday common flu or cold. COVID-19 is spread through respiratory droplets when you cough, sneeze, and touch [2] . COVID-19 spread has become so severe it is shutting down our economies. There are over 127 million worldwide cases and over 2.7 million deaths as of March 29, 2021 and rising daily [3] . Chest X-rays and CT scans can be conducted quickly and efficiently for detecting COVID-19 [4] . It will allow the radiologist, pathologist, and physicians to properly learn the condition of the COVID-19 affected patients for additional care and drive specific clinical solutions to safe lives. The quicker the detection, the quicker the patient will receive treatment and can be put in quarantine to avoid further spread. This work introduces a new CNN-based solution with slow feature learning strategy to predict if the person is affected with COVID-19 using the patient's chest x-ray. The model is solely trained and tested on COVIDx CXR-2 dataset provided by the AI against COVID-19: Screening X-ray Images for COVID-19 Infections competition, which is available at data set. It comprises of over 16000 (480 × 480) chest X-ray scans taken from 15000 patients from across the world (minimum of 51 participating countries). We follow the exact training and test sets splits containing positive and negative classes to indicate COVID or non-COVID cases, and evaluate the proposed model on the hold out set that do not provide the ground truths. For performance computation we submit our model's binary label predictions to the evaluating site leaderboard and receive the results. To tackle the surge of COVID-19, the AI community has been actively developing efficient solutions for automatic detection of COVID-19 patients from various sources as an alternative/supportive to the conventional time consuming diagnosis procedures. Among them the vision-based (e.g., the medical images, like X-rays, CT scans) classification models show promising results. As data scarcity is a longstanding issue in the medical machine learning, most of the researchers go by transfer learning (TL) approach. In this direction, Gozes et al. [5] focus using the well-known UNet [6] and ResNet50-2D [7] architectures for CT scan-based COVID-19 patient classification, quantification and tracking for the patients. Similarly, Wang et al. [8] use ResNet18 architecture, and Ali et al. [9] employ ResNet50, InceptionV3 and Inception-ResNetV2 [10] models. The main aim of these TL techniques is to extract features from the small number of medical images leveraging an exhaustively trained CNN on large-scale data, then a shallow classifiers, like decision tree and SVM on the extracted feature sets. Relatively, such approaches work well. That being said, they are over dependant on the pretrained backbone models. In response to that, there are few attempts where researchers carefully [4] , [11] architect new deep learning models specifically for the detection COVID-19. In this line, this work CNN model is trained from scratch on Chest X-rays to classify COVID-19 cases. Earlier in [12] - [14] , we introduced a novel encoder-decoder (EnDec) foreground segmentation architecture that perform feature learning twice at every stage of down-sampling processing. It has two subnets (cf. Fig. 1 ): encoder (spatial subsampling) and decoder subnet (up-sample the lower dimensional bottle neck output feature map of the encoder back to the original dimension of the image). In the encoder subnet, a spatial input (layer i ) is transformed through a spatial sub-sampling convolutional (Conv) operations ((layer i+1 )), followed by an up-sampling operation using a transpose convolution ((layer i+2 )) that generates exactly matching spatial feature maps to the previous layer's input feature dimension. Fig. 1 : The proposed slow encoding Convent classifier for COVID-19 detection using chest X-rays. All Conv2D layers use ReLU activation. Now, the up-sampled feature maps are aggregated depth wise with the original input features (layer i ). Then, the aggregated new feature maps are encoded using a spatial subsampling Conv layer. In this way, an input feature map in sub-sampling stage is learnt twice before completely moving to the nextlevel of lower spatial dimension. Following that, this work upcycle the model by removing decoder subnet and refurbish it by adding dense layers on the top with a Sigmoid classifier targeting the COVID-19 patient classification using Chest Xray images. Figure 1 2) Testing Results: The proposed model is tested on the given test set on the competition site. The probability scores produces (cf. Fig. 3 ) by the model is converted into class labels using a threshold of 0.5 and it is compared against the ground truths. The model's performance is shown by a confusion matrix in Fig. 4 . Similarly, the model's probability scores on the competition set (cf. Fig. 5 ) is also converted using the same threshold and uploaded to the competition's evaluation site to get the model's overall performance as tabulated in Table I This work has introduced a new feature learning DCNN aiming for COVID-19 diagnosis using chest x-rays. This fist stage of our development shows promising outcome. The future work is dedicated to improving the model's learning ability through class-agnostic semi-supervised training approach. Coronavirus disease (covid-19) pandemic Know the facts about covid-19 Risk assessment for international dissemination of covid-19 to the asean region Covid-net: a tailored deep convolutional neural network design for detection of covid-19 cases from chest x-ray images Rapid ai development cycle for the coronavirus (covid-19) pandemic: Initial results for automated detection & patient monitoring using deep learning ct image analysis U-net: Convolutional networks for biomedical image segmentation Deep residual learning for image recognition A deep learning algorithm using ct images to screen for corona virus disease (covid-19) Automatic detection of coronavirus disease (covid-19) using x-ray images and deep convolutional neural networks Inception-v4, inception-resnet and the impact of residual connections on learning Covid-net cxr-s: Deep convolutional neural network for severity assessment of covid-19 cases from chest x-ray images sendec: An improved image to image cnn for foreground localization Video foreground extraction using multi-view receptive field and encoder-decoder dcnn for traffic and surveillance applications Double encoding -slow decoding image to image cnn for foreground identification with application towards intelligent transportation This work acknowledges IEEE SIGHT MTL, VIP lab, and DarwinAI the organizers of "AI Against COVID19 -Screening X-ray images for COVID-19 Infections".