key: cord-0983911-uo6kg9kw
authors: Belhassen-García, Moncef; Sánchez-Puente, Antonio; Dorado-Díaz, Pedro-Ignacio; López-Bernús, Amparo; Sampedro-Gómez, Jesús; Azibeiro-Melchor, Raúl; Marcano-Millán, Edgard; Rodríguez-Alonso, Beatriz; Sánchez-Barrado, María-Elisa; Hernández-García, Ignacio; Madruga, Ignacio; Hernández-Pérez, Guillermo; Carbonell, Cristina; García-Aparicio, Judit; Burgos, Laura; López-Sánchez, Eugenia; Reina, Carlos; Ramón, Ana-María; Cestero-Ramírez, Laura; Boumhir, Fátima; Encinas-Sánchez, Daniel; Sánchez-Ledesma, María; Herráez, Jacinto; Araoz, Patricia; Sánchez-Crespo, María-José; Rodríguez-Rodríguez, Sandra; Rodríguez-Gude, Ana-Elisa; Sánchez-Hernández, Miguel-Vicente; Borrás, Rafael; Sagredo-Meneses, Víctor; Sánchez, Pedro-Luis; Marcos, Miguel; Martín-Oterino, José-Ángel
title: Date of Admission during COVID-19 Pandemic Impacted Patient Outcomes in Addition to the Higher Efficacy of Tocilizumab Plus High-Dose Corticosteroid Therapy Compared to Tocilizumab Alone
date: 2021-12-30
journal: J Clin Med
DOI: 10.3390/jcm11010198
sha: 1b12ccec90645161856fbbb82fcf08fd79db6c35
doc_id: 983911
cord_uid: uo6kg9kw

Background: The evidence for the efficacy of glucocorticoids combined with tocilizumab (TCZ) in COVID-19 comes from observational studies or subgroup analysis. Our aim was to compare outcomes between hospitalized COVID-19 patients who received high-dose corticosteroid pulse therapy and TCZ and those who received TCZ. Methods: A retrospective single-center study was performed on consecutive hospitalized patients with severe COVID-19 between 1 March and 23 April 2020. Patients treated with either TCZ (400–600 mg, one to two doses) and methylprednisolone pulses (MPD-TCZ group) or TCZ alone were analyzed for the occurrence of a combined endpoint of death and need for invasive mechanical ventilation during admission. The independence of both treatment groups was tested using machine learning classifiers, and relevant variables that were potentially different between the groups were measured through a mean decrease accuracy algorithm. Results: An earlier date of admission was significantly associated with worse outcomes regardless of treatment type. Twenty patients died (27.0%) in the TCZ group, and 33 (44.6%) died or required intubation (n = 74), whereas in the MPD-TCZ group, 15 (11.0%) patients died and 29 (21.3%) patients reached the combined endpoint (n = 136; p = 0.006 and p < 0.001, respectively). Machine learning methodology using a random forest classifier confirmed significant differences between the treatment groups. Conclusions: MPD and TCZ improved outcomes (death and invasive mechanical ventilation) among hospitalized COVID-19 patients, but confounding variables such as the date of admission during the COVID-19 pandemic should be considered in observational studies.

Coronavirus disease 2019 (COVID-19) has evolved into a global pandemic with a profound impact on public health. Approximately 20% of cases may develop severe COVID-19 infection with pneumonia, which could potentially lead to hypoxic respiratory failure, acute respiratory distress syndrome, and/or septic shock [1, 2] . Patients with severe or critical COVID-19 usually display features of systemic inflammation, with increased levels of proinflammatory cytokines (interleukin (IL)-1 or IL-6) and other acute phase reactants (C-reactive protein (CRP), D-dimer or ferritin [3] ). This hyperinflammatory response to SARS-CoV-2 has been suggested to play a key role in the pathogenesis of severe COVID-19, including lung damage and microvascular thrombosis [4] .

Accordingly, immunomodulatory drugs such as glucocorticoids have been proposed as a treatment for patients with severe COVID-19 to tackle hyperinflammation and immune dysregulation [5] . Indeed, the use of dexamethasone and other glucocorticoids in severe COVID-19 has been associated with lower mortality in several trials [6] . Although controversial results have been reported, evidence also suggests that the use of interleukin (IL)-6 antagonists, such as tocilizumab (TCZ), is associated with a mortality benefit [7, 8] . It is uncertain, however, whether the combined use of TCZ and glucocorticoids improves survival, but limited evidence from observational studies [9] and a subgroup analysis of an open-label trial [10] point toward a potential benefit of this combination. Observational studies, however, have potential limitations, such as differences in patients characteristics between groups, the availability of drugs at any given time, and mortality differences in different time points of the pandemic [11, 12] . These limitations may be partially overcome with the use of advanced statistical techniques and previously validated prognostic scores to adjust baseline risk, such as the COVID-19 Salamanca Risk Score [13] .

Therefore, the aim of our study was to compare, by means of machine learning methodology, the outcomes of hospitalized patients with COVID-19 who received TCZ compared with those who received TCZ and high-dose glucocorticoid pulse therapy.

We performed a retrospective study at a 1000-bed university tertiary care hospital located in Salamanca (northwestern Spain). Consecutive patients admitted due to severe COVID-19 from 1 March to 23 April (peak of the first wave in our center) were analyzed for this study. Patients with COVID-19 were considered to have severe disease because of respiratory failure or other organ dysfunction assessed by Sequential Organ Failure Assessment (SOFA) score > 2, which received per protocol in our center TCZ and/or corticosteroids. TCZ was administered according to our hospital protocol and the treatment consisted of two doses until 26 March (administered at a dosage of 8 mg/kg (max 800 mg) by two consecutive administrations 8 h apart) and one dose thereafter (600 mg (400 mg for weight < 70 kg)), due to the recommendation issued on this date by the Spanish Agency of Medicines and Medical Devices (AEMPS) based on drug shortage. High-dose corticosteroid pulse therapy was administered according to the hospital protocol after 26 March (250 mg of intravenous methylprednisolone (MPD) for 3-5 days) and previously at the physician's discretion. Patients who received at least 125 mg of intravenous MPD (or dexamethasone equivalent in case the hospital was out of stock) for 2 to 5 days and intravenous TCZ composed the corticosteroid and TCZ (MPD-TCZ) group, and patients who received only intravenous TCZ composed the TCZ group. Patients within these groups were also able to receive hydroxychloroquine and lopinavir/ritonavir according to the protocol. These groups of patients (MPD and MPD-TCZ) were deemed comparable after stratification by our own validated prognosis score [13] . Thus, we proposed the hypothesis that since the choice of treatment was mainly based on the timing of admission and was not dependent on the characteristics of the patient, the effect of the treatment could be compared between both groups. To understand the potential differences between the patients in both treatment groups, we also analyzed baseline characteristics, comorbidities, outpatient treatments, symptoms, admission measures, and laboratory findings at the time of admission for these patients with three approaches: (a) univariate tests between measured variables in both groups; (b) a comparison using a previously validated machine learning prognostic score for the severity of the disease (COVID-19 Salamanca Risk Score [13] ); and (c) the development of a newly trained machine learning model aimed at detecting differences between both treatment groups to be used as a multivariate test.

We collected data on demographic variables, the patients' individual comorbidities and Charlson Comorbidity Index scores, chronic medical treatments, clinical characteristics, physical examination parameters, and the laboratory findings available at hospital admission, as previously described [13] . Regarding patient outcomes, we defined the severity of disease progression during hospitalization as the use of invasive mechanical ventilation or death. Institutional approval was provided by the Ethics Committee of the University Hospital of Salamanca (2020/03/470), and the need for informed consent was waived. All datasets were anonymously analyzed, and the study was performed following the current recommendations of the Declaration of Helsinki [13] .

The differences in the measured variables between both treatment groups were analyzed using Student's t-test for continuous variables and Fisher's exact test for binary variables. If treatment was assigned randomly to all patients and the measured variables were independent, the p values of these tests would be distributed uniformly. Consequently, we would expect approximately six variables showing differences with statistical significance (p < 0.05) between both treatment groups in univariate analysis. In addition, Kaplan-Meier curves were used to compare mortality rate between groups (long rank test).

The relevance of the collected variables in the prognosis of the patients was previously analyzed in the same cohort of patients [13] , where a prognostic score was developed through machine learning to predict severity (defined as death or intubation), regardless of treatment type. The internal validation results evaluated the predictive power with a value of 0.85 of the area under the receiver operating characteristic (ROC) curve [14] . Of note, an external validation using another cohort from the Hospital Clinic of Barcelona, Spain, obtained an area under the receiver operator characteristic (ROC) curve of 0.83, consistent with the internal validation results [13] .

As previously described, the final model of this COVID-19 Salamanca Risk Score identified the following variables as predictors of severity in both our cohort and the external validation cohort [13] : the peripheral blood oxygen saturation (SpO 2 )/fraction of inspired oxygen (FiO 2 ) ratio, patient age, estimated glomerular filtration rate, procalcitonin levels, C-reactive protein levels, updated Charlson comorbidity index scores, and lymphocyte levels. We considered these predictors separately in the multivariate analysis, as differences in these variables between the treatment groups could have likely impacted our results. Additionally, due to the changing epidemiological situation and evolution of the COVID-19 pandemic, we performed a comparison of the mortality and severity in both treatment groups matched to both the basal risk score of the patients and the date of admission of the patients. This comparison was performed as a subclassification matching with five subclasses divided along quintiles [15] , to assess the effects of the confounders within each treatment group, the effect of the treatment within each stratum, the distribution of each group along the subclasses, and the region of common support. A Mann-Kendall test was also performed to detect trends in the outcomes according to the date of admission.

To test the independence between both treatment groups in a multivariate analysis, we developed a machine-learning algorithm for predicting whether a patient belonged to the TCZ or MPD-TCZ group. Machine learning methods were chosen because they encompass classical statistic models (such as logistic regression) while providing the benefits of regularization and cross-validation, and also offer different categories of models of greater discrimination power in case of non-linear relationships and interaction effects between the variables. The performance of this algorithm was given by the area under the ROC curve and the corresponding 95% confidence interval. The null hypothesis (lack of statistically significant differences between the groups) was rejected if the value of 0.5 for the area under the ROC curve fell outside the confidence interval. This analysis was performed both using all clinical variables and using only the variables included in the abovementioned COVID-19 Salamanca Risk Score [13] .

In brief, machine learning methodology was described as follows [13] : data from patients in both treatment groups were preprocessed, variables with less than 70% completion were dropped, and missing values were filled using a 10-nearest neighbors algorithm [16] . Three classification algorithms that represented state-of-the-art approaches in machine learning, XGBoost [17] , random forest [18] , and regularized logistic regression, were trained within a stratified 10-fold cross-validation scheme with 10 repetitions for validation [19] . The evaluation metrics and their confidence intervals were obtained from the testing folds in the cross-validation scheme [20, 21] . Additionally, we used a mean decrease accuracy algorithm [18] to identify the most relevant variables in the classification algorithms. In addition to the machine learning classifiers, we tested the discriminatory power of the date of admission, the SOFA score, and the abovementioned machine learning severity score to provide a reference.

Between 1 March and 23 April 2020, 918 patients were admitted to the University Hospital of Salamanca because of severe COVID-19 with PCR-confirmed infections. Of them, 74 patients received only TCZ, and 136 patients received TCZ and high-dose corticosteroids (126 received MPD and 10 received dexamethasone; Figure 1 ). The choice of treatment changed with the date of admission, according to modifications in our hospital protocol ( Figure 2 ). Between 1 March and 23 April 2020, 918 patients were admitted to the University Hospital of Salamanca because of severe COVID-19 with PCR-confirmed infections. Of them, 74 patients received only TCZ, and 136 patients received TCZ and high-dose corticosteroids (126 received MPD and 10 received dexamethasone; Figure 1 ). The choice of treatment changed with the date of admission, according to modifications in our hospital protocol ( Figure 2 ). A total of 20 patients died (27%) in the TCZ group and the combined event of death and need for invasive mechanical ventilation occurred in 33 patients (44.6%), whereas 15 patients died (11%), and 29 patients died or required intubation (21.3%) in the MPD-TCZ group. These improved outcomes in the MPD-TCZ group were significant after univariate analysis (p = 0.006 for mortality and p < 0.001 for severity in favor of the MPD-TCZ group). Survival analysis and Kaplan-Meier curves also showed a significant effect (p = 0.002) of MPD-TCZ in mortality ( Figure 3 ). A total of 20 patients died (27%) in the TCZ group and the combined event of death and need for invasive mechanical ventilation occurred in 33 patients (44.6%), whereas 15 patients died (11%), and 29 patients died or required intubation (21.3%) in the MPD-TCZ group. These improved outcomes in the MPD-TCZ group were significant after univariate analysis (p = 0.006 for mortality and p < 0.001 for severity in favor of the MPD-TCZ group). Survival analysis and Kaplan-Meier curves also showed a significant effect (p = 0.002) of MPD-TCZ in mortality ( Figure 3 ). A total of 20 patients died (27%) in the TCZ group and the combined event of death and need for invasive mechanical ventilation occurred in 33 patients (44.6%), whereas 15 patients died (11%), and 29 patients died or required intubation (21.3%) in the MPD-TCZ group. These improved outcomes in the MPD-TCZ group were significant after univariate analysis (p = 0.006 for mortality and p < 0.001 for severity in favor of the MPD-TCZ group). Survival analysis and Kaplan-Meier curves also showed a significant effect (p = 0.002) of MPD-TCZ in mortality ( Figure 3 ). Regarding other differences in patient characteristics between treatment groups, statistically significant differences between the measured variables can be found in Tables 1 Regarding other differences in patient characteristics between treatment groups, statistically significant differences between the measured variables can be found in Tables 1 and 2. In summary, differences were found in the following variables: fever, nasal congestion, hemoptysis, the SOFA score, treatment with hydroxychloroquine or azithromycin prior to hospital admission, and serum levels of calcium, magnesium, protein, creatine kinase, and fibrinogen. The average COVID-19 Salamanca Risk Score, as previously described [13] , was 30.7% for the TCZ group and 28.7% for the MPD-TCZ group (p = 0.543), which means that patients from both groups have a similar risk of severe outcomes according to this score and therefore that these groups may be considered comparable due to similar baseline risk. In addition, no statistically significant differences were found in any of the variables composing this score between both treatment groups. The comparison of the mortality and severity between the treatment groups matched to the score risk of patients is shown in Table 3 . Worse outcomes were associated with higher COVID-19 Salamanca Risk Score in both groups, but patients in the MPD-TCZ group consistently had lower values for death and death or intubation. In addition, and due to the differences in the distribution of patients according to date of admission (Figure 2 ), data from Table 3 were also matched to date of admission, with the average risk score for each period (as shown in Table 4 ). After matching these data, we found that both mortality and combined end-point improved over time. Indeed, until 21st March mortality exceeded 30% and combined-end point reached 50% for both TCZ and MPD and TCZ alone but clearly declined thereafter for both groups. The baseline risk as calculated with COVID-19 Salamanca Risk Score of patients treated with tocilizumab also changed over time, although the average prognostic score was similar for both treatment groups. Very few patients were treated with tocilizumab alone after 26th March due to the change in protocol. A Mann-Kendall trend test showed that the combined endpoint events had a decreasing significant trend with admission date in both the TCZ group (p = 0.004) and the MPD-TCZ group (p = 0.007). Therefore, this finding shows that patients had worse outcomes in the first weeks of the analyzed period regardless of treatment type. Therefore, univariate analysis and stratification according to baseline risk score calculated by means of COVID-19 Salamanca Risk Score and date of admission showed that patients who received tocilizumab and glucocorticoids had better outcomes than those receiving tocilizumab alone, without significant differences in baseline risk score but with differences regarding date of admission. In order to include other variables potentially associated with outcomes, machine learning models were built to test differences between the two treatment groups by means of multivariable analysis. Figure 4 shows the ROC curve for the machine learning models for predicting the treatment group of a patient. The best model built only with the seven variables included in the COVID-19 Salamanca Risk Score (the peripheral blood oxygen saturation (SpO 2 )/fraction of inspired oxygen (FiO 2 ) ratio, patient age, the estimated glomerular filtration rate, procalcitonin levels, C-reactive protein levels, updated Charlson comorbidity index scores, and lymphocytes levels) was regularized logistic regression, which obtained an area under the ROC curve of 0.49 (0.40-0.57). However, the best model built with all the clinical variables was the random forest classifier, which obtained an area under the ROC curve of 0.60 (0.51-0.69), thus detecting statistically significant differences between both groups. Therefore, multivariable analysis including all potentially relevant variables confirmed a statistically significant difference between both treatment groups regarding outcomes. The most relevant variables used for this multivariable analysis as calculated by the mean decrease accuracy algorithm can be found in Table 5 . Variables that were not included in this table and were not significant in the univariate analysis were less likely to impact mortality in our cohort, regardless of potential differences between groups. In addition, we compared whether the date of admission was more relevant than prognostic scores to differentiate between treatment groups. Figure 5 shows the ROC curves for the SOFA score, machine learning severity score, and date of admission, when used to distinguish between both treatment groups, showing no discriminant power for the first two and great discriminant power for the latter. Therefore, we confirmed that the date of admission was a significant variable potentially impacting outcome differences between treatment groups. Receiver operating characteristic curves of the different classification algorithms for treatment difference, including best classifier (random forest with all variables) and logistic regression with 7 variables for comparison. The model with all variables was able to show statistically significant differences between both treatment groups but the model constructed with the 7 clinically relevant variables according to the COVID-19 Salamanca Risk Score did not find differences. In addition, we compared whether the date of admission was more relevant than prognostic scores to differentiate between treatment groups. Figure 5 shows the ROC curves for the SOFA score, machine learning severity score, and date of admission, when used to distinguish between both treatment groups, showing no discriminant power for the first two and great discriminant power for the latter. Therefore, we confirmed that the date of admission was a significant variable potentially impacting outcome differences between treatment groups. There are no statistically significant differences between both treatment groups according to both prognostic scores, but admission date showed significant discriminant power.

In our study, we found that the combination treatment with glucocorticoids and TCZ, when compared with TCZ alone, is associated with both reduced mortality and a reduced risk of a composite endpoint of invasive mechanical ventilation and death. To allow comparison, we selected two groups with similar baseline risk according to our previously validated risk score, which made the presence of potential unknown confounders related Figure 5 . Receiver operating characteristic curves for treatment difference classification based on admission date, SOFA score and machine learning (ML) COVID-19 Salamanca Risk Score. There are no statistically significant differences between both treatment groups according to both prognostic scores, but admission date showed significant discriminant power.

In our study, we found that the combination treatment with glucocorticoids and TCZ, when compared with TCZ alone, is associated with both reduced mortality and a reduced risk of a composite endpoint of invasive mechanical ventilation and death. To allow comparison, we selected two groups with similar baseline risk according to our previously validated risk score, which made the presence of potential unknown confounders related to patient characteristics unlikely [13] . Additionally, we used a machine learning methodology to assess potential differences between groups after adjusting for other variables, and we found that a random forest classifier including all variables confirmed a significant difference between both treatment groups.

Our results are in line with data from other observational studies showing that this combination therapy is associated with better outcomes when compared with either TCZ or glucocorticoids alone [9, [22] [23] [24] . In addition, subgroup analysis from the Recovery trial [10] found that patients who were receiving glucocorticoids were more likely to benefit from TCZ, and a similar result was reported from a recent meta-analysis including TCZ and other IL-6 antagonists [8] . The efficacy of this combination, however, is not yet fully established due to the lack of randomized trials and the presence of controversial results from other studies (e.g., improved outcomes with TCZ alone instead of with combination therapy [25] ). Moreover, previous studies on this topic were prone to potential biases due to small sample sizes and retrospective and observational study designs, despite the different statistical techniques employed to reduce this risk, such as the inverse probability of the treatment weights technique [9] or propensity score matching [24] .

In line with this, although we found a significant difference between the treatments after machine learning methodology, we also found that mortality improved over time as an independent variable associated with better outcomes. In our study, the choice of treatment for each patient was made according to the protocol at the time of admission: patients treated in the early stages of the pandemic received only TCZ, while in later stages, the protocol for treatment changed to include both TCZ and corticosteroids. Mortality improvement over time may have therefore been due, at least in part, to different treatment efficacies, as the random forest classifier also confirmed, but a potential confounding effect for the date of admission has to be considered. Indeed, improved mortality over time has already been described in other series of COVID-19 patients and may also be explained by the increased knowledge of the disease, different population groups being affected by the pandemic at different time points, and reduced hospital burden, regardless of treatment type [11] . This would support the hypothesis of the potential role of the date of admission as a confounding variable because such variable would be a risk factor for an effect (e.g., mortality) and would also be associated with the exposure subject of our study in the population from which the effect derives, without being an intermediate step in the causal pathway between the exposure and the effect that we have analyzed [26] . This variable is, however, complex, since a higher mortality risk has also been described at times of high incidence in comparison with inter-wave period [12] and an analysis of epidemiological time delay dynamics showed a marked decrease in the time from hospitalization to death and infection to death during high incidence periods when health care system was under the most pressure [27] . In any case, taking into account this variable could be of great interest since other studies that compared groups of patients with historical controls during the peak of the first pandemic wave have also found worse outcomes for the cohort admitted earlier in the pandemic [22, 23] . Considering the striking differences in incidence in different periods of the pandemic, our data, along with the results from other authors, allow us to draw the conclusion that the date of admission should be considered as a variable in observational studies during the COVID-19 pandemic. In addition, this variable should be taken into account in other diseases when relevant temporal trends are present.

Another potential limitation of our study is the different sample sizes between groups and the use of different types and doses of steroids. Although the Recovery trial [6, 28] used a low dose (6 mg) of dexamethasone for treatment, other studies, including a small randomized trial, have shown the efficacy of pulse therapy with other steroids [29] [30] [31] , such as MPD (which achieves higher lung tissue concentrations than dexamethasone). Regarding dose, a recent systematic review has shown that COVID-19 patients may be more likely to benefit from medium-high doses of steroids (defined as 90-250 mg/day or 1.5-4 mg/kg/day of MPD or an equivalent dose of other steroids), but higher or lower doses were both associated with improved survival rates [32] . Therefore, despite the lack of evidence regarding an optimal therapy, we do not think that combining the data of patients with equivalent corticosteroid dosages may have a major impact on our results, and other studies have also used this approach [24] . In any case, there is a lack of data on the comparison of corticosteroid pulse therapy with low-dose oral corticosteroids. Finally, although we only present data from the first wave of the pandemic, it is very unlikely to have data to compare tocilizumab vs. tocilizumab and corticosteroids after the first wave because corticosteroids became part of standard treatment in an early phase of the pandemic.

In conclusion, our data support the potential utility of the combination of glucocorticoids with TCZ, in line with previous findings but outcomes were influenced by date of admission regardless of treatment type and thus this variable as a potential source of bias should be considered in observational studies on this topic. Rigorous randomized trials are needed to assess the efficacy of TCZ and corticosteroids combined and to evaluate the optimal corticosteroid dose for treatment.

Genomic characterisation and epidemiology of 2019 novel coronavirus: Implications for virus origins and receptor binding

Characteristics of and Important Lessons from the Coronavirus Disease 2019 (COVID-19) Outbreak in China: Summary of a Report of 72314 Cases from the Chinese Center for Disease Control and Prevention

Immunopathology of Hyperinflammation in COVID-19

Tissue-Specific Immunopathology in Fatal COVID-19

Immunomodulation as a Potent COVID-19 Pharmacotherapy: Past, Present and Future

Association between Administration of Systemic Corticosteroids and Mortality among Critically Ill Patients with COVID-19: A Meta-analysis

Interleukin-6 blocking agents for treating COVID-19: A living systematic review

Association between Administration of IL-6 Antagonists and Mortality among Patients Hospitalized for COVID-19: A Meta-analysis

Combination of Tocilizumab and Steroids to Improve Mortality in Patients with Severe COVID-19 Infection: A Spanish, Multicenter, Cohort Study

Tocilizumab in patients admitted to hospital with COVID-19 (RECOVERY): A randomised, controlled, open-label, platform trial

Improving Survival of Critical Care Patients with Coronavirus Disease 2019 in England: A National Cohort Study

Impact of varying wave periods of COVID-19 on in-hospital mortality and length of stay for admission through emergency department: A territory-wide observational cohort study

Development of a severity of disease score and classification model by machine learning for hospitalized COVID-19 patients

The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology

Matching methods for causal inference: A review and a look forward

Nearest neighbor imputation algorithms: A critical evaluation

XGBoost: A scalable tree boosting system

Random forests

An experimental comparison of cross-validation techniques for estimating the area under the ROC curve

Inference for the generalization error

Choosing between two learning algorithms based on calibrated tests

Historically controlled comparison of glucocorticoids with or without tocilizumab versus supportive care only in patients with COVID-19-associated cytokine storm syndrome: Results of the CHIC study

Corticosteroids and tocilizumab reduce in-hospital mortality in severe COVID-19 pneumonia: A retrospective study in a Spanish hospital

Combination therapy with tocilizumab and corticosteroids for aged patients with severe COVID-19 pneumonia: A single-center retrospective study

Treatment with tocilizumab or corticosteroids for COVID-19 patients with hyperinflammatory state: A multicentre cohort study (SAM-COVID-19)

Understanding an evolving pandemic: An analysis of the clinical time delay distributions of COVID-19 in the United Kingdom

Dexamethasone in Hospitalized Patients with Covid-19

Second week methyl-prednisolone pulses improve prognosis in patients with severe coronavirus disease 2019 pneumonia: An observational comparative study using routine care data

Corticosteroid Pulses for Hospitalized Patients with COVID-19: Effects on Mortality

Intravenous methylprednisolone pulse as a treatment for hospitalised severe COVID-19 patients: Results from a randomised controlled clinical trial

Comparison of Associations between Glucocorticoids Treatment and Mortality in COVID-19 Patients and SARS Patients

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of the University Hospital of Salamanca (2020/03/470), date of approval: 2 April 2020.Informed Consent Statement: Institutional approval was provided by the Ethics Committee of the University Hospital of Salamanca (2020/03/470) and the need for informed consent was waived.Data Availability Statement: Relevant anonymized patient level data are available on reasonable request. Code to develop machine learning model is already available.

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.