key: cord-0843181-jo9wa7ow
authors: Ying, Youguo; Huang, Boli; Zhu, Yan; Jiang, Xiaobin; Dong, Jinxiu; Ding, Yanfen; Wang, Lei; Yuan, Huimin; Jiang, Ping
title: Comparison of Five Triage Tools for Identifying Mortality Risk and Injury Severity of Multiple Trauma Patients Admitted to the Emergency Department in the Daytime and Nighttime: A Retrospective Study
date: 2022-02-25
journal: Appl Bionics Biomech
DOI: 10.1155/2022/9368920
sha: 2488a90d927def3eccb8bdd65b3fd5c07f48c2d4
doc_id: 843181
cord_uid: jo9wa7ow

Effective triage tools are indispensable for doctors to make a prompt decision for the treatment of multiple trauma patients in emergency departments (EDs). The Modified Early Warning Score (MEWS), National Early Warning Score (NEWS), standardized early warning score (SEWS), Modified Rapid Emergency Medicine Score (mREMS), and Revised Trauma Score (RTS) are five common triage tools proposed for trauma management. However, few studies have compared these tools in a multiple trauma cohort and investigated the influence of nighttime admission on the performance of these tools. This retrospective study was aimed at evaluating and comparing the performance of MEWS, NEWS, SEWS, mREMS, and RTS for identifying the mortality risk and trauma severity of patients with multiple trauma admitted to the ED during the daytime and nighttime. Retrospective data were collected from the medical records of patients with multiple trauma admitted in the daytime or nighttime to calculate scores for each triage tool. Logistic regression analysis was conducted on each triage tool for identifying in-hospital mortality and severe trauma (injury severity score > 15) in the daytime and nighttime. The performance of the tools was evaluated and compared by calculating area under the receiver operating characteristic curve (AUROC) of the retrospective logistic model of each tool. We collected data for 1,818 admissions, including 1,070 daytime and 748 nighttime admissions. A comparison of performance for identifying in-hospital mortality between daytime and nighttime yielded the following results (AUROC): MEWS (0.95 vs. 0.93, p = 0.384), NEWS (0.95 vs. 0.94, p = 0.708), SEWS (0.95 vs. 0.94, p = 0.683), mREMS (0.94 vs. 0.92, p = 0.286), and RTS (0.93 vs. 0.93, p = 0.87). Similarly, a comparison of performance for identifying trauma severity between daytime and nighttime yielded the following results (AUROC): MEWS (0.78 vs. 0.78, p = 0.95), NEWS (0.8 vs. 0.8, p = 0.885), SEWS (0.78 vs. 0.78, p = 0.818), mREMS (0.75 vs. 0.69, p = 0.019), and RTS (0.75 vs. 0.74, p = 0.619). All five scores are excellent triage tools (AUROC ≥ 0.9) for identifying in-hospital mortality for both daytime and nighttime admissions. However, they have only moderate effectiveness (AUROC < 0.9) at identifying severe trauma. The NEWS is the best triage tool for identifying severe trauma for both daytime and nighttime admissions. The MEWS, NEWS, SEWS, and RTS exhibited no significant differences in performance for identifying in-hospital mortality or severe trauma during the daytime or nighttime. However, the mREMS was better at identifying severe trauma during the daytime.

Multiple trauma is fatal due to sequelae such as traumatic shock, respiratory failure, or multiple organ dysfunction syndrome, leading to a high risk of mortality among patients. In particular, approximately 4,000 people die from multiple trauma each year in China [1, 2] . Thus, effective triage tools are indispensable for physicians to rapidly identify the risk of mortality in patients presenting to the emergency department (ED) with multiple trauma.

There are various trauma triage tools, such as National Early Warning Score (NEWS) [3] , Modified Early Warning Score (MEWS) [4] , standardized early warning score (SEWS) [5] , Modified Rapid Emergency Medicine Score (mREMS) [6] , and Revised Trauma Score (RTS) [7] , that have been widely used in EDs because they are easy and convenient to memorize, utilize, and assess. Compared with anatomical-based triage tools (e.g., injury severity score (ISS) [8] and Abbreviated Injury Scale (AIS) [9] ), these tools do not require specialized knowledge for assessing injury severity or calculating scores. In addition, the five scoring systems include fewer variables than anatomical systems, and the included variables can be measured and calculated rapidly without specialized medical equipment. These five scoring systems include only 4-6 variables, in contrast to more complicated systems such as the Acute Physiology, Age, and Chronic Health Evaluation (APACHE) III score [10] , which includes 17 variables. Thus, these five common triage tools have been widely used for risk-stratification measurement [11, 12] , mortality risk prediction [5, [13] [14] [15] [16] , need of intensive care unit (ICU) admission [17] [18] [19] , and trauma severity assessment [20, 21] .

However, few previous studies have compared the performance of these five triage tools in consideration of daytime and nighttime admission based on data from a multiple trauma cohort. Those previous studies mainly compared the performance of triage tools for identifying mortality risk among patients with coronavirus disease 2019 [22] [23] [24] , those with splenic abscess [25] , those who were elderly [26, 27] , those admitted to the general ED [28] [29] [30] [31] , and patients with trauma [32] [33] [34] [35] , without considering the patient admission time. However, Hirose et al. [36] reported that mortality is significantly lower among patients admitted to the ED during the daytime than among those admitted during the nighttime. Barbosa et al. [37] also reported that nighttime admission was associated with surgical mortality in patients with trauma. Hence, it is necessary to investigate whether time of day affects the performance of these triage tools.

Therefore, the present retrospective study was aimed at evaluating and comparing the performance of the NEWS, MEWS, SEWS, mREMS, and RTS in identifying the inhospital mortality and trauma severity of multiple trauma patients admitted to the ED during the daytime or nighttime. Logistic regression analysis was conducted on a retrospective multiple trauma cohort dataset to investigate the correlation of each tool with in-hospital mortality and trauma severity. The area under the receiver operating characteristic (AUROC) of the logistic regression result of each tool was calculated to evaluate the performance. We assumed a triage tool whose AUROC ≥ 0:9 as an excellent tool with high discrimination ability for identifying patient outcome.

2.1. Ethical Statement. This retrospective study was approved by the research ethics committee of Shanghai Ninth People's Hospital (approval number: 2020-T368-2), which waived the requirement for informed consent due to the nature of the study.

Collection. Data for this retrospective study were collected from the medical records of patients with multiple trauma admitted to the ED of an urban hospital between May 2014 and April 2020. Shanghai Ninth People's Hospital has the second largest emergency center in Shanghai, with 50 beds for patient admission. Annually, it admits approximately 20,000 trauma patients, among whom 3,000 are multiple trauma patients. ED doctors measured the vital signs and made decisions for medical examinations and trauma triage for all the patients immediately once they were admitted. Generally, ED doctors work on a rotational shift schedule such that if they work during the daytime on one day, they will work during the nighttime the next few days.

The medical records of multiple trauma patient cohort were picked out among all ED patients through the review of the medical examination results (e.g., computed tomography (CT)) by a trauma specialist. Patients were identified as having multiple trauma if they suffered from injury to two or more bodily regions, with at least one injury being potentially life-threatening [38] .

The extracted medical record data of the multiple trauma patient cohort was further filtered based on the following inclusion criteria. We included only adult patients (age ⩾16), based on the design of the scoring systems (e.g., MEWS). Patients with incomplete medical records (e.g., all variables for score calculation are missing) were excluded because their data may have biased the results and it would have been difficult to perform data imputation. Furthermore, we excluded patients with a history of prior injury, infection, or organ dysfunction that may have made it difficult to determine whether outcomes (e.g., mortality) were caused by multiple trauma.

The included cohort was divided into daytime and nighttime populations based on the time of admission. There are no standard criteria for determining the boundary between daytime and nighttime because sunshine durations are different in different regions of the world. We empirically defined daytime as 8:01 am to 17:59 pm and nighttime as 18:00 pm to 8:00 am based on local daytime duration and the hospital's official working hours (http://www.9hospital .com.cn). The daytime and nighttime cohorts were divided into survival and nonsurvival groups according to inhospital mortality records. In-hospital mortality cohort also included all those who died within 90 days. The same two cohorts were divided into minor and severe trauma groups. Severe trauma was defined as an ISS > 15, in accordance with previous definitions [39] . 2 Applied Bionics and Biomechanics 

For each included case, we collected the variables required to calculate the score of the five triage tools (Table 1) . Systolic blood pressure (SBP) and respiratory rate (RR) were collected because all five triage tools use them to calculate the score. Heart rate (HR), temperature (T), oxygen saturation (SaO 2 ), and the Alert, Verbal, Pain, and Unresponsive score (AVPU) [4] were further collected to calculate the score of MEWS [4] , SEWS [5] , and NEMS [3] . Glasgow Coma Scale (GCS) score was collected to calculate the scores of mREMS [6] and RTS [7] . AVPU and GCS are both assessments of consciousness level, and AVPU can be derived from GCS as follows: 14-15 for A, 9-13 for V, 4-8 for P, and 3 for U [4] . Data on age was also acquired for assessing mREMS. In addition to the variables related to the triage tools, we also collected details on sex, length of stay (LOS) in the hospital, and trauma mechanism.

2.3. Statistical Analysis. Statistical analysis was performed to summarize the data characteristics of the included cohort. Multivariate imputation by chained equations (MICE) was performed to impute missing values. Cases were directly excluded without imputation if all variables required to calculate the score of a tool (Table 1) were missing because it would be difficult to impute. Normally distributed numerical variables are expressed as means (standard variation (std)) and were compared using t-tests. Nonnormally distributed numerical variables are expressed as medians (interquartile ranges (IQRS)) and were compared using the Wilcoxon-Mann-Whitney test. Categorical variables are expressed as frequencies and were compared using Pearson's chi-square test.

The scores of each triage tool of the included cohort were calculated based on Table 1 . To compare the performance of the tools, logistic regression analysis was performed on the daytime and nighttime admission cohorts, respectively, in order to investigate the correlation of the score of each tool with in-hospital mortality and trauma severity. AUROC of the logistic regression model was calculated to evaluate the performance (predictive validity) of identifying in-hospital mortality and severe trauma for the five triage tools. For clinical application, cut-offs are important for doctors or nurses to make triage decisions. Hence, the optimal (Opt) cut-off point of the receiver operating characteristic curve of each triage tool was calculated, and sensitivity (Sen) and specificity (Sp) at the optimal cut-off were evaluated. All statistical analyses were conducted using R, version 4.0.2 (R foundation for Statistical Computing, Vienna, Austria). Figure 1 , the cohort included 1,818 eligible patients with multiple trauma, comprising 1,070 daytime admissions and 748 nighttime admissions. All patients arrived in cars or walked into the ED by themselves. Seventy-one patients ( Table 2 . The daytime minor and severe trauma groups included 703 and 367 patients, while the nighttime minor and severe trauma groups included 495 and 253 patients, respectively. The characteristics of the minor and severe trauma groups are shown in Table 3 . The main trauma mechanism (cause of injury) in all groups was traffic accidents and tumble injury. As expected, those that survived had longer length of stay (LOS) in the hospital than those that did not.

In-Hospital Mortality for Daytime and Nighttime Admissions. As shown in Figure 2 and Table 4 , for all five scores, the AUROC values for identifying in-hospital mortality were ≥0.9 for patients admitted during either the daytime or nighttime. Among all scores, the NEWS had the highest sensitivity during the daytime at its optimal cut-off, while the NEWS and SEWS had the highest sensitivity during the nighttime. p values for the comparison of ROCs for daytime and nighttime were all >0.05, indicating that there were no significant differences in the ability of the scores to identify mortality during either the daytime or nighttime.

3.3. Performance of Identifying Trauma Severity for Daytime and Nighttime Admissions. As shown in Figure 3 and Table 5 , AUROC values for identifying severe trauma were lower than those for identifying in-hospital mortality for all five scores (Table 4) , during both daytime and nighttime. Among all scores, the NEWS had the highest AUROC and sensitivity for both daytime and nighttime admissions. There were no significant differences in the ability to identify severe trauma during the daytime and nighttime for the MEWS, NEWS, SEWS, or RTS. However, mREMS performance was better during the daytime than during the nighttime (AUROC 0.75 vs. 0.69, p = 0:019). 

This retrospective study was aimed at comparing the performance of five common trauma triage tools for identifying inhospital mortality and severe trauma in patients admitted to the ED with multiple trauma during the daytime and nighttime.

For identifying in-hospital mortality, our findings indicated that the MEWS, NEWS, SEWS, REM, and RTS are all excellent triage tools (AUROC ≥ 0:9) for both daytime and nighttime admissions. Indeed, we observed no significant differences (p value > 0.05) in the performances of each triage tool between daytime and nighttime admissions ( Table 4 ). This result is in accordance with a previous finding showing that admission time may not influence inhospital mortality. Dybda et al. [40] reported that nighttime admission was not a significant predictor of mortality in patients with severe trauma. The same result was derived from a larger cohort study in the UK by Metcalfe et al. [41] . However, several studies have demonstrated associations between the daytime/nighttime scoring system variables (Table 1 ) and patient outcomes. Fagard et al. [42] reported that nighttime SBP is a better predictor of mortality than daytime SBP in patients with hypertension. Hirose et al. [36] further reported that daytime/nighttime admission is associated with mortality in adult patients. Yue et al. [43] argued that GCS is more important for determining the need for ICU admission during the daytime than during the nighttime. In addition, Palatini et al. [44] showed that nighttime HR is a better predictor of cardiovascular events in patients with hypertension than daytime HR. Although these findings are in contrast to ours, these studies did not include patients with multiple trauma.

Furthermore, by comparing the specific AUROC values of the tools, we found that there was only a small difference in the AUROC values between the triage tools for identifying in-hospital mortality for either daytime or nighttime. This result is partly in accordance with that reported by a previous study using another cohort but without considering admission time. Hu et al. [22] reported that the SEWS and NEWS were superior to the MEWS (AUROC: 0.84, 0.81 vs. 0.67) for predicting mortality in patients with coronavirus disease 2019. Mitsunaga et al. [26] found no significant difference between the NEWS and MEWS (AUROC: 0.68 vs. 0.65) in prehospital settings, whereas the NEWS performed better than the MEWS(AUROC: 0.79 vs. 0.72) in ED settings, although the majority of the cohort was composed of nontrauma cases. Lee et al. [28] further [33] . Cattermole et al. [29] reported that the MEWS, REMS, and RTS exhibit similar performance (AUROC: 0.75 vs. 0.77 vs. 0.77) in predicting 30-day inhospital mortality. This study makes a significant contribution to the literature because we compared AUROC values of triage tools based on multiple cohorts considering the admission time, which has not been reported previously.

To the best of our knowledge, this is the first study to compare the predictive validity of scoring systems for identifying severe trauma in consideration of admission time. Our results showed that the mREMS performed better for daytime admissions than for nighttime admissions, while no significant differences were observed for the MEWS, NEWS, SEWS, or RTS ( Table 5 ). The NEWS outperformed other scores for identifying severe trauma for both daytime and nighttime admissions. Hence, attention should be paid when using the mREMS during the nighttime; otherwise, a more reliable tool (such as the NEWS) for identifying severe trauma should be chosen.

In addition, we observed that all five scoring systems were better at identifying in-hospital mortality than severe trauma for both daytime and nighttime admissions. This result agrees with the findings of a previous study [20] , which showed that scoring systems were only moderately effective as triage tools for trauma severity. This may be because the scoring systems were designed only for assessing mortality rather than trauma severity. One way to improve performance for identifying severe trauma is to redesign the range of variables in the scoring system. Jeong et al. [45] reported improvements in the ability of the RTS to predict in-hospital mortality when the SBP range was revised. The same concept can also be used to improve the ability to predict trauma severity. Alternatively, performance can be improved [21] incorporated an abdominal injury severity variable into the traditional MEWS, which improved the AUROC for identifying severe trauma.

Based on the results of this study, we recommended the clinical application of the triage tools in the ED. As can be seen in Table 4 , the NEWS had higher AUROC values and sensitivity; thus, it should be preferentially chosen to identify mortality risk during daytime and nighttime. Patients with NEWS > 4 at daytime or NEWS > 5 at nighttime are supposed to have high mortality risk; hence, they should be properly triaged so that further assessment and treatment can be undertaken. On the other hand, as seen in Table 5 , the NEWS should also be preferentially used for identifying severe trauma during both daytime and nighttime. As severe trauma may lead to acute deterioration of the patient's condition, the NEWS can be used to determine the need for and frequency of monitoring in admitted patients.

The present study had some limitations, including its retrospective, single-center design. More samples from multiple local urban hospitals are required to further validate our findings. In addition, daytime and nighttime durations may vary due to the location of the hospital. Thus, it remains necessary to compare findings among urban hospitals in various cities or countries. Furthermore, although multiple trauma was assessed by a trauma specialist based on medical records and CT findings, the diagnosis was subjective and was not made in real time. In addition, the medical records were documented by different ED staff within a short time frame, which may have led to variations. In addition, other factors, such as different types of trauma and orthopedic fractures [46] , which were not included in the triage tool, may also be associated with in-hospital mortality. In future studies, we will also include those factors to further improve the performance of the triage tool. 

The MEWS, NEWS, SEWS, REM, and RTS are all excellent triage tools for identifying in-hospital mortality for both daytime and nighttime admissions. Our analysis revealed no significant differences in the ability of these five systems to predict in-hospital mortality between daytime and nighttime admissions. However, the MEWS, NEWS, SEWS, REM, and RTS exhibit only a moderate ability to identify severe trauma. Our findings indicate that the NEWS is the best triage tool with the highest AUROC and sensitivity for identifying severe trauma for both daytime and nighttime admissions. While there were no significant differences in the ability of the MEWS, NEWS, SEWS, and RTS to identify severe trauma between daytime and nighttime, the mREMS performed better during the daytime than during the nighttime.

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Trauma care in china: a systematic review

Clinical analysis of emergency assessment and treatment of severe multiple trauma patients

Exploring the performance of the national early warning score (news) in a European emergency department

Prognostic value of modified early warning score generated in a chinese emergency department: a prospective cohort study

Prediction of inhospital mortality and length of stay using an early warning scoring system: clinical audit

The modified rapid emergency medicine score: a novel trauma triage tool to predict in-hospital mortality

Analysis of the Revised Trauma Score (RTS) in 200 victims of different trauma mechanisms

Injury severity score alone predicts mortality when compared to ems scene time and transport time for motor vehicle trauma patients who arrive alive to hospital

Evolution of the Abbreviated Injury Scale

Predicting mortality of patients with sepsis: a comparison of APACHE II and APACHE III scoring systems

Initial prehospital rapid emergency medicine score (rems) as a predictor of patient outcomes

Risk stratification of hospitalized patients on the wards

The utility of mews for predicting the mortality in the elderly adults with COVID-19: a retrospective cohort study with comparison to other predictive clinical scores

Use of the national early warning score for predicting in-hospital mortality in older adults admitted to the emergency department

Prognostic performance of the Rapid Emergency Medicine Score (REMS) and Worthing Physiological Scoring System (WPS) in emergency department

Validation of trauma scales: ISS, NISS, RTS and TRISS for predicting mortality in a Colombian population

Validation of the national early warning score in the prehospital setting

Initial mews score to predict ICU admission or transfer of hospitalized patients with COVID-19: a retrospective study

Predicting intensive care unit admission and death for COVID-19 patients in the emergency department using early warning scores

Performance of Modified Early Warning Score (mews) and Circulation, Respiration, Abdomen, Motor, and Speech (crams) score in trauma severity and in-hospital mortality prediction in multiple trauma patients: a comparison study

An improved modified early warning score that incorporates the abdomen score for identifying multiple traumatic injury severity

Predictive value of 5 early warning scores for critical COVID-19 patients

Performance analysis of the national early warning score and modified early warning score in the adaptive COVID-19 treatment trial cohort

Effectiveness of 6 scores in predicting the death risk of COVID-19

Comparison of the mortality in emergency department sepsis score, modified early warning score, rapid emergency medicine score and rapid acute physiology score for predicting the outcomes of adult splenic abscess patients in the emergency department

Comparison of the national early warning score (news) and the Modified Early Warning Score (MEWS) for predicting admission and inhospital mortality in elderly patients in the pre-hospital setting and in the emergency department

The most commonly used disease severity scores are inappropriate for risk stratification of older emergency department sepsis patients: an observational multicentre study

Emergency department Triage Early Warning Score (trews) predicts in-hospital mortality in the emergency department

Derivation of a prognostic score for identifying critically ill patients in an emergency department resuscitation room

Comparing the effectiveness of three scoring systems in predicting adult patient outcomes in the emergency department

National early warning score in predicting severe adverse outcomes of emergency medicine patients: a retrospective cohort study

The association between diastolic blood pressure and massive transfusion in severe trauma: a retrospective single-center study

Rapid Emergency Medicine Score (REMS) in the trauma population: a retrospective study

Predictive value of Modified Early Warning Score (MEWS) and Revised Trauma Score (RTS) for the short-term prognosis of emergency trauma patients: a retrospective study

Early detection of intensive care needs and mortality risk by use of five early warning scores in patients with traumatic injuries: an observational study

Impact of nighttime and weekends on outcomes of emergency trauma patients: a nationwide observational study in japan

Night admission is an independent risk factor for mortality in trauma patients-a systemic error approach

Multiple trauma and emergency room management

The changing face of major trauma in the Uk

Is there a diurnal difference in mortality of severely injured trauma patients?

Is there a 'weekend effect' in major trauma?

Daytime and nighttime blood pressure as predictors of death and cause-specific cardiovascular events in hypertension

Circadian variability of the initial Glasgow Coma Scale score in traumatic brain injury patients

Predictive value of night-time heart rate for cardiovascular events in hypertension. The ABP-International study

The new trauma score (NTS): a modification of the revised trauma score for better trauma mortality prediction

Investigating the association between orthopedic fractures and head injury due to road traffic accidents

Rapid emergency medicine score: a new prognostic tool for in-hospital mortality in nonsurgical emergency department patients

This work was supported by the Shanghai Three-year Action Plan for Strengthening the Construction of Public Health System (2020-2022) Grant Number GWV-5.

The authors declare that they have no conflicts of interest.

Youguo Ying and Boli Huang contributed equally to this work as the co-first authors. Xiaobin Jiang and Ping Jiang contributed as correspondence authors. Youguo Ying, Boli Huang, Xiaobin Jiang, and Ping Jiang were responsible for conceptualization. Xiaobin Jiang further contributed to study design, statistical analysis, and algorithm implementation. Yan Zhu, Jinxiu Dong, Yanfen Ding, Lei Wang, and Huimin Yuan helped to collect data. Xiaobin Jiang authored the original draft. All authors reviewed and commented on the manuscript. All authors have read and approved the final version of the manuscript. Boli Huang also contributed to funding acquisition.