key: cord-0813498-t8nulida
authors: Chang, Hansol; Yu, Jae Yong; Yoon, Sun Young; Hwang, Sung Yeon; Yoon, Hee; Cha, Won Chul; Sim, Min Seob; Jo, Ik Joon; Kim, Taerim
title: Impact of COVID-19 Pandemic on the Overall Diagnostic and Therapeutic Process for Patients of Emergency Department and Those with Acute Cerebrovascular Disease
date: 2020-11-26
journal: J Clin Med
DOI: 10.3390/jcm9123842
sha: b5903878e661db44b32d952184389ee1154431b0
doc_id: 813498
cord_uid: t8nulida

(1) Background: During a pandemic, patients and processes in the emergency department (ED) change. These circumstances affect the length of stay (LOS) or degree of crowding in the ED. The processes for patients with acute critical illness, such as cerebrovascular disease (CVD), can be also delayed. Using the process mining (PM) method, this study aimed to evaluate LOS, ED processes for CVD, and delayed processes during the coronavirus disease 2019 (COVID-19) pandemic. (2) Methods: Data were collected from the Clinical Data Warehouse of a medical center. Phase 1 included patients who visited the ED before the COVID-19 outbreak. In Phase 2, post-COVID-19 ED patients were divided into the COVID-19 tested group (CTG) and COVID-19 not tested group (CNTG) according to whether polymerase chain reaction test was performed. We analyzed patients’ ED processes before and after COVID-19 using the PM method. We analyzed patients with acute CVD separately to determine whether the process and LOS of patients with acute critical illness were changed or delayed. (3) Results: After the COVID-19 outbreak, the overall LOS was delayed and all processes in CTG patients were delayed. Registration to triage and triage were delayed in both CTG and CNTG patients. The brain imaging process for CTG patients with acute CVD was also delayed. (4) Conclusion: After a pandemic, some processes were changed, new processes were developed, and processes for patients with acute CVD who needed proper time management were not exempted.

Several pandemics have occurred in the past, such as the severe acute respiratory syndrome, Middle East respiratory syndrome, and influenza [1, 2] . Currently, the coronavirus disease 2019 (COVID-19) has emerged as a pandemic. During a pandemic, the hospital system should be changed, owing to an increase in the demand for medical resources, and the emergency department (ED) is not

This retrospective study was conducted in the ED of a tertiary hospital located in a metropolitan city. The hospital has approximately 1960 inpatient beds. The annual number of patients in the ED is approximately 80,000. This study included patients who visited the ED from 1 February 2019 to 31 July 2019 and 1 February 2020 to 31 July 2020.

We divided the study periods into two phases. Phase 1 included patients who visited the ED from 1 February 2019 to 31 July 2019. Phase 2 included patients who visited the ED from 1 February 2020 to 31 July 2020. Phase 2 was divided into "COVID-19 Tested Group" (CTG) and "COVID-19 Not Tested Group" (CNTG). CTG included patients who underwent the COVID-19 PCR test, and CNTG included patients who did not undergo the COVID-19 PCR test. We excluded patients without information on time in registration, execution, and reading of laboratory tests. We further analyzed CVD patients in the same manner as above and divided them into Phase 1, CTG and CNTG. The process of selecting patients is shown in Figure 1 .

The institutional review board of the hospital approved this study. Informed consent was waived because this was a retrospective, observational, and de-identified study (SMC 2020-08-184). 

The COVID-19 PCR test was performed in accordance with the center's policy for patients with at least one of the following symptoms: fever, cough, sputum production, rhinorrhea, diarrhea, arthralgia, and dyspnea. Patients who stayed for more than 24 h at another hospital or who stayed in a crowded public housing facility for more than 24 h also underwent the COVID-19 PCR test. Finally, patients with a contact history to individuals with confirmed COVID-19 underwent the COVID-19 PCR test. The center collected this information through a questionnaire prior to registration and double-checked such information in triage to sort these patients (Supplementary Figure S1 ). In addition, patients who had abnormal chest radiography or chest CT findings underwent the COVID-19 PCR test, even after they were classified as low-risk patients and were not indicated for COVID-19 PCR test in triage.

We analyzed patients with acute CVD separately to determine whether the process and LOS of severely acute patients were changed or delayed. We separated these patients using the International Statistical Classification of Diseases and Related Health Problems, 10th revision (ICD-10) codes that are specific for acute CVD (I210, I211, I212, I213, I214, I219, I6300, I6301, I6302, I6308, I6309, I6310,  I6311, I6312, I6318, I6319, I6320, I6321, I6322, I6328, I6329, I6330, I6331, I6332, I6333, I6338, I6339, I6340,  I6341, I6342, I6343, I6348, I6349, I6350, I6351, I6352, I6353, I6358, I6359, I636, I638, I639, I64, I610, I611,  I612, I613, I614, I615, I616, I618, I619, I620, I621, I629, I600, I601, I602, I603, I604, I605, I606, I607, I608,  I609) . We also performed the same analysis with the total number of patients in the ED, such as using PM, in the case of acute cerebrovascular patients, and analyzed the length of time of each process. In the case of acute cerebrovascular patients, we focused on brain imaging processes such as brain CT and MRI.

In hospitals using electronic medical record (EMR), log data such as patient demographics and treatment information are available; event log refers to a set of events that are recorded in the context of a process. Patient clinical information, ED visit information, examination prescription information, and time of other evaluation tests were extracted from the Clinical Data Warehouse Darwin-C of Samsung Medical Center for this study. Patient information included age, sex, systolic blood pressure, diastolic blood pressure, pulse rate, respiratory rate, body temperature at arrival, oxygen saturation, Korean triage and acuity scale, mental status, and mode of arrival. In addition, as outcome information, we collected discharge information, including discharge to home, ED death, transfer, and admission. We also recorded the place where admission information was collected, which included the intensive care unit (ICU) and general ward (GW). The major time information used for PM included ED visit time, initial nurse assessment time, registration, laboratory test time, imaging test time, CT, MRI, electrocardiography (ECG) test time, COVD-19 PCR test time, radiologic intervention time, and discharge time.

We describe the methodology in three parts for analyzing the change in the ED process before and after the COVID-19 pandemic using PM. PM is a methodology that focuses on extracting knowledge from database event logs. The major purpose of PM is to discover and monitor the conformance of the process. There are three essential key pieces of information for the execution in the process analysis: patient ID, timestamp, activity. An event log can be viewed as a set of traces that contains the sequence of each activity. We could identify the main process, bottleneck of the process, and total time spent between the activities. Figure 1 shows the framework for the overall process analysis. It consists of data extraction and preparation, creation of a process model, and interpretation. Using PM, we calculated the total spent time from visit to discharge and from one process to another [18, 21] . We also analyzed patient distribution from one process to another [18, 21] . Based on these results, we drew a figure of a process model figure that showed the total process flow during ED stay in each group [22, 23] . Expressing every test into the process model activity can generate the spaghetti model, which is complex and difficult to figure out. Therefore, to reduce the complexity, we categorized the tests. We divided laboratory tests by sample: blood, nasal, and sputum. Blood culture was categorized separately. Imaging test was divided by equipment: CT, MRI, X-ray, and ECG. The COVID-19 PCR test was expressed separately.

Several tools are available for PM such as "proM" and "Disco," and we used the "bupaR" framework in R Studio to discover the process model of ED visit in the event log.

Finally, it was essential to have in-depth discussion with medical experts in the ED. We compared the route and the time derived from the PM results.

We used two main analyses for comparison. First, we compared the time and the number of patients in Phase 1 (February-June 2019), and Phase 2 was divided as CTG and CNTG (February-June 2020) among patients with severe disease. Second, subgroup analysis for acute CVD patients was conducted. To clarify the results of the process, we used PM visualization and a chord diagram. For statistical analysis, we used R, version 3.6.0. Continuous variables are presented as medians and interquartile range (IQR), and p-value for the comparison of the three groups was calculated by Kruskal-Wallis test. Categorical variables are described as frequencies and percentages, p-value was calculated by chi square test, and p < 0.05 was considered to indicate statistical significance. Post hoc analysis with Bonferroni correction was performed for multiple hypothesis testing.

After selecting the patients and performing the analysis, we also performed propensity score matching by age and sex. We chose patients matched for sex and age in CTG and CNTG and performed the analysis again, similar to the original analysis. Therefore, we tried to explain that demographic differences were not the main cause of the different results between the two groups. This result is shown in Supplementary Tables S2 and S3.

The initial data contained those of 61,091 ED visits. We excluded visits related to nontreatment (e.g., for prescriptions, medical certificates) and visits cancelled without being seen (6561). In the final analysis, 31,793 patients were included in Phase 1 and 22,737 patients were included in Phase 2 in the final study, with 3223 CTG patients and 19,514 CNTG patients. Table 1 shows the distribution of the ED patients' demographics. CTG patients were more likely to be older and predominantly male than CNTG or Phase 1 patients (mean age: CTG: 57.7 ± 20.7 years, Phase 1: 46.1 ± 25.5 years, CNTG: 48.3 ± 23.6 years) ( Figure 1 ). 

CTG included more Korea Triage and Acuity Scale (KTAS) 1 and 2 patients than CNTG and Phase 2 (KTAS 1 and 2 patients (%); CNTG: 5.8%, CTG: 10.8%, CNTG: 5.8%). Compared to other groups, the rate of ambulance use was nearly 10% higher in CTG (Phase 1: 18.0%, CTG: 26.6%, CNTG: 17.3%, p < 0.001). The rate of admission was highest in CTG patients (CTG: 49.1%, CNTG: 75.4%, Phase 1: 73.5%). In addition, the ICU admission rate was higher in CTG than in the other two groups (CTG: 13.6%, Phase 1: 9.3%, Phase 2: 7.3%).

The number of activities performed per patient in Phase 1, CTG, and CNTG was 2.67, 5.93, and 2.57, respectively. Table 2 shows the difference in time consumption between each activity in three different groups: Phase 1, CTG, and CNTG. CTG patients took much more time on all occasions, and all the time gaps were significant at α = 0.05. Visit-to-triage time was higher in Phase 2 than in Phase [4.13; 13.28] ).The process trace that starts from triage and proceeds directly to X-ray increased in CTG (48.56%) and CNTG (30.06%) more than in Phase 1 (22.12%) (Figures 2 and 3) . CTG patients underwent "COVID-19 PCR test." However, the rate of triage to blood sample-based laboratory tests was lower in CTG than in Phase 1 and CNTG. Trace variety was increased in CTG ( Figure 2 ). Post hoc analysis showed all processes were delayed in CTG, and a process of triage to X-ray was delayed in both CTG and CNTG. 

The number of activities performed per patient among patients with acute CVD in Phase 1, CTG, and CNTG was 5.54, 9.88, and 6.69, respectively, which is almost double that of the overall patients. In patients with acute CVD, median time from triage to CT ( 

The number of activities performed per patient among patients with acute CVD in Phase 1, CTG, and CNTG was 5.54, 9.88, and 6.69, respectively, which is almost double that of the overall patients. In patients with acute CVD, median time from triage to CT ( (Table 3) .

In Phase 1, patients in the upper 65% trace normally undergo CT earlier than X-ray. However, in Phase 2, some of the CTG and CNTG patients underwent X-ray earlier than CT. Some patients even underwent X-ray immediately after the first triage step in CTG (30%) and CNTG (5.43%) (Figures 4 and 5) . Post hoc analysis showed the process from visit to triage was delayed in both CTG and CNTG, and those of CT and MRI from triage were delayed in CTG more than other groups. In post hoc analysis, a refers to duration of process at phase 1, b refers to duration of process at CTG, c refers to duration of CNTG.

In Phase 1, patients in the upper 65% trace normally undergo CT earlier than X-ray. However, in Phase 2, some of the CTG and CNTG patients underwent X-ray earlier than CT. Some patients even underwent X-ray immediately after the first triage step in CTG (30%) and CNTG (5.43%) (Figures 4 and 5) . Post hoc analysis showed the process from visit to triage was delayed in both CTG and CNTG, and those of CT and MRI from triage were delayed in CTG more than other groups. 

We performed propensity score matching according to age and sex to balance the population of Phase 1, CTG, and CNTG to minimize selection bias. The results of propensity score matching showed the same pattern as that of the original population. Data of demographic characteristic and time difference are provided in Supplementary Tables S2-S4 

We performed propensity score matching according to age and sex to balance the population of Phase 1, CTG, and CNTG to minimize selection bias. The results of propensity score matching showed the same pattern as that of the original population. Data of demographic characteristic and time difference are provided in Supplementary Tables S2-S4 

This study investigated not only the LOS in the ED but also the change in process using PM. According to the National Emergency Department Information System (NEDIS), mortality among patients who visited the ED increased after the COVID-19 outbreak in Korea [24] . The LOS of patients who had fever >37.5 • C also increased [24] . Our study also showed prolonged LOS in both overall ED and CVD patients. In addition, our study also compared delayed loop or process change before and after the pandemic to detect which process, namely, first visit to triage and triage to CT, was delayed in CTG group during a pandemic situation.

As shown in Figures 2 and 4 , the complexity of the ED process increased in COVID-19-tested patients. The COVID-19 test is a new process, and many process methods have been newly developed. The COVID-19 test itself was one of the process changes. As shown in Figures 2 and 4 , the incidence of direct first examination to X-ray process increased after the pandemic. In contrast, the first evaluation of blood decreased in COVID-19 patients. Before the pandemic situation, a blood test was performed first because intravenous (IV) line preparation is performed rapidly for imaging and other tests. This may be due to efforts to first rule out high-risk patients, such as performing chest radiography first to screen for pneumonia or performing COVID-19 PCR test before other evaluations, and minimize contacted medical staff from high-alert patients. Even in acute cerebrovascular patients, X-ray from the first evaluation increased.

In addition, the time from visit to triage completion increased in CTG and in both CTG and CNTG in propensity score matching. This means that time to triage increased compared to that before the pandemic, especially in CTG. To evaluate whether the patient was isolated from another patients for the COVID-19 test, the Center completed some questionnaires before admission and separated the patient into two triage stations: patients who had or who did not have a high risk of isolation for COVID-19. This questionnaire and separation might have caused the delay. However, it can also mean that a patient's separation and triage itself is very important during a pandemic, and it can be one of the processes to focus on to improve the LOS and total process in the ED, for example, redistribution of highly trained people or experts to triage station or assigning more people for the administration of questionnaires.

Particularly, in acute CVD patients, we found that processes from visit to brain imaging, which is critical for patient diagnosis and outcome, were delayed. Process from visit to triage was delayed in both CTG and CNTG. Process from triage to brain imaging was delayed in CTG. In acute CVD, it is recommended to perform brain imaging as immediately as possible [14, 25, 26] . In case of another pandemic, this situation can be repeated, affecting a patient's critical decision making, such as the use of tissue plasminogen activator therapy or intra-arterial therapy. This decision may be affected by hospital policies to isolate patients with high risk of infection diseases. On the other hand, the lack of resources made it impossible to perform high risk patients' diagnosis with portable CT or MRI in isolated places. If possible, new devices should be prepared; however, it will be very expensive. The use of one existing imaging device (e.g., CT or MRI) separately, only for high-risk patients, and establishing a fast track for patients with these devices can be another option. In acute critical diseases, it will be important to establish another fast track during a pandemic to improve process and environment.

Each process time was delayed after COVID-19 compared to before, as determined from the COVID-19 PCR performed. This can be related to the studied center policy that a COVID-19-negative test result should be confirmed before MRI or other procedures are performed outside the ED in CTG group. However, in CTG patients, ECG, enzyme, and methods that can be performed without the COVID-19 test were also delayed. In addition, imaging (CT, MRI, ECG) to discharge, which is a process performed after the COVID-19 test and is not directly affected by COVID-19 PCR test time, was also delayed. Considering this, the COVID-19 test itself was not only a cause of delay in LOS after COVID-19 but also the pandemic situation itself.

In addition, despite the decrement of total ED visit patients per day, LOS was increased in CTG after COVID-19. Normally, it is well known that LOS increases when the number of ED patients increase, and this may mean that the effect of the COVID-19 event overwhelms the decrement of ED patients in the LOS of patients [8, 27, 28] . As explained above, our study supports that these results account for many process changes, such as the COVID-19 PCR test, X-ray, and prolonged triage.

All patients who visit the ED need and want proper time management. However, as shown in our study, in the COVID-19 pandemic situation, process and LOS in the ED change. All processes were delayed in CTG, and some processes, for example, process start from triage to x-ray or process start from first visit to triage in CVD patients, were delayed in CNTG. The best method will be prediction and prevention of the next pandemic; however, it is not always possible because, historically, the pandemic era has recurred [1, 2] . Therefore, investigating whether delay is present and which process is delayed will be helpful to prepare for the next pandemic. Particularly, in acute critical disease, another fast track that is adjusted to a pandemic situation is needed [13] . Further study is needed to establish the exact strategy and protocol for the next pandemic.

This was a single-center retrospective study and there might be selection bias. To minimize bias, we compared the same period of patients before and after the COVID-19 pandemic. In addition, confounders were not considered between Phase 1 and Phase 2, for example, differences in the severity of patients or other patient demographic characteristics. However, we selected the same month of patients before and after COVID-19 and also divided Phase 2 again into those who underwent the COVID-19 test versus those who did not. Finally, there was a significant age difference between the two groups after selecting CTG and CNTG patients. We performed a propensity scoring test to show that there was no significant difference in the results despite adjusting for age between the two groups (Supplementary Tables S2 and S3 ).

In conclusion, after a pandemic outbreak, some processes were changed, some processes were newly developed, and there was no exception in acute cerebrovascular patients who needed proper time management. Therefore, if the next pandemic occurs, then the hospital should prepare a new process for a pandemic situation, based on previous experience, to minimize delay in ED patients.

Supplementary Materials: The following are available online at http://www.mdpi.com/2077-0383/9/12/3842/s1. Figure S1 : Questionnaire used to distinguish candidates of COVID-19 test in triage. In question 6, a daily updated list of places where large-scale COVID-19 outbreaks arose. Table S1 : Post hoc analysis of basic characteristics of the study population between three groups. Table S2 : Basic characteristics after propensity score matching. Table S3 : Duration of each process after propensity score matching. Table S4 : Post hoc analysis of basic characteristics of the study population between three groups after propensity score matching. 

Planning for the unexpected: Ebola virus, Zika virus, what's next?

Lipkin, W.I.; Daszak, P. Prediction and prevention of the next pandemic zoonosis

Hospital-based pandemic influenza preparedness and response: Strategies to increase surge capacity

Response of a community hospital and its emergency department to the H1N1 pandemic influenza

The Association Between Length of Emergency Department Boarding and Mortality

Emergency department crowding: A systematic review of causes, consequences and solutions

The association between a prolonged stay in the emergency department and adverse events in older patients admitted to hospital: A retrospective cohort study

Crowding Delays Treatment and Lengthens Emergency Department Length of Stay, Even Among High-Acuity Patients

Prolonged Length of Stay in the Emergency Department and Increased Risk of In-Hospital Cardiac Arrest: A nationwide Population-Based Study in South Korea

Fateh-Moghadam, S. Comprehensive Imaging of Ischemic Stroke with Multisection CT

American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care

National Clinical Guideline for Stroke

Stroke Fast Track Reduces Time Delay to Neuroimaging and Increases Use of Thrombolysis in an Academic Medical Center in Thailand

Guidelines for the Early Management of Patients With Acute Ischemic Stroke: A Guideline for Healthcare Professionals From the

Diagnosis of acute stroke

Analysis of Hospital Processes with Process Mining Techniques

Assessment of hospital processes using a process mining technique: Outpatient process analysis at a tertiary hospital

Business process mining: An industrial application

Discovery of Outpatient Care Process of a Tertiary University Hospital Using Process Mining

Time prediction based on process mining

Application of process mining in healthcare-A case study in a Dutch hospital

A systematic methodology for outpatient process analysis based on process mining

People who Were Pushed by Corona. The Number of Deaths in the E.R. Increased by 100 per Month

American Heart Association/American Stroke Association Focused Update of the 2013 Guidelines for the Early Management of Patients With Acute Ischemic Stroke Regarding Endovascular Treatment A Guideline for Healthcare Professionals From the

Guidelines for the early management of patients with acute ischemic stroke: A guideline for healthcare professionals from the American Heart Association/American Stroke Association

Effect of crowding on length of stay for common chief complaints in the emergency department: A STROBE cohort study

Emergency Department Crowding Predicts Admission Length-of-Stay But Not Mortality in a Large Health System

Funding: This research no external funding.

The authors declare no conflict of interest.