key: cord-0978684-e78nlnzv authors: Annis, Tucker; Pleasants, Susan; Hultman, Gretchen; Lindemann, Elizabeth; Thompson, Joshua A; Billecke, Stephanie; Badlani, Sameer; Melton, Genevieve B title: Rapid Implementation of a COVID-19 Remote Patient Monitoring Program date: 2020-05-11 journal: J Am Med Inform Assoc DOI: 10.1093/jamia/ocaa097 sha: 5c0d70ca9838cd620ec2d23abd7a162bf06eadab doc_id: 978684 cord_uid: e78nlnzv OBJECTIVE: To evaluate early lessons from a remote patient monitoring engagement and education technology solution for patients with COVID-19 symptoms. MATERIALS AND METHODS: A COVID-19-specific remote patient monitoring solution (GetWell Loop) was offered to patients with COVID-19 symptoms. The program engaged patients and provided educational materials and the opportunity to share concerns. Alerts were resolved through a virtual care workforce of providers and medical students. RESULTS: Between March 18 and April 20, 2020, 2,255 of 3,701 (60.93%) patients with COVID-19 symptoms enrolled resulting in over 2,303 alerts, 4,613 messages, 13 hospital admissions, and 91 emergency room visits. A satisfaction survey was given to 300 patient respondents, 74% of whom would be extremely likely to recommend their doctor. DISCUSSION: This program provided a safe and satisfying experience for patients while minimizing COVID-19 exposure and in-person healthcare utilization. CONCLUSION: Remote patient monitoring appears to be an effective approach for managing COVID-19 symptoms at home. Since the Coronavirus SARS-CoV-2 (COVID-19) outbreak began in December 2019, this pandemic has provided numerous challenges requiring healthcare systems and societies worldwide to respond in unprecedented ways to protect both patients and staff and to prepare for surges of critically ill patients. Healthcare systems are reporting their initial experiences including establishing safe COVID-19 testing options using drive-through methods [1] , converting to a hospital incident command center structure for rapid prioritization and clear decisionmaking [2] , canceling elective surgeries [3] , shifting or delaying other routine care [4] , and aggressively converting in-person care to virtual options with significant telehealth transformation [5] [6] [7] [8] . In Minnesota, our healthcare system's experience with COVID-19 included the above described measures. We also notably created a dedicated COVID-19 hospital in two weeks to rapidly cohort hospitalized COVID-19 patients [9] . Soon after the first case of COVID-19 appeared in the state of Minnesota on March 1, 2020, we also experienced rapidly increasing volumes at urgent care clinics and overwhelming numbers of calls with questions and appointment requests in a matter of days (call wait times went from 30 seconds to over 30 minutes). To combat this, we aggressively marketed the use of asynchronous, protocol-based e-visits for both COVID-19 and non-COVID-19 symptoms and observed a shift to e-visits by mid-March of over 4,000% (from 50 to >2,000 e-visits daily) and on-demand video visits. This increase in demand for virtual care was further complicated and necessitated by extremely limited COVID-19 testing options, so patients with COVID-19 symptoms were presumed to be infected and instructed to selfquarantine. With guidelines rapidly changing, patients reached out repeatedly for updated information, reassurance, and to understand when to seek care or additional evaluation. Together, these challenges uncovered a need to more systematically monitor and engage with presumed COVID-19 patients safely at home with the goal of narrowing in-person emergency care to those needing it most. The use of remote patient monitoring (RPM) and engaging patients around their care at home has been previously described for chronic disease management and more episodic care such as after discharge following surgical procedures. For chronic diseases, RPM appears to be accepted by patients and to enhance management of congestive heart failure [10] , chronic obstructive pulmonary disease [11] , and a range of other chronic conditions [12] . To date, there has been widespread interest in using RPM for COVID-19 patients [5] , but little is known about the outcomes, acceptability, and lessons around program implementation. We sought to describe an integrated health system's initial experience with a COVID-19 RPM program using an interactive engagement technology. Core areas we sought to explore included lessons from rapid technology deployment, program staffing, and program acceptability by both patients and staff. M Health Fairview is an integrated academic healthcare system with 12 hospitals (2,071 beds), 56 primary care clinics, 100+ specialties, and 34,000 employees located in the urban Twin Cities area of Minnesota as well as locations extending north to rural Minnesota and parts of western Wisconsin. A patient education and RPM solution with COVID-19 specific content was configured and deployed (GetWell Loop) ( Figure 1 ). The solution included critical steps of enrollment, engagement, monitoring with first responder escalation, and treatment completion. Prior to the COVID-19 outbreak, this platform was being used for enhanced recovery after surgery (ERAS) programs to offer educational materials and to engage patients around monitoring their pain control, diet, and other self-care. The COVID-19 specific program was able to repurpose this tool to handle the rapid influx of patients allowing for escalation protocols to first responders. Within GetWell Loop, patients are enrolled in a specific "Loop," which contains a set of patient education messages, reminders, and questions specific to a disease state or surgical procedure. Loops vary by duration and frequency of check-ins with the patient. For our COVID-19 Loop, patients were given information about COVID-19, reminders about social distancing and hygiene, and daily check-in questions each morning to assess their symptoms. Information was supplied to patients through a scrolling newsfeed, where they also had the option of sending comments and questions to their care team. Symptom monitoring questions answered with potentially concerning results (e.g. reporting severe shortness of breath) were flagged with either a red or yellow alert and routed to a dashboard for action by a member of the first responder team. Several weeks after our initial go live, there were two updates to the program's content including a question that assessed pulse oximetry data, and the length of the RPM monitoring duration was adjusted from 18 days to 16. Patients that were enrolled were either screened for COVID-19 through one of our virtual care platforms (online, phone, video) or at an urgent care or emergency department visit. To promote the program, system communications were sent to inform providers about the program as a care option for patients with confirmed or suspected COVID-19. We enabled a referral order within our EHR to gather the patients' required information and developed a batch process to automate enrollment. Patients then receive an email with information on how to activate and begin the COVID-19 program. Nurse educators reached out to patients who had not yet activated their accounts to encourage them to do so. In order to staff this application and provide a valuable training opportunity across this and several other virtual care platforms, a virtual health rotation at the University of Minnesota was rapidly created for medical students and residents from multiple local programs including Internal Medicine, Medicine-Pediatrics and Family Medicine residencies. Residents and students on this rotation, with supervision from faculty, comprised the main workforce of the first responder team from 8am-5pm during the peak volume of patient responses. The 8am-5pm hours were typically covered by 3-4 medical students, 2-4 residents, and 1-2 dedicated supervising physicians who would either respond to patients with text comments or a phone call if an alert or comment was particularly concerning or complicated. Within the first few days, it was apparent that despite a notification to the patient to call the MHealth triage line for alerts or comments outside of 8am-5pm, patients were still routinely sending messages in the RPM application after-hours. In response to this, we expanded the workforce to include providers already doing 24/7 virtual care to respond to these urgent after-hours alerts from 5pm-8am. Additionally, as volumes rose in the first several weeks, the 8am-5pm workforce was expanded to include a Nurse Practitioner supervising two Nurse Practitioner students. Patients could choose to opt out at any time if their symptoms resolved or if they were no longer interested in participating. Patients that completed their treatment course via either method were also administered two satisfaction survey questions asking whether they would be likely to recommend their doctor to a friend or family member and what they thought their care team did well. Net Promoter Score was calculated for the recommendation question and was defined as promoters (Extremely Likely) minus subtractors (Neutral, Slightly Unlikely, and Extremely Unlikely) [13] . Between March 18 and April 20, 2020, 3,701 patients were offered the COVID-19 RPM program. Of those who activated the system, 1,496 patients (62% female, median age 38 years) completed the program, and 757 are currently active. The overall activation rate was 61.2% (see table 1). A majority of patients who enrolled in the program were first seen and referred via an asynchronous online e-Visit (3,178, 88.8%). Emergency or hospital encounters (167, 4.58%) and office visits (158, 3.9%) made up the remainder of the enrollees. (see table 2 ). Of the activated patients, 91 had an emergency department visit (median of 7 days into enrollment) and 13 were admitted to the hospital (median 6 days into enrollment). From the data that was available for the patients we had reached out to (N=3270), 92% had not been tested (3,142), 7.2% had tested negative (109), and 1% had tested positive (19). There were 300 patients that responded to the patient satisfaction questions within the application, of which 74% responded that they would be extremely likely to recommend their doctor, 18% were slightly likely, 5% were neutral, 0.7% were slightly unlikely, and 2% were extremely unlikely resulting in a Net Promoter Score of 66.5% [13] . Patient comments about their satisfaction with the care team were predominantly positive about their experiences with the solution. As with any rapid implementation, there are challenges that arise from building a plane while flying it, but overall our rapid deployment was largely successful for remotely monitoring and caring for potential COVID-19 patients. The RPM application did not require major modification to be used in this population health management use case, as the features within its former post-surgical use translated well. Things that could be improved include the capability to mass message patients, additional tools for measuring inflow and outflow of patients to the program, and a more streamlined process of enrolling patients. The greatest success was patient feedback reporting that the program provided a sense of safety and a way to quickly access COVID-19 specific care. In examining satisfaction responses from patients, many patients expressed feeling cared for and protected during uncertain times. Testing and curative treatments are both largely unavailable today for COVID-19; however, this made it perhaps even more critical to support and monitor patients so that they were able to feel safe at home and could be advised to receive care when necessary. Future work should include a more robust analysis of patient experience as well as factors that influence patient decisions on whether to participate in this RPM system. Anecdotally, patients reported avoiding an emergency department or urgent care visit because of the availability of a provider, but additional analysis will be necessary to establish if this RPM system significantly reduces unnecessary utilization of care. While it would have been ideal to be able to systematically test patients in the community and to automate the inclusion of those who were COVID-19 positive, the best that could be done feasibly was to enroll patients based upon suspicion of their reported symptoms. It is clear that a massive increase in testing capacity is needed, which is exemplified in that over 91% of the population enrolled in the program have yet to be tested. The newly created resident and medical student virtual care pandemic response rotation was another success, both for staffing this application and providing significant learning opportunities for medical resources who may have otherwise been sidelined. In addition, this intentional workforce of learners provides a way to ensure patients get consistent and current recommendations about care by providing updates for the students and residents each morning with any guideline changes and frequent didactic sessions on COVID-19 and virtual care topics. Some of the main challenges we experienced were titrating the program to ensure adequate staffing to match the widely variable number of newly enrolled patients and number of messages at any given time. In condensing what typically requires a 4-6 month roll-out process into a matter of two weeks, some limitations on helpful features were imposed. Our initial enrollment process was manual and inefficient. However, over the duration of the program, we added functionality to automate portions of the process and now have a real time interface solution. Customization of the technology platform was also extremely limited, making it difficult to introduce improvements. For example, while we identified early on the value of capturing pulse oximetry data for monitoring patients and studying the COVID-19 virus, this feature was not added until three weeks into the program. We are now planning to extend home monitoring with pulse oximetry to certain patients discharged from the hospital or emergency department. Overall, we were able to quickly and effectively implement a remote patient monitoring program by repurposing an existing third-party application, and rapidly developed a resident and student rotation to staff it. Patients have been extremely grateful and positive about their experience using the tool and feel it has helped them stay safe at home. This demonstrates what can be accomplished through a shared imperative and effective partnerships between industry, healthcare delivery, and academia. Our heartfelt gratitude goes out to the tireless efforts of our IT teams, the team at "GetWell Loop", MHealth Fairview operational leaders, academic faculty at the University of Minnesota, medical students, doctor of nursing practice students, residents, and faculty in the M Health Fairview Virtual Care Rotation. This work was completed as part of our health system's operations and was not funded by any federal awards. COVID-19 Drive Through Testing: An Effective Strategy for Conserving Personal Protective Equipment Maximizing the Calm before the Storm: Tiered Surgical Response Plan for Novel Coronavirus (COVID-19) Elective surgery in the time of COVID-19 Telehealth Transformation: COVID-19 and the rise of Virtual Care COVID-19 transforms health care through telemedicine: evidence from the field A Framework for Prioritizing Head and Neck Surgery during the COVID-19 Pandemic. Head Neck Development of a telehealth geriatric assessment model in response to the COVID-19 pandemic Practice Management During the COVID-19 Pandemic M Health Fairview converts Bethesda Hospital into state's first dedicated COVID-19 care facility | MHealth.org Assessment of Heart Failure Patients' Interest in Mobile Health Apps for Self-Care: Survey Study. JMIR Cardio Telemonitoring in Chronic Obstructive Pulmonary Disease (CHROMED). A Randomized Clinical Trial Patient expectations and experiences of remote monitoring for chronic diseases: Systematic review and thematic synthesis of qualitative studies Point Versus 11 Point Scales None of the authors have any competing or conflicts of interest to declare.