key: cord-265665-411rtt89
authors: Teele, Sarah A.; Sindelar, Anthony; Brown, David; Kane, David A.; Thatte, Nikhil; Williams, Ryan J.; Gueverra, Joy; Wolbrink, Traci A.
title: Online Education In A Hurry: Delivering Pediatric Graduate Medical Education During COVID-19
date: 2020-11-04
journal: Prog Pediatr Cardiol
DOI: 10.1016/j.ppedcard.2020.101320
sha: 
doc_id: 265665
cord_uid: 411rtt89

In the setting of the coronavirus disease 2019 (COVID-19) pandemic, an emergency hospital-wide eWork policy was enacted at Boston Children’s Hospital on March 16, 2020. The number of clinicians on campus was restricted to only essential personnel, guidelines limited clinical care delivery to solely non-elective patients, and strict maximums were placed on the numbers of people allowed to congregate in the same physical space. With this abrupt transition to social distancing and electronic communication, the established approach to educating graduate medical trainees became obsolete overnight. Anticipating significant impact on trainee and faculty professional and personal lives, the importance of adaptive teaching strategies was evident. This document details one approach to redesigning the clinical learning system including a description of the learners and environment, the pedagogical principles that guided the approach, and technological tools used in implementation. Additionally, available literature pertinent to this topic is explored, assessment of the work to date is presented, and suggestions are provided regarding future directions related to online graduate medical education.

Identifying learning and engagement goals early in the initiative helped us focus on the use of technology as a solution to the challenges, as opposed to a gimmick or distractor. This approach is known to be important for learner and faculty buy-in, especially for those not already familiar with the tools. (1,2) We therefore created learning goals and desired results as the first step in the process:

a. Provide high-yield synchronous and asynchronous learning opportunities that engage trainees and faculty using remote technology b. Create an online community that provides social support for one another by solidifying personal and professional relationships despite physical isolation c. Utilize and curate high-quality resources readily available to us (faculty and trainee expertise, pre-existing online resources, unstructured time) under extraordinary circumstances to create a learning tool that will be useful today, and in the future d. Centralize currently available learning tools/resources from across the Cardiovascular Program e. Elicit real-time informal and formal feedback in order to modify and adjust the intervention to best meet the needs of our learners and educators 

In order to rapidly deploy the initiative, we used a combination of pre-existing content and real time content creation. Anticipating rapid expansion in educational resources, we created clearly labeled folders assigned to topics such as "Electrophysiology" and "Cardiac Imaging" (Figure 1 ), each with its own set of sub-folders for organization and ease of use. Task Force reports coordinated by the Society of Pediatric Cardiology Training Program Directors (SPCTPD) were included in each of the relevant sub-specialty folders to provide structure. (5) We identified Divisional educational champions across the Department of Cardiology to help populate folders in the sub-specialty topics with vetted, high quality content related to their area(s) of expertise (e.g. electrophysiology). Standards and guidelines for the care of patients with congenital or J o u r n a l P r e -p r o o f Journal Pre-proof acquired heart disease were included. As the group site developed, it became increasingly easier to link resources which now number in the hundreds. For example, faculty teaching an imaging session on cardiac tumors could refer to the relevant pathology lecture and the surgical technique references already available on the BCH Cardiovascular Program group site.

Synchronous learning is defined as the education of a group of people that occurs simultaneously in real time. At the start of the pandemic, online conferences were immediately identified by global educators as an important solution for synchronous learning when learners could not be face-to-face. BCH had an established relationship with Zoom (https://zoom.us), however, many members of the Department were not familiar with its features. One of the Chief Fellows was tasked with creating a user-friendly document on how to host a Zoom meeting. This was circulated to the faculty and trainees on March 17, 2020.

Prior to the eWork policies, our Department hosted in-person teaching sessions one to two hours daily, Monday through Friday. The approach to these teaching sessions varied but included traditional lecture format and case-based learning. After a brief pause of a week, our core conference schedule was redeployed online, March 23, 2020. We added additional sessions at the request of the learners and interested faculty with a focus on important threshold concepts in the field of pediatric cardiology. Within several weeks, trainees had the option to attend two to three one-hour sessions per day and could choose amongst a variety of topics in the field of pediatric cardiology. Synchronous educational opportunities continued to increase in number throughout J o u r n a l P r e -p r o o f Journal Pre-proof April and May, further complemented by national and international initiatives. Two to four hours of online pediatric cardiology content per day continues to be standard even though the Department has resumed much of its pre-COVID-19 activity. If local sessions do not contain patient health information, they are recorded and uploaded to the private OPENPediatrics group site for future viewing. Lecture references are linked with the recorded material for learners interested in additional content or reviewing sentinel literature.

Asynchronous educational opportunities occur independent of a specific place or time and therefore offer increased flexibility. Learners may work independently or collaborate with others.

This approach presents tremendous potential for active learning where the learner is compelled to engage with the subject material. Additionally, it allows the trainee control over when the learning will take place. With these pedagogical goals in mind, we created a voluntary team- (Figure 2 ), 2. Identify three key references as "must read" articles for a learner interested in the designated lesion, and 3. Create three Accreditation Council for Graduate Medical Education-type board questions based on the lesion with answers and explanations. Four teams were created. All components of the project were completed for the following lesions chosen by respective team members: isolated atrial septal defects, pulmonary atresia with intact ventricular septum, total anomalous pulmonary venous connection, and tetralogy of Fallot with absent pulmonary valve. An example of a complete project can be found in Appendix 1. Faculty coaches reviewed all of the content for accuracy and provided feedback to the learners.

The first step of the project was to address the components of the lesion flow chart. In essence, this provided the scaffolding for a concept map of a specific congenital heart lesion over a patient's lifespan. Each trainee was likely to have prior experience with some aspects of the map.

The key component of the exercise was to elaborate on one's own pre-existing mental model of the lesion by connecting new information in a more sophisticated web. Ideally, combining the varied components of the lesion map (e.g. pathophysiology, management strategies, outcomes) into a complete clinical picture using their own words, helped trainees consolidate and solidify knowledge. Our survey response rate was 70% (26/37). Respondents reported a high level of motivation for participating in online learning. The top three motivating factors were: "I feel continuing my education through online learning is important", "I feel it is my professional responsibility to do this online learning", and "Online learning provides a way to stay professionally connected to my peers and faculty mentors". The most common barriers to participating in online learning were reported to be limitations on time due to clinical obligations, too many options for online learning, and distractions attributable to the COVID-19 pandemic. Eighty-nine percent (23/26) J o u r n a l P r e -p r o o f respondents agreed that the online learning in this intervention was translatable to daily realworld work. Sixty-two percent (16/26) of our learners agreed that they felt more comfortable using technology tools at the time of completing the survey than they had before the online learning initiative.

Unfortunately, because our group on OPENPediatrics is designated as private, we were unable to obtain statistics on platform utilization. Data that would have been helpful and complementary to the survey included click counts, log-in time of day, time spent on the site by a user, and consistency of engagement by faculty and learners over time.

As the COVID-19 pandemic rapidly swept the globe, the international medical education community quickly mobilized to support collaborative real-time solutions to the challenge.

Previously accepted approaches for many aspects of our existences were reimagined, including the delivery of graduate medical education. The BCH Department of Cardiology initiative embraced the video conference format for synchronous learning while simultaneously developing an innovative asynchronous educational opportunity. Although asynchronous activities are not a new concept, they were not part of the BCH Cardiology Fellowship curriculum prior to the pandemic. The extraordinary circumstances offered our trainees unstructured time not typically available to them and therefore an opportunity for inventive approaches to our training program.

Our local approach prioritized quality of content creation through engagement of our learners and faculty. This required a substantial time commitment across the Department. Rapid access to globally shared high-quality education and medical content resources was an important facet of our initiative. In a remarkably prescient document from 2010, a global commission dedicated to health professional education cited global threats, including infectious disease, as motivation to harness the potential power of technology for distance learning and collaborative connectivity. 

This approach to transitioning graduate medical education from an entirely face-to-face experience to completely online learning environment had challenges. Thankfully, all of our learners had reliable access to the internet and therefore digital equity was not a factor.

Additionally, none of our learners required assistive technologies to provide access, but it is an important consideration for educators attempting to design a similar kind of intervention.

Technological literacy and the generation gap between the learners and the faculty was our biggest hurdle. In general, the age of current trainees in graduate medicine qualifies them as "digital natives" and generally fluent in technology. In 2020, a large number of educators in academic medicine are "digital immigrants" with an enormous range of technological literacy.

(29) Many of the faculty participating in the learning initiatives required substantial remote J o u r n a l P r e -p r o o f support from more technologically fluent faculty and learners. In hindsight, a survey of our faculty to assess technological literacy at the start of the initiative would have been helpful.

Even for those comfortable with the technology tools, online teaching and learning presents challenges to those not familiar with the format. Teaching on a computer screen is a very different experience than working with an overflowing lecture hall or intimate small group session. Physical separation and limited face-to-face contact can lead to feeling of disconnection and isolation by either the learner or the educator or both. There is a risk of disengagement and the promotion of superficial learning. Despite the need for rapid deployment of educational interventions, adherence to established concepts in adult learning were prioritized. Important considerations included ensuring that educational materials were relevant and meaningful to the learners' professional work, information was applicable to everyday problems, and learners were engaged with and feel connected to faculty and peers. High levels of connectivity and collaboration in synchronous and asynchronous activities were encouraged.

Online learning was a dynamic and expanding field prior to the pandemic with virtual reality, augmented reality, and gaming viewed as meaningful learning experiences which may engage our learners. (30) These approaches, however, require more established resources than were available at the time of this intervention. Additional exploration of these themes warrants further investigation and will be important to better understand and improve future educational interventions.

J o u r n a l P r e -p r o o f Perhaps most importantly, our educational goals, no matter how noble or grounded in theories of adult learning, were situated in the context of a devastating and historic international crisis. This was an incredibly challenging time for clinicians, professionally and personally. Openly acknowledging that all members of the department were navigating multiple stressors was critical during this initiative.

Innovative, resourceful, and dynamic initiatives were required to manage the challenges highlighted by the COVID-19 pandemic and will be necessary to navigate the uncertainties of the future. Online learning cannot replace the physical examination of patients and the power of human touch. It is, however, an opportunity to deliver high quality learner-centered education in non-traditional settings while simultaneously cultivating intrinsic motivation in our trainees and faculty. It is clear that healthcare professionals yearn for lifelong learning, practice development, and connection to their local and global communities. Additional reflection and ongoing formal evaluation of new initiatives will be essential to understand the implications of these types of innovations.

J o u r n a l P r e -p r o o f 

E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia Learning

Physician internet medical information seeking and on-line continuing education use patterns

Comparison of healthcare professionals' motivations for using different online learning materials. Pediatric Investigation

SPCTPD/ACC/AAP/AHA Training Guidelines for

Pediatric Cardiology Fellowship Programs (Revision of the 2005 Training Guidelines for

A Guide to Quality in Online Learning -Academic Partnerships

Question-writing as a learning tool for students -outcomes from curricular exams

Make It Stick: the Science of Successful Learning

Repeated testing improves long-term retention relative to repeated study: a randomised controlled trial

Development of an Instructional Design Evaluation Survey for Postgraduate Medical E-Learning: Content Validation Study

1: Evaluating Teaching: A New Approach to an Old Problem

Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. The Lancet

COVID-19 and medical education. The Lancet Infectious Diseases

Adapting the Educational Environment for

Cardiovascular Fellows-in-Training During the COVID-19 Pandemic

Reinforcing Cardiology Training During a Pandemic: An Open Letter to Our Leaders

Medical Student Education in the Time of COVID-19

#MedEdPearls: Mastering Adaptive Teaching in the Midst of COVID-19

Developing Online Assessments of Student Learning in a Hurry

Teaching Effectively During Times of Disruption

r e -p r o o f steps-for-a-smoother-transition-to-online-teaching

Free Open Access Medical education (FOAM) for the emergency physician

The Top Ten Websites in Critical Care Medicine Education Today

CJEM and the changing landscape of medical education and knowledge translation

Heart University: a new online educational forum in paediatric and adult congenital cardiac care. The future of virtual learning in a post-pandemic world?

Educational Resources for Fellows