key: cord-0728925-f3ehhc9l authors: Chertoff, Jocelyn D.; Zarzour, Jessica G.; Morgan, Desiree E.; Lewis, Petra J.; Canon, Cheri L.; Harvey, Jennifer A. title: The Early Influence and Effects of the COVID-19 Pandemic on Resident Education and Adaptations date: 2020-07-22 journal: J Am Coll Radiol DOI: 10.1016/j.jacr.2020.07.022 sha: f98090b9d11688feb629287f4fb0c2d902e4eb36 doc_id: 728925 cord_uid: f3ehhc9l Abstract The novel coronavirus, COVID-19, has had a major impact on the education of trainees in the radiology environment. The precipitous drop in patient volumes and sequestering of faculty and trainees to maintain social distancing affects experiential learning. The shift of nearly all teaching settings to a virtual environment has been challenging but may also allow more interaction during teaching sessions than traditional readout sessions or didactic lectures. Faculty development is key in ensuring competence and confidence in this new environment. Recruitment of trainees using a virtual platform will require communication of opportunities as well as the culture of the department and institution as well as the community. Delay of the board examinations has caused angst as well as disruption of the timing of clinical rotations, but may ultimately result in a shift of how the exams are administered. The exceptional disruption of the COVID-19 pandemic allows us to reconsider how the educational aspects of imaging can emerge as improved in the years to come. The novel COVID-19 coronavirus pandemic resulted in deferred imaging examinations and the shifting of radiologists to more isolated reading locations either within the medical facility or at home (1) . This caused a precipitous drop in the volume of imaging studies at most academic medical systems (AMSs) in mid-March. In locations where the COVID-19 infection rate was high, some residents were reassigned to clinical inpatient services, often with little notice. The peak incidence for much of the country appears to have been in mid-April, with recovery beginning in late May and early June, although the incidence is still rising in the Southern U.S. The rapid shift from on-site working "shoulder-to-shoulder" with trainees to working remotely, often in shifts, has resulted in a significant disruption to teaching efforts. Likewise, teaching-related travel is restricted both due to concern for spread of infection and cost containment. Attendance at courses and national meetings, where presentation of papers and educational exhibits has traditionally been encouraged for trainees, will be difficult for the near future. The board certification process has also been disrupted. All of these new restrictions have influenced how we teach, and it is unlikely that we will return to our same methods when the pandemic resolves. New approaches have become mandatory. This pause allows us to reflect on how we can alter our teaching and methods for the better. At this writing, most teaching institutions are recovering their volumes and adjusting to the "new normal." Although most places provided web conferences, and distant readout by telephone or computer, many faculty did not teach during the acute period of the pandemic, and must now catch up with a new and fluid paradigm. Faculty reading in a relatively isolated reading room, or at a reading station at home, may find it challenging to communicate electronically with their learners . Faculty have to adjust their well-developed "view-box" teaching methods to an environment that is less spontaneous, particularly if the IT environment and support are not robust. In contrast, residents are likely to be more facile with the digital environment. This potential mismatch will be particularly challenging as we welcome new residents into our departments. Faculty will have to engage with the new residents, getting to know them, evaluating their abilities, teaching them the culture of radiology, as well as teaching them radiology content, while social distancing. Developing connection with residents may become easier as we return onsite, though with fewer numbers of people who gather in less constricted spaces. For example, teaching conferences could be attended in person by a small proportion of each class as the space allowed. Planz et al have described other ways to engage and ensure inclusion during the pandemic, including frequent virtual communications, social support, and wellness resources (REF3) . Where learners, including residents and fellows, saw themselves as filling essential functions in the department, in many cases they were now feeling redundant. In the new socially-distance image interpretation model, do we still need residents? Institutions currently facing the daunting task of recovery may decide that residency expenses outweigh the benefits. If that happens, departments may have to decide how many residents they can afford, as well as how many they can effectively teach with distancing and decreased volumes, while anticipating additional surges. Many of our residents saw fewer studies and performed fewer procedures, due to reduced clinical volumes, compounded by changes in their environment and activities. Portions of key rotations, critical to call, if missed could reduce knowledge base, experience, and subsequent confidence. Residents about to start taking call may feel, and actually be, less prepared, and may depend on in-house or at home faculty, slowing their progress to independence. Hands-on ultrasound skills will likely be less developed. With schools closing and loss of childcare arrangements, many faculty and learners had to take on the additional responsibility of teaching and caring for their children, in addition to their work. For many residents, this produced a disruption to their learning and anxiety regarding work, boards and their job searches. Our residents may find it more difficult to create a supportive resident group without the usual social activities, casual and organized, with and without other parts of the department. The different experiences of COVID-19 during internship and residencies could be divisive, rather than inclusive. The support of the resident group is more important than ever in this context. There may be an increase in depression and post-traumatic stress disorder [REF3] among residents in COVID-19 "hot spots", as well as due to personal experiences of illness or loss among friends and family. Academic departments need to create an environment that encourages faculty and learners to ask for help, as well as providing access to appropriate care and support. Radiology reading rooms have traditionally been a hub of activity with "readouts" at picture archiving and communication system (PACS) workstations among faculty and residents occurring throughout the day, discussion of interesting cases, teaching of medical students, referring clinicians joining for consultations, and technologists looking for direction. Due to distancing, this workflow has been disrupted and is less efficient with disbursement of these activities and thus the opportunity to provide the "soft" knowledge of interactions between radiologists with patients and providers is lost. Additionally, opportunities for team building and camaraderie are hindered in the virtual format. This will perhaps be felt the most by the new PGY2 residents began their radiology training in July 2020. Programs have worked with their departments and infection prevention to identify new work sites, move workstations, and assign residents to specific workstations (2) . A critical component of radiology training has been through active "on the job" learning in which the resident independently interprets an exam to generate a differential diagnosis and then receives case-specific feedback when reviewing each exam with the supervising radiologist (3). Residents may now be reading remotely from their supervising radiologist and readouts have moved from in-person to virtual sessions using remote desktop software such as Zoom (Zoom, San Jose, CA) or TeamViewer (TeamViewer AG, Goppingen, Germany) allowing Health Insurance Portability and Accountability Act compliant screen sharing. IT support is critical to resolve connectivity and other issues related to the virtual platform. Virtual read-outs should include two-way communication while viewing images simultaneously and should provide for both parties to scroll, annotate, and point on images (3) . Furthermore, didactic, case, and interdisciplinary conferences that consisted of gathering groups of people have ceased and shifted to virtual format. Similarly, journal clubs, quality conferences, and grand rounds have become remote in allowing for continued participation. Maintaining meaningful interaction during virtual conferences requires webcams on so that faces can be shown when speaking via remote software. This also allows for the presenters to "call on" residents during virtual conferences. Innovative teaching methods such as gamification has shown potential positive educational benefits (REF1). The impact to residency programs has varied across the country with some radiology residents and fellows being reassigned to medicine wards including intensive care units (ICU), with others experiencing reduced clinical work due to the initial postponement of non-urgent and elective procedures (1) . Some programs manage the active resident workforce with a team-on team-off approach with one group assigned to clinical work and the other to distance learning. These groups would alternate over time and could fill in the clinical service in case of illness (2, 4) . In response to those assigned to home with distance learning, numerous national radiology societies quickly compiled and disseminated free learning material to residents. Some institutions created PACS teaching files for remote viewing and interpretation with remote readouts with teaching faculty (5). Self-directed learning by radiology residents is now of utmost importance to provide for their continued growth. This is a skill that residents will need beyond residency and will be beneficial to their development. With the reduction in elective and non-urgent procedures, residents experienced decreased procedural volume (6) . Additionally, in an attempt to conserve personal protective equipment, some hospitals have limited those in the room to those radiologists performing the procedure. For those residents in the early specialization in interventional radiology (ESIR) pathway, the Accreditation Council of Graduate Medical Education (ACGME) recognizes that procedural volumes will likely be lower due to the COVID-19 pandemic and is allowing residents to enter independent interventional radiology (IR) residencies with fewer than the 500 case requirement . However, the ACGME still requires a total of 1,000 cases prior to the end of their 2 years of IR training. ESIR block schedules may be adjusted to allow for flexibility in timing of the required ICU rotation (7) . Courses, including the American Institute of Radiologic Pathology (AIRP) and national meetings that have been forced to move to a virtual platform have benefits as well as negative consequences. The virtual platform may need synchronous content provided during hours convenient for those living in all U.S time zones, in addition to asynchronous content that can be accessed at any time. The lack of required travel makes these activities more accessible and less costly. One disadvantage is reduced networking opportunities as well as diminished group experiential learning, although trainees in this generation may place less value on in-person experiences. At most centers, efforts in the initial phase included transforming practice to care effectively for patients with suspected or confirmed COVID-19 followed by training for remote imaging interpretation and education issues surrounding personal protective equipment (8) . The commitment to education of trainees became a second-tier concern (9). As the pandemic moved into new phases, the intermediate and long-range challenges facing faculty required a multifaceted approach to professional development using departmental, institutional, and national resources. The most important initial faculty training requirement caused by the pandemic involved utilization of new communication tools. Immediate needs arose for virtual "gathering" in the setting of physical distancing Thus, faculty development and instruction on the set-up and use of virtual meeting software was necessary to bring groups together for decision-making and dissemination of new and rapidly changing policies. These same tools became new modes for education of trainees and faculty. Open source and peer-reviewed publications addressing ways to pivot teaching methods in the time of physical distancing are beginning to accumulate (11, 12) . This remodeling of teaching within the clinical environment in a proactive manner is where faculty development is most needed (14) , recognizing that the familiar instruction methods of the past will likely not return to the pre-pandemic status quo (15) . Virtual teaching sessions can be effective, interactive, and entertaining, and may allow even more audience participation options than might have been utilized prior to the pandemic. For example, on some platforms learners have the ability to draw simultaneously or label radiographic anatomy on virtually presented PowerPoint presentations (Microsoft, Bellvue, WA). Remote viewbox teaching likewise can be positively affected using virtual platforms. Explanations of the "rules of engagement" for virtual presentations or readout session should be distributed department-wide to enable sustained best practices. Trainee feedback (formal and informal) may be missing or reduced with virtual platforms compared to pre-pandemic experiences. Infrastructure must be provided to assess trainee performance and provide feedback for nonclinical assignments, or to receive information from other departments for non-radiological care rendered by radiology trainees. Nonclinical learning assignments include resident creation of presentations used for medical student education or resident orientation, learning modules with pre-post testing, participation in multidisciplinary conferences, and creation and/or use of simulation exercises for procedures, contrast reactions or patient centered care topics. Finally, group feedback sessions with program directors and departmental leaders facilitated on software such as Zoom (San Jose, CA) can be scaled to meet the needs of various learning groups and can be a tool for faculty development. For faculty development, formal group review of junior faculty presentation skills in real time may be undertaken with less "interference" than perceived during typical conference dynamics. Use of video features during feedback meetings can effectively recreate traditional in-person meetings. Fostering interdisciplinary collaboration through multidisciplinary conferences is an important aspect of faculty development. To ensure that faculty are able to efficiently and expertly host these conferences in the new virtual environment, a standard operating procedure for set up and invitation of faculty and trainees is required. A robust system and rules around screen sharing are necessary. In our experience, the creation of virtual multidisciplinary conferences has allowed many more people to attend, learn, and interact, no matter their location, service assignment, or level of training. A significant challenge of faculty development in the new paradigm of abundant online resources and electronic dissemination of pandemic information is information overload. Offerings on standard faculty development items such as leadership compete with crisis management or COVID diagnosis, roundtables on teaching and trainee issues stream from departments, universities, national radiology organizations, and vendors Leaders must help faculty discover the most meaningful resources to meet both their individual professional development needs as well as those required for the group. One solution is to identify departmental personnel to screen and make recommendations for programs that meet sitespecific needs. Periodic departmental communications can help address this challenge. Recruitment for the 2020-2021 match season will almost definitely be virtual. This has been supported by local institutions, the Coalition for Physician Accountability (16) , the Association of Program Directors in Radiology, and the Association of Program Directors in Interventional Radiology (17) . Despite the unreliability of interviews in predicting performance, they significantly affect ranking and student program preferences and therefore are unlikely to be abandoned (18, 19) . Virtual residency interviews have been proposed from several specialties for some time (20) , and given that the IT infrastructure is available, perhaps their time to be universally employed has come. There are many potential benefits to virtual recruitment. The cost of interviewing and the travel time will be markedly reduced. A 2015 study showed that 13.5% of students applying to radiology spent more than $7k on interviewing (21) . This and reduced scheduling conflicts may allow students to interview at a wider variety of programs, improving the diversity of applicants. More time can be spent on educational pursuits that may include additional elective rotations, research, or sub-internships. In a virtual platform, there are also opportunities to conceal one's gender or race, which may make this approach more supportive of diversity. Cost and time savings also extend to programs. The same number and length of faculty interviews may be reduced, and therefore they may need less time off of the clinical schedules. Programs may be able to offer student access to a wider range of faculty such as by post-interview follow up virtual meetings. For example, a candidate may be very interested in pursuing a career in breast imaging, and interviews with those faculty could be made available even if they were not part of the typical interview process. There are significant potential challenges involved with implementing virtual recruitment. Because applicants will not be on-site to experience the culture first-hand, programs must advertise their institutional, departmental, research, educational, faculty and residency strengths and culture on their websites to attract applicants, which will be especially important for smaller and lesser known programs. Multiple short-focused videos including resident and faculty interviews, institutional, department, and local tours should be developed by programs or institutions. In particular, the culture of the program, institution, and locality need to be conveyed. Social media may be a helpful resource to leverage, as well as streaming resident conferences. With less cost and anxiety over the virtual format, students may apply to more programs, which could improve diversity of the institutional applicant pool though higher numbers could overwhelm the process. Faculty recommendations may be limited as electives have not taken place. The U.S. Medical Licensing Examination Step 2 has been delayed, and these factors may affect the program's ability to evaluate students, particularly International Medical Graduates (IMGs) who rely heavily on these. Interview days will be organizationally and technologically complex. Web-conferencing will need to be thoroughly tested with IT support, and faculty and administrators will be trained to present the institution in its best light, as well as minimizing stressful technological glitches. Interviews may need to be shorter and spaced to reduce video conferencing fatigue. The pre-interview dinner could be replaced by an informal post-interview virtual social hour between small groups of students and residents. Students, particularly disadvantaged students and IMGs, may have concerns that limited technological resources, or the local setting, may affect a program's perception of them. Faculty mentors should guide students in how to optimize their presentations (22) . Medical schools may provide quiet, interruption-free, technologically equipped spaces for students. Interviewing faculty must be constantly aware of any unconscious biases that might influence their evaluation of the students due to these factors (23) . If both programs and candidates put significant effort into planning this virtual match season, approaching it as an opportunity for creativity and improvement and iteratively adapting techniques based on successes and failures, there is every possibility that we will never want to go back to the old system. The mission of the American Board of Radiology (ABR) is to certify that its diplomates demonstrate the requisite knowledge, skill, and understanding of their disciplines to the benefit of patients. Board certification must be sufficiently rigorous to assure public trust of the process. Initially, the ABR cancelled one and rescheduled several of its examinations during the COVID-19 crisis as current testing environments preclude adequate social distancing and incur the risk of travel. The ABR subsequently made the difficult decision of postponing all 2020 exams. Many voiced frustration and a strong desire to pivot to an alternative testing model to avoid the delay. The ABR subsequently committed to administering all currently unscheduled and future oral and computer-based examinations to remote platforms beginning in the first half of 2021 (REF2). Residents originally scheduled to take the core exam in June 2020 will now take the exam in February 2021. Rising third year residents will still take the core exam in June 2021, but with a virtual platform. Certifying exams will be provided twice in 2021. While dedicated "time off" from clinical responsibilities is not (and should not be) condoned by program directors, training programs commonly assign candidates to rotations that allow additional study time preceding the examination. With the delay of exams, this practice may shift or even fall by the wayside. If the diagnostic core exam is delayed so that two classes are taking it simultaneously, the clinical workforce will have reduced access to its best-trained residents. The impact to IR programs is more complicated with trainees moving to more timeintensive interventional rotations during the pre-exam period and distancing the exam from foundational core training. Ironically, this may force the concept that the best preparation is engaged patient care with active learning during clinical rotations and not the binge-and-purge learning process. The current crisis has forced the decision to move to a virtual platform, the method of which has not yet been determined. Multiple exam centers could allow for increased social distancing. The ABR currently uses Pearson VUE testing centers for a limited number of its exams. To date, it has been impossible to hold image-rich diagnostic radiology and IR exams in testing centers because of lack of appropriate equipment, such as servers to handle the large data sets and high resolution monitors, and lack of environmental control, including ambient lighting [24] . Some have queried distribution of exams in Radiology departments with accredited training programs. The equipment becomes less of an issue, and more closely replicates a real imaging environment. Exam validity and security in these micro testing environments is assured by local proctors. A personalized distributed model could mimic the ABR online assessment (OLA) for maintenance of certification (MOC). The OLA process allows for efficient and convenient periodic assessment of diplomates to achieve their MOC requirements. Although it does replace the previous every 10-year exam, it is both a summative and formative tool, providing assessment with immediate feedback and focused learning and is focused on "walking-around knowledge" rather than a deeper foundational knowledge that is expected as part of residency training and assessed in the core examination. A fast pivot of various standardized and certifying exams across the U.S. to alternative processes has occurred. These virtual exams use biometrics, such as facial recognition, to confirm candidates' identity. Sessions are recorded. Proctoring programs can lock-down browsers to prevent searching of content. Some include artificial intelligence to observe behaviors of testing candidates, while others incorporate fitness monitors to detect changes in pulse rate. This may raise suspicion for those concerned about privacy. While trust in the certification process is critical and changes would require time to assure appropriate exam delivery, the uncertainty about the new normal will force the consideration of alternatives to the current testing process. The COVID-19 pandemic has been exceptionally disruptive. While many locations are in recovery, some have yet to hit a peak and secondary peaks could certainly occur. As the number of COVID-19 patients could vary over time and location, we should be prepared to remain flexible in our approach while anticipating additional future needs, potentially even including a shift of trainees to inpatient service. The pandemic has forced virtual platforms for daily teaching as well as participation in departmental, institutional, and national meetings Faculty development will be essential to effectively leverage the advantages of this new approach to education. The recruitment of trainees in the virtual environment will require focus not only on departmental and institutional educational opportunities, but also culture. The administration of board examinations will likely undergo a paradigm shift. We will hopefully take advantage of the many opportunities presented in this new era. • Lower volumes and restricted access to patients may reduce experiential learning for radiology trainees. • The shift to a virtual environment for daily readout sessions as well as most meetings requires a shift in the approach to be more interactive, and support in faculty development is needed to gain expertise in using the virtual environment. • The requirement for virtual recruitment of trainees will necessitate communication of not only educational and research offerings but also the culture of a department, institution, and community. • Administration of initial board certification examinations requires significant logistics including a secure environment with optimal viewing conditions that is not easily replicated in the virtual environment. Delay in exam administration will prompt reevaluation of how these examinations are given. Radiology Department Preparedness for COVID-19: Radiology Scientific Expert Panel Radiology Residency Preparedness and Response to the COVID-19 Pandemic Virtual Read-Out: Radiology Education for the 21st Century During the COVID-19 Pandemic The Impact of COVID-19 on radiology trainees Coronavirus Disease 2019 (COVID-19) and Radiology Education-Strategies for Survival The Impact of COVID-19 on Interventional Radiology Training Programs: What You Need to Know Interventional Radiology Residents, Subspecialty Radiology Fellows, and Program Directors One Academic Health System's Early (and Ongoing) Experience Responding to COVID-19: Recommendations From the Initial Epicenter of the Pandemic in the United States COVID-19: a unique learning opportunity if the well-being of learners and frontline workers is adequately supported Helping medical educators world-wide pivot their curricula online: PivotMedEd.com Faculty Development in a Pandemic: So Close-Yet So Far Online faculty development using Cognitive apprenticeship in response to COVID-19 The Impact of COVID-19 on Medical Education COVID-19: time for a bold new strategy for medical education Acquiring New Skills, and Competencies in the Pandemic Era: Implications and Expectations for Physician Continuing Professional Development Osteopathic, and Non-U.S. Medical School Applicants. The Coalition for Physician Accountability's Work Group on Medical Students in the Class of 2021 Moving Across Institutions for Post Graduate Training Association of Program Directors in Radiology and Association of Program Directors in Interventional Radiology Influence of the Interview on Ranking in the Residency Selection Process Student interviews for Radiology Residency: What Influences How Students Rank Programs? Feasibility and Usability of Tele-interview for Medical Residency Interview Fourth Virtual Interviews: Applicant Preparation Guide. Association of American Medical Colleges Best Practices for Conducting Residency Program Interviews. Association of American Medical Colleges Why Must Candidates Travel for Diagnostic Radiology Initial Certification Exams? American Board of Radiology /fulltext REF2 Coronavirus Information. The American Board of Radiology Burnout and Posttraumatic Stress Disorder in the Coronavirus Disease 2019 (COVID-19) Pandemic: Intersection, Impact and Interventions The authors thank Dr. Alexander Norbash for his contribution in the conception and editing of the manuscript. • Lower volumes and restricted access to patients may reduce experiential learning for radiology trainees.• The shift to a virtual environment for daily readout sessions as well as most meetings requires a shift in the approach to be more interactive, and support in faculty development is needed to gain expertise in using the virtual environment.• The requirement for virtual recruitment of trainees will necessitate communication of not only educational and research offerings but also the culture of a department, institution, and community.• Administration of initial board certification examinations requires significant logistics including a secure environment with optimal viewing conditions that is not easily replicated in the virtual environment. Delay in exam administration will prompt reevaluation of how these examinations are given.