key: cord-0010614-ps4b90qu
authors: Major, Mel E.; Ramaekers, Stephan P. J.; Engelbert, Raoul H. H.; Van der Schaaf, Marike
title: Preparing undergraduate students for clinical work in a complex environment: evaluation of an e-learning module on physiotherapy in the intensive care unit
date: 2020-04-28
journal: BMC Med Educ
DOI: 10.1186/s12909-020-02035-2
sha: 61385469cdd49acae42463c2ab3ed8f48aea6fd4
doc_id: 10614
cord_uid: ps4b90qu

BACKGROUND: Intensive Care Units (ICUs) are daunting environments for physiotherapy (PT) students performing clinical rotations. To prepare students for this environment, a newly developed, evidence-based e-learning module was designed and implemented in the undergraduate curriculum. The aim of this study was to investigate whether e-learning is a feasible method in preparing PT students for clinical work in complex ICU environments, as perceived by students and experts. METHODS: A mixed methods proof of concept study was undertaken. Participants were final-year students of an international curriculum, and experts from didactic and clinical fields. An e-learning module consisting of 7 separate chapters based on the latest scientific evidence and clinical expertise was developed, piloted and incorporated into the undergraduate curriculum as a compulsory course to be completed prior to clinical ICU rotations. Data were collected through 3 focus group meetings and 5 semi-structured interviews; these meetings and interviews were audio recorded, transcribed verbatim and analyzed. RESULTS: The study sample comprised of 14 students and 5 experts. Thematic analysis revealed three themes: expected competencies of PT students in ICU, feeling prepared for ICU clinical work and dealing with local variety. The e-learning module enabled students to anticipate clinical situations and PT tasks in the ICU. Higher level clinical reasoning skills, handling of lines and wires and dealing with out-of-textbook situations could not be achieved with the e-learning module alone. CONCLUSIONS: An e-learning module can sufficiently prepare PT students for their clinical tasks in the ICU, as long as it is integrated with, or closely connected to, the students’ clinical placement.

Developments in intensive care medicine over the past decades have led to both an increase in complexity as well as in the number of patients surviving critical illness, resulting in prolonged intensive care unit (ICU) stays [1, 2] . Evidence on the effects of prolonged immobility in these vulnerable patients is abundant [2] [3] [4] [5] [6] and multidisciplinary interventions directed to early mobilization of ICU patients are globally implemented [7] [8] [9] [10] . Physiotherapists, as part of a rehabilitation team, are essential to ICUs.

Recent studies have identified physiotherapy (PT) competencies required for the ICU setting and recommendations have been made to define a professional profile specifically for ICU physiotherapists (ICU-PTs) [1, [11] [12] [13] [14] [15] . Across these studies, consensus exists on the necessity for ICU-PTs to have knowledge and understanding of medication interaction, pathophysiology, ICU equipment (including mechanical ventilation modes), laboratory testing and imaging investigations. ICU-PTs should also be familiar with practicing PT within safety parameters and based on sound clinical reasoning [12] [13] [14] [15] [16] .

Undergraduate PT curricula need to be adaptive to constantly changing clinical environments and requirements, but also include authentic learning experiences to optimally prepare graduates for the profession [17, 18] . Teaching methods currently applied in preparation for the ICU include theoretical classes, classroom and in-hospital simulations with computerized manikins and compulsory clinical rotations [19] [20] [21] [22] . Despite having had preparational classes or simulation scenarios, PT students are often overwhelmed by the ICU environment and lack confidence in the execution of clinical tasks involving (sedated) patients dependent on mechanical ventilation [23, 24] . E-learning modules use a variety of interactive teaching methods, such as real-life videos, which can be helpful in transferring knowledge and reasoning skills and preparing students for complex environments. It has been shown to be an effective and flexible teaching tool in undergraduate medical and allied health education [25] [26] [27] [28] [29] . With internet-based courses being accessible anywhere in the world and on any electronic device [30, 31] , an e-learning module on ICU-PT could be a convenient teaching method for an internationally oriented curriculum. Therefore, the aim of this study was to develop, implement and evaluate an e-learning module on evidence-based physiotherapy in the ICU and to investigate its feasibility with regards to preparing undergraduate PT students for clinical work in ICUs worldwide.

A mixed method proof of concept study was undertaken in the period of June 2016 until January 2018. Figure 1 shows an overview of the different study phases.

In 2016, the undergraduate curriculum of the European School of Physiotherapy (ESP), Amsterdam University of Applied Sciences (AUAS), did not contain a course specific to PT responsibilities in the ICU. Relevant content, such as cardiorespiratory physiotherapy and pathophysiology, were embedded within different parts of the curriculum, instead of focused into one course module. Undergraduate students in the ESP program are required to conduct 4 clinical rotations, each lasting 10 weeks. The last two clinical rotations are commonly Fig. 1 Phases of study: design and evaluation conducted within rehabilitation facilities, a hospital stroke unit and/or an ICU. As these rotations can take place anywhere in the world, students are provided with internationally oriented course content. Evaluation results led to the decision to design an e-learning module, 'Physiotherapy in the ICU', to be completed before students' practical ICU placements.

Clinical, didactic and research experts provided input on the e-learning module. Core topics, competencies and learning objectives, according to Bloom's revised taxonomy [32] , were identified (Table 1) . Content decisions were based on recent medical and allied health research evidence for physiotherapy in the ICU and aimed to provide a general introduction into the topic. Videos were recorded at the ICUs at the Amsterdam University Medical Centers (Amsterdam UMC) and informed consent for recording was obtained from patients and clinicians.

The final module contained 7 chapters: general introduction to ICU, the impact of ICU admission on patient and family, introduction to ICU rehabilitation, physiotherapeutic assessment, physiotherapeutic interventions, the post-surgical patient and reporting and interprofessional collaboration. A variety of teaching materials was incorporated in the e-learning module to facilitate student learning and motivation: interactive assignments, background literature and short quizzes, self-developed and online videos (patient-testimonials, patient and PT observations, skills-modelling videos), and text presented in presentation slide format, narrated by a native English speaker. Each module finished with a quiz and direct feedback was provided. An online community supported the e-learning module, operating as a forum between lecturer and students where additional material, as well as content and technical questions, could be posted.

A 25 question, multiple choice online exam consisting of 3-answer options was developed as a means to test students on obtained knowledge and reasoning skills related to the learning objectives and predetermined exam matrix. Students required a passing mark before being allowed to start the clinical rotation. After the clinical rotation, students submitted a mandatory case report about one of the ICU patients that they had observed during their placement. The mark received for the case report determined the final ICU course grade.

Technical details of the e-learning system

In 2015, a trial version of the e-learning module was developed in Articulate Storyline© (version 2015) by a trainee developer of the Institute Information Communication Technology and Education (ICTO) of the Amsterdam UMC. Microsoft PowerPoint presentations, supported by audio files, videos and interactive assignments, formed the content of this trial version. The module was accessed through Google Sites. ICU clinicians and a small sample of students (n = 8) provided feedback on content accuracy, user-friendliness and overall aesthetic of the module.

In 2017, the final version of the e-learning module was incorporated in G Suite from Google Cloud©, with additional interactive assignments created in Adobe Acti-vate©. The main reason for the transition to G Suite was the flexibility of the system, enabling easy content updates as new evidence on physiotherapy practices in the ICU emerged.

The aim of this study phase was to evaluate the elearning module on user-friendliness, level of complexity, didactic alignment and accessibility. Between June and October 2016, the e-learning module was piloted among a group of undergraduate students (n = 23, male: 5, female: 18) for whom the module was not a compulsory part of the BSc curriculum. Information was obtained through focus group (FG) sessions, semistructured interviews and exam analysis, which led to technical changes to improve user-friendliness. The key features of the course remained unchanged.

The course was implemented in the curriculum of the academic year 2016-2017. It ran twice for a period of 6 weeks and was evaluated during data collection phase 2. Participants were recruited via e-mail; only students who had completed both the e-learning module and a clinical rotation between November 2016 and July 2017 were included. Clinical experts were purposefully sampled through the faculty's international network. Students and experts were provided with information explaining the aim of the study. Participating experts received PDF files containing the e-learning module's content in preparation for the interview. Interview guides were set up for FG meetings and semi-structured interviews ( Table 2 ). Interviews were conducted by a research assistant, either face-to-face or via Skype©, and had a duration of 30-60 min. FG sessions, lasting approximately one hour per session, took place at the Faculty of Health, AUAS, in Amsterdam. Sessions were moderated by one of the research assistants and monitored by the main investigator.

Interviews and FG sessions were audio-or video recorded and transcribed verbatim. Initial line-by-line coding was followed by focused coding in order to identify categories and transcendent themes from the data. Regular feedback sessions were scheduled with the complete research team to discuss the data analysis and to facilitate a thorough categorization, interpretation and establishment of data saturation. MAXQDA12 was used for qualitative data analysis. The online exam was analyzed for estimated internal consistency reliability (Cronbach's Alpha) between questions, proportions of correct answers and standard measurement error. P-values (difficulty index) corrected for chance score (expressed as Pc), point-biserial correlations (item discrimination index) and distractor efficiency (DE), and were calculated for the exam. Individual exam scores were checked to reveal deviant response patterns. If indicated by the exam statistics, the content of a question was reviewed to establish its validity. No questions were removed from the exam.

Ethical approval has been obtained from the ethical review board of the Netherlands Association for Medical Education (NVMO-ERB) file number 728. Written, informed consent was obtained from each participant.

In total, 14 international bachelor students participated in three FG sessions during study phases 1 and 2. The mean age was 25.3 (SD ± 3.2) and 93% (n = 13) of the students were female. Compared to gender distribution in the ESP program (female 59%, male 41%, 2019-2020 data), the proportion of females in this study was high. This can be explained by the higher number of females volunteering to participate in the 2016 pilot (19 out of 23) and more female students having completed the ICU rotation at the time of recruitment. Therefore, more females met the eligibility criteria for participation. All participating students were in their 3rd or 4th year of study. Purposive sampling of didactic and clinical experts led to participation of 5 experts in total (60% female, mean age 37, SD ± 7.8) ( Table 3) . Results data collection phase 1

Qualitative analysis of transcripts of data collected in phase 1 showed that the content of the e-learning module was perceived positively with regards to: accessibility, degree of difficulty, variation in study assignments, encouragement of further learning and triggering curiosity, and transparency of the module's learning objectives. Didactic alignment was assessed as the alignment between the course objectives and the content of the online exam. Analysis showed that the exam did not align well; only 11 out of 25 questions corresponded with the course objectives. Feedback included suggestions to add case-based exam questions, which was done for the revised version. The learning objectives and testing matrix were fine-tuned and after revision, the exam construct and the didactic alignment improved (18 out of 25 corresponded precisely with the learning objectives). Analysis showed high internal consistency (Cronbach's alpha: 0.84) with a tendency towards questions being too easy (Pc = 0.86).

The following themes were identified: expected competencies of PT students in ICU, feeling prepared for ICU clinical work and dealing with local variety. Being able to connect with the (unconscious) patient and communicate with the patient, family member and ICU staff, was found to be an essential competency by both clinical experts and students.

"Communication I guess with the patient, especially if they've altered consciousness [..]. But even so, even when English is their first language, they can use medical jargon when communicating with patients." (Amy, Irish clinical expert) (1) Germany (1) Israel (1) UK (1) Singapore (1) Greece (1) Germany (2) Netherlands (1) France (1) South Africa (1) Ireland (1) Greece (1) Role Bachelor student (7) Lecturer (1) Web developer (1) Bachelor student (7) ICU physiotherapist and clinical tutor (3) PhD student (1) Postdoctoral research fellow (1) Mean age 26 (SD ± 4.0) 32.5 (SD ± 7.7) 25.7 (SD ± 2.75) 40 (SD ± 7.5)

Years of clinical experience n/a n/a n/ Clinical reasoning skills related to applying the theoretical information in context (i.e. the choice of interventions):

"...uhm, yeah difficulty prioritizing what is important for that patient at that time. So yeah, individualizing the treatment specific to the patient and their problems, rather than having a general sort of recipe -all ICU patients need this package of care, whatever." (Wendy, South African clinical expert)

Feeling prepared for ICU clinical work FG participants expressed feeling overwhelmed by the ICU environment at the start of their clinical rotations, despite having completed the theoretical e-learning module. This was related to specific clinical situations for which they were not prepared, such as wires becoming undetached, alarms going off, or dealing with emergency situations in the ICU.

"He suddenly ripped out his mechanical ventilation [..] And I didn't know how to put it back in like properly, and where I could touch it, and hold it and oh god that was horrible." (Student: Leah)

Clinical experts also experienced undergraduate students feeling anxious and at times, being overly cautious when handling connections to equipment: The e-learning module enabled them to recognize and interpret reporting methods and patient objective data:

"I was able to see the PT's SOAP notes [..] it was a different layout than I was used to, but the abbreviations and stuff it was exactly the same. I felt prepared for that." (Student: Sarah) "Actually, for me, I found many assessment tools from the ICU course in my internship site, so with the RASS and stuff they would use it, so that was actually good to hear about it before." (Student: Jasmine) "I thought the vital signs [..] it was really, really good because [..] especially I saw that in acute care as well, they get on that a lot [..] they were always the things that they were asking me about like: 'Okay, what do those numbers mean? Why is that important?' and that was really good to have in the module." (Student: Ella)

The course also enabled the students to anticipate the ICU patients' often complicated recovery process:

"We had quite a few long-term patients as well so that was actually really useful to learn about all those syndromes. To put it in to perspective what they might get afterwards [..]". (Student: Olivia)

Dealing with the local variety was a theme identified from the data and related to situations where the general character of the e-learning module did not match with the clinical practice in the variety of international ICU settings. This was illustrated by situations where students were expected to perform clinical tasks, such as respiratory care:

"I noticed that, and I think it is different from country to country. "...they don't know about assessing patients, how to assess MRC or uhm hand grip and uhm functional tests and all that stuff." (Alexandra, Greek clinical expert)

Participants sometimes experienced discrepancy between the evidence-based content of the e-learning module compared to daily clinical practice:

"...so we have a competency checklist for respiratory and we also have an 'on call' checklist so I use those to kind of guide me. But they're quite respiratoryoriented. [..] research is getting less and less supportive of our [..] respiratory interventions and more supportive of our rehab interventions." (Amy, Irish clinical expert) "Germany is not really famous for using evidencebased assessment tools [laughs] so maybe... I don't know what they did." (Student: Leah) "..and it's a problem that we have in [ 

This study confirms that an e-learning module is a feasible and valuable teaching method to prepare international undergraduates for intensive care unit physiotherapy (ICU-PT), as learning objectives with regards to recognition, interpretation, understanding and simple application were achieved. Participants to this study perceived the e-learning module to be helpful in anticipating the ICU environment, patient conditions, and basic PT assessment and intervention tasks. Participants felt less prepared for dealing with emergency situations, handling patients' lines and attachments, adapting to the variety in clinical expectations across international ICU settings and utilizing higher-level clinical reasoning skills, such as designing tailor-made interventions based on a patient's clinical presentation. Results from this study align with existing evidence suggesting that supervised practice in clinical settings is required to increase students' confidence and improve clinical reasoning skills [19, 22, 33, 34] . Integration of this e-learning module with clinical practice provides a foundation for the highly demanding clinical responsibilities in ICU. Timing in which the educational tool is offered in relation to the clinical experience is essential [18, 25] . If, additional to this e-learning module, more complex and clinical reasoning-provoking material would be completed during the clinical rotation, learning on the two highest levels of Miller's pyramid of clinical competence -the 'shows how' and the 'does' -could likely be facilitated [35] .

This study also showed the variety of clinical practice requirements in ICU settings worldwide which provides a challenge for undergraduate curricula in the context of (international) mobility of health professionals [36] . Recent studies highlight these differences; ICU-PTs working in Australia or some European countries are expected to adjust ventilator settings, perform (endo) tracheal suctioning and interpret imaging findings, whereas South African ICU-PTs must also show cultural sensitivity and be a team player [13, 15, 16] . To accommodate for this international variety in clinical practice, e-learning modules prove to be efficient teaching tools, as the content is easily adaptable and additional, elective chapters could be added [25, 28] . For faculties, where research, education and clinical practice are tightly linked, e-learning modules can serve as excellent tools to incorporate the results of ongoing communication between these departments, hence providing students with authentic content in preparation for clinical practice.

The small study sample could be a limitation to generalizability of the results to the student population of undergraduate PT programs worldwide. Experts included in this study also comprised a small sample and the results are therefore not meant to be representative of clinical practice in ICUs and hospitals across the globe. Our study sample consisted of mainly females (93%), which is a slight overrepresentation compared to undergraduate PT students worldwide, although a majority of applicants to PT programs, as well as registered physiotherapists, are of female gender [37] [38] [39] .

The chosen topics for the expert interviews were purposefully focused towards required student competencies, and this could have led to bias in the results. However, data collection and analysis did not show reasons for inclusion of new topics or themes and therefore confirmed suitability of the initial topic list.

We did not evaluate clinical performance of the students quantitatively and therefore we cannot quantify improvements in cognitive, behavioral or technical (skills) performance measures.

Although the procedures were monitored carefully, selection bias and observer bias cannot be excluded due to the fact that final year students of our undergraduate program were involved in recruitment of participants as well as data collection through focus groups, which consisted of fellow students.

An evidence-based e-learning module on physiotherapy in the ICU is a feasible and valuable contribution to the undergraduate bachelor program and succeeds in preparing students for their clinical rotation in ICU. The flexibility of this teaching method allows for regular updates to the content and catering for a variety of PT tasks in ICUs worldwide. However, the course did not fully succeed in removing student anxiety when handling complex patient cases; this objective is difficult to achieve with e-learning only. Future endeavors should investigate the feasibility of a closer integration of this elearning module and clinical practice as well as incorporating additional module chapters to facilitate complex clinical reasoning and clinical performance. Authors' contributions MM set up the research protocol, conducted the data collection and analysis, and drafted the manuscript. SR provided methodological support throughout the project and assisted in drafting of the manuscript. RE supervised the research project and contributed to the drafting of the manuscript. MvdS supervised the research project, provided methodological support throughout the project and contributed to the drafting of the manuscript. All authors have read and approved the manuscript.

Mel Major is PhD researcher in the field of physiotherapeutic rehabilitation after critical illness and works as senior lecturer at the European School of Physiotherapy. She is one of the developers of the e-learning module 'Physiotherapy in the ICU'.

Stephan Ramaekers is associate professor clinical reasoning and shared decision making. His research focus is on the development of clinical reasoning competency, in particular in interprofessional teams. Raoul Engelbert: is professor in Physiotherapy, combining patient care, research and education. His research focus is transition of care in complex (pediatric) patients. He supervises PhD candidates performing clinical & research tasks on complex (pediatric) patients during and after their ICU and hospital stay. Marike van der Schaaf is physiotherapist/researcher and associate professor in rehabilitation in acute care. She supervises PhD candidates in the area of rehabilitation in critically ill and frail patients during and after hospital discharge. She is one of the developers of the e-learning module 'Physiotherapy in the ICU'.

MM receives a research grant by the Dutch Research Council (NWO). The funding facilitates MM to conduct PhD research for 2 days a week for a 5year period. The funder does not intervene nor has a role in content related matters of the research projects.

Physiotherapy for adult patients with critical illness: recommendations of the European Respiratory Society and European Society of Intensive Care Medicine Task Force on physiotherapy for critically ill patients

Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders' conference

ICU-acquired weakness and recovery from critical illness

Functional disability 5 years after acute respiratory distress syndrome

A framework for diagnosing and classifying intensive care unitacquired weakness

The impact of extended bed rest on the musculoskeletal system in the critical care environment

Early physical and occupational therapy in mechanically ventilated, critically ill patients: a randomised controlled trial

Physiotherapy in the intensive care unit: an evidence-based, expert driven, practical statement and rehabilitation recommendations

Expert consensus and recommendations on safety criteria for active mobilization of mechanically ventilated critically ill adults

Safety of patient mobilization and rehabilitation in the intensive care unit. Systematic review with meta-analysis

A profile of European intensive care unit physiotherapists

Nationwide acute care physical therapist practice analysis identifies knowledge, skills, and behaviors that reflect acute care practice

Minimum standards of clinical practice for physiotherapists working in critical care settings in Australia and New Zealand: a modified Delphi technique

Developing minimum clinical standards for physiotherapy in south African intensive care units: the nominal group technique in action

Minimum standards of clinical practice for physiotherapists working in critical care settings in the United Kingdom: a modified Delphi technique

Developing minimum clinical standards for physiotherapy in south African ICUs: a qualitative study

Moving forth: imagining physiotherapy education differently

Enhancing the connection between the classroom and the clinical workplace: a systematic review

Simulation experience enhances physical therapist student confidence in managing a patient in the critical care environment

Use of high fidelity human simulation to teach physical therapist decision-making skills for the intensive care setting

Using high fidelity simulation to impact occupational therapy student knowledge, comfort, and confidence in acute care

An acute interprofessional simulation experience for occupational and physical therapy students: key findings from a survey study

Using human simulation to prepare physical therapy students for acute care clinical practice

Undergraduate training in the care of the acutely ill patient: a literature review

Effectiveness of teaching evidencebased medicine to undergraduate medical students: a BEME systematic review

Technology-enhanced simulation for health professions education: a systematic review and meta-analysis

The "flipped classroom" model for teaching in the intensive care unit: rationale, practical considerations, and an example of successful implementation

A blended design in acute care training: similar learning results, less training costs compared with a traditional format

Online eLearning for undergraduates in health professions: a systematic review of the impact on knowledge, skills, attitudes and satisfaction

Randomized controlled trial of simulation-based teaching versus traditional clinical instructions in nursing: a pilot study among critical care nursing students

E-learning in physiotherapy education

A revision of Bloom's taxonomy: an overview

Development and evaluation of a critical care e-learning scenario

Experiences of Turkish undergraduate nursing students in the intensive care unit

The assessment of clinical skills/competence/performance

Health professional mobility and health systems. Evidence from 17 European countries. United Kingdom: WHO Regional Office for Europe

Demographic characteristics of applicants to, and students of, Ontario physiotherapy education programs, 2004-2014: trends in gender, geographical location, aboriginal identity, and immigrant status

Registrant data 01

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

The authors would like to acknowledge the valuable contribution of Mareike Appel, Lis Boever, Anna Kohlmann, Beth Meluch, Alexandra Pittali and Szilvia Sydó. As former students of the BSc (hons) program of the European School of Physiotherapy, Amsterdam University of Applied Sciences, they assisted

Data sharing is not applicable to this article as no datasets were generated or analyzed during the current study.Ethics approval and consent to participate Ethical approval has been obtained from the ethical review board of the Netherlands Association for Medical Education (NVMO-ERB) file number 728. Written, informed consent was obtained from each participant.

Not applicable.

The authors report no competing interests.Author details 1