key: cord-0926993-s05ijbug
authors: Mestre, André; Muster, Marek; El Adib, Ahmed Rhassane; Ösp Egilsdottir, Hugrun; Byermoen, Kirsten Røland; Padilha, Miguel; Aguilar, Thania; Tabagari, Nino; Betts, Lorraine; Sales, Leila; Garcia, Pedro; Ling, Luo; Café, Hugo; Binnie, Alexandra; Marreiros, Ana
title: The impact of small-group virtual patient simulator training on perceptions of individual learning process and curricular integration: a multicentre cohort study of nursing and medical students
date: 2022-05-16
journal: BMC Med Educ
DOI: 10.1186/s12909-022-03426-3
sha: e1bfe6534fee31fd396818c5235bedfe3f8d90f2
doc_id: 926993
cord_uid: s05ijbug

BACKGROUND: The COVID-19 pandemic has precipitated rapid changes in medical education to protect students and patients from the risk of infection. Virtual Patient Simulators (VPS) provide a simulated clinical environment in which students can interview and examine a patient, order tests and exams, prioritize interventions, and observe response to therapy, all with minimal risk to themselves and their patients. Like high-fidelity simulators (HFS), VPS are a tool to improve curricular integration. Unlike HFS, VPS require limited infrastructure investment and can be used in low-resource settings. Few studies have examined the impact of VPS training on clinical education. This international, multicenter cohort study was designed to assess the impact of small-group VPS training on individual learning process and curricular integration from the perspective of nursing and medical students. METHODS: We conducted a multi-centre, international cohort study of nursing and medical students. Baseline perceptions of individual learning process and curricular integration were assessed using a 27-item pre-session questionnaire. Students subsequently participated in small-group VPS training sessions lead by a clinical tutor and then completed a 32-item post-session questionnaire, including 25 paired items. Pre- and post-session responses were compared to determine the impact of the small-group VPS experience. RESULTS: Participants included 617 nursing and medical students from 11 institutions in 8 countries. At baseline, nursing students reported greater curricular integration and more clinical and simulation experience than did medical students. After exposure to small-group VPS training, participants reported significant improvements in 5/6 items relating to individual learning process and 7/7 items relating to curricular integration. The impact of the VPS experience was similar amongst nursing and medical students. CONCLUSIONS: In this multi-centre study, perceptions of individual learning process and curricular integration improved after exposure to small-group VPS training. Nursing and medical students showed similar impact. Small-group VPS training is an accessible, low-risk educational strategy that can improve student perceptions of individual learning process and curricular integration. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1186/s12909-022-03426-3.

Virtual Patient Simulators (VPS) (also known as "High Fidelity Software Simulations" [1] or "Clinical Virtual Simulators" [2] ) are computer-based programs in which students emulate the role of health care providers while caring for virtual patients. Learners can interview and examine their patient, order exams, prioritize and choose interventions and observe response to therapy in real-time.

VPS evolved from Virtual Patients (VP), which are static, computer-based patient cases that provide clinical information in text and image format and then ask for a diagnosis or treatment plan [1] . Unlike a VP case, however, the VPS emulates an actual clinical encounter with the help of a graphical interface (Fig. 1 ) that enables the learner to interact with the virtual patient and their clinical environment. Thus, VPS are an interactive training tool that can mimic a "hands-on" clinical encounter. Like high fidelity simulators (HFS), VPS allow students to apply their learned knowledge to clinical problems in a structured, low risk setting [3] , thereby integrating basic and clinical learning [4] . However, VPS are less expensive than HFS [5, 6] , can be used both individually and in groups and are available in practically any setting in which there is computer access.

Although VPS are intuitively appealing as an educational tool, studies of VPS and their impact on clinical education are lacking [7, 8] . A study of Portuguese nursing students reported that the Body Interact ™ VPS was easy to use and relevant [2] . A subsequent study randomized 42 nursing students to a VPS educational session vs a low-fidelity simulation session; students who attended the VPS session showed improved knowledge retention and clinical reasoning [9] . A study of Norwegian nursing students reported that the Laerdal vSim for Nursing ™ VPS was also well-received amongst nursing students [10] and a study from China reported that a vSim for Nursing teaching session improved knowledge scores amongst nursing students when compared with the usual clinical curriculum [11] . These studies highlight Conclusions: In this multi-centre study, perceptions of individual learning process and curricular integration improved after exposure to small-group VPS training. Nursing and medical students showed similar impact. Smallgroup VPS training is an accessible, low-risk educational strategy that can improve student perceptions of individual learning process and curricular integration.

Keywords: Virtual Patient Simulator, Curricular integration, Simulation training, Clinical education, Learning feedback Fig. 1 The graphical interface of the Body Interact ™ VPS displays the virtual patient and allows the learner to interact with the patient and their clinical environment that VPS are easy to use and can help with knowledge acquisition and retention. However, studies looking at the impact of VPS on individual learning and curricular integration are lacking.

In this study we analysed the impact of small-group VPS training on perceptions of individual learning process and curricular integration amongst nursing and medical students.

We conducted an international, multi-center cohort study to analyse the impact of small-group VPS training on perceptions of individual learning process and curricular integration. The study took place between November 2019 and July 2020. Ethics approval was obtained at participating institutions, in accordance with local regulations. Written consent was obtained from all participants.

The study protocol was defined by the investigators and implemented at each site by one or more clinical tutors with VPS teaching experience (see Supplementary methods for the implementation protocol). The protocol was designed to be pragmatic, given the varying conditions at different participating institutions. All sites had access to the Body Interact ™ VPS in interactive table or computer format and compliance with the protocol was ensured through emails, online meetings, telephone contact and activity registration. Participants were nursing or medical students with no prior contact with the VPS. In keeping with the pragmatic design, the small-group VPS training sessions could be integrated into the regular curriculum or offered as a stand-alone session, at the discretion of the tutor(s). Student participation in the study was voluntary.

Prior to the VPS training session, participants received a brief, non-judgemental introduction to the VPS with an opportunity to ask questions. After this session, the pre-session questionnaire (U0) was completed via an online form. Small-group VPS training sessions took place in groups of 5 to 9 students and consisted of a sample clinical case, to familiarize the students with the functionality of the VPS, followed by two additional clinical cases chosen by the tutor. After the session, participants completed the postsession questionnaire (U1) via an online form. Only participants who completed both questionnaires were included in the final sample. Data access, handling, and treatment were carried out exclusively by the authors.

The study-specific instrument was developed after literature review and consultation with 13 health education experts with medical and nursing backgrounds. The pre-session questionnaire (U0, Supplementary Table 1 ) and the post-session questionnaire (U1, Supplementary Table 2 ) assessed three empirical dimensions: (1) individual learning process (2) degree of curricular integration of the student's course and (3) the student's perception of (a) the VPS environment and (b) the impact of VPS training on student learning. Twenty-five paired items appeared on the pre-and post-questionnaires while two items were exclusive to the pre-questionnaire (U0.7 and U0.8) and seven items were exclusive to the post-questionnaire (U1.26 to U1.32). All items were assessed on a 7-point Likert scale. Scores of 1-3 were interpreted as "negative", 4 was considered "neutral" and 5-7 were interpreted as "positive".

Reliability coefficients for the pre-and post-session questionnaires were determined via iterative integration of medical and nursing schools, resulting in an alpha Cronbach (α) of 0.945 for U0 and 0.949 for U1, confirming good reliability of the instruments.

Statistical analysis was performed using IBM SPSS STA-TISTIC software, version 24. All items were descriptively analysed. Changes in paired items on the pre-and post-session questionnaires were assessed using the paired-samples t-test. Statistical significance was considered P < 0.01. Factor analysis was performed for both the pre-and post-session questionnaires using the Principal Component method. Differences between nursing and medical students were assessed using the t-test for independent samples. Correlations were determined using the Pearson correlation coefficient.

Medical and nursing students from 11 educational institutions were recruited to participate in the study. Of the 681 students who participated in the smallgroup VPS training sessions, 617 (90.6%) consented to participate in the study and completed both study questionnaires. Study participants consisted of 324 (52.5%) nursing students and 293 (47.5%) medical students. The average age of participants was 23 years (SD = 3.8) and females outnumbered males by 482 (78.1%) to 135 (21.9%). Amongst participants for whom year of study was known, 500 (91.6%) were in their pre-clinical years (corresponding to years 1-2 for nursing students and years 1-3 for medical students) while 46 (8.4%) were in their clinical years ( Supplementary Fig. 1 ). 

On the pre-session questionnaire, participants were asked about their individual learning process (Table 1: questions U0.1 to U0.6). Nursing students reported greater balance between theoretical studies and the practical application of knowledge (P < 0.001), more development of communication skills (P < 0.001), greater confidence in their knowledge and in the decision-making process (P < 0.001) and more development of group and conflict management skills (P < 0.001) than did medical students (Supplementary Fig. 2) . Conversely, medical students reported that their studies were more focused on theory (P < 0.001). Overall, students felt that their clinical experience (M = 4.61, SD = 1.53) and simulation experience (M = 4.65, SD = 1.59) were appropriate for their knowledge level, however nursing students rated their clinical and simulation experience more highly than did medical students (P < 0.001 and P < 0.001, respectively) ( Table 1) .

Participants were asked about the degree of curricular integration in their courses (Table 1 : questions U0.9 to U0.15). Nursing students reported greater integration of course contents (P < 0.001), more opportunities to apply learning to practical clinical cases (P < 0.001), more opportunities to participate in clinical simulations (P < 0.001), more training in communication techniques (P < 0.001), and more appropriate teaching methods (P < 0.001) than did medical students ( Supplementary  Fig. 3) . Nursing students were also more confident that their courses were helping them build confidence as future professionals (P < 0.001) ( Table 1) .

On the pre-session questionnaire, participants were asked about their expectations of the VPS training experience (questions U0.16 to U0.25). Students had high expectations for the VPS as a learning tool (M = 5.96, SD = 1.20), as a tool to practice decision-making strategies (M = 5.90, SD = 1.09), and as a tool to transform decision-making errors into a constructive learning process (M = 5.97, SD = 1.13) ( Table 1 ). Medical students reported higher expectations than did nursing students across all items ( Table 1) .

On the post-session questionnaire, participants were asked to re-assess their individual learning process ( Table 2 ). Paired items on the pre-and post-session questionnaires were compared to determine the impact of the VPS training experience (Table 3) . With respect to individual learning process, 6/6 items showed significant increases on the post-session questionnaire: these included the balance between theoretical studies and the practical application of knowledge (P < 0.001), the development of communication skills (P < 0.001), the degree of confidence in the knowledge and decision-making process (P < 0.001) and the development of skills in group management and conflict management (P < 0.018) (Fig. 2) .

On the post-session questionnaire, participants were asked to re-assess the degree of curricular integration in their courses ( Table 2 ). All of the items relating to curricular integration (7/7) showed significant increases on the post-session questionnaire ( Table 3) ; these included the integration of course contents (P < 0.001), opportunities to apply new learning to practical clinical cases (P < 0.001), opportunities to participate in clinical simulations (P < 0.001), training in communication techniques (P < 0.001), discussion of clinical decisions in a controlled learning environment (P < 0.001), and the building of confidence as a future professional (P < 0.001) (Fig. 3) .

On the post-session questionnaire (Table 2 ), participants reported a high level of satisfaction with the VPS as a learning tool (M = 6.27, SD = 1.01) and with the use of a technological resource for learning (M = 6.28, SD = 0.99). They reported that the VPS helped fill gaps in the teaching process (M = 6.06, SD = 1.05) and in their own individual learning (M = 6.08, SD = 1.06). They also felt that it provided real feedback on learning (M = 6.12, SD = 1.07) and identified individual weaknesses in their competencies (M = 6.16, SD = 1.06). Finally, students felt that the VPS provided clinical experience through simulation (M = 6.12, SD = 1.08), helped practice decision-making strategies (M = 6.19, SD = 0.99), and turned clinical decision-making errors into a constructive learning process (M = 6.25, SD = 0.98). Overall, participants considered the VPS to be an important learning tool (M = 6.30, SD = 1.04). When responses from nursing and medical students were compared, medical students reported greater satisfaction with the use of the VPS (P < 0.001) and with its ability to bridge learning gaps (P < 0.001), provide feedback on learning (P < 0.001) and identify weaknesses (P < 0.001)( Table 2 ).

Responses from nursing and medical students were analysed separately to determine whether the impact of the small-group VPS training experience differed between the two groups (Supplementary Table 3 ). No significant differences were noted for items relating to individual learning process. One item relating to curricular integration showed a significant difference (U0.11-U1.9: "In my course we have the opportunity to participate in clinical simulations"), with medical students reporting greater positive change relative to nursing students (Supplementary Table 3 ). No other items relating to curricular integration showed significant differences between the two courses. 

Exploratory factor analysis was used to examine the internal behaviour of the survey instrument before and after small-group VPS training. On the pre-session questionnaire (U0), three factors were defined (Supplementary Tables 4 and 5) : factor C1 represented "curricular integration" and was most impactful while factor C3 represented "focus on theory" and was most specific. An additional factor, C2, was loaded with only one item (U0.12 -"In my course there is adequate training in communication techniques"), which was split over C1 and C2. On the post-session questionnaire, the matched item (U1.10) loaded primarily onto factor C1. This 3-factor model accounted for 60.2% of the variance on the presession questionnaire and 73.8% of the variance on the post-session questionnaire.

In this multi-centre study, nursing and medical students from 11 institutions participated in small-group VPS training sessions supervised by clinical tutors. Perceptions of individual learning process and curricular integration were assessed before and after the VPS training experience. Results demonstrate that small-group VPS training had a positive impact on individual learning process, including the balance between theoretical studies and the practical application of knowledge, the development of communication skills, and the development of group and conflict management skills. Small-group VPS training also improved perceived curricular integration, including the degree of integration of course contents, opportunities to apply learning to clinical cases and opportunities to participate in clinical simulations. At baseline, nursing and medical students differed significantly in terms of individual learning process and curricular integration. Nursing students reported less focus on theory and more clinical and simulation experience. They also reported more opportunities to train non-technical skills such as communication and group and conflict management. Despite these underlying differences, the impact of the intervention was similar across the two groups, suggesting that VPS training can be beneficial in well-integrated courses as well as in more theoretical courses. Medical students had higher expectations of the VPS training experience and rated the experience more highly afterwards. Studies suggest that pre-clinical medical students and pre-clinical nursing students have different perceived learning needs: medical students are focused on learning to gather clinical information and formulating a differential diagnosis [12] while nursing students are focused on acquiring knowledge and technical skills [13] . VPS training aligns closely with the learning needs of medical students, and this may explain their higher expectations and evaluations.

It is important to note that participants in this study were exposed to small-group VPS training, and not largegroup or individual VPS training. Studies have shown that the small-group environment contributes to active learning, enhances deep learning, and helps learners identify weaknesses [14] . It also encourages the development of soft skills, such as communication, teamwork, and group and conflict management [14] . Thus, the small-group environment may have contributed to the benefits of the VPS training experience. A recent study from Japan reported that large-group VPS training improved clinical reasoning scores [15] . The authors did not assess participant perceptions of the experience nor its impact on curricular integration. Studies comparing VPS training in small-groups, large-groups and individually are lacking, however it is likely that the impact of VPS training will differ between these modalities.

Most of the participants in the present study were in their "pre-clinical" years (years 1-2 for nursing students and 1-3 for medical students), where the focus is on theoretical learn and patient contact is more limited. Additional studies will be required to determine whether VPS training has a similar impact on students in their "clinical" years, when there is usually more exposure to the clinical environment.

In conclusion, the results of this study demonstrate that small-group VPS training contributed positively to perceptions of individual learning process and curricular integration amongst nursing and medical students. It also improved opportunities to train key non-technical skills, such as communication and group and conflict management. Further studies will be required to determine whether these benefits translate into improvements in clinical reasoning, decision-making and non-technical skill acquisition.

The study has several important limitations. Firstly, variation existed between study sites in terms of (1) the clinical cases used in the VPS sessions, (2) whether the VPS session was integrated into the curriculum or offered as a stand-alone session and (3) the language of instruction.

These variations were expected given the pragmatic design of the study. In spite of these differences, similar results were observed across institutions, suggesting a limited effect of these variables on study results. Secondly, VPS training occured in small groups supervised by a clinical tutor, so results cannot be extrapolated to unsupervised VPS training or to individual or largegroup VPS training. Finally, the study did not assess hard outcomes such as clinical reasoning, decision-making or non-technical skills.

Small-group VPS training offers an accessible simulation experience that is well-received by students and is perceived to improve individual learning process and curricular integration. These results indicate that smallgroup VPS training is a valuable educational tool that imparts some of the benefits of high-fidelity simulation and clinical training. Future studies should compare VPS training in small-groups, large groups and individually as well as quantifying the impact of VPS training on clinical reasoning, decision-making and non-technical skill acquisition. 

Cross Higher School of Health: Ana Sofia Jesus, Paediatric RN

Sorting Out the Virtual Patient: How to Exploit Artificial Intelligence, Game Technology and Sound Educational Practices to Create Engaging Role-Playing Simulations

Clinical Virtual Simulation in Nursing Education

Comparison of virtual patient simulation with mannequin-based simulation for improving clinical performances in assessing and managing clinical deterioration: randomized controlled trial

Cognition before curriculum: rethinking the integration of basic science and clinical learning

The virtual patient as a learning tool: a mixed quantitative qualitative study

Cost-utility analysis of virtual and mannequin-based simulation

Virtual patient simulations in health professions education: systematic review and meta-analysis by the digital health education collaboration

Virtual patientswhat are we talking about? A framework to classify the meanings of the term in healthcare education

Clinical virtual simulation in nursing education: randomized controlled trial

Norwegian nursing students' evaluation of vSim ® for Nursing

The effects of vsim for nursing&trade; as a teaching strategy on fundamentals of nursing education in undergraduates

Easing the transition: medical students' perceptions of critical skills required for the clerkships

Highfidelity simulation and nursing students' anxiety and self-confidence: a systematic review

Effective small group learning: AMEE Guide No. 48

The utility of virtual patient simulations for clinical reasoning education

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations

The authors would like to thank Daniela Abreu, MSc who established contact with the participating institutions and was responsible for implementation of the study protocol. They also wish to thank the following faculty who assisted with study implementation: University of Rzeszow: Paweł Więch, PhD, DSc,

The online version contains supplementary material available at https:// doi. org/ 10. 1186/ s12909-022-03426-3. Table 3 . Comparison of pre-session and post-session responses of, subdivided by course of study (nursing versus medicine). Supplementary Table 4 . Factor analysis for pre-session questionnaire (U0). Supplementary Table 5 . Factor analysis for post-session questionnaire (U1).Authors' contributions AM, AB, and AM were responsible for conceptualization and design of the study and data analysis. The remaining authors were responsible for implementing the study protocol at their institutions. All authors critically reviewed and approved the final manuscript.

André Mestre was supported by Centro 2020, PT2020 and European Union research grant nº 41388 to Take the Wind Ltd, developers of the Body Interact ™ Virtual Patient Simulator. No other investigators or participants received compensation for their role in the study.

The datasets analysed during the current study are available from the corresponding author on reasonable request. 

Not applicable.

A.Mestre was supported by Centro 2020, PT2020 and European Union research grant nº 41388 to Take the Wind Ltd, developers of the Body Inter-actTM Virtual Patient Simulator. No other investigators or participants received compensation for their role in the study. The authors had access to all study data and sole responsibility for data analysis and the writing of the manuscript. All other authors have no competing interest to declare.