key: cord-0738935-0stvdh3j authors: Zaragoza-García, I; Ortuño-Soriano, I; Posada-Moreno, P; Sánchez-Gómez, R; Raurell-Torredà, M title: VIRTUAL SIMULATION FOR LAST-YEAR NURSING GRADUATE STUDENTS IN TIMES OF COVID-19: A QUASI-EXPERIMENTAL STUDY date: 2021-07-28 journal: Clin Simul Nurs DOI: 10.1016/j.ecns.2021.07.003 sha: b116f797c603bcf907b2d1243eaa80e76692e00c doc_id: 738935 cord_uid: 0stvdh3j Background: The COVID-19 pandemic has made it necessary to adapt university health-education. Virtual simulation has been proposed to be a suitable tool. Methods: A quasi-experimental study was conducted on nursing students in the final year. The virtual simulation platform vSim® was used. Improvements in knowledge, skills during simulation, satisfaction and self-confidence obtained through the training provided were analyzed, as well as satisfaction with the platform. Results: Pre-post training knowledge improved. Skill acquisition improved between the first and last attempts in all cases. The levels of self-confidence and satisfaction with the training and the platform used were high. Conclusions: The vSim® was a useful solution during the pandemic. Knowledge improved and high self-confidence was obtained. • Highlights − Despite the confinement, nursing students could receive virtual hands-on training − Virtual training can increase the knowledge and self-confidence of nursing students − vSim® may be a useful tool for developing skills during periods of confinement − Students expressed a high level of satisfaction with the virtual simulation platform  Key points -It is suggested that the use of a virtual simulation platform may be a useful option for training nursing students during periods of confinement such as the one produced by COVID-19. -Knowledge and skills of nursing students are improved through the use of virtual simulation. In addition, students show high levels of self-confidence and satisfaction with learning and with the use of the platform, which they recommend for future courses. -A virtual simulation platform that is specific to nursing can be effectively used in confinement situations. It would be desirable to create cases adapted to all areas of the academic curriculum and to elaborate distance activities that develop technical skills. The global pandemic of coronavirus disease 2019 has brought about a change in our way of life, including traditional forms of health care education. As of March 2020, social distancing and/or confinement policies have been implemented worldwide. These measures have forced us to change our educational model, and carrying out hands-on health care activities, including practical courses for nursing students, is particularly problematic (Rose, 2020) . While it is true that face-to-face training will continue to be an essential component of the clinical curriculum, distance learning may prove to be an effective and flexible alternative or complement (Newman & Lattouf, 2020) . The use of new technologies is a key element in this, as they allow health students and professionals to increase their knowledge and improve their skill acquisition. Technological developments in recent years have allowed simulation to take center stage in clinical teaching, and it has been shown to be an effective learning methodology as it allows for teaching technical skills and non-technical skills (decision-making, leadership, teamwork and communication, situational awareness, resource management, safe practice and reduction of adverse events) (Cant & Cooper, 2017) . Simulation allows students to link theory and practice (Alamrani et al., 2018) . Its use as a pedagogical method is based on reproducing routine or special clinical situations in a controlled and safe way for the students. The objective of simulation is to create a better understanding and handling of essential aspects when these occur in a real-life context. As a cognitive and behavioral education strategy, simulation promotes high levels of self-esteem and self-confidence, since it allows the internalization of information and satisfaction with the learning process (Cant & Cooper, 2017) . In spite of all this, clinical simulation, even when carried out in small groups, is usually of a face-to-face nature, which can be a problematic matter during a situation of confinement and/or social distancing (Almarzooq et al., 2020) . Given that it is not known how long this situation will last, or if we will have similar situations in the future, we must find effective and feasible solutions for the clinical training of our students (Rose, 2020) . Education experts propose the use of virtual teaching, including web-based virtual simulation (VS), since it complies with social distancing and it allows students to choose the time and place for learning (Rose, 2020) . Moreover, VS offers a high level of interactivity and realism to the student (Gu et al., 2017) . In this scenario, in addition to implementing innovations that allow appropriate training of future professionals, we must evaluate the impact of VS will have on the student. Knowledge as well as satisfaction are considered a strong indicators of quality in educational institutions, mainly due to the fact that they indicate the effectiveness of the teaching strategies used (Almeida et al., 2015) . Furthermore, trust and self-confidence are important aspects of the cognitive component of an individual's self-efficacy. Selfconfidence can be understood as the conviction that an individual is capable of doing or achieving something. In the clinical setting, it can be translated into the personal capability of individuals to achieve their own goals (Almeida et al., 2015) . The purpose of this study was to evaluate if a based-web VS platform is a useful tool, in terms of knowledge, satisfaction and self-confidence in learning in times of COVID-19. A quasi-experimental study, pre-post intervention, with control group for knowledge was conducted during May and July 2020 involving last-year undergraduate nursing students in confinement due to the COVID-19 pandemic. Students who had not completed 50% of their practical clinical training periods in health centers during the final year of their nursing degree studies. Students who decided to compensate their lack of practical training through a healthcare assistant contract. The possibility of carrying out these activities was offered by the university and the health authorities. The study was approved by the Ethics Committee of our reference center (Ref: C.I.20/418-E_COVID). All participants were informed of the purpose of the study and agreed to participate in it. The result of the scores did not affect their final grades of any subject; they only had to perform the exercise. When data collection was completed, all participants in the control group were given voluntary and free access to the platform. The intervention group received training through the vSim® for Nursing platform. The platform was developed through a collaboration between Wolters Kluwer, Laerdal and the National League for Nursing (NLN). vSim® has peer-reviewed clinical cases and the simulations are based on high-fidelity manikins adapted for use in a virtual environment. This web-based VS measures the students' actions in terms of low, moderate and high risk for patient harm. In addition, it calculates a score based on correctly performed nursing activities. The intervention process consisted of three phases and five steps: Phase 1. Checking and preparatory 1) Pre-training knowledge evaluation: before starting the training with the virtual platform, the intervention group was given a test on basic concepts of pharmacology, pathophysiology and nursing interventions. The intention was to establish the baseline in terms of knowledge of the topics to be treated in the clinical cases. The control group did not receive training during the study period. Instead, they conducted supervised health care activities in health care centers. 2) Familiarization with the platform: since none of the students had used vSim®, all of them received training on the use of the platform through video conferencing by a vSim® instructor. For this purpose, a case was used that was not included in the training afterwards. All commands of the simulator and the operation of the system were explained. A document was provided with all commands adjusted to the native language of the participants, so as to facilitate navigation through the platform. 3) Clinical cases: each student was given individually five clinical scenarios: two fundamental nursing cases (hip fracture and pneumonia) and three medical-surgical cases (asthma, diabetes and intestinal obstruction). Before carrying out each case, the students had to review the case and study its contents provided by the platform. These contents are based on various Wolters Kluwers publications. The platform provides different external links so that the student can access updated content. They then proceeded to perform the simulation for a maximum of 30 minutes. Finally, the program gave feedback on those aspects that were done properly and on those that could be improved. The targets were: each case had to be repeated until a score of at least 80% was achieved and the students were not allowed to have any error classified as high or moderate risk to the patient. Each case could be carried out for six days. 4) Online debriefing: these were programmed on the 7th day of each case by the simulation instructor. The debriefing format proposed by the platform was used: opening questions, scenario analysis questions and concluding questions. Each session lasted approximately 90 minutes. Phase 3. Evaluation. 5) Post-training evaluation: a post-training knowledge test was done, the same test as given at the pre-training to the two study groups, control and intervention. We did not consider it necessary to carry out a pre-intervention knowledge test in the control group, since the training of all participants up to the time of the intervention was the same. In addition, self-confidence and satisfaction with the platform used were assessed in the intervention group. -To compare the level of knowledge pre-post intervention in the experimental group and with the control group. -To compare the percentages of nursing activities performed correctly between the first and last attempts for each clinical case in the experimental group. -To evaluate the level of self-confidence in the training received in the experimental group. -To assess the degree of satisfaction with the use of the VS tool used in the experimental group. -Knowledge test. The 35 questions were developed and reviewed along with the clinical cases by experts from the NLN, Laerdal and Wolters Kluwer. Topics related to the different clinical cases were addressed. -Score obtained at the end of the simulations until achieving the targets. The program records each decision and compares the student's performance with the expert's performance, and ultimately yields a score (NLN, 2020). Each clinical case has a set of goals defined by the virtual platform. The participant is required to complete different Nursing Activities during the virtual simulation. Omission, incorrect execution, or carrying out of activities that could put the patient at risk, are penalized in the final score. Incorrect activities are categorized by asterisks into 3 levels: High risk (***)for example, administering medication to the patient without asking if he/she has any allergies; Moderate risk (**) -for example, not providing health education to the patient or their family when necessary; and Low risk (*) -for example, failure to assess blood pressure after administering methyl prednisolone to the patient. -Self-confidence obtained by the training with the VS platform. The Jeffries & Rizzolo questionnaire (2006) adapted to our context was used. The questionnaire comprises 13 items with a Cronbach's alpha of 0.9. It has 2 dimensions: satisfaction and selfconfidence. -Degree of satisfaction with the platform. This was compiled through a questionnaire designed in 2 previous studies focused on student satisfaction with vSim® (Foronda et al., 2016; Tjoflåt et al., 2018) . Score obtained at the end of the simulations until achieving the goals. c) Variables related to the student's perception of learning: Level of self-confidence in learning. A sample size of 51 individuals was estimated, accepting an alpha risk of 0.05 and a beta risk of 0.2 in a bilateral contrast, with a 95% confidence interval. The calculation is based on a sensitivity to change for the skills acquired with the simulation equal to 1.145. A difference of ≥ 4.5 units is expected to be detected. Categorical variables were expressed as frequency and percentage. Fisher's or Chisquared test was used for between-group comparisons. Quantitative variables were expressed as mean and standard deviation and median and interquartile range, and the data were compared using the Wilcoxon test for paired data and the Mann-Whitney U test for independent data. The effect size was calculated for the knowledge gained and Cronbach's alpha was obtained from the self-confidence scale. Data were analysed using IBM SPSS for Windows 25.0 software. 132 participants were assessed for eligibility. Six not meeting inclusion criteria and fourteen declined to participate. Finally, 112 nursing students were analyzed, 56 of the experimental group and 56 of the control group. Most were women with a median age of 22 years. Three quarters of the students declared to have good or very good computer skills. More than 80% said their English skills were average, good or very good, and one third said they had some certificate of English (Table 1) . The score obtained in the knowledge tests showed a significant post-training increase in the experimental group (median=5.6 vs 9.4; p<0.001). The improvement in the experimental group was also significant compared to the control group (median=9.4 vs 5.0; p<0.001). In both cases the effect size is considered to be large. By contrast, the score of the control group is similar to the pre-training score of the experimental group (median=5.0 vs 5.6; p=0.117) ( Table 2) . Three students (5.4%) did not find that the activity performed had provided them with the skills and knowledge necessary to carry out their tasks in the clinical setting. Five students (8.9%) felt that it was not the teacher's responsibility to tell them what to learn from the content of the simulation activities (Table 3 ). The Cronbach alpha coefficient of the scale was 0.811. For all items of the platform satisfaction survey, the agreement was greater than 90%, except for question 8 (82.1%). Four students (7.2%) disagreed with the statement that vSim® was a useful tool (Table 4) . The data obtained support the use of VS for nursing students under social distancing conditions. They show an improvement in both knowledge and skill acquisition. In addition, students showed high levels of satisfaction and self-confidence with the training received. They found the VS platform useful and would recommend it for future training. In the intervention group, the post-training knowledge was increased and the magnitude of the effect size was considerable. Knowledge also showed a significant increase when comparing the control group with the experimental group, since baseline knowledge was the same in both groups. We found few publications related to the use of the vSim® that also evaluate the acquisition of knowledge with the tool. Gu et al. (2017) reported similar results regarding knowledge evaluation (experimental On the other hand, a recent study carried out in Korea used vSim® in the mental health field (Liu, 2020) , and did not find an improvement in knowledge. According to the authors, a possible explanation was the 'ceiling effect' (Bond et al., 2015) , where there is no room for improvement if knowledge is already high. Furthermore, they state that they did not hold debriefing sessions. This situation is also described by Wright et al. (2018) , who find no differences between different teaching methodologies (experimental group 1=58.06 vs experimental group 2=59.03 vs control group=55.31; p=0.433), including VS. They point out that one of their limitations is the lack of debriefing after the cases. Many authors argue that debriefing is the most important part of simulations for the acquisition of knowledge and the development of skills through critical thinking (Alhaj-Ali et al., 2020; Schmidt & Haglund, 2017) . In our case, there was room for improvement and specific debriefing was carried out after completing each VS scenario. Our results support the claims that VS can serve as a tool to improve students' preparation for healthcare/medical/assistance practice (Tabatabai, 2020a; Tabatabai, 2019). A significant improvement was observed between the first and the last simulation performed in each case. We observed a decrease in the median of the first simulation in the fourth scenario, which recovers in the fifth scenario. This may be due to the fact that scenarios 1, 2 and 3 belong to the fundamental care training module whereas scenarios 4 and 5 belong to the medical-surgical care module. Although both modules contain similar aspects, there are different skills to be addressed. Addressing several cases within each module seems to improve the score of the first simulations. Moreover, according to different authors, repeating the simulations helps to improve learning (Springer et al., 2013). Wright et al. (2018) found that, in order to meet the training objective with vSim®, the students required several attempts; they did not specify the number of attempts, but reported that 78% and 69% of the respective experimental groups of students managed to reach 50% of the objectives at the first attempt. We found that the students required a median of 2.6 [2.2-3.4] attempts to reach the programmed target. Although we found a decrease between the repetition of the first and last scenario, we did not find a gradual trend between the scenarios. The difficulty and specific characteristics of each case may be the reason for this variation. What seems clear is that, in most scenarios, it is necessary to perform the scenario at least twice to obtain an adequate score. Moreover, most students repeated the simulations until they reached scores close to 100%. This may be related to the high satisfaction found with the use of the platform. Yeh et al. (2016) state that students' preferences and positive perceptions significantly improve learning outcomes, although this is not always the case. Üzen Cura et al. (2020) evaluate 3 different simulation modalities in relation to chest auscultation: "standardized patient", "high-fidelity manikin" and a "task trainer". The highest student satisfaction was obtained with the standardized patient, but in terms of skill development it obtained the poorest ratings. This may be due to the increased stress that simulation with a standardized patient usually generates compared to other methods. Different authors relate these facts to psychological safety and state that the development of skills and learning improves when stress levels decrease (Cheng et al., 2020) . This may be the reason why VS gives high levels of satisfaction and high scores in the acquisition of knowledge and skills. Kang et al. (2020) use the vSim® and affirm that students feel psychologically safe when performing the simulations. They argue that the students perform the simulations in a safe environment, such as their home, and at the time they consider most appropriate. We believe that this methodology can be the first stage to acquire knowledge and skills, so that later the teaching can be made more complex with more stressful situations. We believe that before presenting complex and stressful scenarios, it would be convenient for students to develop skills in psychologically safe environments. Such a situation is adequately recreated by VS. Further studies are required to confirm these assumptions. Satisfaction and self-confidence in learning levels with the training show high median scores (>4/5 points). It can also be seen that satisfaction with learning ratings are slightly higher than self-confidence ratings. Given the scarce research on VS, we did not find studies that analyze these parameters. Nevertheless, scores similar to those described in studies carried out with nursing students using high and medium fidelity face-to-face simulation have been observed (Costa et al, 2020; Almeida et al., 2015; Franklin et al., 2014) . The good results can be explained by the structure of the training (prebriefing-simulation-debriefing), which according to different authors positively affects satisfaction, self-confidence and learning results (Gu et al., 2017; Almeida et al., 2015) . On the other hand, the possibility of repetition and immediate feedback can increase the security and learning of the students (Gu et al., 2017; Wright 2018 ). Zapko et al. (2018 , state that serial simulations during training seem to increase the confidence of the students. As in other studies, item number 13, which corresponds to self-confidence, was the one that obtained the least agreement. Of the students, 58.9% said they agreed or strongly agreed (mean=3.6±0.8 out of 5). These numbers are similar to those described by authors who use classroom simulation with a manikin: agreement of 68.42% (Franklin et al., 2014 ) and a mean of 3.55±1.12 out of 5 (Almeida et al., 2015) . Regarding the dimension 'satisfaction', item 4 was the worst rated. However, no participant disagreed with the statement that the materials were motivating. Some authors state that not all people find the same motivation in the use of technologies, which can alter the perception of this activity (Foronda et al., 2016) . Concerning the Self-Confidence in Learning dimension, eight participants (14.3%) disagreed with item 7 and 3 participants (5.4%) with item 8. This may be due to the facts that the tool was used as a substitute for hands-on training in the COVID19 situation and that the subjects were last-year students. In their practical training period they rotate among Critical Care units. They were given fundamental nursing and medical-surgical scenarios that did not involve Critical Care cases. Other studies carried out with vSim® were done during initial nursing courses (Gu et al., 2017; Tjoflåt et al., 2018) or as a complement to training. It would be useful to obtain different scenarios that cover all curricular needs of these students (i.e critical care simulations). As for item 8, it is true that VS is related to the development of non-technical skills (Redmond et al., 2020) . It seems that it is necessary to add an activity that allows the development of technical skills at a distance, to complement the acquisition of skills. As in other studies, a high percentage of students recommend the use of this platform (Wright, 2018; Foronda et al., 2016; Foronda et al., 2014) , which suggests that it proved to be a positive and productive experience. Some studies show that there are students who have difficulties with navigation on the platform (Tjoflåt et al., 2018; Wright, 2018; Foronda et al., 2018) . They state that both the language and the technology itself can be challenging for the use of this simulator. In our case we did not encounter these obstacles, possibly because: 1.-our students have a good level of English. Moreover, the research team provided a document with the simulator controls adapted to their language; 2.-the students claimed to have good computer skills. Furthermore, as in Tabatabai's study (2020b), most of them are digital natives, so the simulated experience is something natural for them. Only one student disagreed, and this was the oldest student; 3.-like Kang et al. (2020) , we gave an online presentation of the platform to all students, which allowed direct visualization of both the controls and the possibilities of the simulator. We believe that this familiarization with the environment was key for the students to be able to navigate without losing time, as also stated by other authors (Wright, 2018; Foronda et al.,2018) . Wright et al. (2018) recommended their students to watch a tutorial about the tool, but they did not hold an explanatory session in which the students could interact with the teacher. Finally, the students said they had difficulties with navigation, although they later confirmed that they had not in fact watched the tutorial. obtained, we suggest that the implementation of 100% remote VS with this platform may be an adequate and feasible solution to develop fundamental, especially nontechnical, skills. However, it seems necessary to increase the number of cases adapted to the skills of each course and to find a way to combine it with distance learning for developing technical skills. The study was conducted at a single center. Although it has been used in different studies, the questionnaire on satisfaction with the tool has not been validated. The students did not carry out clinical cases related to critical care. vSim® is a fee-based platform, one license per student. Perhaps not all institutions are able to purchase it annually. Finally, we did not analyze whether the improvement in knowledge with the intervention is maintained over time. Training using the vSim® increases knowledge, allows the development of skills and provides a high level of self-confidence in learning to nursing students. Satisfaction with both the training and the virtual tool is high. New clinical cases that allow the development of skills in all aspects of the nursing curriculum are necessary. This would open the door for further distance learning research that allows the acquisition of nontechnical skills. This work was supported by "Innova UCM" program of the Complutense University of Madrid [grant numbers: 255, 2020] . The authors declare that there is no conflict of interest regarding the publication of this article. The research meets all ethical requirements. Comparing the Effects of Simulation-Based and Traditional Teaching Methods on the Critical Thinking Abilities and Self-Confidence of Nursing Students The impact of debriefing modalities on nurse practitioner students' knowledge and leadership skills in managing fatal dysrhythmias: A pilot study Virtual Learning During the COVID-19 Pandemic: A Disruptive Technology in Graduate Medical Education Validation to Portuguese of the Scale of Student Satisfaction and Self-Confidence in Learning Mental health first aid training for Australian medical and nursing students: an evaluation study The effectiveness of virtual simulation in improving student nurses' knowledge and performance during patient deterioration: A pre and post test design Use of simulation-based learning in undergraduate nurse education: An umbrella systematic review A practical guide to virtual debriefings: communities of inquiry perspective Satisfaction and self-confidence in the learning of nursing students: Randomized clinical trial Use of multiuser, high-fidelity virtual simulation to teach leadership styles to nursing students Evaluation of vSIM for Nursing™: A Trial of Innovation Student preferences and perceptions of learning from vSIM for Nursing™ Psychometric testing on the NLN Student Satisfaction and Self-Confidence in Learning, Simulation Design Scale, and Educational Practices Questionnaire using a sample of pre-licensure novice nurses The Effects of vSIM for NursingTM as a Teaching Strategy on Fundamentals of Nursing Education in Undergraduates Designing and implementing models for the innovative use of simulation to teach nursing care of ill adults and children: a national, multisite, multimethod study The impact of virtual simulation on critical thinking and self-directed learning ability of nursing students The Effects of Virtual Simulation on Undergraduate Nursing Students' Mental Health Literacy: A Prospective Cohort Study Coalition for medical education-A call to action: A proposition to adapt clinical medical education to meet the needs of students and other healthcare learners during COVID-19 Increasing competence in wound care: A cross-sectional study to evaluate use of a virtual patient by undergraduate student nurses. Nurse education in practice Medical Student Education in the Time of COVID-19 Debrief in Emergency Departments to Improve Compassion Fatigue and Promote Resiliency Evaluation of vSim for Nursing in an Adult Health Nursing Course: A Multisite Pilot Study Effects of congruence between preferred and perceived learning environments in nursing education in Taiwan: a cross-sectional study Evaluating best educational practices, student satisfaction, and self-confidence in simulation: A descriptive study Appendices Figure A.1. Evolution of the scores of activities performed correctly between the first and last attempt of each scenario We thank Ron Hartong for his help with the language and writing assistance. In addition, we would like to thank all the nursing students who participated in the study.