key: cord-0971779-v6fwyp7t
authors: Bawa, Dr. Papia
title: Learning in the Age of SARS-COV-2: A Quantitative Study of Learners’ Performance in the Age of Emergency Remote Teaching
date: 2020-11-09
journal: Computers and Education Open
DOI: 10.1016/j.caeo.2020.100016
sha: 898629cf38ab82f35deb5da76a367dbba99b4fe7
doc_id: 971779
cord_uid: v6fwyp7t

• Performance was not negatively affected when students faced Emergency Remote Teaching; • Experimental groups who transitioned to ERT performed better than control groups; • Students’ sense of responsibility was enhanced by the ERT state;

ERT, it may lead to unfair and unsubstantiated notions that prevent its acceptance more readily.

To better grasp the issue, it is crucial to examine the key differences between ERT and distance/online learning, which are briefed below.

Distance /online learning is a complex process in terms of design, analysis and time taken to develop and implement courses and programs. Because it has been around for decades, it has evolved and morphed into a multidimensional procedure that needs meticulous planning, evolvement, and evaluation. It is aimed to provide meaningful learning experiences to students who may not otherwise have the option to attend college, due to personal or professional responsibilities. Students of distance/online courses and programs usually choose to join voluntarily, and designers of such programs purposefully plan for them to be online from the start (Author, 2016 , Hodges et al, 2020 . In contrast ERT is, as the name implies, an emergency/crisis based need to move teaching and learning to alternative environments until the crisis is averted or ended. The skill set required to operate in an ERT situation is quite distinct from that of a distance/online environment. Most importantly, unlike fully online environments that operate on distinctly different set of rules than face to face, ERT uses several practices and features of face to face teaching, but does so using alternative methods Hodges et al, 2020) .

Given the newness of the issue, there is a significant gap in the literature on all aspects of ERT related to the SARS-COV-2 pandemic, but most of all on information related to its impact on student performances. Thus there is a call for "future research to examine, in up-close detail, the effects and consequences of the expansion and embedding of digital technologies and media in education systems, institutions and practices across the world" (Willaimson et al, 2020;  p.107). The purpose of this study is to add to the literature and provide crucial insights into the impact of the SARS pandemic induced ERT on learner performance, using a quantitative research approach with experimental design. . The research question examined, using data from 397 students, is:

What effect does current ERT measures to deal with the SARS-COV-2 pandemic have on learners and their performance?

As is evident from the literature, remote learning comes with the associated stigma of being less valuable to academic success than face to face learning. Views on the superior quality of face to face education versus online have been shared by educators and learners who believe that learners benefit more from the intimate, face to face engagement that online environments cannot replicate. Many subscribe to the belief that online or distance learning may not provide learners with opportunities for academic success with the same robustness as face to face education (Burgan, 2006; Burgess, 2015; Francis et al, 2019; Kemp & Grieve,2014; Marshall, 2011; Young & Hill, 2018) . In the context of 2 year community colleges, Coates et al (2004) suggest against any policies that encourage moving to online as they believe "such policies might not be an efficient use of resources and that the students might not be well-served by such policies" (p.545). Brown's and Liedholm's (2002) study show that online students did not perform as well as face to face learners. Ellis et al (2008) believe that online discussions should be enhanced by fusing face to face discussions, which are 'well established learning activities" (p.280). Okdie et al (2011) suggest that face to face interaction is superior to computer generated interaction because, "FtF [face to face] interaction, and the abundance of social cues inherent in it, make it a better conduit by which individuals may gauge characteristics of others" (p.157).

There is strong suggestion in the literature that students and faculty prefer face to face over online/distance learning, for what they perceive to be difficult subjects. Studies suggest that students in face to face courses could have higher academic success as they feel they learn better from direct instruction and instructor presence (Bejerano, 2016; Ferguson & Tryjankowski, 2009; Jaggars, 2012; Jaggars, 2014; Larson & Sung, 2019; Public Agenda. 2013) .

Based on such assumptions, moving to ERT is raising questions related to its efficacy and the impact it can have on all stakeholders in higher education in terms of health, political, economic, social and psychological elements (Araújo et al, 2020; Rundle et al, 2020; Williamson et al, 2020) . However, skeptics of ERT who believe it is less than face to face may fail to realize that ERT uses several practices and features of face to face teaching, but does so using alternative methods Hodges et al, 2020) . As succinctly expressed by Hodges et al (2020) , ERT, involves the use of fully remote teaching solutions for instruction or education that would otherwise be delivered face-to-face or as blended or hybrid courses and that will return to that format once the crisis or emergency has abated. The primary objective in these circumstances is not to re-create a robust educational ecosystem but rather to provide temporary access to instruction and instructional supports in a manner that is quick to set up and is reliably available during an emergency or crisis. When we understand ERT in this manner, we can start to divorce it from "online learning" (p.6).

The question that is not being addressed is whether moving face to face courses to online delivery when maintaining ERT could affect students' academic success, particularly in negative ways. This is a relevant query, given the current pandemic situation, which necessitates transitioning to remote options to maintain social distancing as a means to control the virus' spread, and the value stakeholders place on face to face instruction as opposed to online counterparts. The polarity of the situation requires specific knowledge to be resolved. Knowing whether students' academic success is negatively impacted by the transition to online is critical to understanding what measures we must take to help students succeed in the current situation, and whether reopening campuses and reverting to face to face models could ensure greater academic success, as opposed to sustaining the online delivery models. A key factor that should be included in academe related decisions is the degree of effect any given situation may have on student grades, given that grades are used extensively by educational institutions as an indicator of academic success and wellbeing (Gilford et al, 2006; York et al, 2020) . "Academic achievement is almost entirely measured with grades (by course or assignment) and GPA. This is unsurprising since grades and GPA measures are by far the most readily available assessments for institutions" (York et al, 2020, p.7 ).

Yet not enough is being done to investigate the 2020 ERT's effect on grades, while making critical decisions like reopening campuses. Although there is some evidence in the current literature regarding the negative emotional and psychological effects of pandemicinduced social distancing and ERT on stakeholders (Cao et al, 2020; Lee, 2020; Liu et al, 2020; Zhai & Du, 2020 ) , there is little information on whether this is affecting students' performances negatively. Performance and grades are considered important indicators of academic success, which is why there is a great need for more tangible evidence that ERT related online learning is indeed harmful for learners' performances, since this may be useful to make informed decisions on developing strategies to adjust learning environments to serve stakeholders safely and productively.

For the purposes of this study, the term social distancing refers to only the time frame relevant to the SARS-COV-2, as opposed to social distancing in any other context. This is appropriate given the problem statement discussed earlier. A pandemic disease is identified by the degree of geographical influence, high attack rates, and high communicability (Morens, Folkers, & Fauci, 2009) . The current pandemic is the result of "The emergence of severe acute respiratory syndrome coronavirus 2 (SARS-COV-2;

previously provisionally named 2019 novel coronavirus or 2019-nCoV) disease in China at the end of 2019" (Lai et al, 2020, p. 2) .

Social distancing in the context of pandemics relate to steps taken to initiate a "social contact network-focused mitigation" to offer protection against the spread of a disease in the absence or shortage of medical means to control it (Glass et al, 2006 (Glass et al, , p.1671 .The purpose of such social distancing currently is to "to reduce transmission, thereby delaying the epidemic peak, reducing the size of the epidemic peak, and spreading cases over a longer time to relieve pressure on the healthcare system" (Fong et al, 2020, p. 976 ).

While the effects of social distancing and resultant ERT measures due to the current pandemic are being discussed and articulated, there is little to no conversations with respect to performance outcomes in higher education in this context. This was established after a review of approximately 2700 articles on Google Scholar using key phrase searches of 'COVID 19 social distancing effects and performance outcomes', 'Emergency Remote Teaching', and 'COVID 19 social distancing effects and academic performance'. Gonzalez et al's (2020) examination of the effect that this pandemic has on higher education students from Spain, is the closest fit to the purpose of this study. Based on their study, Gonzalez et al (2020) suggest that "higher scores are expected due to the COVID-19 confinement that can be directly related to a real improvement in students learning" (p.22).

Other topics relate to the effects of social distancing, including emotional and mental health (Galea et al, 2020; Oosterhof et al, 2020; Santos, 2020; Wolf et al, 2020) , as well as socio-economic ramifications (Atkeson, 2020; Barua, 2020; Hopman et al, 2020; Mhlanga & Ndhlovu,2020; Pacheco,2020) . In the context of learning, a few studies were found relating to medical and K-12 education. Van Lancker and Parolin (2020) discuss the effect of school closures on children's food insecurity. Sintema (2020) suggests that the closures may have a negative effect on K-12 STEM student population in Zambia, based on a qualitative, interview-based study. No quantitative or performance output data was used for Sintema (2020) . Several articles discuss medical education in the context of COVID 19, and include topics on new strategies to teach medical students, assessment and evaluation, and general impact on learners (Rose, 2020; Sabzwari,2020; Theoret & Ming, 2020; Tokuç & Varol,2020; Watson et al, 2020) .

The study examined the effects of the SARS-COV-2 pandemic related ERT on learners' grades, using an Experimental design with data collected from 397 students enrolled in undergraduate, face to face courses of a large college system in the Midwest Region of the United States. Participants included four professors who taught Business, English, Computer Programming and Communication disciplines. Experimental groups were students who directly experienced ERT when their face to face classes were moved online to accommodate social distancing protocols. Control groups were students who either attended college in 2019 or attended the first 8-week courses in spring 2020 semester, which is why these courses were not moved to online. Control group students did not experience the ERT environments and social distancing through course participation due to the current pandemic, since they attended normal schedules face to face. The course content and major assessment methods and materials were same for both experimental and control groups within disciplines. However, the materials and assessments differed, based on the disciplines. All course materials adhered to the institution's curriculum goals and requirements.

When moving courses to online, professors initiated fully online, asynchronous delivery, combined with the option of synchronous lecture delivery in real time (as per the original class schedule for face to face) through technology such as Zoom and WebEx. For Business, Computer Programming and English courses, students had the option to submit work in person or online before the ERT. During the ERT they were required to submit all work online. For Communication courses, some work was to be submitted online and others in person before the social distancing and moving to online delivery. Thereafter, all assignments, including in-person presentations, were delivered online. Three professors also reduced their response time to students' questions and offered appointments during weekends and evenings as student needed. One professor added weekly work, which was not part of the original course package, to mark online attendance.

Upon receiving IRB approval from the institution's Human Research Department, the researcher contacted the professors via phone, informing them of the study's purpose, scope, voluntary and confidential nature. Each participant was asked to randomly select two or more courses using a code generated for Course Reference Numbers (CRN) for the sections that they had taught. Additionally, participants shared student perceptions of the ERT experience from their respective courses using excerpts from course discussion forums and personal communications between the faculty and students. These instruments were used to evaluate student views on ERT, which could help analyze the how and why of the performance grades. The three caveats for the course selection were:

1. Courses should have been taught within 2019 and 2020 2. Selected courses must have the same major assignments and subject matter, irrespective of the year they were taught 3. All courses were originally planned for face to face delivery This ensured that data was a mix of students who had experienced pre and post pandemic situations, and that different teaching styles and subject matter were represented in the sample.

Participants shared deidentified gradebooks from the randomly selected courses. All student identification details were removed and only the grade points, as well as course details including schedule and assignments were provided. Given the wide range of course schedules, both between and within subjects' data was available as per the following categories:

 Students who attended courses in 2019 and were not exposed to the ERT.

 Students who attended 16-week courses from January 2020 to May 2020.

Courses were moved to online delivery from April 2020. The same students experienced pre and post ERT.

 Students who attended first 8-week courses in 2020 (January to March) and did not experience ERT.

 Students who attended the second 8-week courses 2020 (March to May), which were moved to ERT delivery.

The research question examined in this study is: What effect does current ERT measures to deal with the SARS-COV-2 pandemic have on learners and their performances? Both within and between subjects' data were used for a comprehensive and in-depth analysis. The H 0 was that the ERT environment caused by the transition of face to face courses to online due to the current pandemic will not have any effect on students' grades. The H a was that the ERT environment will affect students' grades negatively. Alpha-level were set at 5% (= .05). The confidence level for tests was set at 95%.

Independent variable t Test was used for between subjects, while Paired t Test was used for within subjects. Regarding subject matter differentials, Communication and Computer Programming students were only from 2020, while English and Business students were from both 2019 and 2020. To determine the statistical and practical significance of the experiment, the effect size was interpreted by considering the outcome being studied (Vacha-Haase & Thompson, 2004) , using effect size tests as suggested by Durlak (2009). The American Psychological Association encourages reporting all relevant results, and when required, use original units, such as mean differences, and/or standardized or units-free measure to report effects. This is because effects "are often most easily understood when reported in original units" (American Psychological Association, 2010, p.34) . It is important to not only report results, but also interpret them, which means conclusions should be based on more than simple accept-reject statements based on p value. Instead, the focus of the analysis should be on the size and importance of the effects (Kalinowski & Fidler,2010) .

To examine what the odds were that face to face transition to online would impact grades, this study used suggestions made by the National Center for Special Education Ray and Shadish's (1996) Method 2, was also calculated. The significance levels were determined by the following criteria: Small=0.2. Medium =0.5, Large =0.8.

Significance of the ERT transition's effect in terms of grades was also calculated using frequency distribution of grades for three classes: High (highest numerical class), Medium (second highest numerical class), and Low (all others). The tables are available in the Results section.

The sample included all cases from all subjects. There were 190 students from control and 207 from experimental. Based on the t Test results of p>0.5 (two-tailed P value = 0.5136) the null could not be rejected. As per the t Test results, the grades from the control group and experimental group have no statistically significant differences.

The effect size as per Cohen's d was 0.069, which is not significant. However, the significance in terms of performance grades using the frequency of grades distribution indicate the following: Table 2 Pre-Post Frequency Table   Control Experimental Frequency Distribution 

The sample included 43 students who participated in 16-week courses in spring 2020. The courses were moved to online from face to face in April 2020. The within subjects, Paired sample t-Test results indicate that there is no statistically significant difference between the grades of pre and post exposure to the pandemic related social distancing. Based on the p>.05 (p=.38) the null could not be rejected for this data set.

Effect size is at low significance based on Cohen's d at 0.195 (paired). However, the significance in terms of performance grades using the frequency of grades distribution indicate the following: Table 4 Communication Frequency Table   Control Experimental Frequency Distribution 

The sample included 28 students who participated in 16-week courses, which were moved to online from face to face in April 2020. The within subjects, paired sample t-Test results indicate that there was no statistically significant difference between the grades of pre and post exposure to the pandemic related social distancing. Based on the p>.05 (p=.56) the null could not be rejected for this data set. However, the significance in terms of performance grades using the frequency of grades distribution indicate the following: Table 6 Frequency 

Based on the excerpts shared by the participants, when discussing their ERT experience students expressed both negative and positive views. Using keywords and phrases, 17 codified categories emerge that encompass students' reactions to the ERT situation. Figure 1 provides a graph of the results. Figure 2 displays the positive-negative remarks map and Figure 3 shows a pie chart of the positive vs negative distribution. As revealed in Figure 1 , participants found ERT to be significantly negative, even though some positive elements were also mentioned. The number of comments per category indicate that there were 559 negative and 288 positive remarks. As shown in Figure 4 when discussing teaching strategies there were 373 positive remarks and 472 negative ones. As revealed in Tables 7 and 8 

This study examined the effects of SARS-COV-2 related ERT on learners' performance.

Based on the review of the literature, the assumption was that ERT could affect learners' performance negatively. However, the data analysis suggests otherwise. The statistical results indicate that students performed equally or significantly higher when situated in the ERT environment. There was no evidence to suggest that ERT environments led to lower performance grades. This is especially noteworthy when examined in the light of the data on students' views of their ERT experience, which was mostly negative. As the data revealed, students found the ERT experience to be seriously difficult due to multiple factors including greater time commitment, difficulties consuming online course materials and less structured environments that increased their responsibilities as learners.

However, and perhaps due to these challenges, their grades were not negatively impacted.

This could be attributable to concepts of VUCA and Flow states brought on by the pandemic crisis, which could have generated engagement and drive to succeed and survive. Below is a discussion of how VUCA and Flow elements could possibly be the catalyst for generating higher performances in students facing ERT.

The study's findings indicate strong connections to principles derived from concepts of VUCA, propounded by the US Army War College (Johansen & Euchner, 2015; Lawrence, 2013) . Regarding VUCA, the term was coined in the late1990's and was a military-derived acronym (Lawrence, 2013) . "The acronym, VUCA, stands for Volatility (rapidly changing contexts and conditions), Uncertainty (information missing that is critical to problem solving), Complexity (multiple factors difficult to categorize or control), and Ambiguity (vague data subject to multiple interpretation" (Reeves & Reeves, 2015, p.16) . Research suggests that VUCA can manifest in short term, sudden crisis events, and can motivate people to cope with the associated stress by creating flow states, self-compassion, mindfulness, and learning opportunities (Moynihan, 2008; Moynihan, 2009; Wickremasinghe, 2017) . Crisis situations can create enhanced learning opportunities through the possibility of "intracrisis learning, that is, learning that seeks to improve response during a single crisis episode" (Moynihan, 2009, p.189) .

To further elucidate the key terms, the volatility relates to unprecedented and unpredictable nature, speed, and scope of change. This leads to uncertainty characterized by the inability to predict issues and events or how they will unfold. The volatility and uncertainty exponentially increase the complexity of the situation, where prior examples or casualties are absent or extremely hard to come by. Finally, the three conditions make it hard or impossible to accurately predict threats and opportunities, leading to ambiguity (Lawrence, 2013) . However, despite its negative connotations, VUCA can bring forth positive outcomes through "dilemma flipping" (p. 10) which is essentially taking the confusions and challenges and turning it into opportunities for growth, because not doing so will lead to outcomes people cannot afford (Johansen & Euchner, 2015) .

The pandemic heightened the elements of VUCA in the learners' worlds, thrusting them into a crisis mode and generating intracrisis management and learning opportunities. As the excerpt data suggest, learners felt more responsible, which many of them believed was beneficial in dealing with procrastination and creating greater structure in their learning process. Faced with the consequences of being more deeply responsible for their course work could have engendered the push needed to make learners work more diligently towards completing course work and graduating from the courses. Given the uncertainty of the future due to the pandemic, learners may not have been inclined to give up or lax their commitment. "In areas in which actors perceive themselves as being closely accountable, crises prompt them to process information eff ectively…. Actual crisis experience helps, giving responders an ability to deal with pressure, to engage in sensemaking" (Moynihan, 2008, p.352) . Concentrating on their learning could have been one way to reduce the distraction of focusing on the volatility, uncertainty, complexity, and ambiguity of their situation,

The study's findings indicate strong connections to principles derived from concepts of VUCA as explained above, as well as the Flow State of Mihaly Csikszentmihalyi (Nakamura & Csikszentmihalyi, 2012) . Flow is identified as the "experience of complete absorption in the present moment" (Nakamura & Csikszentmihalyi, 2012, p.195 ). This state is reached when people are presented with rigorous and unique challenges, possess a set of skills that can be used to deal with the challenge, and are provided with clear goals and immediate feedback about their progress in meeting the goals and dealing with the challenges. When in this state, people experience their situations moment to moment, characterized by intense focus on the present moments, and the realization that the 'experience of the activity is intrinsically rewarding, and often such that the end goal is juts an excuse for the process" (Nakamura & Csikszentmihalyi, 2012, p.196) . Essentially, a Flow state induces supreme action using all available skills to deal with an original challenge. These challenges were brought on by the VUCA state, as discussed in the previous sub section.

The pandemic generated a uniquely challenging state of existence within which institutions were forced to adopt ERT. Students experienced their learning in an acute moment to moment immersion. The key condition for flow experiences to occur is that the individuals use their existing skills to deal with a significant challenge or crisis, which in turn provides intrinsic motivation and enjoyment or relief from stress . In the context of learning, students are significantly more engaged and concentrate much harder when presented with unique, unprecedented challenges in their learning. Additionally, a sense of self-worth and pride in being able to accomplish hard tasks is germane to challenge generated motivation and engagement (Kuh et al, 2011) . "Engagement resembling flow experiences reflect a state of complete absorption in a challenging activity with no psychic energy left for distractions" (Hamari et al, 2016, p. 171 ).

In the context of this study, it is possible that the VUCA challenges (as explained above) created in the wake of the pandemic induced ERT, generated flow states in learners. Given that the sample was from undergraduate students, it is likely that they were digital natives who had technological competencies and were using devices and software for personal and academic purposes (Gikas & Grant, 2013; Gu et al, 2013; Prensky, 2010) . Thus, they possessed the skills needed to overcome the challenges of transitioning to a remote learning environment from face to face. Based on the student views, only 52 remarks were made pertaining to technology. Out of those the majority related to issues such as internet access or low output devices. There were no comments pertaining to the lack of knowledge or competencies to use technology. The process of moving suddenly from face to face to remote created challenges of learning that students were able to deal with through their resilience and skills.

Additionally, in the context of this study it is critical to note that the correlation was not just with regards to the Flow concepts that a person's engagement with a task is causally related to the skills possessed to counter a challenge (Csikszentmihalyi, 1975) , and that when skill and difficulty are roughly proportional, people enter Flow states (Cowley, Charles, Black & Hickey, 2008; Csikszentmihalyi,1975) . Rather, the study's findings transcended the notion of skills compatibility with challenges, to exemplify why "As there are situational as well as personal moderators regarding the relation between skills-demands compatibility and flow experience, a measure of skills-demands balance should not be used (or interpreted) as a measure of the flow experience per se" (Landhäußer & Keller,2012, p. 67) .

In the study's context, it is possible that students were in the flow state, not just because they had skills sets to deal with ERT demands, but also because of the intrinsic motivation of engaging in their learning more robustly to deal with the trauma of the pandemic crisis, emulating an Autotelic Experience with "… intense concentration, clear goals and feedback, a balance of challenge and skill, merging of actions and awareness, a sense of control, and enjoyment in flow states" (Ross & Keiser, 2014, p.3) . To gain more control of their VUCA environments, students focused on gaining control over their learning, leading to higher performance. " …flow is characterized by high concentration and a sense of control, which are facilitators of performance (Eklund 1996) . As such, flow is a highly functional state and should result in better performance by itself" (Landhäußer & Keller,2012, p. 78 ).

To discuss the practical significance of this study's findings, it should be viewed through the lens of policy and decision making for strategies to move forward and sustain academic rigor as the pandemic continues to wreak havoc. A key concern relating to the current ERT situation is whether it could and should be sustained long term, at least till such time as vaccinations and other medical necessities are available. To make informed decisions on such crucial matters, institutions and the education industry must evaluate the effects of the ERT on learners. This study provides vital insights into the effects of learners' performance by suggesting that learners performed equally or better when faced with ERT. This is particularly significant, given the challenges of evaluating ERT strategies.

In the context of the current pandemic, the evaluation of ERT measures has been problematic, leading to assumptions and speculations about its efficacy, when concrete and credible evidence is required to make informed decisions about how institutions must move forward. Burgess and Sievertsen (2020) state that it may not be possible to precisely estimate how much the social distancing interruption will affect learning. However, they do believe that "these interruptions will not just be a short-term issue but can also have long-term consequences for the affected cohorts and are likely to increase inequality". With such perceptions, it is not surprising that there are growing concerns regarding continued ERT options, and sustained movement to online formats to accommodate social distancing, which some fear may have detrimental effects on the wellbeing of the educational industry and overall experiences of learners, including academic wellbeing and performance (DePietro, 2020; Flack, 2020) . Crawford et al (2020) discuss related concerns such as the availability of internet and sufficient bandwidth, geopolitical constraints, and the lack of skillset to design effective online courses. It is also feared that not moving back to campus learning and continued online delivery could "lead to less quality assurance activities while the focus is on revenue mitigation" (Crawford et al, 2020, p. 12) .

This belief that ERT based online learning could result in lower academic success could and has influenced major academic decisions, which may or may not be conducive to our society's overall wellbeing and safety. For example, in the light of such concerns, many higher education administrators are contemplating or deciding to reopen campuses as early as fall 2020. According to a survey conducted by Axios, 65% of students want to come back to college, despite the absence of vaccines or other viable safety measures against the virus. The catch is that "The college experience isn't exactly about sheltering in place and keeping six feet away from people, so college administrators will have to solve the public health challenges if they expect to bring students back" (Rothschild, 2020) . As such, careful consideration must be given to how institutions handle the pandemic situation moving forward (Hodges et al, 2020; Williamson et al, 2020 

In addition to the theoretical and practical insights, based on the practice measures used by the participant professors, the findings suggest some ways to elevate the ERT experience for learners and ensure their continued success. Some key suggestions are provided below.

 When selecting lecture delivery options, think of providing learners with both synchronous and asynchronous options. As evident from the data, all participating professors had provided some form of real time interaction, along with online materials that students could consume own their own time. This flexibility and choice may have been a key contributor to defeat negative performance.

 Think of keeping the class learning materials and assignments, as close to the original, face to face version as possible. This will help mitigate the disruption. Based on the data, only one professor had made alterations to the assignments and added weekly work to mark attendance, which was ill received by the learners.

 Wherever possible, and keeping the ethical parameters, think of relaxing grading rigor, even while keeping the original grade calculation formulas.

Accommodations could include allowing students to resubmit some work for higher credit, being more flexible on submission deadlines, and/or offering alternatives for earning extra credits.

 Be cognizant of technology constrains and use multi-modal and multimedia artifacts. For instance, some students may not have access to high speed internet at home, and so may be unable to view videos or other artifacts that require greater bandwidth. For such students it may be helpful to have access to the same or similar information through more conventional means such as pdf and text.

 A key concern and driving factor for success, as revealed in this study's data, was the ease and level of communication between professors and students. All professors shortened their response time by half (12-24 hrs.

instead of 48 hours norm) and took appointments during weekends and evenings. This seemed to be of great help and a motivating factor for students. Think of being more robust and prompter than normal routines, when dealing with student responses during ERT.

 Be sympathetic and empathetic. Everyone is a victim of a crisis such as the SARS-COV-2 pandemic. The data from this study revealed that students wanted to discuss emotional, personal, and family issues more openly with their professors. Giving them a few moments of time and listening to their issues could made a difference in their motivation.

 Use mass and personalized communication tools to ensure higher instructor presence in the remote classrooms. Depending on what LMS the institution is using, think of adopting tools such as announcements, class conversations and messages to not only inform students of course related items, but also of the crisis related news and information. It is perfectly all right to talk about the pandemic, since it gives students a sense that the professors are part of the dynamics as well. This creates a sense of camaraderie and familial rapport.

The current pandemic is uniquely challenging for higher education and all its stakeholders. The crisis has made extraordinary demands on learners, faculty, administrators and staff, who are still dealing with the challenges as best as they can.

These collaborative and individual efforts to handle the pandemic in ways that keeps the rigor of education alive will bring forth wisdom and knowledge that will sustain long after the virus is no more. Higher education, like the rest of the world, has been living in a VUCA state for some time now. However, the SARS-COV-2 pandemic and associated ERT measures have opened up a much needed gateway for educational institutions to research and find useful and viable ways to develop symbiotic plans using pedagogical, technological, economic, social and geopolitical elements that could safely and surely propel the industry into the future, while dealing effectively with volatility, uncertainty, complexity and ambiguity. This study availed of this opportunity to investigate a crucial question regarding ERT. While the purpose of this study is not to support or denigrate remote or face to face teaching, it is a sure step towards unravelling the intricacies and surprises of remote learning experience brought on by a crisis. The findings rest on the positive side of remote teaching, indicating no negative impact of remote transitioning on learner grades. This by no means implies a push for remote learning without doing deeper dives into its pros and cons. However, it does imply, and strongly so that because ERT is born out of a crisis, it can create motivational factors that might circumvent some of the negatives associated with online education. This is certainly a nudge in the right direction and a precursor to future research on evaluating the positives and negatives of ERT. The end game can, and should be to investigate new models of ERT application to convert "volatility into 'Vision' and uncertainty into 'Understanding', complexity into 'Clarity' and ambiguity into 'Agility'" (Yadav & Joshi, 2019 

Negative Positive

Designing quality e-learning environments for emergency remote teaching in coronavirus crisis

Impact of Sars-Cov-2 and its reverberation in global higher education and mental health

What will be the economic impact of COVID-19? Rough estimates of disease scenarios

Understanding Coronanomics: The economic implications of the coronavirus (COVID-19) pandemic

Author

Face-to-face or online instruction? face-to-face is better

Emergency remote teaching in a time of global crisis due to CoronaVirus pandemic

A global outlook to the interruption of education due to COVID-19 Pandemic: Navigating in a time of uncertainty and crisis

Can web courses replace the classroom in principles of microeconomics?

What ever happened to the faculty? Drift and decision in higher education

Cyborg teaching: The transferable benefits of teaching online for the face-to-face classroom

Schools, skills, and learning: The impact of COVID-19 on education

Motivation in synchronous hybrid graduate business programs: A self-determination approach to contrasting online and oncampus students

The psychological impact of the COVID-19 epidemic on college students in China

Toward an understanding of flow in video games

COVID-19: 20 Countries' Higher Education Intra-Period Digital Pedagogy Responses

Beyond Boredom and Anxiety

No significant distance" between face-to-face and online instruction: Evidence from principles of economics

Research design: Qualitative, quantitative, and mixed methods approaches

Understanding education's role in fragility; Synthesis of four situational analyses of education and fragility: Afghanistan

Here's a look at the impact of coronavirus

Engineering students' conceptions of and approaches to learning through discussions in face-to-face and online contexts

COVID-19 -Navigating the uncharted

Online versus face-to-face learning: Looking at modes of instruction in master's-level courses

Educator perspectives on the impact of COVID-19 on teaching and learning in Australia and New Zealand

Nonpharmaceutical measures for pandemic influenza in Nonhealthcare settings-Social distancing measures

The costs of online learning: Examining differences in motivation and academic outcomes in online and face-to-face community college developmental mathematics courses

The mental health consequences of COVID-19 and physical distancing

Locus of control: Academic achievement and retention in a sample of university first-year students

Mobile computing devices in higher education: Student perspectives on learning with cellphones, smartphones & social media. The Internet and Higher Education

Targeted social distancing designs for pandemic influenza

Estimated effectiveness of symptom and risk screening to prevent the spread of COVID-19

Influence of COVID-19 confinement in students' performance in higher education

Meeting the "Digital Natives": Understanding the acceptance of technology in classrooms

What the top 25 colleges and universities in the US have said about their plans to reopen in fall 2020, from postponing the semester to offering more remote coursework

Challenging games help students learn: An empirical study on engagement, flow and immersion in gamebased learning

The difference between emergency remote teaching and online learning

Managing COVID-19 in low-and middle-income countries

Choosing between online and face-to-face courses: Community college student voices

Online learning in community colleges

Navigating the VUCA world

Interpreting significance: The differences between statistical significance, effect size, and practical importance

The classical definition of a pandemic is not elusive

Face-to-face or face-to-screen? Undergraduates' opinions and test performance in classroom vs. online learning

Impacts of COVID-19: Mitigation Efforts versus Herd Immunity (No. 2020-3)

Student success in college: Creating conditions that matter

Severe acute respiratory syndrome coronavirus 2 (SARS-Cov-2) and coronavirus disease-2019 (COVID-19): The epidemic and the challenges

Flow and its affective, cognitive, and performance-related consequences

Comparing student performance: Online versus blended versus faceto-face

Developing leaders in a VUCA environment

The Shift to Remote Learning: The Human Element. Inside Higher Ed

Mental health effects of school closures during COVID-19. The Lancet Child & Adolescent Health

Psychological state of college students during COVID-19 epidemic

More face to face, less face to screen

Socio-economic implications of the COVID-19 pandemic on smallholder livelihoods in Zimbabwe

From Intercrisis to Intracrisis learning

Learning under uncertainty: Networks in crisis management

What Is a Pandemic?

Flow theory and research

Getting to know you: Face-to-face versus online interactions

Adolescents' motivations to engage in social distancing during the COVID-19 pandemic: Associations with mental and social health

The risks of COVID-19 spread rapidly in low-and middle-income countries: The Brazilian scenario

Teaching digital natives: Partnering for real learning

Not yet sold: What employers and community college students think about online education

Educational technology research in a VUCA world. Educational Technology, 26-30

Medical student education in the time of COVID-19

Autotelic personality through a five-factor lens: Individual differences in flow-propensity

65% of college students would attend class in fall even without vaccine

COVID-19-related school closings and risk of weight gain among children

Reflections about the impact of the SARS-COV-2/COVID-19 pandemic on mental health

Rethinking assessment in medical education in the time of COVID-19

Social distancing during the COVID-19 pandemic: Staying home save lives

Effect of COVID-19 on the performance of grade 12 students: Implications for STEM education

Our education, our concerns: Medical student education impact due to COVID-19

COVID-19 in the USA: A question of time

Medical education in Turkey in the time of COVID-19

Top health experts paint bleak picture of pandemic

COVID-19, school closures, and child poverty: A social crisis in the making

COVID-19: Time for a bold new strategy for medical education

It's not my fault but it is my problem: The role of self compassion in a VUCA world

Pandemic politics, pedagogies and practices: Digital technologies and distance education during the coronavirus emergency. Learning, Media and Technology

Success rates of online versus traditional college students

Student performance at a community college: Mode of delivery, employment, and academic skills as predictors of success

High boredom proneness and low trait selfcontrol impair adherence to social distancing guidelines during the COVID-19 pandemic

A Comparative Case Study of K12 Institution towards Imparting Entrepreneurship Education in a VUCA world

Defining and measuring academic success. Practical Assessment, Research, and Evaluation

How online and face-to-face group learning affect test scores and group participation

Addressing collegiate mental health amid COVID-19 pandemic