key: cord-0749996-ex03t83q authors: Ruotolo, Ilaria; Berardi, Anna; Sellitto, Giovanni; Panuccio, Francescaroberta; Polimeni, Antonella; Valente, Donatella; Galeoto, Giovanni title: Criterion Validity and Reliability of SF-12 Health Survey Version 2 (SF-12v2) in a Student Population during COVID-19 Pandemic: A Cross-Sectional Study date: 2021-08-04 journal: Depress Res Treat DOI: 10.1155/2021/6624378 sha: c40a34d7bbd3697489d95d05133d62916137aae8 doc_id: 749996 cord_uid: ex03t83q OBJECTIVE: The novel coronavirus SARS-CoV-2, responsible for the COVID-19 pandemic, led to strict domestic quarantine, social isolation policies, and consequently significant psycho-emotional and lifestyle changes. The individual and societal fear and anxiety cause significant stress affecting health-related quality of life (HRQOL). There is evidence of the psychological and mental health effects of the current pandemic on students, who are known to be a vulnerable population. A decrease in physical activity was reported among students, and it is known to contribute to stress levels, which is strongly associated with HRQOL. This study is aimed at evaluating the validity and reliability of SF-12 Health Survey version 2 (SF-12v2) in the assessment of self-perceived quality of life of Italian students following lifestyle changes due to the outbreak of COVID-19. METHODS: A cross-sectional study was conducted with university students attending the faculty of Medicine and Surgery or Health Professions. The Physical Component Summary (PCS12) and the Mental Component Summary (MCS12) of SF-12v2 were compared to the Perceived Stress Scale (PSS). Internal consistency was examined using Cronbach's Alpha Coefficient. Concurrent validity was evaluated comparing SF-12v2 values to PSS scores, and the Pearson Correlation Coefficient (PCC) was calculated. Cross-cultural validity was investigated through several analyses for correlations between SF-12v2 scores and the gender of participants, University of Italy, body mass index (BMI), and time spent sitting and exercising. RESULTS: The SF-12v2 questionnaire was administered to 583 medical and health professionals' students in July 2020. Cronbach's Alpha showed acceptable reliability for PCS12 and MCS12. In line with expectations, PCS12 scores differed by BMI groups, while the MCS12 was associated with PSS score and showed differences between genders, BMI groups, time spent sitting, and time spent exercising. CONCLUSION: The Italian version of SF-12v2 is a valid and reliable instrument to assess health-related quality of life among medical and health professionals' students. Quality of life (QOL) is a broad multidimensional concept that usually includes subjective evaluations of both positive and negative aspects of life. Health-related quality of life (HRQOL) includes those aspects of quality of life that can be shown to reflect either physical or mental health; it concerns physical, psychological, and social domains of health, and it is broadly accepted as an important outcome measure of health care [1] . The novel coronavirus SARS-CoV-2, responsible for the COVID-19 pandemic, led the various governments to implement strict domestic quarantine and social isolation policies that led people to significant psycho-emotional changes [2] . Regarding Italy, the Civil Protection Department adopted control measures such as information campaigns, closure of schools and universities, workplaces, and subsequently lockdown [3] . In addition to the morbidity and mortality due to the coronavirus-19 disease, the adopted response measures also had important physical and psychological consequences for individuals [4] . In fact, an outbreak is associated with considerable psychological disorders, such as depression, anxiety, and fear in specific communities and medical students [5, 6] . Alternatively, an increase in financial and family stress could be associated with some avoidance behaviors, which would have worsened their mental health and lead to a more passive lifestyle [7] . Sleep problems are also important public health issues when epidemics and disasters occur. This represents a common manifestation of anxiety and depression [8] . It is known that the presence of epidemics accentuates or creates new stressors, including fear and worry for oneself or loved ones, constraints on physical movement and social activities due to quarantine, and sudden and radical lifestyle changes. The unprecedented individual and societal fear and anxiety cause significant stress affecting HRQOL. Additionally, researchers have demonstrated a decrease in the level of outdoor physical activity and an increase in sedentary time during the COVID-19 pandemic as a result of home confinement. There is evidence of the current pandemic's psychological and mental health effects on students, who are known to be a vulnerable population [9] . A recent study indicated an increased percentage of Italian people with high and very high levels of distress compared to the European epidemiological statistics: 53.8% of respondents rated the psychological impact of the outbreak as moderate or severe, 16.5% reported moderate to severe depressive symptoms, 28.8% reported moderate to severe anxiety symptoms, and 8.1% reported moderate to severe stress levels [5] . It is known that the mental health of college students is significantly affected when faced with public health emergencies, and they require attention, help, and support of the society, families, and colleges [10, 11] . A study was conducted on Italian undergraduate students which showed 48.6% of the participants from the same student population decreased their physical activity; this result is in line with other researches performed with college students and adults from the United States and France [4] . Another study reported a decrease of physical activity in almost half of participants, where the majority of the students did not modify other habits, for example, diet and smoking habits [3] . A reduction in physical activity is known to contribute to stress levels, which is strongly associated with HRQOL [12] . In many studies, online questionnaires were used for the assessment of HRQOL and stress levels in students and general populations during the lockdown, and also, other surveys such as the World Health Organization Quality of Life-(WHOQOL-) BREF questionnaire [13] and the Pittsburgh Sleep Quality Index (PSQI) [14] , many studies used the Perceived Stress Scale (PSS) [15] . The SF-12 Health Survey version 2 (SF-12v2) is a generic short-form health survey developed in the USA from the original SF-36. It produces two summary measures evaluating physical and mental self-perceived health; for this reason, it could be a suitable and complete tool to assess the selfperceived quality of life of university students because it allows investigating both the aspects. SF-12v2 has been successfully tested in several Western European countries on large samples of the general population, proving its brevity, comprehensiveness, reliability, validity, and crosscultural applicability [16, 17] . Gandek et al. [18] , in a cross-validation study, tested that the SF-12v2 suggested in the original United State study [19] for nine European countries (Denmark, France, Germany, Italy, the Netherlands, Norway, Spain, Sweden, and the United Kingdom). The SF-12v2, since then, has been extensively used in health status studies involving the general population [20] [21] [22] [23] [24] [25] as well as in studies with disease groups. Until now, no study has investigated the physical and psychological effects on students during the outbreak due to COVID-19 using the SF-12v2. The primary objective of this study is to evaluate the psychometric proprieties of the SF-12v2 in the assessment of self-perceived HRQOL of Italian students after the lifestyle changes due to the outbreak of COVID-19. The secondary objective is to detect different behaviors of the tool in different populations' groups in order to confirm the hypothesis that physical and mental health have been influenced by gender, university of origin (North, Central, and South Italy), body mass index, and number of hours spent sitting or exercising during the lockdown due to COVID-19 pandemic. Specifically, the authors hypothesized the following: (1) PSS would have had strong association with MCS12 and less strong with PCS12, as studied in previous studies [26, 27] (2) PCS12 and MCS12 scores would have had statistically different scores between people from northern/central/southern university, due to different rates of contagion and different restriction measures in these areas (3) PCS12 scores would have had highest for persons with normal BMI but lower for underweight and overweight as evaluated by Wee et al. [28] A cross-sectional study was conducted by a research group of Sapienza University of Rome and Rehabilitation and Outcome Measures Assessment (ROMA) association to evaluate the psychometric properties of SF-12v2 health survey [29] [30] [31] [32] [33] [34] [35] [36] [37] [38] [39] . The institutional review board of Sapienza University of Rome approved the study and guaranteed ethical standards and procedures. The procedures followed the 1964 Helsinki declaration and its later amendments or comparable ethical standards. All individual participants included in the study were asked for informed consent. The datasets analyzed during the study are available from the corresponding author. The study's inclusion criteria were to be university students attending the faculty of Medicine and Surgery or Health Professions in Italian Universities. [40] . The PCS12 and MCS12 are calculated by using US-derived item weights for response categories following recommendations from the authors of the instrument (which were done after having assessed the equivalence between country-specific and US weights in nine countries). Thus, each of the two health components is scored based on information from all 12 items, but different weights are applied for physical health and mental health, to achieve highest possible independence between the two health components. The Perceived Stress Scale (PPS) is a 14-item scale used to measure perceived stress. In this study, the Italian version of PSS-10 was used; it is a shorter version of the original one and includes ten items (1, 2, 3, 6, 7, 8, 9, 10, 11, and 14) , six negatively stated and four positively stated. Analysis. The research group recruited participants according to the inclusion criteria. A mailing list was used to recruit university students attending the faculty of Medicine and Surgery or Health Professions. All participants gave informed consent and then completed the SF-12v2 questionnaire. Structure. Previous studies [40] have found that 6 of the SF-12v2 items (1, 2, 3, 4, 5, 8) are most strongly associated with physical health, while 6 other items (6, 7, 9, 10, 11, 12) are most strongly associated with mental health. In order to confirm this result, we performed an exploratory factor analysis (EFA) with maximum likelihood factoring. Maximum likelihood and principal axis factoring are the generally recommended extraction methods [41] . Extracted factors were rotated by varimax rotation (orthogonal rotation method), and significant factor loading for EFA was set >4 [42] . The appropriateness of sampling was evaluated using the Keiser-Meyer-Olkin (KMO) and Bartlett's test of sphericity. The most appropriate measures of reliability of the PCS12 and MCS12 use reliability indices for weighted composite scores [43] . However, this approach is difficult, since it requires reliability estimates for each of the 8 subscales of the SF-12, some of which has only 1 item. Therefore, we estimated approximate reliability by using Cronbach's coefficient alpha for the 6 items most strongly associated with physical health and the 6 items most strongly associated with mental health. An alpha coefficient of 0.7 is usually seen as acceptable reliability. Moreover, in conformity with previous studies on reliability of the tool, in order to evaluate Cronbach's alpha, we used the value of the response choice categories before weighting the indicator variables and computation of aggregate scores [23, 24, 44] . We reverse scored four items (1, 8, 9 , and 10) so that a higher item value indicates better health for all Sf-12v2 items and summary scales. 2.5. Validity. The criterion validity was evaluated by comparing SF-12v2 values to PSS scores. The two assessment tools were administered together, and the Pearson Correlation Coefficient (PCC) was calculated. PCC can be interpreted as follows: 0 indicates no linear relationship, +1/-1 indicates perfect positive/negative linear We also analyzed known group validity [45] through box plots and ANOVA analysis in order to investigate whether PCS12 or MCS12 differed as hypothesized between gender, BMI group, and number of hours spent sitting and exercising during the lockdown. All statistical analyses were conducted using Statistical Package for Social Sciences (SPSS). The SF-12v2 questionnaire was administered together with the PSS to 583 medical and health professionals' students recruited by the Department of Human Neurosciences of Sapienza University of Rome in July 2020. The demographic characteristics of the sample are summarized in Table 1 . Depression Research and Treatment The results of the exploratory factor analyses are presented in Table 2 . The Bartlett's test of sphericity has a p value < 0.001 and the KMO 0.863. This finding indicates that data were suitable for factor analysis. Factor analysis extracted 2 factors out of the 12 items that explained 54.82% of the variance. As shown in Table 2 , factor 1 included 6 items (items 1, 2, 3, 4, 5, and 8), and factor 2 included 6 items (6, 7, 9, 10, 11, 12) . These results confirm the allocation presented in the original manual [37] . Alpha coefficient was 0.69 as regards PCS12 of SF-12v2 and 0.84 as regards MCS12. From the "Cronbach's Alpha if Item Deleted" analyses, all items resulted to be necessary for the total subscale. The correlation between the PSS and the MCS12 was -0.390 (p < 0:01), while the correlation with the PCS12 was 0.013. The ANOVA analysis of known group validity is presented in Table 3 showing a statistically significant difference in MCS12 for gender, time spent sitting, and time spent exercising. A statistically significant difference was found also in PCS12 scores in people with different BMI. Finally, Figures 1-10 show graphically through box plot differences in mean between PCS12 and MCS12 with time spent sitting and exercising, BMI, and Italian geographic area. The primary objective of this study was to evaluate the psychometric proprieties of the SF-12v2 in the assessment of self-perceived HRQOL of Italian students after the lifestyle changes due to the outbreak of COVID-19. The secondary objective was to detect different score levels of the tool in different populations' groups in order to confirm the hypothesis that physical and mental health are associated with gender, BMI, and number of hours spent sitting or exercising during the lockdown due to COVID-19 pandemic. The results of this study showed that SF-12v2 is a reliable and valid tool to assess self-perceived HRQOL in Italian students in terms of internal consistency reliability and construct validity. As hypothesized, we found a moderate linear correlation between the PSS scale and MCS12 but no correlation between PSS and PCS12 [26, 27] . We found statistically significant differences in scores of PCS12 in students with different BMIs showing that people with obesity had worse self-assessed physical health compared with those of people with normal weight [28] . As expected, scores of MCS-12 were lower for women than for men, but we did not find a similar difference for PCS12. This study shows statistically significant associations between MCS12 and time spent sitting and exercising during the lockdown due to COVID-19 pandemic. With regard to time spent sitting, lowest scores in the MCS12 were found for the group spending 12-18 hours sitting. Surprisingly, best MCS12 scores were seen in the group spending over 18 hours sitting. However, this may be a spurious result due to the small size of the group (n = 14). With regard to time spent exercising, highest MCS12 scores were seen in the groups spending 3 hours or more than 3 hours exercising. This means that students that did not practice physical activity during lockdown reported a lower level of mental health in SF-12v2. The mean value of the MCS12 (41.43) is about ten points below the norm score indicated for SF-12v2 [46] . This result is consistent with the current literature. In fact, other studies conducted on students found that while physical health was above the United States (US) general population norm (50 points), mental health scores of SF-12v2 were lower [47] . It has been demonstrated that increasing physical activity and promoting adequate sleep duration are key health promotion strategies for college students [48] . Regarding mental health, the literature shows increased symptoms of depression, anxiety, and stress related to COVID-19 due to psychosocial stressors such as life disruption, fear of illness, or fear of negative economic effects [49] . As regards the university location, we did not find statistically significant differences in HRQOL scores. North Italy was afflicted with COVID-19 first and has been in a stressful situation for the longest. However, this area had a better situation as regards hospitals and sanitary operation than other areas. Anyway, coronavirus spread rapidly also in the other areas [49] . This study showed that the Italian version of SF-12v2 is a valid and reliable instrument to assess HRQOL for medical and health professionals' students. The data used to support the findings of this study are available from the corresponding author upon request. World Health Organization, Constitution of The World Health Organization, Basic Doc, Forthy-Fifth editionForthy-Fifth edition Distance learning during social seclusion by COVID-19: improving the quality of life of undergraduate dentistry students Understanding knowledge and behaviors related to COVID-19 epidemic in Italian undergraduate students: the EPICO study Sedentary behaviors and physical activity of Italian undergraduate students during lockdown at the time of COVID−19 pandemic A nationwide survey of psychological distress among Italian people during the COVID-19 pandemic: immediate psychological responses and associated factors Humanistic care and psychological counseling on psychological disorders in medical students after COVID-19 outbreak Impact of the COVID-19 pandemic on mental health and quality of life among local residents in Liaoning Province, China: a cross-sectional study Psychological distress and sleep problems when people are under interpersonal isolation during an epidemic: a nationwide multicenter cross-sectional study Effects of COVID-19 on college students' mental health in the United States: interview survey study Psychological state of college students during COVID-19 epidemic Mental health and behavior of college students during the early phases of the COVID-19 pandemic: longitudinal smartphone and ecological momentary assessment study Physical activity, health-related quality of life, and stress among the Chinese adult population during the COVID-19 pandemic The World Health Organization's WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial. A Report from the WHOQOL Group The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research The construct validity of the Perceived Stress Scale Subjective health status assessment: evaluation of the Italian version of the SF-12 health survey. Results from the MiOS Project Reliability, validity, and responsiveness of the short form 12-item survey (SF-12) in patients with back pain Cross-validation of item selection and scoring for the SF-12 health survey in nine countries: results from the IQOLA project A 12-item shortform health survey: construction of scales and preliminary tests of reliability and validity Quality of life in a sample of Brazilian adults using the generic SF-12 questionnaire Validity of SF-12 summary scores in a Greek general population Validity of the SF-12 for use in a lowincome African American community-based research initiative (REACH 2010) Translation, cross-cultural adaptation and psychometric evaluation of Yoruba version of the short-form 12 health survey The Hausa 12-item short-form health survey (SF-12): translation, crosscultural adaptation and validation in mixed urban and rural Nigerian populations with chronic low back pain Psychometric properties of the Polish version of SF-12v2 in the general population survey Coping with stress during the first wave of the COVID-19 pandemic by Turkish people with multiple sclerosis: the relationship between perceived stress and quality of life A comparison study of perceived stress and quality of life among Master of Pharmacy and non-pharmacy master's students Comparing the SF-12 and SF-36 health status questionnaires in patients with and without obesity Parental stress of preschool children with generalized anxiety or oppositional defiant disorder Heart rate monitoring under stress condition during behavioral analysis in children with neurodevelopmental disorders Screening for developmental disorders in 3-and 4-year-old Italian children: a preliminary study Building words on actions: verb enactment and verb recognition in children with specific language impairment SCORS-G and card pull effect of TAT stories: a study with a nonclinical sample of children Tools to assess the quality of life in patients with Parkinson's disease: a systematic review Internal consistency and validity of the Italian version of the Jebsen-Taylor 9 Depression Research and Treatment hand function test (JTHFT-IT) in people with tetraplegia Evaluation instruments for executive functions in children and adolescents: a systematic review Measuring environmental barriers: validation and cultural adaptation of the Italian version of the Craig Hospital Inventory of Environmental Factors (CHIEF) scale General Sleep Disturbance Scale (GSDS-IT) in people with spinal cord injury: a psychometric study Development of the Pregnancy and Motherhood Evaluation Questionnaire (PMEQ) for evaluating and measuring the impact of physical disability on pregnancy and the management of motherhood: a pilot study How to Score the SF12 Physical and Mental Health Summary Scales Evaluating the use of exploratory factor analysis in psychological research Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis User's Manual for the SF-12v2 Health Survey Validation of the Arabic version of the "12-item short-form health survey" (SF-12) in a sample of Lebanese adults COSMIN guideline for systematic reviews of patient-reported outcome measures Association of physical activity, sedentary time, and sleep duration on the health-related quality of life of college students in Northeast China Determinants of health-related quality of life in international graduate students COVID-19 and Italy: what next? How mental health care should change as a consequence of the COVID-19 pandemic The authors declare that there is no conflicts of interest.