key: cord-0004419-83crtevc authors: Moreno Sancho, Federico; Tsakos, Georgios; Brealey, David; Boniface, David; Needleman, Ian title: Development of a tool to assess oral health-related quality of life in patients hospitalised in critical care date: 2019-10-26 journal: Qual Life Res DOI: 10.1007/s11136-019-02335-1 sha: 7c5a6855bf1218f6f4c7238f0ceda906f91e72f3 doc_id: 4419 cord_uid: 83crtevc AIMS AND OBJECTIVES: Oral health deteriorates following hospitalisation in critical care units (CCU) but there are no validated measures to assess effects on oral health-related quality of life (OHQoL). The objectives of this study were (i) to develop a tool (CCU-OHQoL) to assess OHQoL amongst patients admitted to CCU, (ii) to collect data to analyse the validity, reliability and acceptability of the CCU-OHQoL tool and (iii) to investigate patient-reported outcome measures of OHQoL in patients hospitalised in a CCU. METHODS: The project included three phases: (1) the development of an initial questionnaire informed by a literature review and expert panel, (2) testing of the tool in CCU (n = 18) followed by semi-structured interviews to assess acceptability, face and content validity and (3) final tool modification and testing of CCU-OHQoL questionnaire to assess validity and reliability. RESULTS: The CCU-OHQoL showed good face and content validity and was quick to administer. Cronbach’s alpha was 0.72 suggesting good internal consistency. For construct validity, the CCU-OHQoL was strongly and significantly correlated (correlation coefficients 0.71, 0.62 and 0.77, p < 0.01) with global OHQoL items. In the validation study, 37.8% of the participants reported a deterioration in self-reported oral health after CCU admission. Finally, 26.9% and 31% of the participants reported considerable negative impacts of oral health in their life overall and quality of life, respectively. CONCLUSIONS: The new CCU-OHQoL tool may be of use in the assessment of oral health-related quality of life in CCU patients. Deterioration of OHQoL seems to be common in CCU patients. ELECTRONIC SUPPLEMENTARY MATERIAL: The online version of this article (10.1007/s11136-019-02335-1) contains supplementary material, which is available to authorised users. During the last 30 years, much emphasis has been placed on the importance of patient-reported outcome measures (PROM) in research investigating patients hospitalised in critical care [1] . It is well established that oral health status is one of the determinants of quality of life [2] . Poor oral health has been shown to negatively impact quality of life across different populations [3] [4] [5] [6] [7] [8] . Therefore, it is of concern that recent evidence suggests that hospitalisation is associated with deterioration in oral health as shown by increased plaque levels, gingival bleeding and xerostomia [9, 10] . The decline in oral health during hospitalisation is of the utmost Electronic supplementary material The online version of this article (https ://doi.org/10.1007/s1113 6-019-02335 -1) contains supplementary material, which is available to authorised users. importance: this population is more vulnerable to oral disease, this deterioration may potentially affect their quality of life and poor oral health may result in a greater risk of Ventilator Associated Pneumonia (VAP) as it is reported that VAP-associated pathogens may translocate from the oral cavity into the lungs. When patients develop VAP, this infection results in an increase of mortality, length of CCU stay and cost. A systematic review that included 11 trials and 3242 patients concluded that "Oral decontamination of mechanically ventilated adults using antiseptics is associated with a lower risk of ventilator associated pneumonia" indicating that fourteen patients would need to receive this intervention to prevent one case of VAP [11] . Poor oral health might add an additional burden, affecting the patient's comfort and limiting the ability to eat and speak in these already compromised patients [12] . Therefore, deterioration of oral health in CCU patients might constitute a public health issue, as it could reduce quality of life, with evidence indicating that it also confers an increased risk for nosocomial infections [11] . A major limiting factor to further research is the absence of a validated tool to measure oral health-related quality of life in CCU patients. Commonly used generic OHQoL questionnaires include a large number of questions which are irrelevant for the critically ill given their life circumstances, limiting their applicability in this setting. Furthermore, these questionnaires take a long time to complete and are not feasible if the patients are frail and severely compromised, as it is the case in a CCU, because of the burden placed on patients and/or healthcare givers. Therefore, the aim of this study was to develop and validate a suitable tool to assess the impact of critical care on oral health-related quality of life (OHQoL) and to investigate patient-reported outcome measures of OHQoL in patients hospitalised in a CCU. The study was conducted in accordance with the principles of the Declaration of Helsinki (ethical approval NRES REC London -Fulham, IRAS Project ID 136965). We followed a multi-stage approach similar to that described by Guyatt and co-workers [13] . The project included three phases: (a) Initial tool development, (b) Pilot study and (c) Validation study; see Fig. 1 (1) Admitted to CCU for at least 48 h (2) Received level two or level three care as described by the Intensive Care Society Standards (3) Able to communicate in English to the nurse/assessor (Glasgow Coma Scale (GCS) of 15; Richmond Agitation Sedation Scale (RASS) score between 0 and 1) (4) At least 18 years of age Conceptually, for the development of the questionnaire, we used the definition of OHQoL from Locker and Allen: "the impact of oral disorders on aspects of everyday life that are important to patients and persons, with those impacts being of sufficient magnitude, whether in terms of severity, frequency or duration, to affect an individual's perception of their life overall" [14] . A literature search was performed which ascertained that no research was available in relation to OHQoL in CCU nor were there any validated tools to measure the OHQoL of patients at a CCU. We reviewed the literature to identify the most common oral health problems experienced by those hospitalised in CCU. We mapped the items and domains obtained from the literature and sought advice from a panel of experts, including consultants and nurses in critical care and experts in oral care and public health, to compare them against existing OHQoL tools validated in other settings. The domains and items were revised and re-presented to the expert panel until consensus was reached. The comprehension of each of the items was initially assessed using the Question Understanding Aid tool (QUAID) and items modified as required [15] . As a result of this initial research, an initial CCU-OHQoL tool was created (Supplementary Files-Initial tool). The domain and item revision involved administering the tool in a pilot study involving 18 CCU patients before discharge. The patients assessed the interpretability, relevance and acceptability of the CCU-OHQoL. After the questionnaire was completed, the nurses conducted a short interview comprising a series of open-ended questions with regard to the validity of the domains and items of the questionnaire and to identify possibly missing items. The initial tool was modified as necessary. The final version of the CCU-OHQoL tool (Supplementary files-CCU-OHQoL questionnaire) was administered to a larger sample, to assess construct validity, reliability and acceptability. As per the intended final use, the questionnaire was self-administered. There are no definitive criteria for the required sample size in a validation study of this kind. However, previous literature suggests that a sample size of 45 to 50 patients should be sufficient for the proposed analysis [16] . Content validity was assessed through the frequency of endorsement for each item amongst the patients included in the pilot study. For construct validity, the correlation between previously validated global OHQoL items [17] and the score for the items in our questionnaire was analysed using the non-parametric Spearman's rank correlation coefficient. Furthermore, associations between the CCU-OHQol overall score grouped in categories (i.e. good/fair/poor OHQoL) and global ratings of OHRQoL were tested using Kruskal-Wallis non-parametric test. The reliability of the tool was also assessed: internal consistency was measured using Cronbach's alpha coefficient and by analysis of the item-total correlation and Cronbach's Alpha if item deleted. Test-retest reliability was tested via intraclass correlation coefficients. Differences in self-reported oral health before hospitalisation and at CCU discharge were assessed by Wilcoxon signed rank tests. Overall scores for the CCU-OHQoL were calculated by summing up the response codes since ordinal values were coded for each question as presented in Supplementary files-CCU-OHQoL questionnaire. The distribution of the participants within categories ("Good", "Fair" or "Poor" OHQoL) was investigated as well as the distribution of responses for all individual items. We also assessed three summary variables: severity, prevalence and extent; in a similar fashion to that defined by Slade and co-workers [18] and modified to suit the characteristics of our questionnaire: • Severity the sum of ordinal responses • Prevalence the percentage of participants answering one or more item with ordinal values 3 or 4. (i.e. "Very bothered", "Extremely bothered", "Dissatisfied"strongest negative impacts) • Extent the number of items per subject answered with ordinal values 3 or 4 The correlation between the global rating QoL items, the self-reported oral health items and the score for the items in our questionnaire were analysed using the nonparametric Spearman's rank correlation coefficient. The purpose of assessing these correlations was to explore the relationships between self-reported oral health, OHQoL and QoL overall. Furthermore, the associations between self-reported changes in oral health during CCU stay and overall CCU-OHQoL score were tested using one-way analysis of variance. Analysis was carried out using SPSS Statistics for Windows (Version 22.0, IBM Corp, NY). A total of 18 and 45 subjects were recruited for the pilot and validation study, respectively. The demographic characteristics of the study population for both Parts B and C are presented in Table 1 . The expert panel agreed that the tool should include items for the following domains: "satisfaction with oral health", "functional limitations", "oral symptoms", "social impact", "self-care" and "psychological impact". Subsequently, a pool of 93 items was scrutinised until consensus was reached for a total of 13 items to be included in the initial tool (Supplementary files-Initial tool, Items 3 to 15). Questions assessing self-reported oral health, three global OHQoL items and a global QoL item were also included. The analysis of the frequency of endorsement of each item revealed very few items left unanswered (2.9%) and a good distribution of endorsement amongst the available responses for each item. In addition, "floor" and "ceiling" effects were not present when the questionnaire was analysed as a composite score. During the short interviews, 72.2% (n = 13) of the sample reported that the questions were relevant and 12 participants (66.6%) reported that the items related well or very well to their experience during their CCU stay. The addition of questions asking about tooth brushing frequency and bad breath was suggested by five subjects each. The recruitment rate was 47.3% of all subjects asked to participate in the study. The mean time for questionnaire completion was 8 min 33 s (CI 95% 4 min 18 s-12 min 48 s). The majority of the sample (88.9%) thought that the time to complete the questionnaire was reasonable and they would do it again while reporting that the wording of the questions was good (77.7%, n = 14) and easy to understand (94.4%, n = 17). Following data collection and analysis of the pilot study, the results were reviewed by the expert panel in critical care and oral health that contributed to the development of the initial tool. As a result, two items relating to bad breath and toothbrushing frequency were incorporated. The final tool was completed by 45 CCU patients. The correlation coefficient between the CCU-OHQoL score and the overall score of the global items of OHQoL was 0.74 (p < 0.001). Furthermore, the CCU-OHQoL score was strongly or moderately correlated with all three global items individually (item 18: 0.70, item 19: 0.61 and item 20: 0.76) being all also statistically significant (p < 0.001). There was an association between the categorised version of the CCU-OHQoL tool and the mean rating of the global OHQoL tool which was statistically significant (p < 0.001: Kruskal-Wallis non-parametric test). Similar associations and gradients were also observed with each of the global OHQoL items when assessed individually (see Fig. 2 ). Cronbach's alpha coefficient was 0.72. All of the items of the CCU-OHQoL tool showed an item-total correlation between 0.3 and 0.7 (Supplementary files-item-total correlation) with the exception of questions 3 (0.15) and question 16 (− 0.78). These two questions were also the only items where their deletion resulted in an overall increase in Cronbach's Alpha (item 3: 0.73; item 16 (0.77). Test-retest reliability was assessed by asking a subset of the subjects (n = 5) to complete the questionnaire twice, 5 days apart. The mean intraclass correlation coefficients (ICCs) for the scale overall was 0.65 (95% CI 0.38-0.84). A total of 96 patients were approached to take part in Part C of the study and 45 participants were recruited, translating into a recruitment rate of 46.8%. On average, the questionnaires took the participants 8 min and 53 s (CI 95% 4 min 39 s-13 min 7 s) to complete. The dimensionality of the tool was assessed using principal component exploratory factor analysis (EFA). We retained factors with eigenvalues > 1 and rotated them with "Varimax", which is an orthogonal rotation method. Items were assigned to retain rotated factors when they had a loading of ≥ 0.55 in absolute value. The magnitude of factor loadings, distribution of variance amongst the factors, and the relative correlation of the items with the different factors were assessed. After Varimax rotation, the first component explained 22% of the variance, and the second principal component added 19.5% to the variance explained (see Table 2 ). The third, fourth, and fifth components had Eigenvalues of 1.45, 1.28, and 1.13, and explained variances were 12.7%, 10.6%, and 8.8%, respectively. Fourteen out of the 15 items loaded highly on no more than one particular dimension (see Table 3 ). The four items in the first rotated principal component describe functional limitations and include four out of the five items which were included by our expert panel within this dimension and therefore maintained the name of the original dimension. Items referring to psychosocial impacts (items 14 and 17) were found in the second factor only. In addition, this factor also included items 9 and 10 which were included in the oral symptoms dimension. Item 10 may well have been considered by patients as an indicator of a social interaction and this factor was therefore named "Psychosocial impacts". The third dimension/factor included the two items measuring symptoms of dry mouth and was therefore named "Xerostomia". The main item tapping into the 5th factor was question 16. The second highest factor loading (although just short of the cut-off 0.55 value) in this dimension was item 15, which was also the only other item with a factor loading above 0.3 for this component. Since items 15 and 16 were the two items originally included in the dimension "Self-care", this component retained this name. Finally, the fourth factor referred to questions 3 and 9. Question 3 was included as an item for "Satisfaction with oral health" and seems unrelated to question 9; therefore, it is difficult to discern to which specific dimension these items may be tapping and remained unnamed. Table 4 . In addition, nearly 40% of the participants (n = 18) experienced negative impacts that bothered them at least "somewhat", 26 .7% reported that the negative impacts affected their life overall at least "somewhat" and 31.1% had negative impacts that affected their quality of life at least "somewhat". Those who reported a deterioration in self-reported oral health showed a higher mean CCU-OHQoL score (12.22, CI 95% 6.85-17.6) compared to those whose self-reported oral health did not change (6.78, CI 95% 2.34-11.22) although this was not statistically significant (p = 0.11). The CCU-OHQoL showed clear face and content validity. For construct validity, the tool achieved very strong correlations with global OHQoL (p < 0.01) in the expected direction with higher CCU-OHQoL scores indicating worse OHQoL. Furthermore, participants with a "Poor OHQoL" showed greater impacts in their overall life and quality of life. Reliability was adequate with a Cronbach's alpha of 0.72, above the acceptable threshold of 0.7 [19] , and adequate test-retest intraclass correlation coefficient of 0.66 (95% CI 0.38-0.84). Therefore, these data suggest that the CCU-OHQoL has appropriate characteristics to be used for the stated purpose. According to our results, hospitalisation in CCU has a negative effect on the self-perceived oral health of patients. More interestingly, those who reported a deterioration in self-perceived oral health, also showed a higher mean CCU-OHQoL score (poorer OHQoL). Although the correlation marginally failed to show statistical significance (p = 0.056), there was a clear trend with nearly a twofold increase in the overall CCU-OHQoL score which may have reached significance in a larger sample. This could be understood as initial evidence to suggest that changes in oral health after hospitalisation, as perceived by the patients, may indeed have an effect on their quality of life. We also obtained a cross-sectional view of the OHQoL amongst the participants. We use estimates of prevalence, extent and severity as they provide important complimentary information when interpreting OHQoL data [20] . These estimates show significant impacts of oral health on quality of life in our sample. The impacts seem to be more prevalent and intense in the "functional limitations", "oral symptoms" and "self-care" domains and relatively more modest for "psychosocial impact". In addition, the overall QoL items revealed that a significant proportion of the sample had impacts that affected their life overall. To date, there are no other studies exploring self-reported oral health and OHQoL in the critically ill which precludes comparison of these results. The current results suggest a very strong impact of "xerostomia" in the OHQoL of the critically ill. This is consistent with previous evidence reporting that intubated CCU patients have a significantly reduced salivary flow during hospitalisation [21] . In addition, there are some studies suggesting a deterioration of OHQoL in patients admitted to hospital outside CCUs [22, 23] . Similar to our findings, hospitalisation resulted in worsening of oral health and low OHQoL in other hospitalised populations [22] [23] [24] . Yu and co-workers showed that for Chinese geriatric patients, the disruption of the normal daily living routine as a result of hospitalisation translated to a worsening of oral health and low OHQoL [22] . Additionally, Schimmel and co-workers compared the OHQoL of 31 hospitalised stroke patients who presented with hemi-facial and/or limb palsy at the University Hospital of Geneva (Switzerland) to that of 24 subjects with similar age, gender and dental status [23] . The results also indicated a lower OHQoL in the hospitalised population compared with the control group. The OHIP-EDENT [25] mean score was 12.3 ± 17.7 in the control group and 18.8 ± 15.5 in the hospitalised population (p = 0.01), with higher scores indicating lower OHQoL. Also in accordance with the previous studies, Cornejo et al. [24] in a cross-sectional study amongst 194 institutionalised elderly in Barcelona (Spain) found that 67% of the participants had poor OHQoL and this was associated with self-reported poor oral health. All in all, it seems that the decline of quality of life due to a worsening of the oral health might be more marked in unwell and hospitalised patients. Extrapolating what we know about the impact of critical care on the HQoL and the impact of poor oral health on the OHQoL of medically compromised patients as discussed above in addition to the results of our study, it could be possible that some of the deterioration in HQoL of the critically ill is due to changes in oral health. In order to improve patient care, we need to know what OHQoL means to patients and what experiences they relate to their stay in CCU. Experiences of critically ill patients are an important aspect of the quality of the care and are essential to guide bedside decisions in the CCU; they should be placed at the centre of public health debate. The strengths of the study include the systematic process followed to develop the tool tailored to our target population. The CCU-OHQoL tool is "patient-centred and incorporates aspects of daily living that patients deem to be important" as the patients themselves were involved in the development of the tool [14] . Ideally, participants could have been involved earlier in the process via interviews at the stage of item generation to further limit the risk of critical items being overlooked. The aim was to develop a questionnaire that would not be burdensome on patients or staff to complete. The time for completion of the questionnaire was short and 89% of the patients reported they would be happy to repeat the questionnaire if needed. However, we recruited a relatively low number of subjects in the final phase of the project and the low recruitment rates may suggest some degree of selection bias; based on the data presented in Table 1 , the population in our study seems to be representative of the patients seen at the CCU at UCH. Forty-five patients are at the lower end of what would be considered acceptable [16] . In addition, the sample size for test-retest analysis was also small, precluding meaningful interpretation. Completion of the second questionnaire is logistically difficult since many patients may be discharged from the CCU to their homes or to other hospitals. In addition, in the initial development and validation of the tool we did not complete an oral examination to assess objectively the oral health of the participants but rather used a previously validated self-reported measure of oral health. Further studies using the CCU-OHQoL and including objective clinical assessments of the oral health of the participants would allow assessment of the responsiveness of the tool and also provide an opportunity to compare the questionnaire against other generic OHQoL tools. Finally, the cross-sectional analysis of the OHQoL of the participants should be interpreted with caution since the study was designed with the primary aim of developing and validating the CCU-OHQoL tool. Without a control group, the changes might have been due to secular effects not related to CCU. It is not clear what the ideal control group should be. Nonetheless, assessing the oral health and OHQoL of patients admitted to other hospital wards or institutionalised in nursing homes might allow meaningful comparisons even if not representing a true control group [9, 26] . It is also worth noting that it has been proposed that some of the changes in OHQoL and QoL may be due to psychological adjustments such as changes in expectations due to illness which may be particularly relevant in the CCU due to the "response shift" that patients hospitalised in critical care may suffer. Further evaluation of the CCU-OHQoL tool is needed to test its psychometric properties and its applicability in other CCU settings. Future studies should provide information regarding test-retest stability and the ability of the tool to discriminate between groups with different levels of oral health assessed by traditional clinical measures. Finally, the responsiveness of the questionnaire could be studied through administration as part of a randomised controlled trial [27] . As perceived by the patients themselves, our results contribute to the body of evidence suggesting a deterioration in oral health following hospitalisation. More importantly, this deterioration was associated with poorer OHQoL indicating that these changes may indeed have an impact in the life and well-being of those hospitalised in a CCU. Since the care received at the CCU would ultimately influence the oral health of the critically ill, this is an extremely important finding encouraging the search of new interventions and care pathways to maintain oral health following admission to a CCU, being this an important public health matter. By including this OHQoL tool in future research, influential data will be provided to decision makers for the development of health promotion and may help to identify a group of patients for whom new care pathways aimed at improving oral health are needed [28] . Simple CCU nurse-led interventions have already been shown to maintain oral health [10] and therefore this is an achievable objective. (1) This study is the first to develop a tool to measure OHQoL in patients hospitalised in a CCU: the CCU-OHQoL. The new tool has good acceptability, clear face, content and construct validity and satisfactory internal consistency reliability. (2) For a large proportion of the patients, self-rated oral health deteriorated following hospitalisation in a CCU and this deterioration seems to be associated with poorer oral health-related quality of life. (3) Overall, there were substantial negative effects of oral health on the patient's quality of life during their stay at the CCU with a high prevalence, extent and severity of impacts in the patient's daily living and quality of life. Quality of life after intensive care: a systematic review of the literature The concept of positive health: a review and commentary on its application in oral health research Effect of arch length on the functional well-being of dentate adults Impact of prosthodontic status on oral wellbeing: a cross-sectional cohort study Key factors associated with oral health-related quality of life (OHRQOL) in Hong Kong Chinese adults with orofacial pain Effects of severe dentoalveolar trauma on the qualityof-life of children and parents Quality of life and psychological well-being among endodontic patients: a case-control study Impact of oral health on the life quality of periodontal patients The impact of hospitalization on oral health: a systematic review The impact of hospitalization on dental plaque accumulation: an observational study Oral decontamination for prevention of pneumonia in mechanically ventilated adults: systematic review and meta-analysis Guidelines for oral health care for long-stay patients and residents Measuring disease-specific quality of life in clinical trials What do measures of 'oral health-related quality of life' measure? QUAID: a questionnaire evaluation aid for survey methodologists Measuring functioning and well-being. The medical outcomes study approach To what extent do oral disorders compromise the quality of life? Impacts of oral disorders in the United Kingdom and Australia Health measurement scales: a practical guide to their development and use Interpreting oral health-related quality of life data. Community Dentistry and Oral Epidemiology Oral health status and development of ventilator-associated pneumonia: a descriptive study Impact of oral health status on oral health-related quality of life in Chinese hospitalised geriatric patients Oral health-related quality of life in hospitalised stroke patients Oral health-related quality of life in institutionalized elderly in Barcelona (Spain) Developing short-form measures of oral health-related quality of life Changes in dental plaque following hospitalisation in a critical care unit: an observational study Measuring change over time: assessing the usefulness of evaluative instruments Oral health-related quality of life: what, why, how, and future implications Acknowledgements We thank Dr Jean E. Suvan, Deborah Smyth, Magda Rocha, Georgia Bercades, Jung Hyun Ryu, Alicia San Jose and Alison Macklin for their help for study coordination, recruitment and collection of data. This project was supported by researchers at the National Institute for Health Research University College London Hospitals Biomedical Research Centre.Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creat iveco mmons .org/licen ses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. Conflict of interest The authors declare no conflict of interest. UCL and/or UCLH and UCLH CBRC paid salaries as part of their research/ clinical roles to all authors and researchers involved in the project.Ethical approval All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards (Ethical approval NRES REC London -Fulham, IRAS Project ID 136965).Informed consent Informed consent was obtained from all individual participants included in the study.