key: cord-0685125-r9dmfxgr
authors: Yiu, Hei Hang Edmund; Al-Janabi, Hareth; Stewart-Brown, Sarah; Petrou, Stavros; Madan, Jason
title: The use of composite time trade-off and discrete choice experiment methods for the valuation of the Short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS): a think-aloud study
date: 2022-03-24
journal: Qual Life Res
DOI: 10.1007/s11136-022-03123-0
sha: 4a5c30e99933a0e1b0edbd641921ea7d37917650
doc_id: 685125
cord_uid: r9dmfxgr

PURPOSE: To identify patterns and problems in completing composite time trade-off (C-TTO) and discrete choice experiment (DCE) exercises for the valuation of the Short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS) to inform the optimisation of a valuation protocol. METHODS: Fourteen cognitive interviews were conducted in the UK using concurrent and retrospective think-aloud and probing techniques. Each participant completed 8 C-TTO tasks and 8 DCE tasks within a computer-assisted personal interview setting. Verbal information was transcribed verbatim. Axial coding and thematic analysis were used to organise the qualitative data and identify patterns and problems with the completion of tasks. RESULTS: While participants found the tasks generally manageable, five broad themes emerged to explain and optimise the response to the tasks. (1) Format and structure: attention to the design of practice examples, instructions, and layout were needed. (2) Items and levels: underlying relationships were discovered across different combinations of levels of SWEMWBS items. (3) Decision heuristics: participants engaged in diverse strategies to assist trade-off decisions. (4) Valuation feasibility: certain states were difficult to imagine, compare and quantify. (5) Valuation outcome: the data quality was affected by participants’ discriminatory ability across states and their time trade-off decisions. CONCLUSION: The interviews contributed insights regarding the robustness of the proposed methods. The application of C-TTO and DCE valuation techniques was practical and suitable for capturing individual attitudes towards different mental well-being scenarios. A modified protocol informed by the results is being tested in a larger sample across the UK. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11136-022-03123-0.

Governments funding health services often use research developed to value the effects of healthcare services on illness. To extend this to public services other than healthcare services, we need to understand how people value different aspects of well-being.

This study tests approaches developed by economists for valuing health to see how well they apply to valuing mental well-being improvements measured with a reliable, valid and widely used scale -the Short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS).

Valuation tasks were designed on a digital platform based on methods used for valuing a measure very widely used in healthcare service evaluation (the EQ-5D-5L) and mental well-being profiles derived from SWEMWBS. Participants

The quality-adjusted life year (QALY) is an outcome measure used to inform cost-utility analyses of healthcare interventions. However, many generic preference-based measures (e.g. EQ-5D-5L) used to derive health utility values for QALY estimation are subject to limitations as their descriptive systems focus mainly on physical dimensions of health, without sufficiently capturing other aspects of mental health [1] [2] [3] . Mental well-being (MWB) has been shown to be related to many aspects of morbidity, mortality and community outcomes [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] . As a good stage of life is more than the absence of physical problems, an alternative outcome measure named the "Mental Well-being Adjusted Life Year (MWALY)" has been postulated as an approach to capturing benefits of interventions related to broader aspects of wellbeing [14] . The SWEMWBS (reported in Online Resource 1) is a seven-item measure of MWB with five response levels from "none of the time" to "all of the time". The items are positively worded to access hedonic and eudaimonic perspectives of well-being. The total scores range from 7 to 35 where higher scores indicate better MWB. Policymakers in Scotland, Wales and England use this questionnaire for monitoring population MWB [15] [16] [17] . It is psychometrically validated and widely recognised across diverse populations in the UK [18] [19] [20] . There is currently no generic preference-based MWB instrument for the economic evaluations of interventions that affect MWB. Therefore, identifying appropriate valuation protocols for measures of MWB is an important step towards the development of preference-based value sets.

A cognitive testing method is required to explore the validity of the valuation protocols. A common interviewing technique to understand the feelings and thoughts of information processing is the cognitive (or think-aloud) interview [21] . Cognitive interviews in health economics have tended to focus on identification of errors within questionnaire design [22] [23] [24] , but they have also been applied in health preference valuation studies. Goodwin et al. [25] investigated the reasons for discrepancies between the TTO values derived by the general public and patients with multiple sclerosis. Respondents thought aloud their primary appraisal, secondary appraisal, and response process. A content analysis was used to understand the factors affecting respondents' interpretations, judgements and trading criteria for the health states. Ryan et al. [26] applied think-aloud techniques to understand the cognitive process of completing DCE tasks related to choices for bowel cancer screening. Respondents' potential violations of completeness, monotonicity and continuity axioms of utility were investigated. Results from qualitative research were used to complement quantitative data to explain seemingly irrational responses. Spencer [27] applied think-aloud techniques to analyse the completion of different variants of TTO for valuing EQ-5D-3L health states. The results were subsequently used to test the idea of procedural invariance. Although these studies provide some insights into the valuation techniques, we know little about the application of health state valuation techniques into the valuation of MWB. This study, therefore, aims to investigate the cognitive process of completing composite time trade-off (C-TTO) and discrete choice experiment (DCE) exercises for the valuation of the SWEMWBS to inform the optimisation of a valuation protocol.

Face-to-face cognitive interviews were conducted to investigate the completion processes of the C-TTO (i.e. conventional TTO for the valuation of MWB states considered better than death and a lead-time TTO for states considered worse than death) and DCE exercises (examples shown in Figs. 1 and 2). Participants were asked to think aloud during and after the tasks within a computer-assisted personal interview setting.

A snowball convenience sample of the Warwickshire and West Midlands population in the UK aged 18 or above was recruited. The main source was university staff and students identified through personal networks. Motivated by the principle for specifying data saturation proposed by Francis et al. [28] , the initial sample size was set at eight. The interviewer (HHEY) continued to recognise different themes of shared beliefs and the stopping point was applied when there were no new informative ideas identified for three consecutive interviews beyond the eighth interview. 

For the DCE, assisted by the software Ngene, a D-efficient design with zero prior parameter values was used to systematically generate 32 DCE pairs, which were then randomly allocated into four blocks [29] . Each participant was asked to value one block, consisting of eight choice tasks. For the C-TTO, a blocked design was used. The lowest MWB state (1, 111, 111) and one of the states close to full MWB (FMWB) (4555555, 5455555, 5545555, 5554555, 5555455, 5555545 and 5555554) were included as two compulsory states within each block. Also, six additional states generated using the "AlgDesign" package in R were randomly allocated to each block. A levelbalance criterion constructed by the EuroQol group was applied within each subset to check the number of appearances of each level-domain combination [30] . The best subset was randomly and evenly divided into seven blocks. Each participant was required to value one block.

The EQ-VT 2.1 was the most up-to-date platform with a strict quality control process developed by the EuroQol Group for recording C-TTO and DCE responses [31] . The EuroQol Portable Valuation Technology (EQ-PVT), a replica of the EQ-VT 2.1, was used throughout the interview and participants completed tasks displayed on the interviewer's laptop.

All interviews were audio recorded. Respondents were interviewed in their homes or at the university campus with the following procedure:

(1) The interviewer introduced the study purpose. With reference to the EQ-VT 2.1, dynamic questions were added after the first practice example to allow interviewees to become familiar with another evaluation space [31] . Similarly, for the valuation of SWEM-WBS, dynamic questions regarding the assessment of which state is better (i.e. being accepted for the most ideal job) and worse (i.e. regularly being rejected following job applications, and constantly suffering a poor relationship with friends) than the previous examples were asked for valuation. After these, three practice SWEMWBS states were provided: high (4554545), low (2111131) and intermediate (4212354) MWB states. Next, the participant completed the eight valuation tasks. To reduce recall bias, during the process of completing the first three tasks, each participant was asked to think-aloud everything that came to mind concurrently. To save time and reduce the respondent's fatigue, each participant was asked to think-aloud retrospectively only after completing all five remaining tasks. Probing questions (Table 1 ) were used to com-plement the concurrent and retrospective cognitive process if they remained inactive. Finally, the rank ordering inferred by valuations was displayed in the Feedback Module (FM) (Fig. 3) . Each participant was asked to flag any disagreements Table 1 Examples of probing questions during the think-aloud process for the C-TTO/DCE tasks "Could you tell me more about how easy/difficult completing this time trade-off task was?" "You told me that you felt confused about determining the indifferent point for some of these 8 trade-off tasks/choosing between this pair of mental well-being profiles, could you tell me more about it?" "What thoughts came to mind when you were making trade-offs between different mental well-being states/ making a choice between this pair of mental well-being profile?" or inconsistencies with the results but was not asked to alter the problematic valuations. Some remaining debriefing questions (Table 2) were also asked if they were previously unaddressed. (5) The DCE exercise: The paired comparisons and the left-right order of each set of two states were randomised using the EQ-PVT platform. Concurrent think-aloud and retrospective think-aloud were applied to the completions of the first three and remaining five tasks, respectively. These were supplemented by probing questions (Table 1) . Some remaining debriefing questions (Table 3 and 4) were also asked.

After all interviews, verbal information was transcribed verbatim. Thematic analysis was used to analyse data collected by the concurrent and retrospective think-aloud techniques [33, 34] . First, open coding for the first four transcripts was performed by the first rater (HHEY) to identify task completion issues within the text. Coding was discussed and refined with a second rater (HA). With reference to the open coding for the first four transcripts and the field notes for the remaining transcripts, a coding tree for axial coding was then constructed by the first rater. Next, the axial coding framework was applied to code two informative transcripts by the first rater [35] [36] [37] . The second rater coded one of these transcripts and a third rater (JM) coded both transcripts. Upon completion of independent coding for the two transcripts, coding differences were discussed to enhance the consistency and reliability of the coding methods. A more robust version of the coding framework was developed after incorporating feedback raised by the raters. This was applied to code the remaining transcripts by the first rater. Nvivo was used for tagging and labelling potential codes. A codebook to describe the meaning of codes and a descriptive account to re-categorise the coding materials for generating higher-order themes were produced. An explanatory account was finally produced to selectively include quotes for the codes under each higher-order theme [35] .

Fourteen interviews were conducted between 11th February and 18th March 2020. The interview time was ~ 60-75 min per participant. Table 5 describes the characteristics of participants. Participants highlighted the strengths and limitations of applying the valuation protocol and the completion process. Five broad themes were generated following analyses of the verbal text. 

Participants appreciated the well-organised computer setting of the EQ-PVT platform and the automatic allocation of states. However, there were areas for improving the content of the tasks.

Despite most participants understanding the C-TTO practice scenarios, two participants pointed to the irrelevance of the job searching example as they were not current job seekers.

"This is a really tough one… because I'm 67 and I don't really care about job applications". (Female, 67)

Two main sources of response errors for the C-TTO process were identified. (1) Mistakenly clicking the non-preferred option: five participants were confused about the transformation of their own preferences to appropriate clicks in tasks.

(2) Failure to adjust length of life properly: participants sometimes had an indifference point between life A and life B in mind at first glance, but they struggled with the step-by-step procedure to reach that point.

"The scale is portrayed in a manner that my mind doesn't work. I find it quite strange to… delete and workup to equate a matching valuation". (Male, 32)

The DCE exercise simply required participants to click on the preferred option between two scenarios and no option selection problems were identified.

Two participants suggested the inclusion of pictures or colours instead of sole plain texts within the C-TTO FM, to enhance the differentiation of the eight MWB states with their corresponding attribute levels. In addition, nine participants disagreed with some of their own rank orderings of the eight completed C-TTO tasks. Although participants unanimously acknowledged the importance of reviewing their valuation answers, five participants suggested the possibility for allowing swapping of states after indicating disagreements.

Eight participants identified non-intuitive combinations of levels of items presented within states. This was a stumbling block to participants' comprehension and imagination.

"often deal with problems well despite the fact that you can't think clearly now, that is strange. And you can rarely make up your mind, now this does not make sense. I mean how can I only think clearly some of the time and I can't make my mind up about anything, but I can deal with problems well often!" (Female, 67)

Each of the five attribute levels influenced differently to participants' overall impression of a state. As mentioned by two participants, unit changes in attribute levels were not equally valued.

"It's like a sort of a diminishing return... when you go from none of the time to rarely, it is a big jump. But then rarely to some of the time is still quite a big jump. Then some of the time to often is a smaller jump. Then from often to all of the time... it reduces....?" (Male, 32)

Although FMWB is theoretically feasible, one participant rejected the idea of perfection in MWB and preferred a dominated alternative without "all of the time" for all seven items (i.e. non-monotonic valuation). The justification was that a maximal well-being state represented a lack of challenging life experience, which was a crucial element of an exciting and balanced life. Also, FMWB was considered unrealistic and could imply a lack of awareness or illusionary thinking, the failure to recognise individuals' self-position. 

Various decision strategies were found during the C-TTO and DCE valuation process.

Participants normally put more weight on important items and less for relatively unimportant items when interpreting the overall impression of a state. However, six participants exhibited a non-compensatory preference, in which they selected a preferred option based on a subset of the most important attribute(s) [38] . This violation of the continuity axiom was particularly obvious in the completion of the DCE exercise as they failed to trade off all attributes when making a final decision.

"They might instinctively [be] going towards option B… just because you're relaxed, you've got people close to you…" (Male, 32)

Nine participants considered the existence of extreme levels at the highest end and the lowest end of the response category. They preferred a state with more balanced attribute levels, which were considered preferable for achieving multiple aspects of MWB.

"I would go for B because I think A seems more extreme like none none, and then all all, whereas B is... you know only got one all and one none. So it's sort of more middle of the road". (Female, 29)

Four participants chose a preferred state with a higher levelsum score by counting the number of occurrences of each level in a state.

Participants with different demographic background (e.g. ages and occupations), personal judgements and characteristics (e.g. habits, outlook and commitments in life) influenced preferences towards MWB states. Furthermore, the existence of external support would increase the acceptability of a particular state.

"Possibly I don't make up my mind about things, I'll leave things to her (i.e. his wife)…" (Male, 28)

Eight participants assessed the frequency of a class or the probability of an event by the ease with which instances could be brought to mind [39] . They explained 

One participant observed that their decision to select a particular state within a DCE pair was sometimes informed by the elimination of an unimaginable state.

"Sometimes I was choosing the other one, not necessarily because I preferred it, but because I rejected one. It's like I just don't believe that." (Female, 67)

Difficulties such as imagination of states and quantification of years in the C-TTO tasks accentuated cognitive burden. Some participants also felt overwhelmed when completing forced DCE pairs as the process of comparing alternative permutations of levels for seven attributes induced information fatigue.

"It was tough... but... doable... in terms of... used quite a brainpower... it's just you're trying to hold a lot of things in your mind at the same time as you've got the profile of attributes on the left and then the profile on the right, and then is just trying to weight those up simultaneously." (Male, 32) However, all participants found the interviews manageable and the C-TTO and DCE tasks complementary. Participants also acknowledged the importance of the C-TTO practice tasks to relieve uncertainties from mere description of instructions and recognise their standard and position on time preference. The C-TTO and DCE tasks were beneficial and allowed them to reflect on life and their personal preferences.

One participant with prior experience of mental illness failed to reach the indifference point for four states even after exhausting all lead time in the worse-than-death scenario. Particularly, for the lowest state 1,111,111, she found it distressing and was not willing to live in this state, no matter how many years of lead time were given ahead of it. This constituted the value of -∞. Among those participants who valued states as better than death, one participant failed to reach the indifference point for some states due to her dislike of the concept of FMWB. The task failed to proceed as it violated the theoretical assumption of setting FMWB as the best state. This implied a value of > 1.

Nine participants were not willing to give up years of life if the states were considered sufficiently promising. 

This paper summarises the issues identified through the cognitive process of completing C-TTO and DCE tasks for the valuation of the SWEMWBS. Implications for modifications (Table 6 ) and other interview findings are discussed in this section. First, the style and structure of the C-TTO questions were challenged. The cognitive burden from imagination for the practice questions identified in this study was not documented in the wheelchair examples used in the EQ-5D-5L valuation studies [40] . This could be explained by the generic nature of physical health issues, as these were applicable to people with different ages. Considering this, one additional version of generic practice example related to physical health and relationships (Online Resource 2) was added to the original versions of the job application and relationship examples in the follow-on SWEMWBS valuation study. Participants are given the flexibility to choose between two practice versions. Also, inexperienced participants unintentionally made mistakes even after practising because of the complexity of the C-TTO completion. The presentation context was improved by deepening and slowing the instruction explanations. Clarification of the meaning of the life A and life B scenarios after each move are now described, ensuring that participants recognise the trade-off purpose. The selection of experimental design choice sets with potential uncommonly reported states could be avoided The exhibition of lexicographic ordering 3.3.1 Participants will be instructed to consider all attributes within the allocated states The existence of preference heterogeneity 3.3.3 Advanced modelling techniques with the inclusion of covariates and interaction terms could be applied Visualisation of states from a third party perspective 3.3.4

Participants will be told by the instruction to imagine themselves being in the allocated states Promising manageability of the number of tasks 3.4

The number of tasks for each of the C-TTO and DCE parts will be increased from 8 to 10 (i.e. 10 C-TTO and 10 DCE tasks)

To enhance the visual readability of the C-TTO FM, more guidance on reading the pooled states line-by-line is now provided. This slide was useful to check the robustness of the results as more than half of the participants flagged problematic rank ordering of states. The modelling results from other country-specific EQ-5D-5L value sets with the adoption of EQ-VT also showed a goodness-of-fit improvement after dropping flagged states [41, 42] . Some participants suggested corrections to rank ordering deliberately by allowing swapping between states. However, arguably, this would sacrifice the role of C-TTO in deriving the value of states. To keep the C-TTO theoretical foundation, with reference to the EQ-VT, data from those flagged invalid states will be deleted and no swapping of states will be required after indicating disagreements [31] . Some features of the valuation items and levels were identified by the interviews. Regarding potential conflicting combination of levels of attributes within a state, national datasets in the U.K. that include the SWEMWBS were separately analysed to explore characteristics of response patterns to the measure (Online Resource 3). Interestingly, there was insufficient evidence to exclude any SWEMWBS states, as the implausible states claimed by participants were not uncommon in national survey responses. Instead of state exclusion, when allocating choice sets to participants, the selection of experimental designs with potential uncommonly reported states can be avoided among many iterations. Moreover, regarding the non-linear effects of attribute levels, dummy coding was used in the utility specification of the DCE experimental design [43] . The interview results supported this assumption, as some participants indicated that they placed different weights on different levels. Lastly, no valid conclusion about the issue of non-monotonic valuation (i.e. not preferring FMWB) on the suitability of C-TTO technique can be made as this was only identified by one participant.

Additionally, completion heuristics were discovered. The participants' weighting of items was affected by the framing of the tasks (i.e. C-TTO-matching tasks versus choice-based DCE tasks) and the combination of levels of attributes. The presence of lexicographic ordering, a focusing effect normally discovered when respondents interpreted a state [26] , caused the failure to reflect full preference when some attributes were unattended. Moreover, the strategy of solely interpreting the level-sum score of states within the DCE pairs posed a risk of neglecting the essence of items. Considering these, participants should be reminded to interpret a state with both its levels and attributes before task completions. This could encourage them to take as much information into account as possible, even though not every attribute was equally important for them. Furthermore, values attached to a specific state were influenced by the variation in individuals' characteristics and tastes (i.e. preference heterogeneity). Choice models can explain deterministic (across observed individual characteristics) and random (unobserved) heterogeneities [44] . Furthermore, a few participants visualised states through the lens of available examples in society or through a third-party state. Participants are now reminded that the theoretical setting of both C-TTO and DCE techniques requires them to primarily immerse themselves into the allocated scenarios rather than imagining how others would behave in the state.

Concerning the manageability of the exercise, both C-TTO and DCE exercises are being maintained for the follow-on valuation study to allow different aspects of analysing preferences. Even though some participants felt cognitively exhausted to answer a forced DCE pair, the idea of a forced choice was to maximise the trade-offs between items and avoid the loss of power [45] . It could sometimes be difficult for participants to compare alternative permutations of levels for seven attributes. However, it was considered impossible to further reduce the number of items as the SWEMWBS descriptive system has already undergone comprehensive Rasch analyses [46, 47] . Keeping several levels of items identical between the two DCE alternatives could have relieved participants' cognitive burden. However, as documented in other studies which tested the effect of overlapping some dimensions across pairs [48] , participant's neglect of these identical items made the trade-off decision less informative. As all participants found the number of tasks within the interview manageable and a majority expressed the ability to complete more tasks, the number of tasks for both the C-TTO and DCE in the follow-on valuation study is increased by two each.

Finally, regarding the valuation outcome, there was only one participant who failed to reach the indifference point for some C-TTO tasks. A decision on the need to extend the amount of lead time will be investigated in the larger valuation study. The issue of non-trading could be a potential limitation for the adoption of the C-TTO technique for the valuation of SWEMWBS due to the lack of discriminatory potential. The distribution of the derived C-TTO values will be investigated in the results of the larger valuation study, to discover any potential clustering of the values at 1.

The limitations of this study include its small sample size. This study was conducted as the COVID-19 pandemic was unfolding, which restricted and ultimately curtailed our ability to identify participants for face-to-face interviews. The preference data collected were highly limited to individuals within an academic environment, even though effort was exerted to include non-academic staff. The predominance of university staff or students (ten participants) in the sample may have influenced the results. The fact that data saturation was reached suggests that the study was able to identify the main issues in spite of these limitations, but there was insufficient data to assess whether the issues raised by one participant were of broader concern. Moreover, the valuation tasks were randomly allocated to participants, without tailoring tasks consistently for each participant to test the potential violation of axioms of utility theory in their responses.

This study constitutes the first attempt to apply health state valuation techniques to the valuation of MWB as measured by the SWEMWBS. The results from the cognitive interviews support the feasibility of this application and provides insights that inform the optimisation of the valuation protocol.

The online version contains supplementary material available at https:// doi. org/ 10. 1007/ s11136-022-03123-0.

Acknowledgements Attendees at the Health Economists' Study Group Summer (HESG) 2021 Meeting and the 2021 International Health Economics Association (iHEA) Congress discussed this article, provided feedback on methodology and structure issues, and contributed insights about the interpretation of results. The EuroQol Group shared the EQ-PVT platform for recording the valuation responses.

All authors contributed to the study conception and design. Material preparation and data collection were performed by HHEY. HAJS, SSB, SP and JM supervised the interview progress and provided suggestions on improving the interview protocol. Data analysis was mainly performed by HHEY. HAJ contributed the idea of constructing the axial coding framework for thematic analysis and acted as a second rater for checking the codes. JM was a third rater. The first draft of the manuscript was written by HHEY and all authors commented on previous versions of the manuscript. All authors read and approved the final manuscript.

Funding This study was funded by the Chancellor's International Scholarship awarded by the University of Warwick.

The authors have no relevant financial or non-financial interests to disclose.

Ethical approval This research was approved by the Biomedical and Scientific Research Ethics Committee at the University of Warwick (Reference: BSREC.44 /19-20) .

Informed consent Informed consent was obtained from all individual participants included in the study.

The authors affirm that human research participants provided informed consent for publication of anonymised verbatim quotations.

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http:// creat iveco mmons. org/ licen ses/ by/4. 0/.

Quality of life of people with schizophrenia, bipolar disorder and other psychotic disorders

Views of the UK general public on important aspects of health not captured by EQ-5D

Is the EQ-5D fit for purpose in mental health?

Addressing the determinants of positive mental health: Concepts, evidence and practice

Depression is a risk factor for noncompliance with medical treatment -Meta-analysis of the effects of anxiety and depression on patient adherence

The benefits of frequent positive affect: Does happiness lead to success? Psychological bulletin

SLAN 2007: Survey of Lifestyle, Attitudes and Nutrition in Ireland Mental Health and Social Well-being Report

Mental health, resilience and inequalities

Positive psychological well-being and mortality: A quantitative review of prospective observational studies

Does positive affect influence health?

Well-being and affective style: Neural substrates and biobehavioural correlates

Well-being: Towards an integration of psychology, neurobiology and social science

Positive affect and health-related neuroendocrine, cardiovascular, and inflammatory processes

Where's WALY? : A proof of concept study of the "wellbeing adjusted life year" using secondary analysis of cross-sectional survey data

National indicator performance

The Scottish Health Survey: A National Statistics Publication for Scotland

Establishing a core set of national, sustainable mental health indicators for adults in Scotland: Rationale paper

Evaluating and establishing national norms for mental wellbeing using the short Warwick-Edinburgh Mental Well-being Scale (SWEMWBS): Findings from the Health Survey for England

Validation of Warwick-Edinburgh mental well-being scale (WEMWBS) in a population of people using secondary care mental health services

The validation of the Short Warwick-Edinburgh mental well-being scale (SWEMWBS) with deaf British sign language users in the UK. Health and Quality of Life Outcomes

Cognitive interviewing: A tool for improving questionnaire design

The value of cognitive interviewing techniques in palliative care research

The ICECAP-SCM tells you more about what I'm going through': A think-aloud study measuring quality of life among patients receiving supportive and palliative care

Can capabilities be self-reported? A think aloud study

What drives differences in preferences for health states between patients and the public? A qualitative investigation of respondents' thought processes

Rationalising the 'irrational': A think aloud study of discrete choice experiment responses

The TTO method and procedural invariance

What is an adequate sample size? Operationalising data saturation for theory-based interview studies

Applied choice analysis: a primer

The "power" of eliciting EQ-5D-5L values: the experimental design of the EQ-VT

Overview, update, and lessons learned from the international EQ-5D-5L valuation work: Version 2 of the EQ-5D-5L valuation protocol

Qualitative Methods for Health Economics: Rowman & Littlefield International Limited

Using thematic analysis in psychology

Six mechanisms behind carer wellbeing effects: A qualitative study of healthcare delivery

Basics of qualitative research

Understanding primary data analysis. Qualitative methods for health economics

Lexicographic preferences in discrete choice experiments. Consequences on individual-specific willingness to pay estimates

Availability: A heuristic for judging frequency and probability

Quality control process for EQ-5D-5L valuation studies

A hybrid modelling approach for eliciting health state preferences: The Portuguese EQ-5D-5L value set

Assessing the use of a feedback module to model EQ-5D-5L health states values in Hong Kong

Dummy coding vs effects coding for categorical variables: Clarifications and extensions

Discrete choice experiments: A guide to model specification, estimation and software

The effect of including an opt-out option in discrete choice experiments

Internal construct validity of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS): A Rasch analysis using data from the Scottish Health Education Population Survey

Further validation of the Warwick-Edinburgh mental well-being scale (WEMWBS) in the UK veterinary profession: Rasch analysis

Applying EuroQol Portable Valuation Technology to the EQ Health and Wellbeing Short (EQHWB-S): A pilot study