key: cord-354690-ywb9krdp
authors: Barr, Margo; Raphael, Beverley; Taylor, Melanie; Stevens, Garry; Jorm, Louisa; Giffin, Michael; Lujic, Sanja
title: Pandemic influenza in Australia: Using telephone surveys to measure perceptions of threat and willingness to comply
date: 2008-09-15
journal: BMC Infect Dis
DOI: 10.1186/1471-2334-8-117
sha: 
doc_id: 354690
cord_uid: ywb9krdp

BACKGROUND: Baseline data is necessary for monitoring how a population perceives the threat of pandemic influenza, and perceives how it would behave in the event of pandemic influenza. Our aim was to develop a module of questions for use in telephone health surveys on perceptions of threat of pandemic influenza, and on preparedness to comply with specific public health behaviours in the event of pandemic influenza. METHODS: A module of questions was developed and field tested on 192 adults using the New South Wales Department of Health's in-house Computer Assisted Telephone Interviewing (CATI) facility. The questions were then modified and re field tested on 202 adults. The module was then incorporated into the New South Wales Population Health Survey in the first quarter of 2007. A representative sample of 2,081 adults completed the module. Their responses were weighted against the state population. RESULTS: The reliability of the questions was acceptable with kappa ranging between 0.25 and 0.51. Overall 14.9% of the state population thought pandemic influenza was very or extremely likely to occur; 45.5% were very or extremely concerned that they or their family would be affected by pandemic influenza if it occurred; and 23.8% had made some level of change to the way they live their life because of the possibility of pandemic influenza. In the event of pandemic influenza, the majority of the population were willing to: be vaccinated (75.4%), be isolated (70.2%), and wear a face mask (59.9%). People with higher levels of threat perception are significantly more likely to be willing to comply with specific public health behaviours. CONCLUSION: While only 14.9% of the state population thought pandemic influenza was very or extremely likely to occur, a significantly higher proportion were concerned for self and family should a pandemic actually occur. The baseline data collected in this survey will be useful for monitoring changes over time in the population's perceptions of threat, and preparedness to comply with specific public health behaviours.

If an outbreak of pandemic influenza should occur, it is essential that public health authorities are prepared to act. While resources have been prepared to educate the population about the nature of a threat and planned government actions, [1] it is necessary to understand the potential response of a population.

Most of the existing information about a population's response to the threat of pandemics comes from research on outbreaks of the SARS coronavirus, most notably in Hong Kong, Singapore, and Canada, [2] [3] [4] [5] and on studies of risk perception and anticipated behaviours in a potential pandemic in humans from the avian influenza virus (especially the H5N1 subtype). [6] [7] [8] [9] To date, Australia has been relatively unaffected by SARS or H5N1; however, some of Australia's neighbours have experienced limited outbreaks: for example, SARS in Hong Kong and Singapore; and H5N1 in Indonesia and Hong Kong and China. Globally, the threat of a pandemic of H5N1 is high.

A key component of a population's response is the perception of risk or threat. Research shows that in a SARS outbreak willingness to comply with risk-reducing behaviours is linked to the perceived immediacy and seriousness of the threat. [2, 3, 5] Three risk perception studies on potential avian influenza outbreaks were conducted in 2005. In the first study, Lau et al. surveyed residents of Hong Kong on a potential outbreak of H5N1. [7] Their study focussed on protective behaviours and likely compliance with them; however, the researchers also asked respondents about the perceived threat of H5N1 and the likelihood of it occurring within the next 12 months. It was found that 33% of respondents felt the chance of an outbreak was high or very high. Lau's study also asked respondents how worried they would be about oneself or a family member contracting the virus in the event of a local outbreak; 54% said they would be very worried.

In the second study, de Zwart et al. compared the risk perceptions of European and Asian respondents to the threat of avian influenza, [8] and measured self-efficacy beliefs to assess the likely compliance with protective health measures. Overall the study found that 45% of respondents thought they were likely or very likely to become infected should an outbreak of avian influenza occur. This figure varied from 32% (Denmark and Singapore) to 61% (Poland and Spain). The researchers took a composite measure of risk perception and found that higher scores were observed in Europe rather than Asia. They found higher risk perceptions in females and older respondents; while lower self-efficacy beliefs in Europe suggested that adherence to protective measures would be lower in Europe.

In the third study, Di Giuseppe et al. surveyed the knowledge and attitudes of an Italian population to avian influenza. [9] They found that around 19% of respondents had a high risk perception and felt very much at risk of contracting avian influenza. In this study lower socioeconomic status and lower education levels were associated with higher risk perception, and those with a higher risk perception were more likely to comply with hygiene practices to avoid the spread of disease.

Our aim was to develop a module of questions for use in telephone health surveys on perceptions of threat of pandemic influenza, and on preparedness to comply with specific public health behaviours in the event of pandemic influenza. [7] [8] [9] As such, our literature search identified no relevant studies on response to pandemic influenza specifically, although other studies have been published on general threat perception and compliance with protective behaviours in the context of infectious diseases or other emergencies.

The primary reference was a study by Canadian researchers on anticipated public response to terrorism. [10] Questions on the threat likelihood, effect on family, and behavioural compliance, were adapted with permission by subject matter experts and survey methodologists. Each proposed question was considered for clarity, ease of administration, and possible biases. A set of 6 questions was developed for field-testing (Table 1) , as well as an additional open question: "Do you have any comments you would like to make on any of the questions or any other issues?"

The pandemic influenza questions were field tested for test-retest reliability using the protocol of the New South Wales Health Survey Program. [11] The questions were then modified based on the results from the field testing and were re field tested. For both field tests the target sample was 200 persons living in the state aged 16 years and over stratified by geographical region. This sample size ensures that a kappa of 0.6 (good or excellent) is able to be detected at a significance level of 5% and a power of 80% when compared to a kappa of 0.4 or less (fair or poor) for response frequencies greater than 20%. [11] Additional context added before question to provide better context. Likelihood of being affected was changed to concern about being affected, to tap a sense of vulnerability rather than probability. Responses altered to reflect concern and increase to 5 options. Households were contacted using random digit dialling. One person aged 16 years and over from each household was randomly selected for field testing. Trained interviewers conducted the interviews. Up to 7 calls were made to establish initial contact with a household, and at least 5 calls were made to contact a selected respondent. When the respondent completed the first field test, an appointment was made for a retest at least a week later but within 3 weeks of the initial field test. If a respondent was unable to be contacted during this 2 week window they were deemed to be unavailable and their initial field test was deleted. [11] Test-retest reliability and validity were estimated by Cohen's kappa statistic for binary variables, and weighted kappa with Cicchetti-Allison weights for ordinal variables. Unbalanced tables were corrected using the method described by Crewson. [11] Since erroneously low values of kappa can arise from skewed data, per cent agreement was also presented for categorical variables, calculated as the proportion of respondents in the same category at test and retest. Responses for don't know and refused are also reviewed. [11] Data manipulation and analysis were conducted using SAS Version 9.2. [11] The survey The New South Wales Population Health Survey is a continuous telephone survey of the health of the state population using the in-house CATI facility of the New South Wales Department of Health. [11] Only residential phone numbers were used in the sample, as residential phone coverage in Australia still remains high, [12] and results from persons who only have mobile phones has been shown to be comparable in the United States. [13, 14] The pandemic influenza module was administered as part of the survey between 22 January and 31 March 2007. The pandemic influenza questions were submitted to a lead ethics committee for approval prior to use. The survey also includes other modules on health behaviours, health status (including psychological distress, using the Kessler K10 measure, and self-rated health status), and access to health services, as well as the demographics of respondents and households. The target population for the survey is all state residents living in households with private telephones. Up to 7 calls were made to establish initial contact with a household, and 5 calls were made in order to contact a selected respondent.

Response categories were dichotomised into indicators of interest and don't knows and refused were removed. For the hypothetical questions -that is, likelihood of pandemic influenza, likelihood that family or self affected, willingness to comply with vaccination, isolation or wearing a face mask -the responses of extremely likely and very likely were combined into the indicator of interest. For the non-hypothetical question "changed way live because of the possibility of an influenza pandemic" responses a little, moderately, very much and extremely were combined into the indicator of interest: that is, changed life.

The survey data were weighted to adjust for probability of selection and for differing non-response rates among males and females and different age groups. [15] Data were manipulated and analysed using SAS version 9.2. [11] The SURVEYFREQ procedure in SAS was used to analyse the data and calculate point estimates and 95 per cent confidence intervals for the prevalence estimates. For pairwise comparisons of subgroup estimates, the p-value for a two-tailed test was calculated using the normal distribution probability function PROBNORM in SAS, assuming approximate normal distribution of each individual subgroup estimates with the estimated standard errors, and approximate normal distribution for the estimated difference.

In total, 192 residents aged 16 years and over completed the first field test and 202 residents completed the second field test. Estimates of test-retest reliability for the first and second field tests are shown in second field test. Kappa values for the indicators derived from the questions ranged between 0.25 and 0.51 in the second field test. There were low don't know response rates (0-3.9%) and no respondent refused to answer any question.

In response to the open question "Do you have any comments you would like to make on any of the questions or any other issues?": 79% made positive comments about the questions, 48.7% found the question wording easy to understand and answer, and 29.9% found the subject matter relevant and interesting. Of the respondents who had difficulty answering the questions, the main issues were: the questions were too vague (7.1%), response options were not descriptive enough (7.1%), or the topic area was difficult (6.5%). Table 3 shows the responses to each question, including don't know and refused. The percentage of don't know or refused responses was low. Table 4 shows the indicators for pandemic influenza likely, concern for self and family, and changed life by sex, age group, demographic characteristics, and the indicators of level of psychological distress and general self-rated health status. Overall 14.9% of the population thought pandemic influenza was very or extremely likely, 45.5% were very or extremely concerned that they or their family would be affected by pandemic influenza, and 23.8% had made some (small to extreme) level of change to the way they live their life because of the possibility of pandemic influenza.

When the indicators for pandemic influenza likelihood, concern for self and family and changed life were combined, as shown in Figure 1 , the greatest proportion of the population (41.3%) thought pandemic influenza was unlikely to occur, would not be concerned for themselves or their family, and had not changed the way they lived their life because of the possibility of pandemic influenza. A quarter of the population (25.1%) thought pandemic influenza was unlikely to occur and had not made any changes to their lives, but would be concerned for themselves and their family in the event of pandemic influenza. Table 4 also shows the combined indicators pandemic influenza likely and concern for self and family as well as pandemic influenza likely and concern for self and family and changed life by sex, age group, demographic characteristics, and the indicators of level of psychological distress and general self-rated health status. Table 5 shows the indicators willing to receive vaccination, isolate themselves, or wear a face mask by sex, age group, demographic characteristics, and the indicators of level of psychological distress and general self-rated health status. Overall, the majority of the population would be willing to receive vaccination (75.4%), willing to be isolated (70.2%), and willing to wear a mask (59.9%), if pandemic influenza were to occur.

When the indicators for willing to receive vaccination, isolate themselves, and wear a face mask were combined, as shown in Figure 2 , 48.3% reported being willing to receive vaccination, isolate themselves, and wear a face mask if pandemic influenza were to occur; 13.7% would not be willing to receive vaccination, isolate themselves and wear a face mask; 13.1% would be willing to receive vaccination, isolate themselves but not wear a face mask; and 10.4% would be willing to receive vaccination and wear a face mask but not isolate themselves. Table 5 also shows the combined indicator for willing to receive vaccination, isolate themselves, and wear a face mask by sex, age group, demographic characteristics, and the indicators of level of psychological distress and general self-rated health status. Table 6 shows the indicators for willing to receive vaccination, isolate themselves, or wear a face mask as well as complying with all the specific public health behaviours: that is, willing to receive vaccination, isolate themselves, and wear a face in people who think a pandemic influenza is very or extremely likely, and who are also very or extremely concerned for themselves and their family.

This study shows it is possible to construct a small set of questions about threat perception for a general population, which can be used for health surveillance. Field testing identifies improvements that can be made to the questions and the response structure, and highlights the population's interest in surveys of this nature. Kappa values for the indicators ranged from 0.25-0.51, which is acceptable for hypothetical questions. The items had low don't know response rates (0-3.9%); no respondents refused to answer any of the questions; and the majority of respondents made positive comments about the questions.

Those reporting the highest levels of threat perception are older people, those with fair or poor self-rated health status, no formal qualifications, low household incomes, and those living in rural areas. Perhaps surprisingly, there were no differences noted between the perceptions of men and women, or between those persons with or without children.

Overall, the majority of the population has taken no action, at this point, to change the way they live their life because of the possibility of pandemic influenza. The only two subgroups reporting moderate changes are those born overseas and those who speak a language other than English in the home.

Although direct comparisons with other studies are difficult to make, these findings suggest that the threat perceptions of the New South Wales population are similar to those reported by residents of Hong Kong, even though Australia has not been exposed directly to SARS or H5N1.

Willingness to comply with specific public health behaviours is generally high (60-75%), with willingness to be vaccinated greater than being willing to be isolated, which in turn is greater than being willing to wear a face mask. There is clearly a lower level of willingness to comply with wearing a face mask, especially in younger people, those living in urban areas, and those who speak a language other than English in the home.

Current findings on compliance with protective behaviours are comparable with findings from studies con- ducted in Hong Kong in relation to anticipated SARS and H5N1. [4, 7] A study about SARS in Hong Kong indicates that those with higher risk perception and moderate levels of anxiety were more likely to take comprehensive precautionary measures against infection, and younger less educated males were least likely to adopt preventative measures. [3] Our data suggest that younger people are less likely to comply with protective behaviours, while a higher level of formal education (a university degree or equivalent) is associated with higher willingness to comply with all protective behaviours, but especially wearing a face mask.

A study of this nature has a number of limitations. First, people are being asked about a hypothetical event of which they have no experience. However, comparisons [4] and reported mask wearing rising from 11% in the early stages to 94% in the later stages of the outbreak. Clearly data in that study support the increased likelihood of protective behaviours being adopted with increased risk perception; and, in our study, those with higher levels of threat perception were significantly more likely to be willing to comply with specific public health behaviours. Prevalence estimates and 95% confidence intervals for response combinations to the three questions on health protection behaviours for pandemic influenza Willing to be vaccinated, isolated, and wear a face mask

Willing to be vaccinated and isolated, but not willing to wear a face mask

Willing to be vaccinated and wear a face mask, but not willing to be isolated Willing to be vaccinated, but not willing to be isolated or wear a face mask

Willing to be isolated and to wear a face mask, but not willing to be vaccinated Willing to be isolated, but not willing to be vaccinated or to wear a face mask

Willing to wear a face mask, but not wiling to be vaccinated or isolated Not willing to be vaccinated, isolated, or wear a face mask % Our data indicate that while most respondents are very or extremely willing to perform a behaviour; the remaining respondents are expressing varying, but lower, degrees of willingness to perform these behaviours, with 21-31% indicating they would be moderately or a little willing, and 3-8% indicating they would be not at all willing to perform these behaviours. However, evidence such as data indicating very high levels of compliance with quarantine and minimal requirement for enforceable quarantine orders during SARS in Canada suggests that, in the event of a serious and immediate threat, the majority of those who are indecisive would shift their position and comply. [19] It is likely, however, that even with such a compliance 'shift' the relative compliance of sub groups within the population noted in our study will be upheld; as these patterns of compliance have been supported consistently by studies of actual protective behaviours. [3, 4] 

This study of the response of the New South Wales population to the threat of pandemic influenza is part of a broader study of perceptions and behaviours around adverse events, including terrorism and global warming.

As post-disaster studies generally report a lack of baseline data as a major handicap to understanding the trajectory for psychosocial recovery, [17, 18] our study takes the first steps in establishing baseline for data vital for emergency planning, against which impact and recovery can be monitored.

Australian Health Management Plan for Pandemic Influenza Canberra: Australian Government Department of Health and Ageing

Infectious disease and risk: Lessons from SARS London: The Nuffield Trust

The impact of community psychological responses on outbreak control for Severe Acute Respiratory Syndrome in Hong Kong

Monitoring community psychological responses to the SARS epidemic in Hong Kong: From day 10 to day 62

Risk perception and compliance with quarantine during the SARS outbreak

Avian influenza risk perception: Hong Kong

Anticipated and current preventative behaviours in response to an anticipated human-to-human H5N1 epidemic in Hong Kong Chinese general population

Notes: Level of statistical significance: * p < 0

‡ Population level frequencies do not agree with Table 3 as don't know/ refused responses were excluded from this analysis. § For pairwise comparison testing in subgroups with more than two categories comparisons are made between each subgroup prevalence and the overall population prevalence. ψ Psychological distress was measured using the K10. Values range from 10-50, with 'high' psychological distress considered as being ≥ 22

Avian Influenza Risk Perception

A survey of knowledge, attitudes and practices towards avian influenza in an adult population of Italy

National public survey of perceived CBRN terrorism threat and preparedness. In University of Ottawa in partnership with Health Canada and the Canadian Food Inspection Agency Ottawa: Institute of Population Health

NSW Population Health Survey: Description of Methods

Australian Bureau of Statistics: Population Survey Monitor. Catalogue no. 4103.0 Canberra: ABS

Estimation Issues in Dual Frame Sample of Cell and Landline Numbers

Surveying households on cell phones: Results and lessons. Paper presented at the Annual Conference of the American Association for Public Opinion Research

NSW Population Health Survey: Review of Weighting Procedures

Australian Bureau of Statistics: Census of Population and Housing

Effects of fear and anger on perceived risks of terrorism: A national field experiment

Comparison of post-disaster psychiatric disorders after terrorist bombings in Nairobi and Oklahoma City

Public health measures to control the spread of the Severe Acute Respiratory Syndrome during the outbreak in Toronto

This study was funded by Emergency Management Australia and the New South Wales Department of Health. The following staff of the Centre for Epidemiology and Research, New South Wales Department of Health, assisted with the study: Matthew Gorringe, question development and data collection; Raymond Ferguson, SAS programming and infrastructure; Frances Garden, comparing weighted survey data against census data.

The authors declare that they have no competing interests.

The authors contributed equally to this work.Publish with Bio Med Central and every scientist can read your work free of charge 

The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1471-2334/8/117/pre pub