key: cord-0767424-bn2loscc
authors: Pelat, Camille; Falchi, Alessandra; Carrat, Fabrice; Mosnier, Anne; Bonmarin, Isabelle; Turbelin, Clément; Vaux, Sophie; van der Werf, Sylvie; Cohen, Jean Marie; Lina, Bruno; Blanchon, Thierry; Hanslik, Thomas
title: Field Effectiveness of Pandemic and 2009-2010 Seasonal Vaccines against 2009-2010 A(H1N1) Influenza: Estimations from Surveillance Data in France
date: 2011-05-10
journal: PLoS One
DOI: 10.1371/journal.pone.0019621
sha: 9580bfcbdb77b78a21887a8911bb9b69444182a4
doc_id: 767424
cord_uid: bn2loscc

BACKGROUND: In this study, we assess how effective pandemic and trivalent 2009-2010 seasonal vaccines were in preventing influenza-like illness (ILI) during the 2009 A(H1N1) pandemic in France. We also compare vaccine effectiveness against ILI versus laboratory-confirmed pandemic A(H1N1) influenza, and assess the possible bias caused by using non-specific endpoints and observational data. METHODOLOGY AND PRINCIPAL FINDINGS: We estimated vaccine effectiveness by using the following formula: VE = (PPV-PCV)/(PPV(1-PCV)) × 100%, where PPV is the proportion vaccinated in the population and PCV the proportion of vaccinated influenza cases. People were considered vaccinated three weeks after receiving a dose of vaccine. ILI and pandemic A(H1N1) laboratory-confirmed cases were obtained from two surveillance networks of general practitioners. During the epidemic, 99.7% of influenza isolates were pandemic A(H1N1). Pandemic and seasonal vaccine uptakes in the population were obtained from the National Health Insurance database and by telephonic surveys, respectively. Effectiveness estimates were adjusted by age and week. The presence of residual biases was explored by calculating vaccine effectiveness after the influenza period. The effectiveness of pandemic vaccines in preventing ILI was 52% (95% confidence interval: 30–69) during the pandemic and 33% (4–55) after. It was 86% (56–98) against confirmed influenza. The effectiveness of seasonal vaccines against ILI was 61% (56–66) during the pandemic and 19% (−10–41) after. It was 60% (41–74) against confirmed influenza. CONCLUSIONS: The effectiveness of pandemic vaccines in preventing confirmed pandemic A(H1N1) influenza on the field was high, consistently with published findings. It was significantly lower against ILI. This is unsurprising since not all ILI cases are caused by influenza. Trivalent 2009-2010 seasonal vaccines had a statistically significant effectiveness in preventing ILI and confirmed pandemic influenza, but were not better in preventing confirmed pandemic influenza than in preventing ILI. This lack of difference might be indicative of selection bias.

Estimating the field effectiveness of influenza vaccines (VE) poses specific challenges for the 2009 A(H1N1) pandemic. In particular, both pandemic and seasonal vaccination campaigns took place during the epidemic and, as a consequence, vaccine coverage changed through time, both in influenza cases and in the population as a whole.

In France, pandemic vaccination conformed to a priority list established by public health authorities based on exposure and/or transmission probability, or on risk of complication subsequent to influenza [1] . The priority allocation of pandemic vaccines is shown in Figure 1 , along with the evolution of vaccine coverage over time, by broad age categories. Medical and paramedical staffs working in hospitals were first called, on October 20 th (week 43). Individuals working with ambulatory patients presenting with influenza or working with patients at high risk of complication for influenza were called on November 2 nd (week 45). Risk factors of complication, stated in a High Committee of Public Health advice, on September 7 th 2009, were: pregnancy (in particular from the second trimester), obesity, and chronic conditions such as broncopulmonary diseases, heart diseases, diabetes and immunosuppression [2] . On November 12 th (week 46) all other health care professional were called (880,000), as well as all persons in contact with infants younger than six month-old (1,200,000), childminders working with children under three year-old (500,000), and every person between six months and 64 years of age with a risk factor (2,815,000). Pregnant women from their second trimester and 6-to 23 month-old children without risk factor were called on November 20 th (week 47). High school pupils were called on November 25 th (week 48). People over 65 year-old with a risk factor (3, 200 ,000) and children older than 23 month-old (7,700,000) and were called in week 49. Finally, adults over 18 year-old without a risk factor were called in week 53 (39,000,000). In the end, 63,295,000 persons had been called to vaccination centers to receive a pandemic influenza vaccine: all the French population, except infants younger than 6 month-old.

Seasonal vaccines were available to everyone at high risk of seasonal influenza related complications, from September 21 st (week 39/2009 ). For both vaccines, most vaccinations were completed by the end of January 2010.

In France, influenza-like illness (ILI) incidence has been monitored since 1984 by the Sentinelles network, a surveillance system based on sentinel general practitioners (GPs) [3] . ILI incidence crossed the epidemic threshold in week 37/2009, while detection of 2009 pandemic A(H1N1) viruses remained sporadic until week 42 (see Figure 2 ). ILI incidence peaked in week 49 and fell below the epidemic threshold in week 53. During the epidemic, the pandemic strain was dominant (99.7%) among influenza virus isolates [4] . In the first weeks of the pandemic, the sharpest increase in ILI incidence was observed in children under five yearold. After five weeks, 5 to 14 year-old children became the most affected group. The biggest difference between age-specific incidence rates was observed at the peak of the epidemic. It can be seen in Figure 2 that adults over 65 year-old were almost unaffected by the pandemic wave in France.

The purpose of this study was to assess how effective the pandemic and 2009-2010 trivalent seasonal vaccines were in preventing ILI on the field during the 2009-2010 season, using surveillance data. To evaluate how using ILI instead of a more specific influenza endpoint biased VE estimates, we conducted a validation study on a sample of laboratory-confirmed A(H1N1) influenza. We also assessed the existence of selection biases by estimating VE outside the influenza-circulating period.

The Orenstein's screening method was used to calculate vaccine effectiveness with the following formula:

where PCV is the proportion of vaccinated among influenza cases and PPV is the proportion of vaccinated among the population [5, 6] . PPV was obtained from administrative sources. Two influenza datasets were used: one of clinically defined ILI cases, and one of laboratoryconfirmed pandemic A(H1N1) influenza cases. One injection was considered sufficient to confer a vaccinated status [7, 8] . Because influenza vaccines were not given to children under six month-old, they were excluded from the study. Individuals with missing age or vaccination status were also excluded.

For ILI data, an epidemic and a post-epidemic study period were defined for each vaccine. The epidemic study period began three weeks after the start of the vaccination campaign: in week 42/2009 (October 12 th ) for seasonal vaccines and in week 46/ 2009 (November 9 th ) for pandemic vaccines, and lasted until week 52/2009, end of the epidemic. The post-epidemic study period started in week 05/2010 (February 1 st ) and lasted until week 34/ 2010 (August 29 th ). Weeks 53/2009 to 04/2010 constituted a ''washout period'' since residual circulation of influenza viruses was observed even though the epidemic itself was over. Study periods are shown in Figure 1 and 2.

For laboratory-confirmed data, a single study period, spanning weeks 46/2009 to 04/2010, was defined.

Case recruitment ILI cases were reported by Sentinelles GPs in France excluding overseas territories but including Corsica, as part of a surveillance routine using the following definition: ''sudden onset of fever .39uC (.102uF) with respiratory signs and myalgia'' [3] .

Laboratory-confirmed influenza cases in France excluding Corsica and overseas territories were reported by physicians from the Regional Groups of Influenza Observation (GROG) as part of a surveillance routine. GROG is a network of private-practice GP and pediatricians dedicated to the virological surveillance of influenza [9] . Corsican laboratory-confirmed influenza cases were reported by Sentinelles GPs [10] . Nasopharyngeal swabs were collected through a randomized selection routine. Doctors included the first patient of each week, of any age (Sentinelles protocol) or of a personally assigned age group among 0-4, 5-14, 15-64, and $65 year-old (GROG protocol). Only patients presenting between 0 and 7 days after symptom onset were swabbed.

GROG doctors swabbed patients presenting with acute respiratory infection, defined as: sudden onset of a respiratory sign (cough, rhinitis, coryza,…) and a systemic sign evoking an infection (fever, asthenia, headache, myalgia, faintness). Corsican Sentinelles GPs swabbed patients presenting with ILI according to the Sentinelles definition. Swabs were analyzed in 11 laboratories, depending on the region of swabbing (two national reference centers and nine laboratories), by real-time polymerase chain reaction and/or culture.

For both ILI and laboratory-confirmed influenza cases, the following information was included: date of consultation, age, status regarding pandemic and seasonal influenza vaccination, and a logical indicating whether the time from vaccination to consultation was #3 or .3 weeks. The viral strain was known for laboratory-confirmed influenza cases.

The pandemic vaccine coverage in the population was calculated from the National Health Insurance database (Caisse Nationale d'Assurance Maladie). The provided database contained weekly counts of all persons vaccinated in France (excluding overseas territories and including Corsica) with a pandemic vaccine, from the start of the vaccination campaign to week 18 of 2010. Detailed coverage was provided for nine age groups: 6 month-to 4 year-old, 5-14, 15-24, 25-34, 35-49 , 50-64, 65-69, 70-74, and $75 yearold. Counts from weeks 19 to 34 of 2010 were assumed to be equal to those during week 18, since the data show that very few pandemic vaccinations were completed after winter.

Pandemic vaccine coverage at week w, for age group g, P V p jw,g À Á , was calculated as:

with v p,g,w the number of people in age group g vaccinated with the pandemic vaccine before or during week w, and pop g the population size of age group g in 2009 in France (with Corsica, without overseas territories). This vaccine coverage was monotonically increasing since 1) once vaccinated, people remained as such throughout the season and 2) the database contained all people vaccinated with a pandemic vaccine, so that no random fluctuation was present.

For seasonal vaccines, a similar database was not maintained by the National Health Insurance. Instead, vaccine coverage in the population was estimated each month from September 2009 to April 2010 by the Health Surveillance Institute (Institut de Veille Sanitaire, InVS) using computer-assisted telephone surveys. Each month a random sample from the French population (excluding overseas territories and including Corsica) were interviewed during an, on average, 11 day window. During the first stage of each survey, the sampling frame was the telephone numbers list, stratified by region and town size. At the second stage, the sampling frame was household residents, stratified by age (,5 years, $5 years). Each month around 800 questionnaires were filled in. Details of the sample design are provided elsewhere [11] . Pandemic vaccination status was also asked from November 2009, enabling identification of the proportion of people vaccinated with both vaccines, P V p \V s jw,g À Á . For the purpose of calculating the weekly seasonal vaccine coverage, we began by attributing the interview data to the weeks that accounted for most days of the interview windows. In other words, using the interview data, we first estimated the proportion of people vaccinated with seasonal vaccines, P V s jw,g ð Þ , and covaccinated with pandemic and seasonal vaccines, P V p \V s jw,g À Á , for weeks 38, 42, 47 and 50 of 2009, and 2, 7, 11 and15 of 2010.

We then fitted logistic functions to these data points to obtain smoothed, monotonically increasing weekly predictions of vaccine coverage for all weeks in the study period:P P V s jw,g ð Þ and P P V p \V s jw,g À Á .

To account for the end of the vaccination campaigns, the predicted coverage of seasonal vaccines and of covaccinations, were constrained to remain stable respectively from week 5 and week 11 of 2010. Finally, the weekly coverage of seasonal vaccines in people that did not get the pandemic vaccine, P V s jw,g, V V p À Á , was calculated as:

We used Farrington's implementation of the screening method to estimate VE adjusted on age and time [12] . In brief, VE was estimated with a logistic regression model allowing a different offset in each age 6time strata. Age was divided into nine strata (6 month-to 4 year-old, 5-14, 15-24, 25-34, 35-49, 50-64, 65-69, 70-74 and $75 year-old), and time was divided into one week strata.

A consensus view is that a period of at least 14 days is needed to achieve a protective concentration of antibody after influenza vaccination, but this timeline may vary [13] . Herein, for pandemic and seasonal influenza vaccines, individuals were considered vaccinated three weeks after receiving a dose of vaccine, and unvaccinated if they had received no vaccine or if the vaccine had been given in the last three weeks.

In practice, for the calculation of VE in a week t, we compared the proportion of population vaccinated for more than three weeks at week t to the proportion of influenza cases vaccinated for more than three weeks that were seen by sentinel GPs in week t. Figure 1 shows the proportion of vaccinated in the population (plain lines), and the proportion of population that has been vaccinated for more than three weeks (dashed lines).

Since delay from injection was missing for some influenza cases, we ran two analyses. In the first one we assumed that these cases had received influenza vaccination in the three weeks preceding the consultation, and included them as unvaccinated. In the second analysis, we assumed that they had been vaccinated for more than three weeks and we included them as vaccinated. We explored in a third analysis what vaccine effectiveness was when vaccination was considered completed immediately after the injection of one vaccine dose. Because the question related to the interval between consultation and vaccination was dichotomized at three weeks, we could no further explore the protection timeline.

As trivalent 2009-2010 seasonal vaccines were expected to be less specific of 2009 A(H1N1) than pandemic vaccines, effectiveness of the seasonal vaccines was calculated only using those individuals that did not receive pandemic vaccination. As a sensitivity analysis, a second analysis included those cases.

The use of ILI, a non-specific influenza outcome, as a primary endpoint for estimating the effectiveness of influenza vaccines can bias VE estimates downward. Indeed, if only 50% of ILI cases are caused by influenza, a hundred percent effective influenza vaccine will have at most 50% effectiveness in preventing ILI: as the specificity of the outcome decreases, so do VE estimates [14] [15] [16] .

To assess this first source of bias, we compared VE estimates obtained using the ILI case sample provided by Sentinelles GPs to VE estimates obtained using the confirmed pandemic A(H1N1) influenza cases provided by GROG and some Sentinelles GPs.

A second source of bias was identified in that we used observational data of patients consulting a GP for an influenza episode, and compared their vaccine coverage to the one in the general population. Patients consulting a GP for an influenza episode might not be comparable to the rest of the population. In particular, if people vaccinated with influenza vaccine consulted differently than the rest of the population for an influenza episode, because of comorbidities or because of a different propensity to seek care for example, this could be a confusion factor when estimating VE. As suggested by several authors, such a selection bias should affect VE estimated on GP data during the influenzacirculation period as well as VE estimated outside this period [17] [18] [19] [20] [21] [22] . This is particularly interesting when using ILI, as influenza vaccine effectiveness in preventing ILI should be null outside the influenza-circulation period, if no bias was present. We therefore calculated VE against ILI after the influenza epidemic period, as an indication of selection bias in our data. As no vaccine was given before the epidemic start, pre-epidemic VE could not be assessed. We did not calculate VE against laboratory-confirmed A(H1N1) influenza outside the influenza-circulating period.

Pandemic vaccines. During the study period, Sentinelles GPs reported 7586 ILI cases above 6 month-old, with information on age and pandemic vaccine status, which were included in the pandemic vaccines analysis. Among them, 172 (2%) were vaccinated. Detailed numbers by study period and age group are presented in Table 1 .

Pandemic influenza vaccination had been done in the three weeks preceding the consultation for 108 vaccinated cases (63%), more than three weeks before consultation for 56 cases (33%), or at an unknown date for 8 of them. During the pandemic period, 67% (29/43) of the 6 month-to 4 year-old ILI cases were vaccinated in the three weeks preceding the consultation, versus 77% (34/44) of the 5 to14 year-old and 86% (42/49) of the 15 to 64 year-old (Fisher's test p = 0.12). None of the two vaccinated ILI cases $65 year-old reported by Sentinelles GPs during the pandemic had been vaccinated for more than three weeks.

Six month to four year-old children mostly received the nonadjuvanted PanenzaH vaccine (21/48 i.e. 44%); four of them (8%) received the adjuvanted PandemrixH vaccine; trademark was unknown for the remaining 23 ones. On the contrary, 5 to 14 year-old children mostly received the PandemrixH vaccine ( Seasonal vaccines. For the purpose of estimating the effectiveness of seasonal influenza vaccines, 9564 cases were eligible. Among them, 540 (6%) were vaccinated. Detailed numbers by study period and age group are presented in Table 2 . Vaccination had been done in the three weeks preceding the consultation for 115 cases (21%), more than three weeks before consultation for 401 cases (74%), or at an unknown date for 24 of them. Sixty-one of them (11%) were also vaccinated with the pandemic vaccine, while 465 (86%) were not, the remaining 14 patients having not answered the pandemic vaccination question.

Pandemic vaccines. Together, the GROG and Sentinelles samples provided 838 laboratory-confirmed pandemic A(H1N1) influenza cases $6 month-old that were described for pandemic vaccination and age, and were included in the analysis of pandemic vaccines. We did not include in the analysis those influenza isolates that were not typed (18), were of not-subtyped type A (26), or were of subtype A(H3N2) (one). No B strain was present in the sample.

Twenty-five of the included A(H1N1) cases were vaccinated (3%). Detailed numbers by age group are presented in Table 3 . It is noteworthy that none of the five confirmed A(H1N1) cases aged $65 year-old that were included in the study had received a pandemic vaccine.

Six month-to four year-old children mostly received the nonadjuvanted PanenzaH vaccine (12/13 i.e. 92%); only one of them received the adjuvanted PandemrixH vaccine. Four of the nine vaccinated children between five and fourteen year-old were given the PanenzaH vaccine (44%); three receive the PandemrixH vaccine (33%); two received a pandemic vaccine of unknown brand. Among the three vaccinated cases above 15 years, two received the PandemrixH and one the PanenzaH vaccine.

Vaccination had been done in the three weeks preceding the consultation for 20 of the 25 vaccinated cases (80%), before that delay for two cases (8%), or at an unknown date for three of them (12%). Eighty-five percent (11/13) of the 6 month-to 4 year-old laboratoryconfirmed cases were vaccinated in the three weeks preceding the consultation, versus 89% (8/9) of the 5 to14 year-old and 33% (1/3) of the 15 to 64 year-old (Fisher's test p = 0.16). Twenty-three cases (92%) had received one dose of vaccine, the other two cases did not precise this information. None has received two injections.

Seasonal vaccines. The laboratory-confirmed case sample contained 856 pandemic A(H1N1) cases that were described for age and seasonal vaccine status and could be included in the study. Fifty-one of them (6%) were vaccinated. Detailed numbers by age group are presented in Table 4 . Vaccination had been done in the three weeks preceding the consultation for 10 of the vaccinated cases (20%), more than three weeks before consultation for 29 cases (57%), or at an unknown date for 12 of them (24%). All confirmed pandemic A(H1N1) cases $65 year-old included in the study had received the seasonal vaccine. Five (10%) of the cases vaccinated with a seasonal vaccine had also received a pandemic vaccine, while 43 (84%) had not.

As exposed in the method section, three analyses were carried out. 1) In the first one (primary one), vaccination is considered completed three weeks after injection and all influenza cases with missing injection date are treated as unvaccinated. 2) As a first sensitivity analysis, influenza cases with missing vaccination date are treated as vaccinated. 3) Vaccination is considered completed immediately after the injection of one vaccine dose.

Since, during the pandemic, most reported influenza cases were vaccinated in the three weeks that preceded the consultation, considering missing injection date as belonging to the last three weeks, as was done in the first analysis, might be the more realistic option. The first analysis is thus considered the primary one, and its main results are reported hereafter. Detailed results of the three analyses are provided in Table 5 and Table 6 .

Effectiveness of pandemic vaccines. When vaccination was considered completed three weeks after the injection of one vaccine dose, the effectiveness of pandemic vaccine in preventing ILI was 52% (95% confidence interval 30-69) in the epidemic period, and 33% (4-55) in the post-epidemic period. When vaccination was considered completed immediately after injection, pandemic vaccine effectiveness in preventing ILI was 54% (45-61) in the epidemic period and 24% in the post-epidemic period.

When vaccination was considered completed three weeks after injection, pandemic vaccine effectiveness in preventing laboratoryconfirmed pandemic A(H1N1) influenza was 86% (56-98). When vaccination was considered completed immediately after injection, pandemic vaccine effectiveness in preventing laboratory-confirmed pandemic A(H1N1) influenza was 49% (25-67).

The effectiveness of pandemic vaccines in preventing ILI and confirmed pandemic A(H1N1) influenza in different age groups is presented in Table 5 . As no confirmed case above 65 year-old was vaccinated, the age-specific effectiveness of pandemic vaccine in this age group is not presented.

Effectiveness of seasonal vaccines. In the primary analysis of the field effectiveness of trivalent 2009-2010 seasonal vaccine, shown below, we excluded those individuals that received Table 3 . Pandemic vaccine uptake among laboratory-confirmed cases included in the pandemic vaccine effectiveness analysis. pandemic vaccination. The results of the analysis that included them are shown in the last column of Table 6 . When vaccination was considered completed three weeks after the injection of one vaccine dose, the effectiveness of seasonal vaccine in preventing ILI was 61% (56-66) in the epidemic period, and 19% (210-41) in the post-epidemic period. When vaccination was considered completed immediately after injection, seasonal vaccine effectiveness in preventing ILI was 47% (42) (43) (44) (45) (46) (47) (48) (49) (50) (51) (52) (53) in the epidemic period and 5% (227-31) in the post-epidemic period.

When vaccination was considered completed three weeks after the injection of one vaccine dose, the effectiveness of seasonal vaccine in preventing laboratory-confirmed pandemic A(H1N1) influenza was 60% (41-74). When vaccination was considered completed immediately after injection, seasonal vaccine effectiveness in preventing laboratory-confirmed pandemic A(H1N1) influenza was 20% (27) (28) (29) (30) (31) (32) (33) (34) (35) (36) (37) (38) (39) (40) (41) (42) .

The effectiveness of seasonal vaccines in preventing ILI and confirmed pandemic A(H1N1) influenza by age groups is presented in Table 6 . Since only five laboratory-confirmed pandemic A(H1N1) cases older than 65 year-old were included in the analysis, we do not present age-specific VE for this age group.

We obtained estimates of vaccine effectiveness by comparing vaccine coverage of influenza cases (clinically defined or biologically confirmed) to vaccine coverage of population samples, using Orenstein's screening method [5, 12] . To allow for a delay between the injection of a vaccine dose and immunization, vaccination was considered completed only three weeks after injection. In other words, in our primary analysis, individuals vaccinated for less than three weeks were considered unvaccinated. As a consequence of the late vaccination campaigns, the number of vaccinations we could consider completed during the pandemic was low.

We found that pandemic vaccines had a field effectiveness of 86% (56-98) in preventing laboratory-confirmed pandemic A(H1N1) influenza, which is in the range of previously reported values [7, 8, [23] [24] [25] [26] . More specifically, our estimates are slightly above the results of a multicenter case-control study conducted in seven European countries and are above the results of a casecontrol study conducted in the United Kingdom, which both found VE = 72% [8, 23] . They are also above the VE found by a Korean study, namely 73% [24] . However, they are below the estimates from a Scottish cohort study (95%) [25] , a German study based on the screening method (83-97%) [26] and a Canadian test-negative incident case-control study (.90%) [7] .

We found that pandemic vaccines had a significantly lower effectiveness in preventing ILI than in preventing confirmed A(H1N1) influenza: 52% (30-69) versus 86% (56-98). This is unsurprising as only a part of the 2009-2010 ILI cases were due to pandemic A(H1N1) influenza and therefore could be prevented by the pandemic vaccine. This part was estimated between 30% and 55%, depending on the country [27, 28] .

The effectiveness of pandemic vaccines in preventing ILI and confirmed influenza seemed to vary with age, yet not significantly and in no reproducible order through our different analysis. Since few reported influenza cases were vaccinated, large confidence intervals surround our age-specific VE estimates. In particular, no confirmed A(H1N1) case and only two ILI cases above 65 year-old were vaccinated with the pandemic vaccine. Indeed, elderly people were not a priority target group for pandemic vaccination and were called late to vaccination centers ( Figure 1 ). Estimations of vaccine effectiveness in this subgroup are therefore highly uncertain.

As others, we considered that one dose of pandemic vaccine was sufficient to provide immunization for all age classes [7, 8, 23, 24, 26] . However, it was shown that a single dose of pandemic A(H1N1) vaccine was more immunogenic in children older than three years than in younger children, and that a second dose was needed to reach seroprotection and seroconversion rates of 90-99% in both of these age groups [29] .

Influenza vaccines are theoretically expected to be more effective three weeks after their injection than immediately after. We did observe a significantly higher effectiveness of pandemic vaccines in preventing laboratory-confirmed pandemic A(H1N1) influenza when only vaccinations dating back to more than three weeks were considered completed than when treating all vaccinations as completed: 86% (56-98) versus 49% ). Yet, we did not find a significant difference in that respect regarding the effectiveness of pandemic vaccines against ILI: 52% (30-69) versus 54% (45-61), which is a first indication of the presence of biases in the estimation.

We found that the 2009-2010 seasonal vaccines had a significant effectiveness in preventing laboratory-confirmed influenza: VE = 60% . Unlike pandemic vaccines, seasonal vaccines were not significantly better in preventing laboratoryconfirmed pandemic A(H1N1) influenza than in preventing ILI: respectively VE = 60% (41-74) versus VE = 61% (56-66). This result cannot be explained by ILI comprising an appreciable number of seasonal influenza cases against which seasonal vaccine could have proven effective: more than 99% of influenza isolates during the 2009-2010 season were pandemic A(H1N1) [4] . This result might, instead, indicate that our effectiveness estimates of seasonal vaccines are driven by biases, in particular case selection biases. Indeed, the population that yearly vaccinates against seasonal influenza might be distinct from the rest of the population, in particular in its propensity to consult. This could induce a selection bias, since influenza cases are recruited through GPs. Therefore, the absence of adjustments in our study, when most studies adjusted by comorbidities and previous vaccination, could be a reason for the high effectiveness we observed.

We identified a source of bias in our seasonal vaccine study in that we used underestimated seasonal vaccine coverage for the 6 month-to 4 year-old population age group. Indeed, the vaccine coverage data provided by the InVS study concerned the 0-4 year-old age group, even if 0 to 6 month-old children were not concerned by seasonal influenza vaccination. Nevertheless, this should result in under-estimating, not over-estimating, vaccine effectiveness in this age group.

Our results come within a succession of contradictory evidences regarding the effectiveness of seasonal vaccines against pandemic 2009 A(H1N1) influenza. [30] . A subsequent paper evidenced a moderate effectiveness of the 2008-2009 seasonal vaccines against pandemic A(H1N1) mild outcomes (VE = 42%, 29-53%) [31] , while another one put forward an increased risk (odds-ratio = 2.45, 1.34-4.48) [32] .

Regarding the effectiveness of the 2009-2010 seasonal vaccines, most works found no protection against confirmed pandemic A(H1N1) [8, 23, [33] [34] [35] [36] , while one found an effectiveness of 50% (40) (41) (42) (43) (44) (45) (46) (47) (48) (49) (50) (51) (52) (53) (54) (55) (56) (57) (58) (59) in preventing pandemic A(H1N1) related hospitalizations [37] .

We adjusted by age to take into account different vaccine responses with age, and used weekly strata to account for the evolution of vaccine coverage in the population throughout the study period. As noted before, the lack of further adjustment could result in biased VE estimates, both for ILI and confirmed influenza. However, as our study was integrated in an ongoing surveillance system based on GP voluntary reporting of ILI cases, adjustment covariates were not collected in order to keep the questionnaire as short as possible. As a compromise, only essential covariates for VE calculation were asked to GPs: age, vaccine status (pandemic and seasonal), delay since vaccination (dichotomized at three weeks), and vaccine trademark (for pandemic vaccine only). Considering the small number of reported vaccinated influenza cases, pandemic VE was not calculated by vaccine trademark.

We used a three weeks delay between vaccination and consultation to differentiate vaccinated influenza cases fully immunized from those that were still unprotected. This delay might be too astringent: in most papers, a two week delay between vaccination and symptom onset is used [7, 23, 24, 26] , as data on seasonal influenza showed that protective antibodies were present in over 90% of persons fourteen days after vaccination [13] . However, as the question used for ILI cases was ''Is delay since vaccination #3 weeks?'', no data was available to make sensitivity analysis.

Bias due to the use of a non-specific endpoint. ILI is a non-specific proxy for influenza infection. Disposing of a validation sample of laboratory-confirmed pandemic A(H1N1) influenza cases allowed us to explore the bias in VE inherent to the use of such a non-specific outcome. Regarding the effectiveness of pandemic vaccines, the results are in accordance with the theoretical principle which stipulates that, as the specificity of the outcome decreases, so should the measured vaccine effectiveness [14] [15] [16] . Effectiveness of seasonal vaccines, however, did not show such a difference.

A few studies have used ILI as an endpoint for evaluating influenza vaccine effectiveness on the field [38] [39] [40] [41] , although laboratory-confirmed influenza is a more common endpoint. In particular, a case-control study based on university students reporting ILI episodes through a web interface evidenced a significant reduction of ILI among vaccinated students during seasonal influenza (adjusted odds ratio: 0.70, 95% confidence interval 0.56-0.89) but not during non-influenza periods (adjusted odds ratio: 0.98, 0.73-1.30) [42] .

Herein, we do observe a lower effectiveness of pandemic vaccines in preventing ILI after the epidemic period (VE = 33%, 4-55); however, unlike in Nichol et al, the effectiveness remains significantly above zero. As suggested by previous works, we can attribute this overestimation to the presence of biases, such as selection biases [17] [18] [19] [20] [21] [22] . Stochastic variations due to our little sample sizes are another possible explanation.

Sensitivity of the outcome ''ILI consulting a GP'' to track true influenza is also an issue: asymptomatic cases, subclinical cases and presentations different from the chosen ILI definition are missed. Call et al reviewed the probabilities of presence of different symptoms in influenza cases, i.e. the sensitivity of these symptoms for detecting influenza: depending on the age group, they were between 0.3 and 0.9, with lower sensitivities in the elderly [43] . Orenstein et al demonstrated in a simulation study that poorly sensitive outcomes could lead to underestimation of field vaccine effectiveness in three different observational designs [16] . However, our analysis seems more subject to overestimation biases.

Bias due to incomparability of cases and population sample. Another potential source of bias in our study is the uncertain comparability of cases recruited by GPs with samples drawn from the general population. To further assess the possible lack of comparability between cases and population samples, an alternative population sample taken directly among GPs usual patients could be used for validation. To that effect, during 2010-2011 influenza season, a cross-sectional survey at GPs offices will be carried out to assess the vaccine coverage among Sentinelles GPs patients.

Selection biases. As was visible in the results of seasonal vaccine effectiveness, selection biases might be present in our study design and bias result upwards. To try and further evidence these selection biases, vaccine effectiveness against ILI was computed after the influenza circulation period. Effectiveness of pandemic vaccine during this period was significantly above zero (33%, 4-57), although not significant in most age subgroups except in the six to fourteen year-old group. Effectiveness of seasonal vaccines was, as for it, not significant, whether overall (19%, 210-41) or in each age subgroup. In conclusion, for both vaccine types, a moderate vaccine effectiveness was found after the 2009 A(H1N1) influenza virus stopped circulating at appreciable levels, which is indicative of upward biases in our VE estimates, but this postpandemic effectiveness was mainly not statistically significant.

List of prioritary target groups for pandemic vaccination

Recommendations on the sanitary priorities of influenza A(H1N1)v pandemic vaccines

A computer network for the surveillance of communicable diseases: the French experiment

A(H1N1)2009 pandemic in France: epidemiological features based on virological surveillance

Field evaluation of vaccine efficacy

Assessing vaccine efficacy in the field. Further observations

Effectiveness of AS03 adjuvanted pandemic H1N1 vaccine: case-control evaluation based on sentinel surveillance system in Canada

Estimates of Pandemic Influenza Vaccine Effectiveness in Europe, 2009-2010: Results of Influenza Monitoring Vaccine Effectiveness in Europe (I-MOVE) Multicentre Case-Control Study

A new influenza surveillance system in France: the Ile-de-France "GROG". 1. Principles and methodology

Co-circulation of two genetically distinct sub-groups of A/H3N2 influenza strains during the 2006-2007 epidemic season in Corsica Island, France

Influenza vaccination coverage against seasonal and pandemic influenza and their determinants in France: a cross-sectional survey

Estimation of vaccine effectiveness using the screening method

Influenza virus: immunity and vaccination strategies. Comparison of the immune response to inactivated and live, attenuated influenza vaccines

Using validation sets for outcomes and exposure to infection in vaccine field studies

On estimation of vaccine efficacy using validation samples with selection bias

Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness

A cohort study of the effectiveness of influenza vaccine in older people, performed using the United Kingdom general practice research database

A meta-analysis of effectiveness of influenza vaccine in persons aged 65 years and over living in the community

Influenza vaccination and mortality: differentiating vaccine effects from bias

Mortality reduction with influenza vaccine in patients with pneumonia outside "flu" season: pleiotropic benefits or residual confounding?

Vaccines for preventing influenza in the elderly

Effect of influenza vaccination on hospitalizations in persons aged 50 years and older

Effectiveness of pandemic and seasonal influenza vaccine in preventing pandemic influenza A(H1N1)2009 infection in England and Scotland

Effectiveness of the pandemic influenza A/H1N1 2009 monovalent vaccine in Korea

Vaccine effectiveness in pandemic influenza -primary care reporting (VIPER): an observational study to assess the effectiveness of the pandemic influenza A (H1N1)v vaccine

Pandemic influenza A(H1N1) 2009 breakthrough infections and estimates of vaccine effectiveness in Germany

Detection of novel respiratory viruses from influenza-like illness in the Philippines

Changes in the viral distribution pattern after the appearance of the novel influenza A H1N1 (pH1N1) virus in influenza-like illness patients in Peru

Influenza A (H1N1) 2009 two-dose immunization of US children: an observer-blinded, randomized, placebo-controlled trial

Does Seasonal Influenza Vaccination Increase the Risk of Illness with the 2009 A/H1N1 Pandemic Virus?

Seasonal influenza vaccine and protection against pandemic (H1N1) 2009-associated illness among US military personnel

Seasonal influenza vaccine and increased risk of pandemic A/H1N1-related illness: first detection of the association in British Columbia

Association between 2009 seasonal influenza vaccine and influenza-like illness during the 2009 pandemic: preliminary results of a large household transmission study in Western Australia

and pandemic vaccines, to prevent influenza hospitalizations during the autumn 2009 influenza pandemic wave in Castellon, Spain. A test-negative, hospitalbased, case-control study

Flutracking provides a measure of field influenza vaccine effectiveness, Australia

Effectiveness of the 2009 seasonal influenza vaccine against pandemic influenza A(H1N1)2009 in healthcare workers

Protection of trivalent inactivated influenza vaccine against hospitalizations among pandemic influenza A (H1N1) cases in Argentina

Influenza vaccination levels and influenza-like illness in long-term-care facilities for elderly people in Niigata, Japan, during an influenza A (H3N2) epidemic

A prospective, Internet-based study of the effectiveness and safety of influenza vaccination in the 2001-2002 influenza season

Reduced efficiency of influenza vaccine in prevention of influenza-like illness in working adults: a 7 month prospective survey in EDF Gaz de France employees

Inactivated influenza vaccine effectiveness against influenza-like illness among young children in Japan--with special reference to minimizing outcome misclassification

Influenza vaccination among college and university students: impact on influenzalike illness, health care use, and impaired school performance

Does this patient have influenza

The authors wish to thank all the participating general practitioners, Pierre-Yves Boëlle for his help on statistical methodology aspects, Angie Bone for her help with data management and the two anonymous referees for helping improving the manuscript.