key: cord-0943307-d9b814yp
authors: Haas, Julia W.; Bender, Friederike L.; Ballou, Sarah; Kelley, John M.; Wilhelm, Marcel; Miller, Franklin G.; Rief, Winfried; Kaptchuk, Ted J.
title: Frequency of Adverse Events in the Placebo Arms of COVID-19 Vaccine Trials: A Systematic Review and Meta-analysis
date: 2022-01-18
journal: JAMA Netw Open
DOI: 10.1001/jamanetworkopen.2021.43955
sha: 0761fef5709a327fdfbf05d6c38900b145a7fc80
doc_id: 943307
cord_uid: d9b814yp

IMPORTANCE: Adverse events (AEs) after placebo treatment are common in randomized clinical drug trials. Systematic evidence regarding these nocebo responses in vaccine trials is important for COVID-19 vaccination worldwide especially because concern about AEs is reported to be a reason for vaccination hesitancy. OBJECTIVE: To compare the frequencies of AEs reported in the placebo groups of COVID-19 vaccine trials with those reported in the vaccine groups. DATA SOURCES: For this systematic review and meta-analysis, the Medline (PubMed) and Cochrane Central Register of Controlled Trials (CENTRAL) databases were searched systematically using medical subheading terms and free-text keywords for trials of COVID-19 vaccines published up to July 14, 2021. STUDY SELECTION: Randomized clinical trials of COVID-19 vaccines that investigated adults aged 16 years or older were selected if they assessed solicited AEs within 7 days of injection, included an inert placebo arm, and provided AE reports for both the vaccine and placebo groups separately. Full texts were reviewed for eligibility by 2 independent reviewers. DATA EXTRACTION AND SYNTHESIS: Data extraction and quality assessment were performed independently by 2 reviewers, adhering to the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guideline and using the Cochrane risk-of-bias tool. Meta-analyses were based on random-effects models. MAIN OUTCOMES AND MEASURES: The primary outcomes were the proportions of placebo recipients reporting overall, systemic, and local (injection-site) AEs as well as logarithmic odds ratios (ORs) to evaluate group differences. Outcomes were tested for significance using z tests with 95% CIs. RESULTS: Twelve articles with AE reports for 45 380 participants (22 578 placebo recipients and 22 802 vaccine recipients) were analyzed. After the first dose, 35.2% (95% CI, 26.7%-43.7%) of placebo recipients experienced systemic AEs, with headache (19.3%; 95% CI, 13.6%-25.1%) and fatigue (16.7%; 95% CI, 9.8%-23.6%) being most common. After the second dose, 31.8% (95% CI, 28.7%-35.0%) of placebo recipients reported systemic AEs. The ratio between placebo and vaccine arms showed that nocebo responses accounted for 76.0% of systemic AEs after the first COVID-19 vaccine dose and for 51.8% after the second dose. Significantly more vaccine recipients reported AEs, but the group difference for systemic AEs was small after the first dose (OR, −0.47; 95% CI, −0.54 to −0.40; P < .001; standardized mean difference, −0.26; 95% CI, −0.30 to −0.22) and large after the second dose (OR, −1.36; 95% CI, −1.86 to −0.86; P < .001; standardized mean difference, −0.75; 95% CI, −1.03 to −0.47). CONCLUSIONS AND RELEVANCE: In this systematic review and meta-analysis, significantly more AEs were reported in vaccine groups compared with placebo groups, but the rates of reported AEs in the placebo arms were still substantial. Public vaccination programs should consider these high rates of AEs in placebo arms.

A systematic literature search of studies published up to July 14, 2021 was conducted across the Medline database (PubMed) and the Cochrane Central Register of Controlled Trials (CENTRAL) . As a first step, these databases were searched for Medical Sub Heading (Mesh) terms ("COVID-19 Vaccines" [Mesh] AND "Randomized Controlled Trial" [Publication Type]). In addition, a free text search was conducted using the following keywords: (89) 27 (14) 168 (84) 16 (8) 170 (85) 21 (11) 166 (83) 15 (8) (47) 1 (2) 13 (27) 1 (2) 7 (15) 0 (0) 10 (21) (9) 14 (2) 26 (3) 181 (19) 304 (32) 114 (12) 158 (17) NA NA NA NA 115 (12) 215 (23) 70 (7) 95 (10) 137 (14) 290 (30) 79 (8) 153 (17) 250 (26) (21) 223 (17) 130 (10) 158 (12) 123 (9) 66 (5) 90 (7) 68 (5) 192 (14) 304 (22) 130 (10) 290 (21) 334 (24) 239 (18) 73 (5) −0.28 0.08 −3.30 < .001 −0.44 −0.11 0.00 7 −0.15 Note. AE = adverse event; log OR = logarithmic odds ratio; SE = standard error; CI = confidence interval; d = standard mean difference. Analyses control for risk of bias due to selective reporting (no AE reports over both doses or time interval of AE assessment > 7 days), incomplete outcome data (high drop-out rate in placebo group) and other source of bias (inclusion of sentinel participants in AE reports). 1 95 % CI 0.00-49.22; 2 95 % CI 0.00-98.98; 3 95 % CI 0.00-0.00; 4 95 % CI 0.00-94.99; 5 95 % CI 0.00-97.30; 6 95 % CI 0.00-85.35; 7 95 % CI 0.00-97.52. eFigure 2. Adverse event severity grading in the phase-3 trial of the Novavax vaccine (Heath et al., 2021) . Plots show fractions of severity grades within participants who reported any adverse events (A), any systemic adverse event (B) or any local adverse event (C). Grade 1 = mild, grade 2 = moderate, grade 3 = severe, grade 4 = life-threatening.

Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine

A preliminary report of a randomized controlled phase 2 trial of the safety and immunogenicity of mRNA-1273 SARS-CoV-2 vaccine

Safety and immunogenicity of SARS-CoV-2 recombinant protein vaccine formulations in healthy adults: interim results of a randomised , placebo-controlled , phase 1 -2 , dose-ranging study. The Lancet Infectious Diseases

Safety and Efficacy of NVX-CoV2373 Covid-19 Vaccine

Phase 1-2 Trial of a SARS-CoV-2 Recombinant Spike Protein Nanoparticle Vaccine

Safety and immunogenicity of the SARS-CoV-2 BNT162b1 mRNA vaccine in younger and older Chinese adults: a randomized, placebo-controlled, doubleblind phase 1 study

Efficacy of the ChAdOx1 nCoV-19 Covid-19 Vaccine against the B.1.351 Variant

Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine

Safety and immunogenicity of S-Trimer (SCB-2019), a protein subunit vaccine candidate for COVID-19 in healthy adults: a phase 1, randomised, double-blind, placebo-controlled trial

Interim Results of a Phase 1-2a Trial of Ad26.COV2.S Covid-19 Vaccine

Efficacy of NVX-CoV2373 Covid-19 Vaccine against the B.1.351 Variant

Safety and Immunogenicity of Two RNA-Based Covid-19 Vaccine Candidates