Mitigating bias in observational vaccine effectiveness studies using simulated comparator populations: Application to rotavirus vaccination in the UK

Daniel Hungerford*, Roberto Vivancos, Jonathan M. Read, Laura J. Bonnett, Naor Bar-Zeev, Miren Iturriza-Go'Mara, Nigel A. Cunliffe, Neil French

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)

Abstract

Background: Measuring vaccine effectiveness (VE) relies on the use of observational study designs. However, achieving robust estimates of direct and indirect VE is frequently compromised by bias, particularly when using syndromic diagnoses of low-specificity. Methods: In order to mitigate confounding between the measured outcome and vaccine uptake, we developed a method to balance comparator populations using individual-level propensity scoring derived from the vaccine-exposed population, and applied it to the unexposed comparator population. Indirect VE was estimated by comparing the unvaccinated vaccine-exposed group with a propensity score-simulated unvaccinated, unexposed group. Direct VE was derived by removing indirect VE from the overall VE. We applied this method to an evaluation of the effectiveness of infant rotavirus vaccination in the UK. Using a general practice cohort of 45,259 live births between May 2010 and December 2015, we calculated indirect and direct VE against consultations for acute gastroenteritis using conventional and vaccination-propensity adjustment comparator populations. Results: The overall VE during the rotavirus-season (January-May) calculated using mixed-effects Cox regression was 30% [95% confidence intervals (95% CI: 25,35%)]. Use of conventional comparator populations resulted in implausible VE estimates −14% (95% CI: −41,7%) for direct and 29% (95% CI: 14,42%) for indirect effects. Applying our alternative method, direct VE was 26% (95% CI: 1,45%) and indirect VE was 8% (95% CI: −19,29%). Conclusions: Estimating VE using propensity score simulated comparator populations, particularly for studies using routine health data with syndromic, low-specificity endpoints will aid accurate measurement of the broader public health impact of a vaccine programme.

Original languageEnglish
Pages (from-to)6674-6682
Number of pages9
JournalVaccine
Volume36
Issue number45
DOIs
Publication statusPublished - 29 Oct 2018

Bibliographical note

Funding Information:
The work was supported by the University of Liverpool. R.V. receives a salary contribution from NIHR Health Protection Research Unit in Emerging and Zoonotic Infections and R.V. and M.I.G. also receive salary contributions from the NIHR Health Protection Research Unit in Gastrointestinal Infections. J.M.R acknowledges support from the EPSRC Liverpool Centre for Mathematics in Healthcare [EP/N014499/1]. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, the Department of Health or Public Health England.

Funding Information:
The work was supported by the University of Liverpool. R.V. receives a salary contribution from NIHR Health Protection Research Unit in Emerging and Zoonotic Infections and R.V. and M.I.G. also receive salary contributions from the NIHR Health Protection Research Unit in Gastrointestinal Infections . J.M.R acknowledges support from the EPSRC Liverpool Centre for Mathematics in Healthcare [EP/N014499/1]. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR, the Department of Health or Public Health England.

Funding Information:
N.C, N.F, M.I.G, R.V, N.B-Z and D.H are in receipt of research grant support from GlaxoSmithKline (GSK) Biologicals; M.I.G and D.H are in receipt of research grant support from Sanofi Pasteur, and Merck & Co., Inc. (Kenilworth, NJ USA) after the closure of Sanofi Pasteur-MSD in December 2016; and, N.C has received honoraria for participation in GSK Rotavirus Vaccine Advisory Board Meetings. All other authors report no potential conflicts.

Publisher Copyright:
© 2018 The Authors

Keywords

  • Bias
  • Epidemiologic methods
  • Gastroenteritis
  • Propensity score
  • Rotavirus vaccines
  • Vaccine effectiveness

Fingerprint

Dive into the research topics of 'Mitigating bias in observational vaccine effectiveness studies using simulated comparator populations: Application to rotavirus vaccination in the UK'. Together they form a unique fingerprint.

Cite this