Inattention or reluctance? Parental responses to vaccination reminder letters

https://doi.org/10.1016/j.jhealeco.2021.102439Get rights and content

Abstract

This paper studies non-adherence in the Danish Childhood Vaccination Program using a nationwide introduction of a vaccination reminder letter policy and administrative data from 2011–2017. First, I provide causal estimates of how the reminder letter policy affects vaccination adherence using a Regression Discontinuity Design (RDD). Second, I link parental responses to the reminder letter to parents’ causes for being non-adherent. I find that the reminder letter policy positively affects adherence. However, 72% of non-adherent parents are non-responsive to the reminder letter indicating that reluctance and not inattention is the leading cause for non-adherence. Thus, other policies beyond reminder letters – such as mandatory vaccination laws – are necessary to substantially increase vaccination coverage.

Introduction

Socio-economic differences in child and later-life health are well-documented (Case et al., 2002, Mackenbach et al., 2008, Chetty et al., 2016, Kreiner et al., 2018) but our understanding of their origins remains limited. One suggested explanation is differences in parental investments and health behavior. This paper addresses an important part of preventive health behavior by studying non-adherence in the free of charge and voluntary Danish Childhood Vaccination Program.

Non-adherence in vaccination programs in developed countries poses a major challenge for public health (Black and Rappuoli, 2010, Shetty, 2010) and scepticism concerning vaccinations is becoming more widespread although scientific evidence strongly documents the importance and safety of existing vaccinations (Centers for Disease Control and Prevention, 1999, Offit et al., 2002, Elliman and Bedford, 2003, Stern and Markel, 2005). Thus, knowledge about the differential causes for vaccination non-adherence is of crucial importance in order to increase coverage rates and understand and mitigate inequalities in health behaviors.

This paper studies the effects of a reminder letter policy on subsequent vaccination behavior, sibling spill-overs and participation in other parts of the preventive care system beyond the vaccination program. To assess the driving forces of vaccination non-adherence, I propose a decomposition into shares of responsive, non-responsive and delaying parents based on their reaction to the reminder letter and provide a framework that links parental responses to the reminder letter to causes for non-adherence.1

I exploit a national reform, which introduced a vaccination reminder letter policy on May 15, 2014, in a sharp Regression Discontinuity Design (RDD) to estimate the causal effects of the policy. Parents with a child registered as lacking at least one scheduled vaccination at age 2 receive a reminder letter. The letter only informs parents that their child has not received all recommended vaccinations and highlights that vaccinations are voluntary. I provide evidence for the validity of the design by showing that a wide range of pre-determined covariates are well-balanced and that there is no bunching across the cut-off. Moreover, the results are robust to bandwidth selection, estimation method and pass various placebo tests.

I find that the reminder letter policy increases adherence by 50% for non-adherent children a year after receiving the reminder letter. The response is immediate as only vaccination behavior in the quarter following the intervention is affected. The timing of the response suggests that the reminder letter mainly affects inattentive parents. The resulting coverage rates show that the reminder letter policy pushes the rate above the minimum herd immunity threshold for measles but falls short for pertussis (whooping cough). Furthermore, I estimate positive effects of the reminder letter on participation in a GP preventive care program but no spill-overs on participation in later vaccination rounds. I detect negative sibling spill-overs suggesting a cost of information as parents postpone vaccinations knowing they will be reminded.

Using my estimates, I decompose the group of parents of non-adherent children at age 2. I find that 8.7% are responsive, while 19.2% and 72.1% are delayers and non-responsive, respectively. Moreover, by evaluating heterogeneity, I discover that responsiveness to the reminder letter is stronger among not first-time parents, parents with an education in a health- or childcare-related field, parents of children with unproblematic births and parents without a university degree. The finding, that parents with an education in a health- or childcare-related field are non-responsive to the reminder letter, indicates that responsive parents were non-adherent due to inattention. Furthermore, as responsive parents have lower education levels, the reminder letter policy reduces socio-economic differences in vaccination adherence. Finally, a simple comparison of the effect on adherence and the cost of the policy shows that the vaccination reminder letter policy costs an estimated 1246 DKK (166 EUR) per additional fully-vaccinated child.

The paper contributes twofold to the understanding of vaccination adherence. First, I extend the literature on the impact of recall systems and reminder letter policies. While research on pro-vaccination campaigns finds modest to no effect (Leader et al., 2009, Chanel et al., 2011, Sadaf et al., 2013, Nyhan et al., 2014, Dubé et al., 2015, Buttenheim et al., 2016, Baskin, 2018),2 studies highlight that reminders and recall systems improve coverage in a wide variety of contexts (Vann and Szilagyi, 2005, Harvey et al., 2015). Closely related, Suppli et al., 2017, Suppli et al., 2018 evaluate the effects of the reminder letter policy in Denmark using the same natural experiment in a before-after strategy. They use a before-sample one year prior to the intervention and an after-sample one year post the intervention. They find that during a 6-month follow-up period 2264 more vaccinations are administered to children in the treatment group. I extend their analysis of the impact of the reminder letter policy in four distinct ways: (i) I address causality more rigorously by dealing with time trends and seasonality in a RDD, (ii) I relate the impact on adherence to herd immunity thresholds, (iii) I study other types of preventive care participation beyond the vaccination program and (iv) I test for persistent effects by studying younger siblings of the treated children.

Second, I provide evidence on the factors influencing vaccination non-adherence. Existing evidence has identified factors such as parents’ perception of infections and side-effects risks, religion, ideology and social pressure (Tickner et al., 2006, Grabenstein, 2013, Wombwell et al., 2015, Larson et al., 2016, Amin et al., 2017, Karing, 2018). Recently, a growing literature highlights misinformation as a major factor causing parents to opt out of vaccination programs (Anderberg et al., 2011, Chang, 2018, Hansen and Schmidtblaicher, 2019, Carrieri et al., 2019, Gørtz et al., 2020, Qian et al., 2020).3 The economic literature furthermore shows the difficulties in reaching full coverage due to free-riding (Philipson, 1996, Geoffard and Philipson, 1997, Oster, 2018): When a substantial share of the population is covered, the immunized individuals not only protect themselves but also lend protection to individuals without vaccinations. Consequently, the private benefit of vaccinations might be low in a society with relatively high coverage rates. My results indicate that reluctance is a leading cause for non-adherence in this setting and that other policies (beyond reminder letters) are necessary to substantially increase vaccination coverage (preferably after identifying the reasons for reluctance).

The paper proceed as follows: In Section 2, I provide background on The Danish Childhood Vaccination Program and describe the introduction and purpose of the policy. Section 3 covers my empirical strategy. Section 4 describes data and descriptive statistics. Section 5 presents results and section 6 performs a simple cost-effectiveness analysis. Finally, Section 7 concludes.

Section snippets

The Danish childhood vaccination program

Introduced in 1951 as a reaction to frequent epidemics and the discoveries of several vaccinations, the Danish Childhood Vaccination Program initially offered vaccinations against diphtheria, tetanus (lockjaw), smallpox and tuberculosis. In the following decades, the program underwent changes in response to epidemics and medical innovations.4

Identification strategy: impact of the reminder letter policy on adherence

To identify the causal effects of the reminder letter policy, I rely on the reform date in a Regression Discontinuity Design (RDD). Non-adherent parents of children with date of births prior to May 15 receive no reminder letter while parents of children with date of births at and after May 15 do. The introduction of the policy creates a sharp discontinuity in treatment assignment,8

Data and sample

I use administrative data from Statistics Denmark.11 My sample includes the universe of children turning 2 years in a 180-day window at either side of the cut-off (May 15, 2014); from November 17, 2013 to November 11, 2014. I observe parental characteristics: employment history, educational attainment, income, age, marital

Validation of empirical strategy

Appendix Figure A2 shows the density of children in the sample around the cut-off. The figure shows the total number of non-adherent children in the Danish Childhood Vaccination Program at age 2 within 40 equal-sized bins (five days in each bin and 180-day bandwidth). There is no visible bunching of children just below or above the cut-off. To formally test parents ability to systematically manipulate the selection variable, I perform a McCrary density test (McCrary, 2008). Appendix Figure A3

Cost and effect of the reminder letter policy

In this section, I compare the cost to the effect on vaccination coverage of the vaccination reminder letter policy. As a measure of the cost of the national reminder letter policy, I rely on the estimated annual additional cost associated with the policy put forth by the government at one million DKK (133,333 EUR). The one million DKK covered development of the program as well as operational costs. Further, more doses of vaccinations were required after the policy. Doses of the vaccinations

Conclusion

This paper studies parental responses to a vaccination reminder letter policy in the Danish Childhood Vaccination Program. I use the timing of the policy in a Regression Discontinuity Design to estimate the causal effects of the policy. The reminder letter brings attention to parents’ failure to adhere with the Danish Childhood Vaccination Program without changing their preferences towards vaccinations. Furthermore, I provide an interpretation of parental responses to reminder letters into

Conflict of interest

The authors declare no conflict of interest.

References (74)

  • G.W. Imbens et al.

    Regression discontinuity designs: a guide to practice

    J. Econom.

    (2008)
  • H.J. Larson et al.

    The state of vaccine confidence 2016: global insights through a 67-country survey

    EBioMedicine

    (2016)
  • T. May et al.

    ‘clustering of exemptions’ as a collective action threat to herd immunity

    Vaccine

    (2003)
  • J. McCrary

    Manipulation of the running variable in the regression discontinuity design: a density test

    J. Econom.

    (2008)
  • E. Oster

    Does disease cause vaccination? Disease outbreaks and vaccination response

    J. Health Econ.

    (2018)
  • M. Qian et al.

    Confirmatory bias in health decisions: evidence from the mmr-autism controversy

    J. Health Econ.

    (2020)
  • A. Sadaf et al.

    A systematic review of interventions for reducing parental vaccine refusal and vaccine hesitancy

    Vaccine

    (2013)
  • P. Shetty

    Experts concerned about vaccination backlash

    Lancet

    (2010)
  • C.H. Suppli et al.

    Sociodemographic predictors are associated with compliance to a vaccination-reminder in 9692 girls age 14 Denmark 2014–2015

    Prev. Med. Rep.

    (2018)
  • B. Taylor et al.

    Autism and measles, mumps, and rubella vaccine: no epidemiological evidence for a causal association

    Lancet

    (1999)
  • S. Tickner et al.

    Factors underlying suboptimal childhood immunisation

    Vaccine

    (2006)
  • A. Wakefield et al.

    Retracted: ileal-lymphoid-nodular hyperplasia, non-specific colitis, and pervasive developmental disorder in children

    Lancet

    (1998)
  • O.P. Wójcik et al.

    Validation of the 5-year tetanus, diphtheria, pertussis and polio booster vaccination in the Danish childhood vaccination database

    Vaccine

    (2013)
  • H. Al-Janabi et al.

    A framework for including family health spillovers in economic evaluation

    Med. Decis. Mak.

    (2016)
  • A.B. Amin et al.

    Association of moral values with vaccine hesitancy

    Nat. Hum. Behav.

    (2017)
  • E. Baskin

    Increasing influenza vaccination rates via low cost messaging interventions

    PLOS ONE

    (2018)
  • S. Black et al.

    A crisis of public confidence in vaccines

    Sci. Transl. Med.

    (2010)
  • S.E. Black et al.

    The more the merrier? the effect of family size and birth order on children’s education

    Q. J. Econ.

    (2005)
  • K.S. Buckles et al.

    Season of birth and later outcomes: old questions new answers

    Rev. Econ. Stat.

    (2013)
  • V. Carrieri et al.

    Vaccine Hesitancy and Fake News: Quasi-Experimental Evidence from Italy

    (2019)
  • A. Case et al.

    Economic status and health in childhood: the origins of the gradient

    Am. Econ. Rev.

    (2002)
  • Centers for Disease Control and Prevention 1999

    Ten great public health achievements-united states, 1900–1999 MMWR

    Morb. Mortal. Wkly. Rep.

    (1999)
  • L.V. Chang

    Information, education, and health behaviors: evidence from the mmr vaccine autism controversy

    Health Econ.

    (2018)
  • R. Chetty et al.

    Salience and taxation: theory and evidence

    Am. Econ. Rev.

    (2009)
  • R. Chetty et al.

    The association between income and life expectancy in the United States, 2001–2014

    JAMA

    (2016)
  • J. Currie et al.

    Within-mother analysis of seasonal patterns in health at birth

    Proc. Natl. Acad. Sci. USA

    (2013)
  • T. Dalby et al.

    Epi-News no 28/33: High Incidence of Whooping Cough

    (2019)
  • Cited by (0)

    I gratefully acknowledge financial support from the Innovation Foundation Denmark grant 5155-00001B (The Innovation Foundation Denmark had no involvement in the study). I thank Miriam Wüst and Mette Gørtz for valuable comments. I thank seminar participants at The Danish Center for Social Science Research (VIVE), the PhD Seminar at the University of Copenhagen, the Department of Paediatrics at Herlev Hospital, the 2019 European Society for Population Economics (ESPE) conference at the University of Bath, the Danish Graduate Program in Economics (DGPE) workshop 2019 and the 2019 Health Economics Workshop at the University of Copenhagen for helpful comments.

    View full text