Background: This article reports on the Future to Discover Project—a Canadian randomized controlled trial of two high school interventions—where data on key postsecondary enrollment outcomes were collected for two phases. During the initial phase, outcomes were recorded from administrative data and follow-up surveys. During the later phase, data came from administrative records only. Objectives: The article provides analyses that are informative about the consequences of a change from administrative-only data to survey-only data (and vice versa) for the estimation of impacts. Results: The change from administrative-only to survey-only data tended to produce apparent drops in postsecondary enrollment rates that varied by subgroup and education outcome. Nonetheless, levels and significance of impact with respect to postsecondary enrollment remained relatively stable. Conclusions: The findings of the article provide evidence that estimating education program impacts in the context of a randomized experiment can be relatively robust to the data sources chosen. They suggest that internal validity and conclusions for policy need not be affected by changing data sources even when the change produces marked changes in levels of the outcome of interest observed.

中文翻译：

---

影响估计对所用数据源的敏感性：从访问中学后教育实验的分析。

背景：本文报道了“未来发现项目”（一项加拿大对两项高中干预措施的随机对照试验）的研究，该项目从两个阶段收集了关于中学毕业后主要学习成果的数据。在初始阶段，从管理数据和后续调查中记录结果。在后面的阶段中，数据仅来自管理记录。目标：本文提供了一些分析，这些分析对于从仅管理数据更改为仅调查数据（反之亦然）对影响的估计的后果提供了有益的信息。结果：从仅行政管理数据到仅调查数据的变化倾向于使中学后入学率明显下降，其入学率因亚组和教育结果而异。尽管如此，中学入学率的影响水平和重要性保持相对稳定。结论：本文的发现提供了证据，证明在随机实验的情况下评估教育计划的影响对选择的数据源可能相对稳健。他们认为，即使变更产生了观察结果的显着变化，数据源也不会受到内部有效性和政策结论的影响。