ABSTRACT

This paper covers considerations in using criterion measures based on administrative data. We begin with a conceptual framework for understanding and evaluating administrative criterion measures as “objective” rather than (ratings-based) assessments of job performance. We then describe the associated advantages (e.g., availability) and disadvantages (e.g., contamination) of using administrative data for criterion-related validation purposes. Best practices in the use of administrative data for validation purposes, including procedures for (a) handling missing data, (b) performing data checks, and (c) reporting detailed decision rules so future researchers can replicate the analyses are also described. Finally, we discuss “modern data management” approaches for improving administrative data for supporting organizational decision-making.

 抽象的

本文涵盖了使用基于行政数据的标准措施的注意事项。我们从一个概念框架开始，用于理解和评估行政标准措施作为“客观”而不是（基于评级的）工作绩效评估。然后，我们描述了使用管理数据进行与标准相关的验证目的的相关优点（例如，可用性）和缺点（例如，污染）。还描述了使用管理数据进行验证的最佳实践，包括 (a) 处理缺失数据、(b) 执行数据检查和 (c) 报告详细决策规则以便未来研究人员可以重复分析的程序。最后，我们讨论了用于改进管理数据以支持组织决策的“现代数据管理”方法。