ABSTRACT The Performance Diagnostic Checklist-Human Services (PDC-HS) is primarily an informant-based assessment tool designed to help consultants identify variables contributing to problematic employee performance and formatted specifically for use in human service settings. In an evaluation of the tool’s validity and reliability, a previous study used a series of video vignettes to simulate a consultant using the PDC-HS to troubleshoot performance problems; participants scored each video twice, providing measures of validity, test–retest reliability, and interrater reliability. Although the results suggested that the PDC-HS was valid and reliable, the vignettes may have lacked external validity. In the current study, we replicated and extended previous research to include video-based scenarios from actual consultant interviews using the PDC-HS. Twenty-one participants scored three videos, each with a different set and number of domains indicated for intervention. Approximately one month later, participants scored the same videos to assess test–retest reliability. Results suggest that participants were largely able to identify the problematic PDC-HS domains and that the tool was generally reliable, although scores were somewhat lower than those reported by in previous research. Results also suggest that the tool is most effectively implemented by a consultant with at least some background in behavior analysis.

中文翻译：

---

性能诊断清单的有效性和可靠性的进一步评估 - 人类服务

摘要 绩效诊断清单 - 人类服务 (PDC-HS) 主要是一种基于线人的评估工具，旨在帮助顾问识别导致问题员工绩效的变量，并专门为在人类服务环境中使用而格式化。在评估该工具的有效性和可靠性时，之前的一项研究使用一系列视频小插曲来模拟使用 PDC-HS 解决性能问题的顾问；参与者对每个视频进行两次评分，提供效度、重测信度和测试者信度的衡量标准。尽管结果表明 PDC-HS 是有效和可靠的，但这些小插曲可能缺乏外部有效性。在当前的研究中，我们复制并扩展了先前的研究，以包括使用 PDC-HS 的实际顾问访谈中的基于视频的场景。21 名参与者对三个视​​频进行了评分，每个视频都有不同的一组和数量的域指示进行干预。大约一个月后，参与者对相同的视频进行评分，以评估重测信度。结果表明，参与者在很大程度上能够识别有问题的 PDC-HS 域，并且该工具总体上是可靠的，尽管分数略低于先前研究报告的分数。结果还表明，该工具由至少具有一些行为分析背景的顾问最有效地实施。结果表明，参与者在很大程度上能够识别有问题的 PDC-HS 域，并且该工具总体上是可靠的，尽管分数略低于先前研究报告的分数。结果还表明，该工具由至少具有一些行为分析背景的顾问最有效地实施。结果表明，参与者在很大程度上能够识别有问题的 PDC-HS 域，并且该工具总体上是可靠的，尽管分数略低于先前研究报告的分数。结果还表明，该工具由至少具有一些行为分析背景的顾问最有效地实施。