ABSTRACT

When assessed, treatment fidelity is most often evaluated by checklists of intervention steps after an observation session, though estimates can vary depending on how intervention steps are operationalized and rated. A more straightforward approach may involve the adoption of direct observation methods such as time sampling or event recording, which are regularly used to evaluate student behavior. This study explores the utility of using time sampling and event recording in comparison to the traditional post-observation checklist method. Five paraeducator consultees’ treatment fidelity of behavior support plans for students with autism was assessed by post-observation ratings. In addition, 15-sec whole-interval recording of treatment fidelity across intervention steps and event recording of prompts (an intervention step for all plans) were collected throughout the observation session. To compare treatment fidelity data, we present visual analysis, associated quantitative metrics, and correlations. Implications for future treatment fidelity assessment research and consultation practice are described.

摘要

在评估时，治疗保真度通常是通过观察会议后的干预步骤清单来评估的，尽管估计值可能会因干预步骤的操作和评级方式而异。更直接的方法可能涉及采用直接观察方法，例如时间采样或事件记录，这些方法经常用于评估学生行为。本研究探讨了使用时间采样和事件记录与传统的观察后检查表方法相比的效用。通过观察后评级评估五名辅助教育者咨询者对自闭症学生行为支持计划的治疗保真度。此外，在整个观察过程中收集了 15 秒全间隔记录的干预步骤的治疗保真度和提示的事件记录（所有计划的干预步骤）。为了比较治疗保真度数据，我们提供了视觉分析、相关的定量指标和相关性。描述了对未来治疗保真度评估研究和咨询实践的影响。