Supervision seems to be an essential part of therapist training and thus also of implementing evidence-based practices. However, there is a shortage of valid and reliable instruments for objective assessment of supervision competence that include both global measures and frequency counts of behaviour—two essential aspects of supervisory competence. This study tests the internal consistency and inter-rater reliability of an assessment tool that includes both these measures. Additionally, strategies and techniques used by 10 supervisors in 35 Motivational interviewing supervision sessions are described. Codings were conducted after two separate coding training sessions. The internal consistency across the global measures was acceptable (α = 0.70; 0.71). After the second training, the inter-rater reliabilities for all frequency counts were in the moderate to good range, except for two that were in the poor range; inter-rater reliability for one of the four global measures was in the moderate range, and three were in the poor range. A prerequisite for identifying specific supervisor skills central to the development of therapist skills, teaching these skills to supervisors and performing quality assurance of supervision, is to create instruments that can measure these behaviours. This study is a step in that direction.

中文翻译：

---

一种基于行为的编码工具，用于评估主管的依从性和能力：动机访谈实施研究的结果

监督似乎是治疗师培训的重要组成部分，因此也是实施循证实践的重要组成部分。然而，缺乏有效和可靠的工具来客观评估监管能力，包括全球措施和行为频率计数——监管能力的两个基本方面。本研究测试了包含这两项措施的评估工具的内部一致性和评分者间可靠性。此外，还描述了 10 位主管在 35 次动机性访谈监督会议中使用的策略和技巧。在两次单独的编码培训课程后进行编码。全球措施的内部一致性是可以接受的（α = 0.70; 0.71）。第二次训练后，所有频率计数的评分者间可靠性都在中等到良好的范围内，除了两个处于较差范围内；四项全球措施之一的评分者间信度处于中等范围，三项处于较差范围。确定对治疗师技能发展至关重要的特定督导技能、向督导教授这些技能并执行督导质量保证的先决条件是创建可以衡量这些行为的工具。这项研究是朝着这个方向迈出的一步。