Fidelity is conceptualized as a key mechanism impacting treatment outcomes, yet community examination of fidelity is limited, partly due to limited feasible training methods and tools. Provider-report tools represent a feasible method for improving routine fidelity monitoring. Additional work examining the effectiveness of these methods and concordance with other fidelity sources is needed. Further, provider and client factors impact both intervention implementation and concordance, but their impact on fidelity measurement is poorly understood. Using a train-the-trainer methodology, we examine concordance between three methods of assessing fidelity (trained independent coders, supervisor evaluation and provider self-report) using a fidelity assessment tool adapted for community use. Multilevel models examined predictors (provider- and child-level factors) and outcomes (provider average fidelity) of concordance. Results suggest supervisors and providers are able to use the fidelity tool, but demonstrated variable concordance, with higher concordance with trained coders for supervisors than providers. Provider credentials and child language were marginally predictive of rater concordance. Higher supervisor accuracy was associated with higher provider fidelity. Findings inform broader efforts to improve the development and implementation of feasible fidelity tools for routine use in community settings and highlight multi-level factors impacting the adoption and implementation of such tools.

保真度被概念化为影响治疗结果的关键机制，但社区对保真度的检查有限，部分原因是可行的培训方法和工具有限。提供者报告工具代表了一种改进日常保真度监控的可行方法。需要进行额外的工作来检查这些方法的有效性以及与其他保真度来源的一致性。此外，提供者和客户因素会影响干预措施的实施和一致性，但人们对它们对保真度测量的影响却知之甚少。使用培训师培训方法，我们使用适合社区使用的保真度评估工具检查三种评估保真度的方法（训练有素的独立编码员、主管评估和提供者自我报告）之间的一致性。多级模型检查了一致性的预测变量（提供者和儿童级别的因素）和结果（提供者平均保真度）。结果表明主管和提供者能够使用保真度工具，但显示出可变的一致性，与受过训练的主管编码员的一致性高于提供者。提供者证书和儿童语言对评分者的一致性有轻微的预测作用。更高的监督准确性与更高的提供者保真度相关。调查结果为改进社区环境中常规使用的可行保真工具的开发和实施提供了更广泛的努力，并强调了影响这些工具的采用和实施的多层次因素。但表现出可变的一致性，与受过训练的主管编码员的一致性高于提供者。提供者证书和儿童语言对评分者的一致性有轻微的预测作用。更高的监督准确性与更高的提供者保真度相关。调查结果为改进社区环境中常规使用的可行保真工具的开发和实施提供了更广泛的努力，并强调了影响这些工具的采用和实施的多层次因素。但表现出可变的一致性，与受过训练的主管编码员的一致性高于提供者。提供者证书和儿童语言对评分者的一致性有轻微的预测作用。更高的监督准确性与更高的提供者保真度相关。调查结果为改进社区环境中常规使用的可行保真工具的开发和实施提供了更广泛的努力，并强调了影响这些工具的采用和实施的多层次因素。