Background: In aphasia research, to improve a study's reliability, the aphasia journals compel their authors to report fidelity. Aphasia researchers are mostly concerned about Type I and Type II errors to maintain the level of confidence. However, the third type (Type III error) can significantly affect the study outcomes and question the research fidelity. Objective: This study explains the methodology of how investigators maintained research fidelity in the context of hiring and training remote data collectors and conducted a multi-site data collection. Methods: The present study used a descriptive analysis design to explicate the three-step process of remote data collection: (1) remotely selecting and training data collectors, (2) remotely supervising data collection and data management, and (3) optimizing and monitoring screening/assessment fidelity. At the initial step, investigators interviewed seven candidates and short-listed four of them, who were trained using a standard training protocol and participated in a mock data collection. For the next two steps, data collectors video-recorded each study session and e-shared the data with the investigator, who watched all the video-recordings and provided necessary feedback with a focus on the screening sections. The screenings were a part of the inclusion-exclusion criteria. Results: Two data collectors (both clinical psychologists) with the highest scores were selected and received final training. One-to-one e-supervision by the investigator resulted in significant improvement in data collectors' performance. Only 4% of the total collected sample size was excluded, and 99 participants' data were analyzed. Conclusion: The present study adds information on maintaining research fidelity for remote data collection, where limited studies exist.


中文翻译：

---

保持研究忠诚度：失语症研究中临床助理的远程培训和监控


背景：在失语症研究中，为了提高研究的可靠性，失语症期刊强制其作者报告忠实度。失语症研究人员主要关注 I 型和 II 型错误以保持信心水平。然而，第三种类型（III 型错误）会显着影响研究结果并质疑研究的真实性。目的：本研究解释了调查人员如何在雇用和培训远程数据收集者的背景下保持研究忠实度并进行多站点数据收集的方法。方法：本研究采用描述性分析设计来阐述远程数据采集的三步过程：（1）远程选择和培训数据采集者，（2）远程监督数据采集和数据管理，（3）优化和监控筛选/评估保真度。在最初的步骤中，调查人员采访了七名候选人，并从中选出了四名候选人，他们使用标准培训协议进行培训，并参与了模拟数据收集。在接下来的两个步骤中，数据收集者对每个研究会话进行视频录制，并与调查人员通过电子方式共享数据，调查人员观看所有视频记录并提供必要的反馈，重点关注筛选部分。筛查是纳入排除标准的一部分。结果：选择得分最高的两名数据收集者（均为临床心理学家）并接受最终培训。调查员的一对一电子监督显着提高了数据收集者的绩效。仅排除了总收集样本量的 4%，并分析了 99 名参与者的数据。结论：本研究增加了关于保持远程数据收集的研究保真度的信息，其中存在有限的研究。