ABSTRACT

Background

Social communication impairments following acquired brain injury (ABI) are well-documented. There is evidence that group interventions are beneficial but research into validated instruments to measure group outcomes is a new field of investigation.

Aims

This study reports on the inter-rater reliability of three established social communication measures for use with group interaction data: the Profile of Pragmatic Impairment in Communication (PPIC), the Behaviorally Referenced Rating System of Intermediate Social Skills (BRISS-R), the Adapted Measure of Participation in Conversation (MPC). Inter-rater reliability of the Interactional Network Tool (INT), a new digital tool designed for group interactional behaviours, is also evaluated.

Method

Thirty-one video samples of ABI group interactions were independently rated by two rater pairs using the four outcome measures. Inter-rater reliability was calculated using intra-class correlations (ICC).

Results

ICC estimates and their 95% confidence intervals were calculated for the different measures. The measures showed differential sensitivity. Rater agreement on the MPC interaction (ICC = 0.77) and transaction (ICC = 0.74) scales was moderate to good. The INT initiation frequencies (ICC = 0.83) were moderate to excellent and the INT response frequencies (ICC = 0.69) were poor to good. Poor to moderate reliability was achieved on the BRISS-R PCSS (ICC = 0.49) and PDBS (ICC = 0.50) scale and PPIC findings were moderate but showed presence of skew.

Conclusion

Acceptable reliability was achieved on two measures of participation (MPC and INT). The INT shows promise as a new method to characterise interactions and detect change in group communication behaviour.

中文翻译：

---

测量获得性脑损伤后的群体社交互动：评估者间的可靠性评估

摘要

背景

获得性脑损伤 (ABI) 后的社交沟通障碍有据可查。有证据表明团体干预是有益的，但研究经过验证的工具来衡量团体结果是一个新的研究领域。

宗旨

本研究报告了与群体互动数据一起使用的三种既定社会沟通措施的评估者间可靠性：沟通中的语用障碍概况 (PPIC)、中级社交技能的行为参考评级系统 (BRISS-R)、对话参与度 (MPC)。还评估了交互网络工具 (INT) 的评估者间可靠性，这是一种为群体交互行为设计的新数字工具。

方法

ABI 组交互的 31 个视频样本由两个评分者对使用四种结果测量独立评分。使用类内相关性 (ICC) 计算评分者间的可靠性。

结果

ICC 估计值及其 95% 置信区间是针对不同测量值计算的。这些措施显示出不同的敏感性。MPC 互动 (ICC = 0.77) 和交易 (ICC = 0.74) 量表上的评分者协议中等至良好。INT 起始频率 (ICC = 0.83) 为中等至极好，INT 响应频率 (ICC = 0.69) 为差至好。BRISS-R PCSS (ICC = 0.49) 和 PDBS (ICC = 0.50) 量表的可靠性较差至中等，PPIC 结果中等但显示存在偏差。

结论

在两种参与措施（MPC 和 INT）上实现了可接受的可靠性。INT 显示出作为表征交互和检测群体交流行为变化的新方法的前景。