当前位置: X-MOL 学术npj Digit. Med. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Assessing the accuracy of automatic speech recognition for psychotherapy.
npj Digital Medicine ( IF 12.4 ) Pub Date : 2020-06-03 , DOI: 10.1038/s41746-020-0285-8
Adam S Miner 1, 2, 3 , Albert Haque 4 , Jason A Fries 3 , Scott L Fleming 5 , Denise E Wilfley 6 , G Terence Wilson 7 , Arnold Milstein 8 , Dan Jurafsky 4, 9 , Bruce A Arnow 1 , W Stewart Agras 1 , Li Fei-Fei 4 , Nigam H Shah 3
Affiliation  

Accurate transcription of audio recordings in psychotherapy would improve therapy effectiveness, clinician training, and safety monitoring. Although automatic speech recognition software is commercially available, its accuracy in mental health settings has not been well described. It is unclear which metrics and thresholds are appropriate for different clinical use cases, which may range from population descriptions to individual safety monitoring. Here we show that automatic speech recognition is feasible in psychotherapy, but further improvements in accuracy are needed before widespread use. Our HIPAA-compliant automatic speech recognition system demonstrated a transcription word error rate of 25%. For depression-related utterances, sensitivity was 80% and positive predictive value was 83%. For clinician-identified harm-related sentences, the word error rate was 34%. These results suggest that automatic speech recognition may support understanding of language patterns and subgroup variation in existing treatments but may not be ready for individual-level safety surveillance.



中文翻译:


评估心理治疗自动语音识别的准确性。



心理治疗中录音的准确转录将提高治疗效果、临床医生培训和安全监测。尽管自动语音识别软件已经上市,但其在心理健康环境中的准确性尚未得到很好的描述。目前尚不清楚哪些指标和阈值适合不同的临床用例,这些用例的范围可能从人群描述到个体安全监测。在这里,我们证明自动语音识别在心理治疗中是可行的,但在广泛使用之前需要进一步提高准确性。我们符合 HIPAA 标准的自动语音识别系统的转录单词错误率为 25%。对于抑郁相关话语,敏感性为 80%,阳性预测值为 83%。对于临床医生识别的与伤害相关的句子,单词错误率为 34%。这些结果表明,自动语音识别可能有助于理解现有治疗中的语言模式和亚组变异,但可能尚未准备好进行个人级别的安全监测。

更新日期:2020-06-03
down
wechat
bug