Language resources for studying doctor–patient interaction are rare, primarily due to the ethical issues related to recording real medical consultations. Rarer still are resources that involve more than one healthcare professional in consultation with a patient, despite many chronic conditions requiring multiple areas of expertise for effective treatment. In this paper, we present the design, construction and output of the Patient Consultation Corpus, a multimodal corpus of simulated consultations between a patient portrayed by an actor, and at least two healthcare professionals with different areas of expertise. As well as the transcribed text from each consultation, the corpus also contains audio and video where for each consultation: the audio consists of individual tracks for each participant, allowing for clear identification of speakers; the video consists of two framings for each participant—upper-body and face—allowing for close analysis of behaviours and gestures. Having presented the design and construction of the corpus, we then go on to briefly describe how the multi-modal nature of the corpus allows it to be analysed from several different perspectives.

用于研究医患互动的语言资源很少，主要是由于与记录真正的医疗咨询有关的道德问题。尽管有许多慢性疾病需要有效治疗的多个专业领域，但仍然有很多资源需要与多名医务人员进行协商。在本文中，我们介绍了患者咨询语料库的设计，构建和输出，由演员描述的患者与至少两名具有不同专业领域的医疗专业人员之间的模拟咨询多模式语料库。除了每次咨询的转录文本外，语料库还包含音频和视频，用于每次咨询：音频由每个参与者的单独音轨组成，可以清楚地识别说话者；该视频由每个参与者的两个框架（上半身和脸部）组成，可以对行为和手势进行仔细分析。介绍了语料库的设计和构建之后，我们接下来简要地介绍语料库的多模式性质，如何从几个不同的角度分析语料库。