The primary goal of this work is to examine prosodic structure as expressed concurrently through articulatory and manual gestures. Specifically, we investigated the effects of phrase-level prominence (Experiment 1) and of prosodic boundaries (Experiments 2 and 3) on the kinematic properties of oral constriction and manual gestures. The hypothesis guiding this work is that prosodic structure will be similarly expressed in both modalities. To test this, we have developed a novel method of data collection that simultaneously records speech audio, vocal tract gestures (using electromagnetic articulometry) and manual gestures (using motion capture). This method allows us, for the first time, to investigate kinematic properties of body movement and vocal tract gestures simultaneously, which in turn allows us to examine the relationship between speech and body gestures with great precision. A second goal of the paper is thus to establish the validity of this method. Results from two speakers show that manual and oral gestures lengthen under prominence and at prosodic boundaries, indicating that the effects of prosodic structure extend beyond the vocal tract to include body movement.1

中文翻译：

---

发音和手动手势韵律结构的运动学研究：数据收集新方法的结果

这项工作的主要目标是检查通过发音和手势同时表达的韵律结构。具体来说，我们研究了短语级突出（实验 1）和韵律边界（实验 2 和 3）对口头收缩和手势的运动学特性的影响。指导这项工作的假设是韵律结构将以两种方式类似地表达。为了测试这一点，我们开发了一种新的数据收集方法，可以同时记录语音、声道手势（使用电磁发音法）和手动手势（使用动作捕捉）。这种方法使我们第一次能够同时研究身体运动和声道手势的运动学特性，这反过来又使我们能够非常精确地检查语音和身体姿势之间的关系。因此，本文的第二个目标是确定该方法的有效性。两位发言者的结果表明，在突出和韵律边界下，手动和口头手势会延长，这表明韵律结构的影响超出了声道，包括身体运动。 1