当前位置: X-MOL 学术Cognitive Science › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Alignment in Multimodal Interaction: An Integrative Framework
Cognitive Science ( IF 2.617 ) Pub Date : 2020-10-29 , DOI: 10.1111/cogs.12911
Marlou Rasenberg 1, 2, 3 , Asli Özyürek 1, 2, 3, 4 , Mark Dingemanse 1, 2, 3, 4
Affiliation  

When people are engaged in social interaction, they can repeat aspects of each other’s communicative behavior, such as words or gestures. This kind of behavioral alignment has been studied across a wide range of disciplines and has been accounted for by diverging theories. In this paper, we review various operationalizations of lexical and gestural alignment. We reveal that scholars have fundamentally different takes on when and how behavior is considered to be aligned, which makes it difficult to compare findings and draw uniform conclusions. Furthermore, we show that scholars tend to focus on one particular dimension of alignment (traditionally, whether two instances of behavior overlap in form), while other dimensions remain understudied. This hampers theory testing and building, which requires a well‐defined account of the factors that are central to or might enhance alignment. To capture the complex nature of alignment, we identify five key dimensions to formalize the relationship between any pair of behavior: time, sequence, meaning, form, and modality. We show how assumptions regarding the underlying mechanism of alignment (placed along the continuum of priming vs. grounding) pattern together with operationalizations in terms of the five dimensions. This integrative framework can help researchers in the field of alignment and related phenomena (including behavior matching, mimicry, entrainment, and accommodation) to formulate their hypotheses and operationalizations in a more transparent and systematic manner. The framework also enables us to discover unexplored research avenues and derive new hypotheses regarding alignment.

中文翻译:

多模式交互中的对齐:一个集成框架

当人们参与社交互动时,他们可以重复彼此交流行为的某些方面,例如言语或手势。这种行为对齐已经在广泛的学科中进行了研究,并通过不同的理论进行了解释。在本文中,我们回顾了词汇和手势对齐的各种操作。我们发现,学者们对何时以及如何被视为一致的行为有着根本不同的看法,这使得比较研究结果和得出统一结论变得困难。此外,我们表明学者倾向于关注对齐的一个特定维度(传统上,两个行为实例是否在形式上重叠),而其他维度仍未得到充分研究。这阻碍了理论测试和构建,这需要对对于对齐或可能增强对齐的核心因素进行明确定义。为了捕捉对齐的复杂性,我们确定了五个关键维度来正式化任何一对行为之间的关系:时间、顺序、意义、形式和情态。我们展示了关于对齐的潜在机制的假设(沿着启动接地)模式以及五个维度的操作。这个综合框架可以帮助对齐和相关现象(包括行为匹配、模仿、夹带和适应)领域的研究人员以更加透明和系统的方式制定他们的假设和操作。该框架还使我们能够发现未探索的研究途径并得出关于对齐的新假设。
更新日期:2020-10-29
down
wechat
bug