当前位置: X-MOL 学术J. Royal Soc. Interface › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Perceiving and remembering speech depend on multifractal nonlinearity in movements producing and exploring speech
Journal of The Royal Society Interface ( IF 3.7 ) Pub Date : 2021-08-04 , DOI: 10.1098/rsif.2021.0272
Lauren Bloomfield 1 , Elizabeth Lane 1 , Madhur Mangalam 2 , Damian G Kelty-Stephen 1
Affiliation  

Speech perception and memory for speech require active engagement. Gestural theories have emphasized mainly the effect of speaker's movements on speech perception. They fail to address the effects of listener movement, focusing on communication as a boundary condition constraining movement among interlocutors. The present work attempts to break new ground by using multifractal geometry of physical movement as a common currency for supporting both sides of the speaker–listener dyads. Participants self-paced their listening to a narrative, after which they completed a test of memory querying their narrative comprehension and their ability to recognize words from the story. The multifractal evidence of nonlinear interactions across timescales predicted the fluency of speech perception. Self-pacing movements that enabled listeners to control the presentation of speech sounds constituted a rich exploratory process. The multifractal nonlinearity of this exploration supported several aspects of memory for the perceived spoken language. These findings extend the role of multifractal geometry in the speaker's movements to the narrative case of speech perception. In addition to posing novel basic research questions, these findings make a compelling case for calibrating multifractal structure in text-to-speech synthesizers for better perception and memory of speech.



中文翻译:

感知和记忆语音取决于产生和探索语音的运动中的多重分形非线性

语音感知和语音记忆需要积极参与。手势理论主要强调说话者的动作对言语感知的影响。他们未能解决听众运动的影响,将交流作为限制对话者之间运动的边界条件。目前的工作试图通过使用物理运动的多重分形几何作为支持说话者-听者对偶双方的通用货币来开辟新天地。参与者自定进度聆听叙述,之后他们完成了一项记忆测试,询问他们的叙述理解和从故事中识别单词的能力。跨时间尺度的非线性相互作用的多重分形证据预测了语音感知的流畅性。使听众能够控制语音呈现的自定节奏运动构成了一个丰富的探索过程。这种探索的多重分形非线性支持感知口语记忆的几个方面。这些发现将多重分形几何在说话者动作中的作用扩展到语音感知的叙述案例。除了提出新的基础研究问题外,这些发现为校准文本到语音合成器中的多重分形结构以更好地感知和记忆语音提供了令人信服的案例。s 运动到言语感知的叙事案例。除了提出新的基础研究问题外,这些发现为校准文本到语音合成器中的多重分形结构以更好地感知和记忆语音提供了令人信服的案例。s 运动到言语感知的叙事案例。除了提出新的基础研究问题外,这些发现为校准文本到语音合成器中的多重分形结构以更好地感知和记忆语音提供了令人信服的案例。

更新日期:2021-08-11
down
wechat
bug