当前位置: X-MOL 学术IEEE Trans. Haptics › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A Multi-sensory Approach to Present Phonemes as Language through a Wearable Haptic Device
IEEE Transactions on Haptics ( IF 2.9 ) Pub Date : 2020-01-01 , DOI: 10.1109/toh.2020.3009581
Nathan Dunkelberger , Jennifer L. Sullivan , Joshua Bradley , Indu Manickam , Gautam Dasarathy , Richard Baraniuk , Marcia K. O'Malley

Communication is an important part of our daily interactions; however, communication can be hindered, either through visual or auditory impairment, or because usual communication channels are overloaded. When standard communication channels are not available, our sense of touch offers an alternative sensory modality for transmitting messages. Multi-sensory haptic cues that combine multiple types of haptic sensations have shown promise for applications, such as haptic communication, that require large discrete cue sets while maintaining a small, wearable form factor. This paper presents language transmission using a multi-sensory haptic device that occupies a small footprint on the upper arm. In our approach, phonemes are encoded as multi-sensory haptic cues consisting of vibration, radial squeeze, and lateral skin stretch components. Participants learned to identify haptically transmitted phonemes and words after training across a four day training period. A subset of our participants continued their training to extend word recognition free response. Participants were able to identify words after four days using multiple choice with an accuracy of 89% and after eight days using free response with an accuracy of 70%. These results show promise for the use of multi-sensory haptics for haptic communication, demonstrating high word recognition performance with a small, wearable device.

中文翻译:

通过可穿戴触觉设备将音素呈现为语言的多感官方法

沟通是我们日常互动的重要组成部分;然而,由于视觉或听觉障碍,或者因为通常的沟通渠道过载,沟通可能会受到阻碍。当标准的沟通渠道不可用时,我们的触觉提供了另一种传递信息的感官方式。结合多种类型触觉的多感官触觉提示已显示出在触觉通信等应用中的前景,这些应用需要大型离散提示集,同时保持小巧的可穿戴外形。本文介绍了使用多感官触觉设备的语言传输,该设备在上臂上占据很小的空间。在我们的方法中,音素被编码为多感官触觉线索,包括振动、径向挤压和横向皮肤拉伸分量。在为期四天的培训期间,参与者学会了识别触觉传输的音素和单词。我们的一部分参与者继续接受培训,以扩展单词识别自由反应。参与者能够在四天后使用多项选择识别单词,准确率为 89%,八天后使用自由回答,准确率为 70%。这些结果显示了使用多感官触觉进行触觉通信的前景,展示了小型可穿戴设备的高单词识别性能。参与者能够在四天后使用多项选择识别单词,准确率为 89%,八天后使用自由回答,准确率为 70%。这些结果显示了使用多感官触觉进行触觉通信的前景,展示了小型可穿戴设备的高单词识别性能。参与者能够在四天后使用多项选择识别单词,准确率为 89%,八天后使用自由回答,准确率为 70%。这些结果显示了使用多感官触觉进行触觉通信的前景,展示了小型可穿戴设备的高单词识别性能。
更新日期:2020-01-01
down
wechat
bug