当前位置: X-MOL 学术IEEE Trans. Learning Technol. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
An Experiential Learning Approach to Learning Manual Communication Through a Virtual Reality Environment
IEEE Transactions on Learning Technologies ( IF 3.7 ) Pub Date : 2020-04-20 , DOI: 10.1109/tlt.2020.2988523
Edison Rho , Kenney Chan , Elliot John Varoy , Nasser Giacaman

There is a pressing need for effective pedagogical methods of manual languages, as evident in the decline of manual languages, such as New Zealand Sign Language (NZSL). Despite being recognized as one of New Zealand's official languages, recent censuses have shown that fluent NZSL signers have been steadily decreasing. There is a cultural responsibility to preserve such languages, yet the combination of barriers to acquisition and the limited availability of effective teaching methods are standing in the way. In light of this, this article proposes a computer-assisted sign language learning system that incorporates virtual reality and validation-based feedback as tools to implement the experiential learning model. An implementation in the form of virtual reality NZSL is presented, targeting the set of NZSL alphabet. Results show that a vision-based classification method, using the Leap Motion controller, is a scalable, accurate, and usable solution for feedback-assisted manual language learning. A formative usability evaluation of $n=10$ participants showed promising results for engagement, confidence, and memory retention. The results indicate that virtual reality technology is uniquely situated as an innovative medium for the self-directed acquisition of manual languages. It is hoped this article inspires technology researchers to pursue collaborations with the deaf/Deaf community to design and develop pedagogical technology solutions for manual communication.

中文翻译:

一种通过虚拟现实环境学习手动交流的体验式学习方法

迫切需要有效的人工语言教学方法,这一点从诸如新西兰手语(NZSL)等人工语言的减少中可以明显看出。尽管被公认为是新西兰的官方语言之一,但最近的人口普查显示,流利的NZSL签名者正在稳步下降。保留这种语言是文化上的责任,但是阻碍获取的障碍和有效教学方法的有限可用性正处于阻碍之中。有鉴于此,本文提出了一种计算机辅助手语学习系统,该系统将虚拟现实和基于验证的反馈作为实现体验式学习模型的工具。以NZSL字母表为目标,提出了虚拟现实NZSL形式的实现。结果表明,使用Leap Motion控制器的基于视觉的分类方法是一种可扩展,准确且可用的解决方案,用于反馈辅助的手动语言学习。形成性可用性评估$ n = 10 $参与者在敬业度,信心和记忆力方面表现出可喜的结果。结果表明,虚拟现实技术是一种独特的定位,是一种用于手动指导手动语言获取的创新媒介。希望本文能激发技术研究人员寻求与聋人/聋人社区的合作,以设计和开发用于手动交流的教学技术解决方案。
更新日期:2020-04-20
down
wechat
bug