当前位置: X-MOL 学术ACM Trans. Asian Low Resour. Lang. Inf. Process. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Sign Language Generation System Based on Indian Sign Language Grammar
ACM Transactions on Asian and Low-Resource Language Information Processing ( IF 2 ) Pub Date : 2020-04-24 , DOI: 10.1145/3384202
Sugandhi 1 , Parteek Kumar 1 , Sanmeet Kaur 1
Affiliation  

Sign Language (SL), also known as gesture-based language, is used by people with hearing loss to convey their messages. SL interpreters are required for people who do not have the knowledge of SL, but interpreters are not readily available. Thus, a machine-based translation system is required to translate the text into SL. In this article, a system is implemented for translating English text into Indian Sign Language (ISL). It acts as a tool for human-computer interaction and eliminates the need for an ISL human interpreter for communicating with people who have hearing loss. The system features a rich corpus of English words and commonly used sentences. It consists of components such as an ISL parser, the Hamburg Notation System, the Signing Gesture Mark-up Language, and 3D avatar animation for generating SL according to ISL grammar. The proposed system has been tested rigorously by SL users. The results proved that the proposed system is highly efficient and achieves an average score of accuracy (i.e., 4.2 for English words and 3.8 for sentences on a scale from 1 to 5). The performance of proposed system has also been evaluated using the BiLingual Evaluation Understudy score, which results in 0.95 accuracy. The proposed system and mobile application together has the potential to bring individuals with hearing loss and their entourage together.

中文翻译:

基于印度手语语法的手语生成系统

听力障碍人士使用手语(SL),也称为基于手势的语言来传达其消息。不具备SL知识的人需要使用SL口译员,但是口译员并不容易获得。因此,需要基于机器的翻译系统来将文本翻译成SL。在本文中,实现了将英语文本翻译成印度手语(ISL)的系统。它充当人机交互的工具,并且不需要ISL人工解释器与有听力障碍的人进行交流。该系统具有丰富的英语单词和常用句子的语料库。它由ISL解析器,汉堡符号系统,签名手势标记语言和3D头像动画等组件组成,这些动画可根据ISL语法生成SL。拟议的系统已通过SL用户的严格测试。结果证明,所提出的系统是高效的,并且达到了平均准确度得分(即,英语单词为4.2,句子为3.8,范围为1到5)。所提议系统的性能也已使用双语评估咨询分数进行了评估,得出0.95的准确性。拟议中的系统和移动应用程序一起使用,有可能使有听力障碍的人及其随行人员聚集在一起。结果为0.95。拟议中的系统和移动应用程序一起使用,有可能使有听力障碍的人及其随行人员聚集在一起。结果为0.95。拟议中的系统和移动应用程序一起使用,有可能使有听力障碍的人及其随行人员聚集在一起。
更新日期:2020-04-24
down
wechat
bug