当前位置: X-MOL 学术arXiv.cs.MM › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Angel's Girl for Blind Painters: an Efficient Painting Navigation System Validated by Multimodal Evaluation Approach
arXiv - CS - Multimedia Pub Date : 2021-07-27 , DOI: arxiv-2107.12921
Hang Liu, Menghan Hu, Yuzhen Chen, Qingli Li, Guangtao Zhai, Simon X. Yang, Xiao-Ping Zhang, Xiaokang Yang

For people who ardently love painting but unfortunately have visual impairments, holding a paintbrush to create a work is a very difficult task. People in this special group are eager to pick up the paintbrush, like Leonardo da Vinci, to create and make full use of their own talents. Therefore, to maximally bridge this gap, we propose a painting navigation system to assist blind people in painting and artistic creation. The proposed system is composed of cognitive system and guidance system. The system adopts drawing board positioning based on QR code, brush navigation based on target detection and bush real-time positioning. Meanwhile, this paper uses human-computer interaction on the basis of voice and a simple but efficient position information coding rule. In addition, we design a criterion to efficiently judge whether the brush reaches the target or not. According to the experimental results, the thermal curves extracted from the faces of testers show that it is relatively well accepted by blindfolded and even blind testers. With the prompt frequency of 1s, the painting navigation system performs best with the completion degree of 89% with SD of 8.37% and overflow degree of 347% with SD of 162.14%. Meanwhile, the excellent and good types of brush tip trajectory account for 74%, and the relative movement distance is 4.21 with SD of 2.51. This work demonstrates that it is practicable for the blind people to feel the world through the brush in their hands. In the future, we plan to deploy Angle's Eyes on the phone to make it more portable. The demo video of the proposed painting navigation system is available at: https://doi.org/10.6084/m9.figshare.9760004.v1.

中文翻译:

盲人画家的天使女孩:通过多模态评估方法验证的高效绘画导航系统

对于热爱绘画但不幸有视力障碍的人来说,拿着画笔创作是一项非常艰巨的任务。这个特殊群体中的人们渴望拿起画笔,就像达芬奇一样,去创造并充分发挥自己的才能。因此,为了最大限度地弥补这一差距,我们提出了一种绘画导航系统,以帮助盲人进行绘画和艺术创作。该系统由认知系统和引导系统组成。系统采用基于二维码的画板定位、基于目标检测的画笔导航、灌木实时定位。同时,本文采用基于语音的人机交互和简单高效的位置信息编码规则。此外,我们设计了一个标准来有效判断画笔是否到达目标。根据实验结果,从测试者面部提取的热曲线表明,蒙眼甚至盲测者的接受度相对较好。提示频率为1s时,涂装导航系统性能最佳,完成度89%,SD为8.37%,溢出度347%,SD为162.14%。同时,优秀和良好类型的笔尖轨迹占74%,相对移动距离为4.21,SD为2.51。这项工作表明,盲人通过手中的画笔感受世界是切实可行的。未来,我们计划在手机上部署Angle's Eyes,使其更加便携。
更新日期:2021-07-28
down
wechat
bug