当前位置:
X-MOL 学术
›
arXiv.cs.MM
›
论文详情
Our official English website, www.x-mol.net, welcomes your
feedback! (Note: you will need to create a separate account there.)
Angel's Girl for Blind Painters: an Efficient Painting Navigation System Validated by Multimodal Evaluation Approach
arXiv - CS - Multimedia Pub Date : 2021-07-27 , DOI: arxiv-2107.12921 Hang Liu, Menghan Hu, Yuzhen Chen, Qingli Li, Guangtao Zhai, Simon X. Yang, Xiao-Ping Zhang, Xiaokang Yang
arXiv - CS - Multimedia Pub Date : 2021-07-27 , DOI: arxiv-2107.12921 Hang Liu, Menghan Hu, Yuzhen Chen, Qingli Li, Guangtao Zhai, Simon X. Yang, Xiao-Ping Zhang, Xiaokang Yang
For people who ardently love painting but unfortunately have visual
impairments, holding a paintbrush to create a work is a very difficult task.
People in this special group are eager to pick up the paintbrush, like Leonardo
da Vinci, to create and make full use of their own talents. Therefore, to
maximally bridge this gap, we propose a painting navigation system to assist
blind people in painting and artistic creation. The proposed system is composed
of cognitive system and guidance system. The system adopts drawing board
positioning based on QR code, brush navigation based on target detection and
bush real-time positioning. Meanwhile, this paper uses human-computer
interaction on the basis of voice and a simple but efficient position
information coding rule. In addition, we design a criterion to efficiently
judge whether the brush reaches the target or not. According to the
experimental results, the thermal curves extracted from the faces of testers
show that it is relatively well accepted by blindfolded and even blind testers.
With the prompt frequency of 1s, the painting navigation system performs best
with the completion degree of 89% with SD of 8.37% and overflow degree of 347%
with SD of 162.14%. Meanwhile, the excellent and good types of brush tip
trajectory account for 74%, and the relative movement distance is 4.21 with SD
of 2.51. This work demonstrates that it is practicable for the blind people to
feel the world through the brush in their hands. In the future, we plan to
deploy Angle's Eyes on the phone to make it more portable. The demo video of
the proposed painting navigation system is available at:
https://doi.org/10.6084/m9.figshare.9760004.v1.
中文翻译:
盲人画家的天使女孩:通过多模态评估方法验证的高效绘画导航系统
对于热爱绘画但不幸有视力障碍的人来说,拿着画笔创作是一项非常艰巨的任务。这个特殊群体中的人们渴望拿起画笔,就像达芬奇一样,去创造并充分发挥自己的才能。因此,为了最大限度地弥补这一差距,我们提出了一种绘画导航系统,以帮助盲人进行绘画和艺术创作。该系统由认知系统和引导系统组成。系统采用基于二维码的画板定位、基于目标检测的画笔导航、灌木实时定位。同时,本文采用基于语音的人机交互和简单高效的位置信息编码规则。此外,我们设计了一个标准来有效判断画笔是否到达目标。根据实验结果,从测试者面部提取的热曲线表明,蒙眼甚至盲测者的接受度相对较好。提示频率为1s时,涂装导航系统性能最佳,完成度89%,SD为8.37%,溢出度347%,SD为162.14%。同时,优秀和良好类型的笔尖轨迹占74%,相对移动距离为4.21,SD为2.51。这项工作表明,盲人通过手中的画笔感受世界是切实可行的。未来,我们计划在手机上部署Angle's Eyes,使其更加便携。
更新日期:2021-07-28
中文翻译:
盲人画家的天使女孩:通过多模态评估方法验证的高效绘画导航系统
对于热爱绘画但不幸有视力障碍的人来说,拿着画笔创作是一项非常艰巨的任务。这个特殊群体中的人们渴望拿起画笔,就像达芬奇一样,去创造并充分发挥自己的才能。因此,为了最大限度地弥补这一差距,我们提出了一种绘画导航系统,以帮助盲人进行绘画和艺术创作。该系统由认知系统和引导系统组成。系统采用基于二维码的画板定位、基于目标检测的画笔导航、灌木实时定位。同时,本文采用基于语音的人机交互和简单高效的位置信息编码规则。此外,我们设计了一个标准来有效判断画笔是否到达目标。根据实验结果,从测试者面部提取的热曲线表明,蒙眼甚至盲测者的接受度相对较好。提示频率为1s时,涂装导航系统性能最佳,完成度89%,SD为8.37%,溢出度347%,SD为162.14%。同时,优秀和良好类型的笔尖轨迹占74%,相对移动距离为4.21,SD为2.51。这项工作表明,盲人通过手中的画笔感受世界是切实可行的。未来,我们计划在手机上部署Angle's Eyes,使其更加便携。