Muteness at its various levels is a common disability. Most of the technological solutions to the problem creates vocal speech through the transition from mute languages to vocal acoustic sounds. We present a new approach for creating speech: a technology that does not require prior knowledge of sign language. This technology is based on the most basic level of speech according to the phonetic division into vowels and consonants. The speech itself is expected to be expressed through sensing of the hand movements, as the movements are divided into three rotations: yaw, pitch, and roll. The proposed algorithm converts these rotations through programming to vowels and consonants. For the hand movement sensing, we used a depth camera and standard speakers in order to produce the sounds. The combination of the programmed depth camera and the speakers, together with the cognitive activity of the brain, is integrated into a unique speech interface. Using this interface, the user can develop speech through an intuitive cognitive process in accordance with the ongoing brain activity, similar to the natural use of the vocal cords. Based on the performance of the presented speech interface prototype, it is substantiated that the proposed device could be a solution for those suffering from speech disabilities.

中文翻译：

---

使用手势生成语音的基于直观认知的方法

不同程度的沉默是一种常见的残疾。该问题的大多数技术解决方案通过从无声语言过渡到有声的声音来创建有声语音。我们提出了一种创建语音的新方法：一种不需要先验手语知识的技术。该技术基于语音的最基本层次，根据语音分为元音和辅音。语音本身预计将通过感知手部运动来表达，因为运动分为三个旋转：偏航、俯仰和滚动。所提出的算法通过编程将这些旋转转换为元音和辅音。对于手部运动感应，我们使用了深度摄像头和标准扬声器来产生声音。编程深度相机和扬声器的组合，与大脑的认知活动一起，被集成到一个独特的语音界面中。使用这个界面，用户可以根据正在进行的大脑活动，通过一个直观的认知过程来开发语音，类似于声带的自然使用。基于所提出的语音接口原型的性能，证实所提出的设备可以成为那些患有语言障碍的人的解决方案。