当前位置: X-MOL 学术arXiv.cs.HC › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
Visual Motion Imagery Classification with Deep Neural Network based on Functional Connectivity
arXiv - CS - Human-Computer Interaction Pub Date : 2021-03-04 , DOI: arxiv-2103.02851
Byoung-Hee Kwon, Ji-Hoon Jeong, Seong-Whan Lee

Brain-computer interfaces (BCIs) use brain signals such as electroencephalography to reflect user intention and enable two-way communication between computers and users. BCI technology has recently received much attention in healthcare applications, such as neurorehabilitation and diagnosis. BCI applications can also control external devices using only brain activity, which can help people with physical or mental disabilities, especially those suffering from neurological and neuromuscular diseases such as stroke and amyotrophic lateral sclerosis. Motor imagery (MI) has been widely used for BCI-based device control, but we adopted intuitive visual motion imagery to overcome the weakness of MI. In this study, we developed a three-dimensional (3D) BCI training platform to induce users to imagine upper-limb movements used in real-life activities (picking up a cell phone, pouring water, opening a door, and eating food). We collected intuitive visual motion imagery data and proposed a deep learning network based on functional connectivity as a mind-reading technique. As a result, the proposed network recorded a high classification performance on average (71.05%). Furthermore, we applied the leave-one-subject-out approach to confirm the possibility of improvements in subject-independent classification performance. This study will contribute to the development of BCI-based healthcare applications for rehabilitation, such as robotic arms and wheelchairs, or assist daily life.

中文翻译:

基于功能连接的深度神经网络视觉运动图像分类

脑机接口(BCI)使用脑电图等脑信号来反映用户的意图并实现计算机与用户之间的双向通信。BCI技术最近在医疗保健应用(例如神经康复和诊断)中受到了广泛关注。BCI应用程序还可以仅通过大脑活动来控制外部设备,这可以帮助身体或精神上有障碍的人,尤其是那些患有神经系统和神经肌肉疾病(例如中风和肌萎缩性侧索硬化症)的人。运动图像(MI)已被广泛用于基于BCI的设备控制,但是我们采用了直观的视觉运动图像来克服MI的弱点。在这项研究中,我们开发了三维(3D)BCI培训平台,以诱使用户想象现实生活中使用的上肢运动(拿起手机,倒水,开门和吃东西)。我们收集了直观的视觉运动图像数据,并提出了一种基于功能连接的深度学习网络,作为一种读心技术。结果,提出的网络平均记录了较高的分类性能(71.05%)。此外,我们应用了“留一题”方法来确认改进独立于主题的分类性能的可能性。这项研究将有助于开发基于BCI的康复医疗应用程序,例如机械臂和轮椅,或有助于日常生活。我们收集了直观的视觉运动图像数据,并提出了一种基于功能连接的深度学习网络,作为一种读心技术。结果,提出的网络平均记录了较高的分类性能(71.05%)。此外,我们应用了“留一题”方法来确认改进独立于主题的分类性能的可能性。这项研究将有助于开发基于BCI的康复医疗应用程序,例如机械臂和轮椅,或有助于日常生活。我们收集了直观的视觉运动图像数据,并提出了一种基于功能连接的深度学习网络,作为一种读心技术。结果,提出的网络平均记录了较高的分类性能(71.05%)。此外,我们应用了“留一题”方法来确认改进独立于主题的分类性能的可能性。这项研究将有助于开发基于BCI的康复医疗应用程序,例如机械臂和轮椅,或有助于日常生活。我们应用了留一法的方法来确认改进独立于主题的分类性能的可能性。这项研究将有助于开发基于BCI的康复医疗应用程序,例如机械臂和轮椅,或有助于日常生活。我们应用了留一法的方法来确认改进独立于主题的分类性能的可能性。这项研究将有助于开发基于BCI的康复医疗应用程序,例如机械臂和轮椅,或有助于日常生活。
更新日期:2021-03-05
down
wechat
bug