There is a potential for immersive tools that can teach some basic aspects of conducting in a constructive way. This work presents a Kinect-based conducting system that uses a gestural interface for visualization of musical structures, aimed towards educational purpose. The system provides a solution that enables students to practice conducting without the actual need of the physical presence of an orchestra or choir. Visualization of melodic and harmonic structures through an audiovisual mapping is provided to enable the understanding of complex musical pieces, such as operas and concertos. Real-time visual and gestural feedback is generated for the conductor and audience through the display of a set of particle emitters and the trajectory traversed by the captured gestures. Focusing on delivering a better user experience (UX), the system was also evaluated by professional conductors, musicians and users without any formal musical knowledge. UX played an important part in identifying that this type of experience is viable as an additional support for conducting and musical theory learning.

沉浸式工具有可能以建设性的方式教授行为的一些基本方面。这项工作提出了一种基于Kinect的指挥系统，该系统使用手势界面对音乐结构进行可视化，旨在达到教育目的。该系统提供了一种解决方案，使学生可以练习指挥，而无需实际需要管弦乐队或合唱团的参与。通过视听映射可视化旋律和和声结构，以帮助理解复杂的音乐作品，例如歌剧和协奏曲。通过显示一组粒子发射器和捕获的手势所遍历的轨迹，为指挥和观众生成实时的视觉和手势反馈。专注于提供更好的用户体验（UX），该系统还由专业指挥，音乐家和没有任何正式音乐知识的用户进行了评估。UX在确定这种体验是否可行作为指导和音乐理论学习的额外支持方面发挥了重要作用。