This paper studies a set of MR technologies for middle school experimental teaching environments and develops a multi-channel MR user interface called Dream-Experiment. The goal of Dream-Experiment is to improve the traditional MR user interface, so that users can get a real, natural 3D interactive experience like real experiments, but without danger and pollution. In terms of visual presentation, we design multi-camera collaborative registration to realize robust 6-DoF MR interactive space, and also define a complete rendering pipeline to provide improved processing of virtual-real objects' occlusion including translucent devices. In the virtual-real interaction, we provide six interaction modes that support visual interaction, tangible interaction, virtual-real gestures with touching, voice, thermal feeling, and olfactory feeling. After users' testing, we find that Dream-Experiment has better interactive efficiency and user experience than traditional MR environments.

中文翻译：

---

梦想实验：用于自然实验的具有自然多通道交互作用的MR用户界面。

本文研究了一套用于中学实验教学环境的MR技术，并开发了一个称为Dream-Experiment的多通道MR用户界面。Dream-Experiment的目标是改善传统的MR用户界面，以便用户能够获得真实，自然的3D交互体验，就像真实的实验一样，而且没有危险和污染。在视觉呈现方面，我们设计了多摄像头协同注册以实现强大的6自由度MR交互空间，并定义了完整的渲染管线以提供对虚拟对象的遮挡（包括半透明设备）的改进处理。在虚拟现实交互中，我们提供了六种交互模式，这些模式支持视觉交互，有形交互，具有触摸，语音，热感和嗅觉的虚拟现实手势。