Entering text in virtual environments can be challenging, especially without auxiliary input devices. We investigate text input in virtual reality using hand-tracking and speech. Our system visualizes users' hands in the virtual environment, allowing typing on an auto-correcting midair keyboard. It also supports speaking a sentence and then correcting errors by selecting alternative words proposed by a speech recognizer. We conducted a user study in which participants wrote sentences with and without speech. Using only the keyboard, users wrote at 11 words-per-minute at a 1.2% error rate. Speaking and correcting sentences was faster and more accurate at 28 words-per-minute and a 0.5% error rate. Participants achieved this performance despite half of sentences containing an uncommon out-of-vocabulary word (e.g. proper name). For sentences with only in-vocabulary words, performance using speech and midair keyboard corrections was faster at 36 words-per-minute with a low 0.3% error rate.

中文翻译：

---

使用语音和空中键盘在虚拟环境中输入文本

在虚拟环境中输入文本可能具有挑战性，尤其是在没有辅助输入设备的情况下。我们使用手部跟踪和语音研究虚拟现实中的文本输入。我们的系统在虚拟环境中可视化用户的手，允许在自动更正的空中键盘上打字。它还支持说一个句子，然后通过选择语音识别器提出的替代词来纠正错误。我们进行了一项用户研究，参与者在有和没有语音的情况下写句子。仅使用键盘，用户以每分钟 11 个字的速度书写，错误率为 1.2%。口语和纠正句子更快、更准确，每分钟 28 个单词，错误率为 0.5%。尽管有一半的句子包含不常见的词汇外单词（例如专有名词），但参与者仍取得了这一成绩。