This article describes a music rhythm game called AutoRhythm, which can automatically generate the hit timing as game contents from a given piece of music, and identify user-defined percussion of real objects in real time for gameplay. More specifically, AutoRhythm can generate the hit timing of a piece of music based on onset detection, so the user can use any music from their own collection for the rhythm game. Moreover, to make the game more realistic, AutoRhythm also allows the user to interact with the game via any object that can produce percussion sounds, such as a pen or a chopstick hitting against a table. AutoRhythm can identify the percussions in real time to replace tapping on the screen. This real-time user percussion identification is achieved based on the frame-based power spectrum of the filtered recording after background music reduction, which is performed based on the concept of active noise cancellation, with the estimated noisy playback music being subtracted from the original recording. Based on a test data set of 100 recordings, our experiment indicates that our system can achieve an F-measure of 78.22%, which outperforms other well-known classifiers and is quite satisfactory for the purpose of gameplay.

中文翻译：

---

AutoRhythm：具有自动点击时间生成和打击乐识别的音乐游戏

本文介绍了一款名为 AutoRhythm 的音乐节奏游戏，它可以从给定的音乐中自动生成点击时间作为游戏内容，并实时识别用户定义的真实对象打击乐以进行游戏。更具体地说，AutoRhythm 可以根据开始检测生成一段音乐的命中时间，因此用户可以将自己收藏的任何音乐用于节奏游戏。此外，为了让游戏更加逼真，AutoRhythm 还允许用户通过任何可以产生敲击声的物体与游戏进行交互，例如钢笔或筷子敲击桌子。AutoRhythm 可以实时识别打击乐，取代敲击屏幕。这种实时的用户打击乐识别是基于背景音乐减少后过滤录音的基于帧的功率谱来实现的，这是基于主动降噪的概念进行的，从原始录音中减去估计的嘈杂播放音乐. 基于 100 条记录的测试数据集，我们的实验表明，我们的系统可以达到 78.22% 的 F-measure，这优于其他知名分类器，并且对于游戏性而言相当令人满意。