Music information retrieval (MIR) has a great potential in musical live coding because it can help the musician–programmer to make musical decisions based on audio content analysis and explore new sonorities by means of MIR techniques. The use of real-time MIR techniques can be computationally demanding and thus they have been rarely used in live coding; when they have been used, it has been with a focus on low-level feature extraction. This article surveys and discusses the potential of MIR applied to live coding at a higher musical level. We propose a conceptual framework of three categories: (1) audio repurposing, (2) audio rewiring, and (3) audio remixing. We explored the three categories in live performance through an application programming interface library written in SuperCollider, MIRLC. We found that it is still a technical challenge to use high-level features in real time, yet using rhythmic and tonal properties (midlevel features) in combination with text-based information (e.g., tags) helps to achieve a closer perceptual level centered on pitch and rhythm when using MIR in live coding. We discuss challenges and future directions of utilizing MIR approaches in the computer music field.

中文翻译：

---

现场编码中的音乐信息检索：一个理论框架

音乐信息检索 (MIR) 在音乐现场编码方面具有巨大潜力，因为它可以帮助音乐家-程序员根据音频内容分析做出音乐决策，并通过 MIR 技术探索新的声音。实时 MIR 技术的使用可能需要大量计算，因此它们很少用于实时编码；当它们被使用时，它一直专注于低级特征提取。本文调查并讨论了 MIR 应用于更高音乐水平的现场编码的潜力。我们提出了三个类别的概念框架：（1）音频再利用，（2）音频重新布线，和（3）音频重新混合。我们通过用 SuperCollider MIRLC 编写的应用程序编程接口库探索了现场表演中的三个类别。我们发现实时使用高级特征仍然是一个技术挑战，但是使用节奏和音调属性（中级特征）结合基于文本的信息（例如标签）有助于实现更接近于以在实时编码中使用 MIR 时的音高和节奏。我们讨论了在计算机音乐领域使用 MIR 方法的挑战和未来方向。