This article presents a multimodal dataset comprising various representations and annotations of Franz Schubert’s song cycle Winterreise . Schubert’s seminal work constitutes an outstanding example of the Romantic song cycle—a central genre within Western classical music. Our dataset unifies several public sources and annotations carefully created by music experts, compiled in a comprehensive and consistent way. The multimodal representations comprise the singer’s lyrics, sheet music in different machine-readable formats, and audio recordings of nine performances, two of which are freely accessible for research purposes. By means of explicit musical measure positions, we establish a temporal alignment between the different representations, thus enabling a detailed comparison across different performances and modalities. Using these alignments, we provide for the different versions various musicological annotations describing tonal and structural characteristics. This metadata comprises chord annotations in different granularities, local and global annotations of musical keys, and segmentations into structural parts. From a technical perspective, the dataset allows for evaluating algorithmic approaches to tasks such as automated music transcription, cross-modal music alignment, or tonal analysis, and for testing these algorithms’ robustness across songs, performances, and modalities. From a musicological perspective, the dataset enables the systematic study of Schubert’s musical language and style in Winterreise and the comparison of annotations regarding different annotators and granularities. Beyond the research domain, the data may serve further purposes such as the didactic preparation of Schubert’s work and its presentation to a wider public by means of an interactive multimedia experience. With this article, we provide a detailed description of the dataset, indicate its potential for computational music analysis by means of several studies, and point out possibilities for future research.

中文翻译：

---

Schubert Winterreise 数据集

本文介绍了一个多模式数据集，包括弗朗茨舒伯特歌曲周期的各种表示和注释冬季旅行. 舒伯特的开创性作品构成了浪漫主义歌曲循环的杰出典范——西方古典音乐的核心流派。我们的数据集统一了由音乐专家精心创建的多个公共资源和注释，以全面和一致的方式编译。多模态表示包括歌手的歌词、不同机器可读格式的乐谱和九场表演的录音，其中两个可免费访问以用于研究目的。通过明确的音乐测量位置，我们在不同的表示之间建立了时间对齐，从而能够对不同的表演和形式进行详细的比较。使用这些对齐方式，我们为不同的版本提供了描述音调和结构特征的各种音乐学注释。该元数据包括不同粒度的和弦注释、音乐键的局部和全局注释以及结构部分的分段。从技术角度来看，该数据集允许评估自动音乐转录、跨模式音乐对齐或音调分析等任务的算法方法，并测试这些算法在歌曲、表演和模式中的稳健性。从音乐学的角度来看，该数据集可以系统地研究舒伯特的音乐语言和风格。或音调分析，并用于测试这些算法在歌曲、表演和模态中的稳健性。从音乐学的角度来看，该数据集可以系统地研究舒伯特的音乐语言和风格。或音调分析，并用于测试这些算法在歌曲、表演和模态中的稳健性。从音乐学的角度来看，该数据集可以系统地研究舒伯特的音乐语言和风格。冬季旅行以及关于不同注释器和粒度的注释比较。除了研究领域之外，这些数据还可以用于进一步的目的，例如为舒伯特的作品进行教学准备，并通过交互式多媒体体验将其展示给更广泛的公众。在本文中，我们提供了数据集的详细描述，通过多项研究表明其在计算音乐分析方面的潜力，并指出未来研究的可能性。