Sound synthesiser controls typically correspond to technical parameters of signal processing algorithms rather than intuitive sound descriptors that relate to human perception of sound. This makes it difficult to realise sound ideas in a straightforward way. Cross-modal mappings, for example between gestures and sound, have been suggested as a more intuitive control mechanism. A large body of research shows consistency in human associations between sounds and shapes. However, the use of drawings to drive sound synthesis has not been explored to its full extent. This paper presents an exploratory study that asked participants to sketch visual imagery of sounds with a monochromatic digital drawing interface, with the aim to identify different representational approaches and determine whether timbral sound characteristics can be communicated reliably through visual sketches. Results imply that the development of a synthesiser exploiting sound-shape associations is feasible, but a larger and more focused dataset is needed in followup studies.

中文翻译：

---

素描声音：对声音形状关联的探索性研究

声音合成器控件通常对应于信号处理算法的技术参数，而不是与人类对声音的感知相关的直观声音描述符。这使得很难以直接的方式实现合理的想法。跨模态映射，例如手势和声音之间的映射，已被建议作为更直观的控制机制。大量研究表明，声音和形状之间的人类关联是一致的。然而，尚未充分探索使用绘图来驱动声音合成。本文提出了一项探索性研究，要求参与者使用单色数字绘图界面绘制声音的视觉图像，目的是确定不同的表示方法，并确定是否可以通过视觉草图可靠地传达音色声音特征。结果表明，开发利用声音形状关联的合成器是可行的，但后续研究需要更大、更集中的数据集。