当前位置: X-MOL 学术arXiv.cs.MM › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
An Artistic Visualization of Music Modeling a Synesthetic Experience
arXiv - CS - Multimedia Pub Date : 2020-12-15 , DOI: arxiv-2012.08034
Matthew Joseph Adiletta, Oliver Thomas

This project brings music to sight. Music can be a visual masterpiece. Some people naturally experience a visualization of audio - a condition called synesthesia. The type of synesthesia explored is when sounds create colors in the 'mind's eye.' Project included interviews with people who experience synesthesia, examination of prior art, and topic research to inform project design. Audio input, digital signal processing (including Fast Fourier Transforms (FFTs)) and data manipulation produce arguments required for our visualization. Arguments are then applied to a physics particle simulator which is re-purposed to model a synesthetic experience. The result of the project is a simulator in MAX 8, which generates a visual performance using particles by varying each particle's position, velocity, and color based on parameters extracted via digital processing of input audio.

中文翻译:

音乐的艺术形象化模拟了一种综合体验

这个项目将音乐带入视线。音乐可以是视觉上的杰作。有些人自然会体验到音频的可视化-一种称为联觉的状况。探索的联觉类型是声音在“头脑”中产生色彩。项目包括与经历过联觉的人的访谈,对现有技术的检查以及主题研究,以为项目设计提供信息。音频输入,数字信号处理(包括快速傅立叶变换(FFT))和数据处理产生了我们可视化所需的参数。然后将参数应用于物理粒子模拟器,该粒子模拟器可用于模拟合成体验。该项目的结果是MAX 8中的模拟器,该模拟器通过改变每个粒子的位置,速度,
更新日期:2020-12-16
down
wechat
bug