当前位置: X-MOL 学术arXiv.cs.HC › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
SophiaPop: Experiments in Human-AI Collaboration on Popular Music
arXiv - CS - Human-Computer Interaction Pub Date : 2020-11-20 , DOI: arxiv-2011.10363
David Hanson, Frankie Storm, Wenwei Huang, Vytas Krisciunas, Tiger Darrow, Audrey Brown, Mengna Lei, Matthew Aylett, Adam Pickrell, Sophia the Robot

A diverse team of engineers, artists, and algorithms, collaborated to create songs for SophiaPop, via various neural networks, robotics technologies, and artistic tools, and animated the results on Sophia the Robot, a robotic celebrity and animated character. Sophia is a platform for arts, research, and other uses. To advance the art and technology of Sophia, we combine various AI with a fictional narrative of her burgeoning career as a popstar. Her actual AI-generated pop lyrics, music, and paintings, and animated conversations wherein she interacts with humans real-time in narratives that discuss her experiences. To compose the music, SophiaPop team built corpora from human and AI-generated Sophia character personality content, along with pop music song forms, to train and provide seeds for a number of AI algorithms including expert models, and custom-trained transformer neural networks, which then generated original pop-song lyrics and melodies. Our musicians including Frankie Storm, Adam Pickrell, and Tiger Darrow, then performed interpretations of the AI-generated musical content, including singing and instrumentation. The human-performed singing data then was processed by a neural-network-based Sophia voice, which was custom-trained from human performances by Cereproc. This AI then generated the unique Sophia voice singing of the songs. Then we animated Sophia to sing the songs in music videos, using a variety of animation generators and human-generated animations. Being algorithms and humans, working together, SophiaPop represents a human-AI collaboration, aspiring toward human AI symbiosis. We believe that such a creative convergence of multiple disciplines with humans and AI working together, can make AI relevant to human culture in new and exciting ways, and lead to a hopeful vision for the future of human-AI relations.

中文翻译:

SophiaPop:流行音乐的人与AI合作实验

一支由工程师,艺术家和算法组成的多元化团队,通过各种神经网络,机器人技术和艺术工具,共同为SophiaPop创作了歌曲,并在机器人名人和动画角色Sophia the Robot上对结果进行了动画处理。Sophia是艺术,研究和其他用途的平台。为了提高Sophia的艺术和技术水平,我们将各种AI与她作为流行歌星的事业蓬勃发展的虚构叙述相结合。她实际通过AI生成的流行歌词,音乐和绘画以及动画对话,在对话中她与人类实时互动,讨论了她的经历。为了创作音乐,SophiaPop团队根据人类和AI生成的Sophia角色个性内容以及流行音乐歌曲形式构建了语料库,以训练并提供多种AI算法的种子,包括专家模型,以及经过定制训练的变压器神经网络,然后生成原始的流行歌曲歌词和旋律。然后,我们的音乐家包括Frankie Storm,Adam Pickrell和Tiger Darrow,对AI产生的音乐内容(包括唱歌和乐器)进行了解释。然后由基于神经网络的Sophia语音处理人类执行的歌唱数据,该语音由Cereproc根据人类表演进行定制训练。然后,此AI生成了歌曲的独特Sophia语音唱歌。然后,我们使用各种动画生成器和人工生成的动画来制作Sophia动画,以演唱音乐视频中的歌曲。作为算法和人类,SophiaPop协同工作,代表着人类与AI的合作,向往人类AI共生。
更新日期:2020-11-23
down
wechat
bug