Scene-Aware Background Music Synthesis

Yujia Wang, Wei Liang*, Wanwan Li, Dingzeyu Li, Lap Fai Yu

*此作品的通讯作者

科研成果: 书/报告/会议事项章节会议稿件同行评审

17 引用 (Scopus)

摘要

In this paper, we introduce an interactive background music synthesis algorithm guided by visual content. We leverage a cascading strategy to synthesize background music in two stages: Scene Visual Analysis and Background Music Synthesis. First, seeking a deep learning-based solution, we leverage neural networks to analyze the sentiment of the input scene. Second, real-time background music is synthesized by optimizing a cost function that guides the selection and transition of music clips to maximize the emotion consistency between visual and auditory criteria, and music continuity. In our experiments, we demonstrate the proposed approach can synthesize dynamic background music for different types of scenarios. We also conducted quantitative and qualitative analysis on the synthesized results of multiple example scenes to validate the efficacy of our approach.

源语言英语
主期刊名MM 2020 - Proceedings of the 28th ACM International Conference on Multimedia
出版商Association for Computing Machinery, Inc
1162-1170
页数9
ISBN(电子版)9781450379885
DOI
出版状态已出版 - 12 10月 2020
活动28th ACM International Conference on Multimedia, MM 2020 - Virtual, Online, 美国
期限: 12 10月 202016 10月 2020

出版系列

姓名MM 2020 - Proceedings of the 28th ACM International Conference on Multimedia

会议

会议28th ACM International Conference on Multimedia, MM 2020
国家/地区美国
Virtual, Online
时期12/10/2016/10/20

指纹

探究 'Scene-Aware Background Music Synthesis' 的科研主题。它们共同构成独一无二的指纹。

引用此