TY - GEN
T1 - Multi-Track Music Generation with WGAN-GP and Attention Mechanisms
AU - Chen, Luyu
AU - Shen, Lin
AU - Yu, Dan
AU - Wang, Zhihua
AU - Qian, Kun
AU - Hu, Bin
AU - Schuller, Björn W.
AU - Yamamoto, Yoshiharu
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Music generation with artificial intelligence is a complex and captivating task. The utilisation of generative adversarial networks (GANs) has exhibited promising outcomes in producing realistic and diverse music compositions. In this paper, we propose a model based on Wasserstein GAN with gradient penalty (WGAN-GP) for multi-track music generation. This model incorporates self-attention and introduces a novel cross-attention mechanism in the generator to enhance its expressive capability. Additionally, we transpose all music to C major in training to ensure data consistency and quality. Experimental results demonstrate that our model can produce multi-track music with enhanced rhythm and sound characteristics, accelerate convergence, and improve generation quality.
AB - Music generation with artificial intelligence is a complex and captivating task. The utilisation of generative adversarial networks (GANs) has exhibited promising outcomes in producing realistic and diverse music compositions. In this paper, we propose a model based on Wasserstein GAN with gradient penalty (WGAN-GP) for multi-track music generation. This model incorporates self-attention and introduces a novel cross-attention mechanism in the generator to enhance its expressive capability. Additionally, we transpose all music to C major in training to ensure data consistency and quality. Experimental results demonstrate that our model can produce multi-track music with enhanced rhythm and sound characteristics, accelerate convergence, and improve generation quality.
UR - http://www.scopus.com/inward/record.url?scp=85179759137&partnerID=8YFLogxK
U2 - 10.1109/GCCE59613.2023.10315503
DO - 10.1109/GCCE59613.2023.10315503
M3 - Conference contribution
AN - SCOPUS:85179759137
T3 - GCCE 2023 - 2023 IEEE 12th Global Conference on Consumer Electronics
SP - 606
EP - 607
BT - GCCE 2023 - 2023 IEEE 12th Global Conference on Consumer Electronics
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 12th IEEE Global Conference on Consumer Electronics, GCCE 2023
Y2 - 10 October 2023 through 13 October 2023
ER -