EmoGen: An Emoji-Based Interactive App to Support Emotion Expression via Generative Music (Exploring Usability and Emotional Resonance in Symbolic Music Interaction)

  • Jiayuan Guo
  • , Zhaolin Lu
  • , Jinyuan Guo
  • , Weihan Chen
  • , Tian Yuan
  • , Yue Zhang*
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Emojis offer an intuitive and affective means of emotional communication in digital environments. However, existing AI-driven music generation systems often rely on text-based inputs, which may be cognitively demanding and less precise in conveying emotions. This study presents EmoGen, an emoji-based interactive application that supports emotional expression in generative music. Users select emojis across five categories: emotion, scene, object, style, and instrument, which are mapped to text prompts for customized music generation with audiovisual feedback. A mixed-method evaluation with eight participants (aged 21–48) was conducted, using the System Usability Scale (SUS) and thematic analysis of interview data. Results showed high emotional alignment between user inputs and generated music (mean = 7.12–7.88/10) and strong usability (SUS = 80.9). Qualitative feedback highlighted use cases such as emotional journaling, event-based music creation, and mood-based self-care. The evaluation results suggest that EmoGen supports active emotional exploration through symbolic musical interaction, externalizing the externalization of emotions into personalized soundscapes. This work demonstrates how intuitive emoji-based interfaces can enhance emotional resonance and contribute to emotional interaction design in generative music systems.

Original languageEnglish
Title of host publicationHCI International 2025 - Late Breaking Papers - 27th International Conference on Human-Computer Interaction, HCII 2025, Proceedings
EditorsMartin Schrepp, Matthias Rauterberg
PublisherSpringer Science and Business Media Deutschland GmbH
Pages41-57
Number of pages17
ISBN (Print)9783032131638
DOIs
Publication statusPublished - 2026
Externally publishedYes
EventLate breaking papers from the 27th International Conference on Human-Computer Interaction, HCI International 2025 - Gothenburg, Sweden
Duration: 22 Jun 202527 Jun 2025

Publication series

NameLecture Notes in Computer Science
Volume16342 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceLate breaking papers from the 27th International Conference on Human-Computer Interaction, HCI International 2025
Country/TerritorySweden
CityGothenburg
Period22/06/2527/06/25

Keywords

  • Emoji
  • Generative music
  • Human computer interaction
  • Musical expression
  • System usability
  • User experience

Fingerprint

Dive into the research topics of 'EmoGen: An Emoji-Based Interactive App to Support Emotion Expression via Generative Music (Exploring Usability and Emotional Resonance in Symbolic Music Interaction)'. Together they form a unique fingerprint.

Cite this