跳到主要导航 跳到搜索 跳到主要内容

Cross-modal Prompt Disentangled Graph Neural Networks for incomplete conversational emotion recognition

  • Shi Qiao
  • , Xiaowei Zhang
  • , Qinglin Zhao
  • , Bimei Wang
  • , Jisheng Dang*
  • , Bin Hu*
  • , Hong Peng
  • *此作品的通讯作者
  • Lanzhou University

科研成果: 期刊稿件 › 文章 › 同行评审

摘要

Multimodal emotion recognition relies on the joint modeling of text, speech, and visual signals. In real-world scenarios, however, some modalities are often unavailable due to noise, occlusion, recognition errors, or device malfunction. This not only weakens the use of complementary cross-modal information, but also intensifies imbalance in modality learning. To address this issue, we propose a Cross-modal Prompt Disentangled Graph Neural Network (CPD-GNN) for incomplete multimodal conversational emotion recognition. Specifically, to reduce interference caused by modality heterogeneity, the proposed method first projects incomplete multimodal features into a unified semantic space and disentangles them into shared representations and modality specific representations. On this basis, the framework jointly performs cross-modal information compensation and dynamic modality balancing, providing a robust foundation for modeling both local contextual interactions and higher-order conversational dependencies under missing-modality conditions. Extensive experiments on multiple benchmark datasets demonstrate that the proposed method is effective for incomplete multimodal learning and achieves competitive or superior performance compared with existing approaches.

源语言英语
期刊论文编号116547
期刊Knowledge-Based Systems
卷350
DOI
出版状态已出版 - 27 9月 2026
已对外发布是

学术指纹

探究 'Cross-modal Prompt Disentangled Graph Neural Networks for incomplete conversational emotion recognition' 的科研主题。它们共同构成独一无二的学术指纹。

引用此