MHA: a multimodal hierarchical attention model for depression detection in social media

Zepeng Li, Zhengyi An, Wenchuan Cheng, Jiawei Zhou, Fang Zheng, Bin Hu*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

31 Citations (Scopus)
Plum Print visual indicator of research metrics
  • Citations
    • Citation Indexes: 32
  • Captures
    • Readers: 71
see details

Abstract

As a serious mental disease, depression causes great harm to the physical and mental health of individuals, and becomes an important cause of suicide. Therefore, it is necessary to accurately identify and treat depressed patients. Compared with traditional clinical diagnosis methods, a large amount of real and different types of data on social media provides new ideas for depression detection research. In this paper, we construct a depression detection data set based on Weibo, and propose a Multimodal Hierarchical Attention (MHA) model for social media depression detection. Multimodal data is fed into the model and the attention mechanism is applied within and between modalities at the same time. Experimental results show that the proposed model achieves the best classification performance. In addition, we propose a distribution normalization method, which can optimize the data distribution and improve the accuracy of depression detection.

Original languageEnglish
Article number6
JournalHealth Information Science and Systems
Volume11
Issue number1
DOIs
Publication statusPublished - Dec 2023

Keywords

  • Attention mechanism
  • Deep neural network
  • Depression detection
  • Multimodality
  • Social media

Fingerprint

Dive into the research topics of 'MHA: a multimodal hierarchical attention model for depression detection in social media'. Together they form a unique fingerprint.

Cite this

Li, Z., An, Z., Cheng, W., Zhou, J., Zheng, F., & Hu, B. (2023). MHA: a multimodal hierarchical attention model for depression detection in social media. Health Information Science and Systems, 11(1), Article 6. https://doi.org/10.1007/s13755-022-00197-5