跳到主要导航 跳到搜索 跳到主要内容

Somatisation Disorder Detection via Speech: Introducing a Self-Supervised Learning Model

  • Zhihao Bao*
  • , Kun Qian*
  • , Zhonghao Zhao
  • , Mengkai Sun
  • , Ruolan Huang*
  • , Dewen Xu
  • , Bin Hu
  • , Yoshiharu Yamamoto
  • , Bjorn W. Schuller
  • *此作品的通讯作者
  • Beijing Institute of Technology
  • Nanfang Hospital
  • Shenzhen University
  • The University of Tokyo
  • Imperial College London
  • Augsburg University

科研成果: 书/报告/会议事项章节会议稿件同行评审

摘要

With the depressive psychiatric disorders becoming more common, people are gradually starting to take it seriously. Somatisation disorders, as a general mental disorder, are rarely accurately identified in clinical diagnosis for its specific nature. In the previous work, speech recognition technology has been successfully applied to the task of identifying somatisation disorders on the Shenzhen Somatisation Speech Corpus. Nevertheless, there is still a scarcity of labels for somatisation disorder speech database. The current mainstream approaches in the speech recognition heavily rely on the well labelled data. Compared to supervised learning, self-supervised learning is able to achieve the same or even better recognition results while reducing the reliance on labelled samples. Moreover, self-supervised learning can generate general representations without the need for human hand-crafted features depending on the different recognition tasks. To this end, we apply self-supervised learning pre-trained models to solve few-labelled somatisation disorder speech recognition. In this study, we compare and analyse the results of three self-supervised learning models (contrastive predictive coding, wav2vec and wav2vec 2.0). The best result of wav2vec 2.0 model achieves 77.0 % unweighted average recall and is significantly better than CPC (p <.005), performing better than the benchmark of the supervised learning model.Clinical relevance-This work proposed a self-supervised learning model to resolve the few-labelled SD speech data, which can be well used for helping psychiatrists with clinical assistant to diagnosis. With this model, psychiatrists no longer need to spend a lot of time labelling SD speech data.

源语言英语
主期刊名2023 45th Annual International Conference of the IEEE Engineering in Medicine and Biology Conference, EMBC 2023 - Proceedings
出版商Institute of Electrical and Electronics Engineers Inc.
ISBN(电子版)9798350324471
DOI
出版状态已出版 - 2023
活动45th Annual International Conference of the IEEE Engineering in Medicine and Biology Conference, EMBC 2023 - Sydney, 澳大利亚
期限: 24 7月 202327 7月 2023

丛书

姓名Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS
ISSN(印刷版)1557-170X

会议

会议45th Annual International Conference of the IEEE Engineering in Medicine and Biology Conference, EMBC 2023
国家/地区澳大利亚
Sydney
时期24/07/2327/07/23

联合国可持续发展目标

此成果有助于实现下列可持续发展目标:

  1. 可持续发展目标 3 - 良好健康与福祉
    可持续发展目标 3 良好健康与福祉

学术指纹

探究 'Somatisation Disorder Detection via Speech: Introducing a Self-Supervised Learning Model' 的科研主题。它们共同构成独一无二的学术指纹。

引用此