跳到主要导航 跳到搜索 跳到主要内容

Enhancing End-to-end Multilingual Medical Speech Translation via Terminology Injection Mechanism

  • Shuanghong Huang
  • , Chong Feng*
  • , Xia Liu*
  • , Jinlei Xu
  • , Xuan Zhao
  • , Ge Shi
  • , Yuhang Guo
  • , Yulong Gao
  • *此作品的通讯作者

科研成果: 期刊稿件文章同行评审

摘要

Speech-to-text translation (S2TT) in the medical domain presents significant challenges due to the complexity of medical terminology and the scarcity of high-quality multilingual data. To address these issues, we propose MMST (Multilingual Medical Speech-to-text Translation), a novel framework that integrates domain knowledge into S2TT. Initially, we develop a multilingual medical terminology dictionary utilizing a large language model to extract terms from multilingual medical corpora. Following this, we create MMST, which consists of two main components: a two-stage training approach that integrates general pretraining with fine-tuning specific to the medical domain, and a terminology injection mechanism that embeds target terms into translation prompts, directing the generation process during training. Experiments on a many-to-many multilingual medical dataset demonstrate that MMST consistently outperforms the strong QwenAudio baseline, achieving an average BLEU improvement of +6.97 and higher BERTScore, particularly on terminology-rich and low-resource language pairs.

源语言英语
期刊论文编号20250112
期刊Data Intelligence
8
2
DOI
出版状态已出版 - 1 6月 2026

学术指纹

探究 'Enhancing End-to-end Multilingual Medical Speech Translation via Terminology Injection Mechanism' 的科研主题。它们共同构成独一无二的学术指纹。

引用此