生成式大语言模型在中文放射医学领域的应用研究

Longfei Chen, Xin Gao, Haotian Hou, Chuyang Ye, Ya'ou Liu, Meihui Zhang*

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

摘要

In the Chinese radiology domain, radiology reports serve as a crucial basis for clinical decision-making. Therefore, utilizing natural language processing (NLP) technology to understand and learn from the textual content of radiology reports, thereby aiding radiological clinical work, has become an important research direction in this domain. However, when dealing with the natural language classification and generation tasks based on Chinese radiology reports using traditional methods, there are still challenges such as a lack of training corpora, privacy concerns, and poor model generalization capabilities, leading to insufficient overall performance. To address these issues, a solution for natural language tasks in the Chinese radiology domain based on locally efficient fine-tuning large language models is proposed. By collecting and constructing a large-scale, high-quality dataset for natural language tasks in the Chinese radiology reports, and employing the LoRA efficient fine-tuning method for supervised fine-tuning training of the open-source large language model Baichuan2, the“RadGPT”capable of solving four types of clinical tasks in the Chinese radiology domain simultaneously is proposed. A set of evaluation systems for natural language classification and generation tasks in the Chinese radiology domain is introduced. Multiple sets of experiments are conducted on three types of radiology report datasets from two centers, and comparisons are made with several typical existing methods. The results demonstrate that the proposed method performs better in terms of classification performance, text summarization and expansion capabilities, and model generalization.

投稿的翻译标题Application of Generative Large Language Models in Chinese Radiology Domain
源语言繁体中文
页(从-至)2337-2348
页数12
期刊Journal of Frontiers of Computer Science and Technology
18
9
DOI
出版状态已出版 - 1 9月 2024

关键词

  • efficient fine-tuning strategy
  • large language model
  • radiology report
  • text classification
  • text generation

指纹

探究 '生成式大语言模型在中文放射医学领域的应用研究' 的科研主题。它们共同构成独一无二的指纹。

引用此