生成式大语言模型在中文放射医学领域的应用研究

Translated title of the contribution: Application of Generative Large Language Models in Chinese Radiology Domain

Longfei Chen, Xin Gao, Haotian Hou, Chuyang Ye, Ya'ou Liu, Meihui Zhang*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

Abstract

In the Chinese radiology domain, radiology reports serve as a crucial basis for clinical decision-making. Therefore, utilizing natural language processing (NLP) technology to understand and learn from the textual content of radiology reports, thereby aiding radiological clinical work, has become an important research direction in this domain. However, when dealing with the natural language classification and generation tasks based on Chinese radiology reports using traditional methods, there are still challenges such as a lack of training corpora, privacy concerns, and poor model generalization capabilities, leading to insufficient overall performance. To address these issues, a solution for natural language tasks in the Chinese radiology domain based on locally efficient fine-tuning large language models is proposed. By collecting and constructing a large-scale, high-quality dataset for natural language tasks in the Chinese radiology reports, and employing the LoRA efficient fine-tuning method for supervised fine-tuning training of the open-source large language model Baichuan2, the“RadGPT”capable of solving four types of clinical tasks in the Chinese radiology domain simultaneously is proposed. A set of evaluation systems for natural language classification and generation tasks in the Chinese radiology domain is introduced. Multiple sets of experiments are conducted on three types of radiology report datasets from two centers, and comparisons are made with several typical existing methods. The results demonstrate that the proposed method performs better in terms of classification performance, text summarization and expansion capabilities, and model generalization.

Translated title of the contributionApplication of Generative Large Language Models in Chinese Radiology Domain
Original languageChinese (Traditional)
Pages (from-to)2337-2348
Number of pages12
JournalJournal of Frontiers of Computer Science and Technology
Volume18
Issue number9
DOIs
Publication statusPublished - 1 Sept 2024

Fingerprint

Dive into the research topics of 'Application of Generative Large Language Models in Chinese Radiology Domain'. Together they form a unique fingerprint.

Cite this