跳到主要导航 跳到搜索 跳到主要内容

Implicit Discourse Relation Recognition by Scoring Special Tokens

  • Mingyang Cai*
  • , Ping Jian
  • , Yuhang Tian
  • , Hai Wang
  • *此作品的通讯作者
  • Beijing Institute of Technology

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

Implicit discourse relation recognition is one of the most difficult tasks in natural language understanding. Because of the lack of explicit connectives, the ability to extract logical information between the two discourse arguments is highly required. Previous studies mainly focus on designing complex neural network layers and various kinds of interactions between the two arguments, without further exploring the logical semantics in the pre-Trained language models. We propose a novel method that utilizes the power of the pre-Trained language model (RoBERTa) by introducing different kinds of extra special tokens, which can represent the relations between the discourse arguments respectively. On one hand, these special tokens learn to aggregate category features that profit classification; on the other hand, they can also be regarded as new 'words' that the prediction of them inspires the pre-Train language model. To effectively learn these special tokens, a scorer is then trained to give the discourse connected by corresponding special tokens higher scores than those with other special tokens. The experiments show the result of our approach exceeds our baseline by 4.24% F1, and the state-of-The-Art model by approximately 2.37% F1 on the four-way classification of the PDTB 2.0 dataset.

源语言英语
主期刊名Proceedings - 2023 3rd International Conference on Frontiers of Electronics, Information and Computation Technologies, ICFEICT 2023
编辑Weijian Liu, Zhuo Zheng Wang, Peng You
出版商Institute of Electrical and Electronics Engineers Inc.
页407-413
页数7
ISBN(电子版)9798350302356
DOI
出版状态已出版 - 2023
活动3rd International Conference on Frontiers of Electronics, Information and Computation Technologies, ICFEICT 2023 - Yangzhou, 中国
期限: 26 5月 2023 → 29 5月 2023

丛书

姓名Proceedings - 2023 3rd International Conference on Frontiers of Electronics, Information and Computation Technologies, ICFEICT 2023

会议

会议3rd International Conference on Frontiers of Electronics, Information and Computation Technologies, ICFEICT 2023
国家/地区中国
市Yangzhou
时期26/05/23 → 29/05/23

学术指纹

探究 'Implicit Discourse Relation Recognition by Scoring Special Tokens' 的科研主题。它们共同构成独一无二的学术指纹。

引用此