Triple extraction based on meta-type prompt learning and bidirectional relation complementary attention

Tianxiang Xu, Chunxia Zhang*, Xiaoyu Jin, Na Li

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Knowledge extraction is a significant issue in fields including knowledge graph construction and natural language processing. Triple extraction, as a crucial issue within knowledge extraction, is intended to acquire structured triples from unstructured texts, that is, to identify entities, their types and relations. Typically, it provides technical support for downstream tasks such as information recommendation, semantic search, and question answering. However, present triple extraction methods fail to sufficiently utilize the information related to relation types and entity types during the sentence embedding generation, and cannot fully exploit the auxiliary semantic information about relation for entity extraction. To address the aforementioned challenges, this paper proposes a triple extraction approach founded on Meta-type Prompt learning and Bidirectional relation Collaborative Attention (MPBCA). That method utilizes meta-type prompt learning which introduces relation types, entity types and their correlations to optimize the token embedding. Thereby, the generated word embeddings can be more adaptive for the triple extraction task by exploring the intrinsic logical connections of target triple components. Furthermore, our approach designs a bidirectional relation complementary attention mechanism to identify entity head and tail positions. That mechanism not only strengthens the semantic modelling capabilities for relations between entities, but also improves fault tolerance and captures the potentially accurate target triples by using bidirectional sentence structures, not unidirectional structures. The results of experiments on two public datasets show that our triple extraction approach MPBCA proposed in this paper is superior to the existing methods, confirming the effectiveness and superiority of the proposed model.

Original languageEnglish
Title of host publicationSeventh International Conference on Advanced Electronic Materials, Computers, and Software Engineering, AEMCSE 2024
EditorsLvqing Yang
PublisherSPIE
ISBN (Electronic)9781510681866
DOIs
Publication statusPublished - 2024
Event7th International Conference on Advanced Electronic Materials, Computers, and Software Engineering, AEMCSE 2024 - Nanchang, China
Duration: 10 May 202412 May 2024

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume13229
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference7th International Conference on Advanced Electronic Materials, Computers, and Software Engineering, AEMCSE 2024
Country/TerritoryChina
CityNanchang
Period10/05/2412/05/24

Keywords

  • bidirectional entity extraction
  • meta-type prompt learning
  • relation complementary attention
  • triple extraction

Fingerprint

Dive into the research topics of 'Triple extraction based on meta-type prompt learning and bidirectional relation complementary attention'. Together they form a unique fingerprint.

Cite this