TY - GEN
T1 - Triple extraction based on meta-type prompt learning and bidirectional relation complementary attention
AU - Xu, Tianxiang
AU - Zhang, Chunxia
AU - Jin, Xiaoyu
AU - Li, Na
N1 - Publisher Copyright:
© 2024 SPIE.
PY - 2024
Y1 - 2024
N2 - Knowledge extraction is a significant issue in fields including knowledge graph construction and natural language processing. Triple extraction, as a crucial issue within knowledge extraction, is intended to acquire structured triples from unstructured texts, that is, to identify entities, their types and relations. Typically, it provides technical support for downstream tasks such as information recommendation, semantic search, and question answering. However, present triple extraction methods fail to sufficiently utilize the information related to relation types and entity types during the sentence embedding generation, and cannot fully exploit the auxiliary semantic information about relation for entity extraction. To address the aforementioned challenges, this paper proposes a triple extraction approach founded on Meta-type Prompt learning and Bidirectional relation Collaborative Attention (MPBCA). That method utilizes meta-type prompt learning which introduces relation types, entity types and their correlations to optimize the token embedding. Thereby, the generated word embeddings can be more adaptive for the triple extraction task by exploring the intrinsic logical connections of target triple components. Furthermore, our approach designs a bidirectional relation complementary attention mechanism to identify entity head and tail positions. That mechanism not only strengthens the semantic modelling capabilities for relations between entities, but also improves fault tolerance and captures the potentially accurate target triples by using bidirectional sentence structures, not unidirectional structures. The results of experiments on two public datasets show that our triple extraction approach MPBCA proposed in this paper is superior to the existing methods, confirming the effectiveness and superiority of the proposed model.
AB - Knowledge extraction is a significant issue in fields including knowledge graph construction and natural language processing. Triple extraction, as a crucial issue within knowledge extraction, is intended to acquire structured triples from unstructured texts, that is, to identify entities, their types and relations. Typically, it provides technical support for downstream tasks such as information recommendation, semantic search, and question answering. However, present triple extraction methods fail to sufficiently utilize the information related to relation types and entity types during the sentence embedding generation, and cannot fully exploit the auxiliary semantic information about relation for entity extraction. To address the aforementioned challenges, this paper proposes a triple extraction approach founded on Meta-type Prompt learning and Bidirectional relation Collaborative Attention (MPBCA). That method utilizes meta-type prompt learning which introduces relation types, entity types and their correlations to optimize the token embedding. Thereby, the generated word embeddings can be more adaptive for the triple extraction task by exploring the intrinsic logical connections of target triple components. Furthermore, our approach designs a bidirectional relation complementary attention mechanism to identify entity head and tail positions. That mechanism not only strengthens the semantic modelling capabilities for relations between entities, but also improves fault tolerance and captures the potentially accurate target triples by using bidirectional sentence structures, not unidirectional structures. The results of experiments on two public datasets show that our triple extraction approach MPBCA proposed in this paper is superior to the existing methods, confirming the effectiveness and superiority of the proposed model.
KW - bidirectional entity extraction
KW - meta-type prompt learning
KW - relation complementary attention
KW - triple extraction
UR - http://www.scopus.com/inward/record.url?scp=85201949594&partnerID=8YFLogxK
U2 - 10.1117/12.3038202
DO - 10.1117/12.3038202
M3 - Conference contribution
AN - SCOPUS:85201949594
T3 - Proceedings of SPIE - The International Society for Optical Engineering
BT - Seventh International Conference on Advanced Electronic Materials, Computers, and Software Engineering, AEMCSE 2024
A2 - Yang, Lvqing
PB - SPIE
T2 - 7th International Conference on Advanced Electronic Materials, Computers, and Software Engineering, AEMCSE 2024
Y2 - 10 May 2024 through 12 May 2024
ER -