Enhancing joint entity and relation extraction with language modeling and hierarchical attention

Renjun Chi, Bin Wu, Linmei Hu*, Yunlei Zhang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

16 Citations (Scopus)
Plum Print visual indicator of research metrics
  • Citations
    • Citation Indexes: 16
  • Captures
    • Readers: 11
see details

Abstract

Both entity recognition and relation extraction can benefit from being performed jointly, allowing them to enhance each other. However, existing methods suffer from the sparsity of relevant labels and strongly rely on external natural language processing tools, leading to error propagation. To tackle these problems, we propose an end-to-end joint framework for entity recognition and relation extraction with an auxiliary training objective on language modeling, i.e., learning to predict surrounding words for each word in sentences. Furthermore, we incorporate hierarchical multi-head attention mechanisms into the joint extraction model to capture vital semantic information from the available texts. Experiments show that the proposed approach consistently achieves significant improvements on joint extraction task of entities and relations as compared with strong baselines.

Original languageEnglish
Title of host publicationWeb and Big Data - 3rd International Joint Conference, APWeb-WAIM 2019, Proceedings
EditorsJie Shao, Man Lung Yiu, Masashi Toyoda, Dongxiang Zhang, Wei Wang, Bin Cui
PublisherSpringer Verlag
Pages314-328
Number of pages15
ISBN (Print)9783030260712
DOIs
Publication statusPublished - 2019
Externally publishedYes
Event3rd APWeb and WAIM Joint Conference on Web and Big Data, APWeb-WAIM 2019 - Chengdu, China
Duration: 1 Aug 20193 Aug 2019

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11641 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference3rd APWeb and WAIM Joint Conference on Web and Big Data, APWeb-WAIM 2019
Country/TerritoryChina
CityChengdu
Period1/08/193/08/19

Keywords

  • Entity recognition
  • Hierarchical attention
  • Joint model
  • Language modeling objective
  • Relation extraction

Fingerprint

Dive into the research topics of 'Enhancing joint entity and relation extraction with language modeling and hierarchical attention'. Together they form a unique fingerprint.

Cite this

Chi, R., Wu, B., Hu, L., & Zhang, Y. (2019). Enhancing joint entity and relation extraction with language modeling and hierarchical attention. In J. Shao, M. L. Yiu, M. Toyoda, D. Zhang, W. Wang, & B. Cui (Eds.), Web and Big Data - 3rd International Joint Conference, APWeb-WAIM 2019, Proceedings (pp. 314-328). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11641 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-26072-9_24