Retrieval-Augmented Document-Level Event Extraction with Cross-Attention Fusion

Yuting Xu, Chong Feng*, Bo Wang, Jing Huang, Xinmu Qi

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Document-level event extraction intends to extract event records from an entire document. Current approaches adopt an entity-centric workflow, wherein the effectiveness of event extraction heavily relies on the input representation. Nonetheless, the input representations derived from earlier approaches exhibit incongruities when applied to the task of event extraction. To mitigate these discrepancies, we propose a Retrieval-Augmented Document-level Event Extraction (RADEE) method that leverages instances from the training dataset as supplementary event-informed knowledge. Specifically, the most similar training instance containing event records is retrieved and then concatenated with the input to enhance the input representation. To effectively integrate information from retrieved instances while minimizing noise interference, we introduce a fusion layer based on cross-attention mechanism. Experimental results obtained from a comprehensive evaluation of a large-scale document-level event extraction dataset reveal that our proposed method surpasses the performance of all baseline models. Furthermore, our approach exhibits improved performance even in low-resource settings, emphasizing its effectiveness and adaptability.

Original languageEnglish
Title of host publicationSocial Media Processing - 11th Chinese National Conference, SMP 2023, Proceedings
EditorsFeng Wu, Xiangnan He, Xuanjing Huang, Jiliang Tang, Shu Zhao, Daifeng Li, Jing Zhang
PublisherSpringer Science and Business Media Deutschland GmbH
Pages218-229
Number of pages12
ISBN (Print)9789819975952
DOIs
Publication statusPublished - 2024
Event11th Chinese National Conference on Social Media Processing, SMP 2023 - Anhui, China
Duration: 23 Nov 202326 Nov 2023

Publication series

NameCommunications in Computer and Information Science
Volume1945 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference11th Chinese National Conference on Social Media Processing, SMP 2023
Country/TerritoryChina
CityAnhui
Period23/11/2326/11/23

Keywords

  • Cross-attention fusion
  • Document-level event extraction
  • Retrieval-augmented

Fingerprint

Dive into the research topics of 'Retrieval-Augmented Document-Level Event Extraction with Cross-Attention Fusion'. Together they form a unique fingerprint.

Cite this