Research on abstractive automatic summarization technology based on deep learning

Junyi Wang, Hongyi Su*, Hong Zheng, Bo Yan, Shenghua Xu, Wenli Tang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Automatic summarization technology is a method to obtain important information from documents, which can alleviate people's time and energy problems in the era of information explosion. This paper mainly studied the abstractive automatic summarization technology based on deep learning. Abstractive automatic summarization is consistent with the human habit of writing abstract, and has the characteristics of simplicity, flexibility and diversity. The experimental results based on English automatic summary data set (CNN/Daily Mail) and Chinese short text summary data set (LCSTS) showed that after the Attention Mechanism, Pointer Networks and Coverage Mechanism were added to the Seq2Seq model, the automatic summary Rouge evaluation index had an apparent improvement. In addition, comparative experiments were carried out from the neural network types (LSTM, GRU, SRU, etc.), the impact of Pointer Networks and Coverage Mechanism and the role of position features and Beam Search. After adding Batch Normalization and location features to the Point-Generator Network, there was a significant improvement in the Rouge1 and Rouge2 evaluation index.

Original languageEnglish
Title of host publicationProceedings - 2019 15th International Conference on Mobile Ad-Hoc and Sensor Networks, MSN 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages433-438
Number of pages6
ISBN (Electronic)9781728152127
DOIs
Publication statusPublished - Dec 2019
Event15th International Conference on Mobile Ad-Hoc and Sensor Networks, MSN 2019 - Shenzhen, China
Duration: 11 Dec 201913 Dec 2019

Publication series

NameProceedings - 2019 15th International Conference on Mobile Ad-Hoc and Sensor Networks, MSN 2019

Conference

Conference15th International Conference on Mobile Ad-Hoc and Sensor Networks, MSN 2019
Country/TerritoryChina
CityShenzhen
Period11/12/1913/12/19

Keywords

  • Abstractive Automatic Summarization
  • Attention Mechanism
  • Beam Search
  • Coverage Mechanism
  • Pointer Networks
  • Seq2Seq

Fingerprint

Dive into the research topics of 'Research on abstractive automatic summarization technology based on deep learning'. Together they form a unique fingerprint.

Cite this