Text understanding with a hybrid neural network based learning

Shen Gao, Huaping Zhang*, Kai Gao

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Citation (Scopus)

Abstract

Teaching machine to understand needs to design an algorithm for the machine to comprehend documents. As some traditional methods cannot learn the inherent characters effectively, this paper presents a new hybrid neural network model to extract sentence-level summarization from single document, and it allows us to develop an attention based deep neural network that can learn to understand documents with minimal prior knowledge. The proposed model composed of multiple processing layers can learn the representations of features. Word embedding is used to learn continuous word representations for constructing sentence as input to convolutional neural network. The recurrent neural network is also used to label the sentences from the original document, and the proposed BAM-GRU model is more efficient. Experimental results show the feasibility of the approach. Some problems and further works are also present in the end.

Original languageEnglish
Title of host publicationData Science - 3rd International Conference of Pioneering Computer Scientists, Engineers and Educators, ICPCSEE 2017, Proceedings
EditorsQilong Han, Beiji Zou, Xiaoning Peng, Zeguang Lu, Guanglu Sun, Weipeng Jing
PublisherSpringer Verlag
Pages115-125
Number of pages11
ISBN (Print)9789811063879
DOIs
Publication statusPublished - 2017
Event3rd International Conference of Pioneer Computer Scientists, Engineers, and Educators, ICPCSEE 2017 - Changsha, China
Duration: 22 Sept 201724 Sept 2017

Publication series

NameCommunications in Computer and Information Science
Volume728
ISSN (Print)1865-0929

Conference

Conference3rd International Conference of Pioneer Computer Scientists, Engineers, and Educators, ICPCSEE 2017
Country/TerritoryChina
CityChangsha
Period22/09/1724/09/17

Keywords

  • Convolutional neural network
  • Deep learning
  • Gated recurrent unit
  • Recurrent neural network
  • Word embedding

Fingerprint

Dive into the research topics of 'Text understanding with a hybrid neural network based learning'. Together they form a unique fingerprint.

Cite this