Text classification with enriched word features

Jingda Xu, Cheng Zhang, Peng Zhang, Dawei Song*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Citations (Scopus)

Abstract

Text classification is a fundamental task in natural language processing. Most existing text classification models focus on constructing sophisticated high-level text features but ignore the importance of word features. Those models only use low-level word features obtained from a linear layer as input. To explore how the quality of word representations affects text classification, we propose a deep architecture which can extract high-level word features to perform text classification. Specifically, we use different temporal convolution filters, which vary in size, to capture different contextual features. Then a transition layer is used to coalesce the contextual features and form an enriched high-level word representations. We also find that word feature reuse is useful in our architecture to enrich word representations. Extensive experiments on six publically available datasets show that enriched word representations can significantly improve the performance of classification models.

Original languageEnglish
Title of host publicationPRICAI 2018
Subtitle of host publicationTrends in Artificial Intelligence - 15th Pacific Rim International Conference on Artificial Intelligence, Proceedings
EditorsXin Geng, Byeong-Ho Kang
PublisherSpringer Verlag
Pages274-281
Number of pages8
ISBN (Print)9783319973098
DOIs
Publication statusPublished - 2018
Externally publishedYes
Event15th Pacific Rim International Conference on Artificial Intelligence, PRICAI 2018 - Nanjing, China
Duration: 28 Aug 201831 Aug 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11013 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference15th Pacific Rim International Conference on Artificial Intelligence, PRICAI 2018
Country/TerritoryChina
CityNanjing
Period28/08/1831/08/18

Keywords

  • Enriched word representation
  • Temporal convolution
  • Text classification

Fingerprint

Dive into the research topics of 'Text classification with enriched word features'. Together they form a unique fingerprint.

Cite this