News abridgement algorithm based on word alignment and syntactic parsing

Min Yu; Huaping Zhang; Yu Zhang; Yang Qiao; Zhonghua Zhao; Yueying He

doi:10.1007/978-3-319-47674-2_26

News abridgement algorithm based on word alignment and syntactic parsing

Min Yu^*, Huaping Zhang, Yu Zhang, Yang Qiao, Zhonghua Zhao, Yueying He

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

The rapid development of new media results in a lot of redundant information, increasing the difficulty of quickly obtaining useful information and browsing simplified messages on portable devices. Thus emerges the automatic news abridgement technology. We propose a novel method of word alignment, aiming at news headlines, applying the combination method of statistics and rules to intelligent abridgement. And a new framework based on the combination of sentence abridgement and sentence selection to generate the abridgement result of news contents, abridging the original text to the word limit, in order to achieve the uttermost conservation of the original meaning. Meanwhile, for a fair and intelligent evaluation, this paper presents an evaluation method of automatic summarization specific to sentence abridgement techniques. Experimental results show that the proposed methods are feasible, and able to automatically generate coherent and representative summaries of given news with high density.

Original language	English
Title of host publication	Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 15th China National Conference, CCL 2016 and 4th International Symposium, NLP-NABD 2016, Proceedings
Editors	Maosong Sun, Zhiyuan Liu, Yang Liu, Hongfei Lin, Xuanjing Huang
Publisher	Springer Verlag
Pages	313-323
Number of pages	11
ISBN (Print)	9783319476735
DOIs	https://doi.org/10.1007/978-3-319-47674-2_26
Publication status	Published - 2016
Event	15th China National Conference on Chinese Computational Linguistics, CCL 2016 and 4th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2016 - Yantai, China Duration: 15 Oct 2016 → 16 Oct 2016

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10035 LNAI
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	15th China National Conference on Chinese Computational Linguistics, CCL 2016 and 4th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2016
Country/Territory	China
City	Yantai
Period	15/10/16 → 16/10/16

Keywords

Heuristic rules
Keyword features
News abridgement
Sentence abridgement
Sentence selection

Access to Document

10.1007/978-3-319-47674-2_26

Cite this

Yu, M., Zhang, H., Zhang, Y., Qiao, Y., Zhao, Z., & He, Y. (2016). News abridgement algorithm based on word alignment and syntactic parsing. In M. Sun, Z. Liu, Y. Liu, H. Lin, & X. Huang (Eds.), Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 15th China National Conference, CCL 2016 and 4th International Symposium, NLP-NABD 2016, Proceedings (pp. 313-323). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10035 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-319-47674-2_26

Yu, Min ; Zhang, Huaping ; Zhang, Yu et al. / News abridgement algorithm based on word alignment and syntactic parsing. Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 15th China National Conference, CCL 2016 and 4th International Symposium, NLP-NABD 2016, Proceedings. editor / Maosong Sun ; Zhiyuan Liu ; Yang Liu ; Hongfei Lin ; Xuanjing Huang. Springer Verlag, 2016. pp. 313-323 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{1818f43379d940b086adfd37f53e355b,

title = "News abridgement algorithm based on word alignment and syntactic parsing",

abstract = "The rapid development of new media results in a lot of redundant information, increasing the difficulty of quickly obtaining useful information and browsing simplified messages on portable devices. Thus emerges the automatic news abridgement technology. We propose a novel method of word alignment, aiming at news headlines, applying the combination method of statistics and rules to intelligent abridgement. And a new framework based on the combination of sentence abridgement and sentence selection to generate the abridgement result of news contents, abridging the original text to the word limit, in order to achieve the uttermost conservation of the original meaning. Meanwhile, for a fair and intelligent evaluation, this paper presents an evaluation method of automatic summarization specific to sentence abridgement techniques. Experimental results show that the proposed methods are feasible, and able to automatically generate coherent and representative summaries of given news with high density.",

keywords = "Heuristic rules, Keyword features, News abridgement, Sentence abridgement, Sentence selection",

author = "Min Yu and Huaping Zhang and Yu Zhang and Yang Qiao and Zhonghua Zhao and Yueying He",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG 2016.; 15th China National Conference on Chinese Computational Linguistics, CCL 2016 and 4th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2016 ; Conference date: 15-10-2016 Through 16-10-2016",

year = "2016",

doi = "10.1007/978-3-319-47674-2_26",

language = "English",

isbn = "9783319476735",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "313--323",

editor = "Maosong Sun and Zhiyuan Liu and Yang Liu and Hongfei Lin and Xuanjing Huang",

booktitle = "Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 15th China National Conference, CCL 2016 and 4th International Symposium, NLP-NABD 2016, Proceedings",

address = "Germany",

}

Yu, M, Zhang, H , Zhang, Y, Qiao, Y, Zhao, Z & He, Y 2016, News abridgement algorithm based on word alignment and syntactic parsing. in M Sun, Z Liu, Y Liu, H Lin & X Huang (eds), Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 15th China National Conference, CCL 2016 and 4th International Symposium, NLP-NABD 2016, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10035 LNAI, Springer Verlag, pp. 313-323, 15th China National Conference on Chinese Computational Linguistics, CCL 2016 and 4th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2016, Yantai, China, 15/10/16. https://doi.org/10.1007/978-3-319-47674-2_26

News abridgement algorithm based on word alignment and syntactic parsing. / Yu, Min; Zhang, Huaping ; Zhang, Yu et al.
Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 15th China National Conference, CCL 2016 and 4th International Symposium, NLP-NABD 2016, Proceedings. ed. / Maosong Sun; Zhiyuan Liu; Yang Liu; Hongfei Lin; Xuanjing Huang. Springer Verlag, 2016. p. 313-323 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10035 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - News abridgement algorithm based on word alignment and syntactic parsing

AU - Yu, Min

AU - Zhang, Huaping

AU - Zhang, Yu

AU - Qiao, Yang

AU - Zhao, Zhonghua

AU - He, Yueying

N1 - Publisher Copyright: © Springer International Publishing AG 2016.

PY - 2016

Y1 - 2016

N2 - The rapid development of new media results in a lot of redundant information, increasing the difficulty of quickly obtaining useful information and browsing simplified messages on portable devices. Thus emerges the automatic news abridgement technology. We propose a novel method of word alignment, aiming at news headlines, applying the combination method of statistics and rules to intelligent abridgement. And a new framework based on the combination of sentence abridgement and sentence selection to generate the abridgement result of news contents, abridging the original text to the word limit, in order to achieve the uttermost conservation of the original meaning. Meanwhile, for a fair and intelligent evaluation, this paper presents an evaluation method of automatic summarization specific to sentence abridgement techniques. Experimental results show that the proposed methods are feasible, and able to automatically generate coherent and representative summaries of given news with high density.

AB - The rapid development of new media results in a lot of redundant information, increasing the difficulty of quickly obtaining useful information and browsing simplified messages on portable devices. Thus emerges the automatic news abridgement technology. We propose a novel method of word alignment, aiming at news headlines, applying the combination method of statistics and rules to intelligent abridgement. And a new framework based on the combination of sentence abridgement and sentence selection to generate the abridgement result of news contents, abridging the original text to the word limit, in order to achieve the uttermost conservation of the original meaning. Meanwhile, for a fair and intelligent evaluation, this paper presents an evaluation method of automatic summarization specific to sentence abridgement techniques. Experimental results show that the proposed methods are feasible, and able to automatically generate coherent and representative summaries of given news with high density.

KW - Heuristic rules

KW - Keyword features

KW - News abridgement

KW - Sentence abridgement

KW - Sentence selection

UR - http://www.scopus.com/inward/record.url?scp=84992476971&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-47674-2_26

DO - 10.1007/978-3-319-47674-2_26

M3 - Conference contribution

AN - SCOPUS:84992476971

SN - 9783319476735

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 313

EP - 323

BT - Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 15th China National Conference, CCL 2016 and 4th International Symposium, NLP-NABD 2016, Proceedings

A2 - Sun, Maosong

A2 - Liu, Zhiyuan

A2 - Liu, Yang

A2 - Lin, Hongfei

A2 - Huang, Xuanjing

PB - Springer Verlag

T2 - 15th China National Conference on Chinese Computational Linguistics, CCL 2016 and 4th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2016

Y2 - 15 October 2016 through 16 October 2016

ER -

Yu M, Zhang H , Zhang Y, Qiao Y, Zhao Z, He Y. News abridgement algorithm based on word alignment and syntactic parsing. In Sun M, Liu Z, Liu Y, Lin H, Huang X, editors, Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 15th China National Conference, CCL 2016 and 4th International Symposium, NLP-NABD 2016, Proceedings. Springer Verlag. 2016. p. 313-323. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-47674-2_26

News abridgement algorithm based on word alignment and syntactic parsing

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this