Skip to main navigation Skip to search Skip to main content

Tibetan syllable-based functional chunk boundary identification

  • Beijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications
  • Beijing Institute of Technology
  • Chinese Academy of Social Sciences

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Tibetan syntactic functional chunk parsing is aimed at identifying syntactic constituents of Tibetan sentences. In this paper, based on the Tibetan syntactic functional chunk description system, we propose a method which puts syllables in groups instead of word segmentation and tagging and use the Conditional Random Fields (CRFs) to identify the functional chunk boundary of a sentence. According to the actual characteristics of the Tibetan language, we firstly identify and extract the syntactic markers as identification characteristics of syntactic functional chunk boundary in the text preprocessing stage, while the syntactic markers are composed of the sticky written form and the non-sticky written form. Afterwards we identify the syntactic functional chunk boundary using CRF. Experiments have been performed on a Tibetan language corpus containing 46783 syllables and the precision, recall rate and F value respectively achieves 75.70%, 82.54% and 79.12%. The experiment results show that the proposed method is effective when applied to a small-scale unlabeled corpus and can provide foundational support for many natural language processing applications such as machine translation.

Original languageEnglish
Title of host publicationChinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data - 16th China National Conference, CCL 2017 and 5th International Symposium, NLP-NABD 2017, Proceedings
EditorsMaosong Sun, Baobao Chang, Xiaojie Wang, Deyi Xiong
PublisherSpringer Verlag
Pages439-448
Number of pages10
ISBN (Print)9783319690049
DOIs
Publication statusPublished - 2017
Event16th China National Conference on Computational Linguistics, CCL 2017 and 5th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2017 - Nanjing, China
Duration: 13 Oct 201715 Oct 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10565 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference16th China National Conference on Computational Linguistics, CCL 2017 and 5th International Symposium on Natural Language Processing Based on Naturally Annotated Big Data, NLP-NABD 2017
Country/TerritoryChina
CityNanjing
Period13/10/1715/10/17

Keywords

  • CRF
  • Chunk boundary recognition
  • Syllable
  • Syntactic marker
  • Tibetan syntactic functional chunk

Fingerprint

Dive into the research topics of 'Tibetan syllable-based functional chunk boundary identification'. Together they form a unique fingerprint.

Cite this