Mapping sentences to concept transferred space for semantic textual similarity

Heyan Huang, Hao Wu*, Xiaochi Wei, Yang Gao, Shumin Shi

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

2 Citations (Scopus)

Abstract

Semantic textual similarity (STS) seeks to assess the degree of semantic equivalence between two sentences or snippets of texts. Most methods of STS are based on word surface and deem words as meaning unrelated symbols, which makes these methods indiscriminative for ubiquitous conceptual association among words. Recently, concept transferred space (CTS) is proposed to solve word conceptual association problem. It is generated from the noun concepts with their IS-A relations in WordNet. However, the CTS-based model can only calculate nouns; as a result, a large number of words, i.e., verbs, adjectives, adverbs as well as out-of-vocabulary named entities (OOV NEs), are neglected, thus resulting in information loss in the semantic similarity evaluation. This paper presents ways to solve this problem: To involve words other than nouns, derivational links in WordNet are employed to associate verbs, adjectives, and adverbs with their corresponding noun concepts; to prevent information loss by OOV NEs, the increased quantity of information of them is predicted according to the tendency learned from known NEs. Moreover, to further improve the accuracy of the CTS-based model, we take the importance of different types of words into consideration by assigning corresponding weights for them. Experimental results suggest that the proposed comprehensive CTS-based model achieves significant improvement compared with the primitive one without the non-nominal words, OOV NEs, and word weights and also outperforms all the yearly state-of-the-art systems at the *SEM/SemEval 2013–2016 STS tasks. Additionally, at the SemEval 2017 STS task, our team with the comprehensive CTS-based model ranked the second and the first among all teams and on Track 1 dataset, respectively.

Original languageEnglish
Pages (from-to)1353-1376
Number of pages24
JournalKnowledge and Information Systems
Volume60
Issue number3
DOIs
Publication statusPublished - 1 Sept 2019

Keywords

  • Concept transferred space
  • Information content
  • Semantic textual similarity
  • WordNet

Fingerprint

Dive into the research topics of 'Mapping sentences to concept transferred space for semantic textual similarity'. Together they form a unique fingerprint.

Cite this