A Fuzzy Word Similarity Measure for Selecting Top-k Similar Words in Query Expansion

Qian Liu, Heyan Huang, Junyu Xuan, Guangquan Zhang, Yang Gao, Jie Lu*

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

16 Citations (Scopus)

Abstract

Top-$ k$ words selection is a technique used to detect and return the $ k$ most similar words to a given word from a candidate set. This is a crucial and widely used tool in various tasks. The key issue in top-$k$ words selection is how to measure the similarity between words. One popular and effective solution is to use a word embedding-based similarity measure, which represents words as low-dimensional vectors and measures the similarities between words according to the similarity of the vectors, using a metric. However, most word embedding methods only consider the local proximity properties of two words in a corpus. To mitigate this issue. In this article, we propose to use association rules for measuring word similarity at a global level, and a fuzzy similarity measure for top-k words selection that jointly encodes the local and the global similarities. Experiments on a real-world query task with three benchmark datasets, i.e., TREC-disk 4&5, WT10G, and RCV1, demonstrate the efficiency of the proposed method compared to several state-of-the-art baselines.

Original languageEnglish
Article number9091826
Pages (from-to)2132-2144
Number of pages13
JournalIEEE Transactions on Fuzzy Systems
Volume29
Issue number8
DOIs
Publication statusPublished - Aug 2021

Keywords

  • Fuzzy logic
  • Fuzzy machine learning
  • Natural language processing
  • Word embedding

Fingerprint

Dive into the research topics of 'A Fuzzy Word Similarity Measure for Selecting Top-k Similar Words in Query Expansion'. Together they form a unique fingerprint.

Cite this