An improved KNN text categorization algorithm by adopting cluster technology

Xiao Fei Zhang*, He Yan Huang

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

17 Citations (Scopus)

Abstract

k-Nearest Neighbor (KNN) algorithm has the advantage of high accuracy and stability. But the time complexity of KNN is directly proportional to the sample size, its classification speed is low and it is problematic to be put into practice in large-scale information processing. An improved KNN text categorization algorithm is proposed which classifies faster than the traditional KNN does. Firstly, some similar sample documents are combined into a center document through adopting automatic text clustering technology. Then, a large number of original samples are replaced with the small amount of sample cluster centers. Therefore, the calculation amount of KNN is reduced greatly and the classification is speeded up. The experimental results show that the time complexity of the proposed algorithm is decreased by one order of magnitude and its accuracy is approximately equal to those of the SVM and traditional KNN.

Original languageEnglish
Pages (from-to)936-940
Number of pages5
JournalMoshi Shibie yu Rengong Zhineng/Pattern Recognition and Artificial Intelligence
Volume22
Issue number6
Publication statusPublished - Dec 2009
Externally publishedYes

Keywords

  • Cluster center
  • Natural language processing (NLP)
  • Text categorization
  • Text clustering
  • k-Nearest neighbor (KNN)

Fingerprint

Dive into the research topics of 'An improved KNN text categorization algorithm by adopting cluster technology'. Together they form a unique fingerprint.

Cite this