Semantic concept detection for video based on extreme learning machine

Bo Lu*, Guoren Wang, Ye Yuan, Dong Han

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

18 Citations (Scopus)

Abstract

Semantic concept detection is an important step in concept-based semantic video retrieval, which can be regarded as an intermediate descriptor to bridge the semantic gap. Most existing concept detection methods utilize Support Vector Machines (SVM) as concept classifier. However, there are several drawbacks of using SVM, such as the high computational cost and large number of parameters to be optimized. In this paper we propose an Extreme Learning Machine (ELM) based Multi-modality Classifier Combination Framework (MCCF) to improve the accuracy of semantic concept detection. In this framework: (i) three ELM classifiers are trained by exploring three kinds of visual features respectively, (ii) a probability-based fusion method is then proposed to combine the prediction results of each ELM classifier, (iii) we integrate the prediction results of ELM classifier with the information of contextual correlation among concepts to further improve the accuracy of semantic concept detection. Experiments on the widely used TRECVID datasets demonstrate that our approach can effectively improve the accuracy of semantic concept detection and achieve performance at extremely high speed.

Original languageEnglish
Pages (from-to)176-183
Number of pages8
JournalNeurocomputing
Volume102
DOIs
Publication statusPublished - 15 Feb 2013
Externally publishedYes

Keywords

  • Contextual correlation
  • ELM classifier
  • ELM-OAA classifier
  • Extreme learning machine
  • Multi-modality
  • Probability-based fusion
  • Semantic concept detection
  • Single hidden layer feedforward networks

Fingerprint

Dive into the research topics of 'Semantic concept detection for video based on extreme learning machine'. Together they form a unique fingerprint.

Cite this