跳到主要导航 跳到搜索 跳到主要内容

Rebuilding visual vocabulary via spatial-temporal context similarity for video retrieval

  • Robert Gordon University
  • Tianjin University
  • Open University Milton Keynes

科研成果: 书/报告/会议事项章节 › 会议稿件 › 同行评审

摘要

The Bag-of-visual-Words (BovW) model is one of the most popular visual content representation methods for large-scale content-based video retrieval. The visual words are quantized according to a visual vocabulary, which is generated by a visual features clustering process (e.g. K-means, GMM, etc). In principle, two types of errors can occur in the quantization process. They are referred to as the UnderQuantize and OverQuantize problems. The former causes ambiguities and often leads to false visual content matches, while the latter generates synonyms and may lead to missing true matches. Unlike most state-of-the-art research that concentrated on enhancing the BovW model by disambiguating the visual words, in this paper, we aim to address the OverQuantize problem by incorporating the similarity of spatial-temporal contexts associated to pair-wise visual words. The visual words with similar context and appearance are assumed to be synonyms. These synonyms in the initial visual vocabulary are then merged to rebuild a more compact and descriptive vocabulary. Our approach was evaluated on the TRECVID2002 and CC-WEB-VIDEO datasets for two typical Query-By-Example (QBE) video retrieval applications. Experimental results demonstrated substantial improvements in retrieval performance over the initial visual vocabulary generated by the BovW model. We also show that our approach can be utilized in combination with the state-of-the-art disambiguation method to further improve the performance of the QBE video retrieval.

源语言英语
主期刊名MultiMedia Modeling - 20th Anniversary International Conference, MMM 2014, Proceedings
页74-85
页数12
版本PART 1
DOI
出版状态已出版 - 2014
已对外发布是
活动20th Anniversary International Conference on MultiMedia Modeling, MMM 2014 - Dublin, 爱尔兰
期限: 6 1月 2014 → 10 1月 2014

丛书

姓名Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
编号PART 1
卷8325 LNCS
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议20th Anniversary International Conference on MultiMedia Modeling, MMM 2014
国家/地区爱尔兰
市Dublin
时期6/01/14 → 10/01/14

学术指纹

探究 'Rebuilding visual vocabulary via spatial-temporal context similarity for video retrieval' 的科研主题。它们共同构成独一无二的学术指纹。

引用此