Data-Aware Proxy Hashing for Cross-modal Retrieval

Rong Cheng Tu, Xian Ling Mao*, Wenjin Ji, Wei Wei, Heyan Huang

*此作品的通讯作者

科研成果: 书/报告/会议事项章节会议稿件同行评审

7 引用 (Scopus)

摘要

Recently, numerous proxy hash code based methods, which sufficiently exploit the label information of data to supervise the training of hashing models, have been proposed. Although these methods have made impressive progress, their generating processes of proxy hash codes are based only on the class information of the dataset or labels of data but do not take the data themselves into account. Therefore, these methods will probably generate some inappropriate proxy hash codes, thus damaging the retrieval performance of the hash models. To solve the aforementioned problem, we propose a novel Data-Aware Proxy Hashing for cross-modal retrieval, called DAPH. Specifically, our proposed method first train a data-aware proxy network that takes the data points, label vectors of data, and the class vectors of the dataset as inputs to generate class-based data-aware proxy hash codes, label-fused image-aware proxy hash codes and label-fused text-aware proxy hash codes. Then, we propose a novel hash loss that exploits the three types of data-aware proxy hash codes to supervise the training of modality-specific hashing networks. After training, DAPH is able to generate discriminate hash codes with the semantic information preserved adequately. Extensive experiments on three benchmark datasets show that the proposed DAPH outperforms the state-of-the-art baselines in cross-modal retrieval tasks.

源语言英语
主期刊名SIGIR 2023 - Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval
出版商Association for Computing Machinery, Inc
686-696
页数11
ISBN(电子版)9781450394086
DOI
出版状态已出版 - 19 7月 2023
活动46th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2023 - Taipei, 中国台湾
期限: 23 7月 202327 7月 2023

出版系列

姓名SIGIR 2023 - Proceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval

会议

会议46th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2023
国家/地区中国台湾
Taipei
时期23/07/2327/07/23

指纹

探究 'Data-Aware Proxy Hashing for Cross-modal Retrieval' 的科研主题。它们共同构成独一无二的指纹。

引用此