Image captioning with relational knowledge

Huan Yang, Dandan Song*, Lejian Liao

*此作品的通讯作者

科研成果: 书/报告/会议事项章节会议稿件同行评审

2 引用 (Scopus)
Plum Print visual indicator of research metrics
  • Citations
    • Citation Indexes: 2
  • Captures
    • Readers: 2
see details

摘要

People have learned extensive relational knowledge from daily life. This is one of the facts that enables human to describe the information from images easily. In this paper, we propose a novel framework called Image Captioning with Relational Knowledge (ICRK) that combines relational knowledge with image captioning model and utilizes relational knowledge to strengthen the learning process of representing words. As more precise syntactic and semantic word relationships were learned, the image captioning model acquires more semantic features that help to generate more accurate image descriptions. Experiments on several benchmark datasets, using automatic evaluation metrics, have all demonstrated that our model can significantly improve the quality of image captioning.

源语言英语
主期刊名PRICAI 2018
主期刊副标题Trends in Artificial Intelligence - 15th Pacific Rim International Conference on Artificial Intelligence, Proceedings
编辑Xin Geng, Byeong-Ho Kang
出版商Springer Verlag
378-386
页数9
ISBN(印刷版)9783319973098
DOI
出版状态已出版 - 2018
活动15th Pacific Rim International Conference on Artificial Intelligence, PRICAI 2018 - Nanjing, 中国
期限: 28 8月 201831 8月 2018

出版系列

姓名Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
11013 LNAI
ISSN(印刷版)0302-9743
ISSN(电子版)1611-3349

会议

会议15th Pacific Rim International Conference on Artificial Intelligence, PRICAI 2018
国家/地区中国
Nanjing
时期28/08/1831/08/18

指纹

探究 'Image captioning with relational knowledge' 的科研主题。它们共同构成独一无二的指纹。

引用此

Yang, H., Song, D., & Liao, L. (2018). Image captioning with relational knowledge. 在 X. Geng, & B.-H. Kang (编辑), PRICAI 2018: Trends in Artificial Intelligence - 15th Pacific Rim International Conference on Artificial Intelligence, Proceedings (页码 378-386). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); 卷 11013 LNAI). Springer Verlag. https://doi.org/10.1007/978-3-319-97310-4_43