TY - GEN
T1 - Recurrent attention LSTM model for image chinese caption generation
AU - Zhang, Chaoying
AU - Dai, Yaping
AU - Cheng, Yanyan
AU - Jia, Zhiyang
AU - Hirota, Kaoru
N1 - Publisher Copyright:
© 2018 IEEE.
PY - 2018/7/2
Y1 - 2018/7/2
N2 - A Recurrent Attention LSTM model (RAL) is proposed for image Chinese caption generation. The model uses Inception-v4 as CNN model developed by Google to extract image features while the recurrent attention LSTM mechanism determines feature weights. The model can generate words accurately because of adding the weights of image region. Therefore, the proposed model is able to generate more relevant descriptions and improve the efficiency of the system. Compared with Neural Image Caption (NIC) model, the experiment results show that the performance of the proposed model is improved by 1.8% with BLEU-4 metrics and 6.2% with CIDEr metrics on the AI Challenger Image Chinese Captioning dataset.
AB - A Recurrent Attention LSTM model (RAL) is proposed for image Chinese caption generation. The model uses Inception-v4 as CNN model developed by Google to extract image features while the recurrent attention LSTM mechanism determines feature weights. The model can generate words accurately because of adding the weights of image region. Therefore, the proposed model is able to generate more relevant descriptions and improve the efficiency of the system. Compared with Neural Image Caption (NIC) model, the experiment results show that the performance of the proposed model is improved by 1.8% with BLEU-4 metrics and 6.2% with CIDEr metrics on the AI Challenger Image Chinese Captioning dataset.
KW - Convolutional Neural Network
KW - Image Chinese Caption Generation
KW - Long Short-Term Memory
KW - Recurrent Attention LSTM
UR - http://www.scopus.com/inward/record.url?scp=85067103894&partnerID=8YFLogxK
U2 - 10.1109/SCIS-ISIS.2018.00134
DO - 10.1109/SCIS-ISIS.2018.00134
M3 - Conference contribution
AN - SCOPUS:85067103894
T3 - Proceedings - 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems and 19th International Symposium on Advanced Intelligent Systems, SCIS-ISIS 2018
SP - 808
EP - 813
BT - Proceedings - 2018 Joint 10th International Conference on Soft Computing and Intelligent Systems and 19th International Symposium on Advanced Intelligent Systems, SCIS-ISIS 2018
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - Joint 10th International Conference on Soft Computing and Intelligent Systems and 19th International Symposium on Advanced Intelligent Systems, SCIS-ISIS 2018
Y2 - 5 December 2018 through 8 December 2018
ER -