SARNN: A Spatiotemporal Prediction Model for Reducing Error Transmissions

Yonghui Liang, Lu Zhang, Yuqing He*, Na Xu, Mingqi Liu, Jeremy Jianshuo li Mahr

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Spatiotemporal prediction has become an important research topic in weather forecasting and traffic planning. Due to the cyclic structure for prediction images frame by frame, the error generation and accumulation has often led to blurred images. In this paper, we propose a new end-to-end spatiotemporal attention recurrent neural network (SARNN) to overcome this problem. A new cyclic core mechanism based on long-short term memory (LSTM) is used for extracting the directions of spatial correlation and temporal evolution feature separately. Specifically, an attention mechanism added in temporal direction allows for adaptively choosing highlight input time step of hidden state, instead of decoder just relying on the output of previous time step; a scale change convolution block has been added in the spatial direction to enhance the capability of extraction multi-level semantic features. The validation experiment on Moving-Mnist and KTH dataset demonstrates that SARNN can output more accurate and clearer prediction frames.

Original languageEnglish
Title of host publicationPattern Recognition - 6th Asian Conference, ACPR 2021, Revised Selected Papers
EditorsChristian Wallraven, Qingshan Liu, Hajime Nagahara
PublisherSpringer Science and Business Media Deutschland GmbH
Pages130-143
Number of pages14
ISBN (Print)9783031023743
DOIs
Publication statusPublished - 2022
Event6th Asian Conference on Pattern Recognition, ACPR 2021 - Virtual, Online
Duration: 9 Nov 202112 Nov 2021

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13188 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference6th Asian Conference on Pattern Recognition, ACPR 2021
CityVirtual, Online
Period9/11/2112/11/21

Keywords

  • Attention mechanism
  • LSTM
  • RNN based model
  • Spatiotemporal prediction

Fingerprint

Dive into the research topics of 'SARNN: A Spatiotemporal Prediction Model for Reducing Error Transmissions'. Together they form a unique fingerprint.

Cite this