Motion-flow-guided recurrent network for respiratory signal estimation of x-ray angiographic image sequences

Huihui Fang, Heng Li*, Shuang Song, Kun Pang, Danni Ai, Jingfan Fan, Hong Song, Yang Yu, Jian Yang*

*此作品的通讯作者

科研成果: 期刊稿件文章同行评审

2 引用 (Scopus)

摘要

Motion compensation can eliminate inconsistencies of respiratory movement during image acquisitions for precise vascular reconstruction in the clinical diagnosis of vascular disease from x-ray angiographic image sequences. In x-ray-based vascular interventional therapy, motion modeling can simulate the process of organ deformation driven by motion signals to display a dynamic organ on angiograms without contrast agent injection. Automatic respiratory signal estimation from x-ray angiographic image sequences is essential for motion compensation and modeling. The effects of respiratory motion, cardiac impulses, and tremors on structures in the chest and abdomen bring difficulty in extracting accurate respiratory signals individually. In this study, an end-to-end deep learning framework based on a motion-flow-guided recurrent network is proposed to address the aforementioned problem. The proposed method utilizes a convolutional neural network to learn the spatial features of every single frame, and a recurrent neural network to learn the temporal features of the entire sequence. The combination of the two networks can effectively analyze the image sequence to realize respiratory signal estimation. In addition, the motion-flow between consecutive frames is introduced to provide a dynamic constraint of spatial features, which enables the recurrent network to learn better temporal features from dynamic spatial features than from static spatial features. We demonstrate the advantages of our approach on designed datasets which contain coronary and hepatic angiographic sequences with diaphragm structures, and coronary angiographic sequences without diaphragm structures. Our method improves over state-of-the-art manifold-learning-based methods by 85.7%, 81.5% and 75.3% in respiratory signal accuracy metric on these datasets. The results demonstrate that the proposed method can effectively estimate respiratory signals from multiple motion patterns.

源语言英语
文章编号245020
期刊Physics in Medicine and Biology
65
24
DOI
出版状态已出版 - 21 12月 2020

指纹

探究 'Motion-flow-guided recurrent network for respiratory signal estimation of x-ray angiographic image sequences' 的科研主题。它们共同构成独一无二的指纹。

引用此

Fang, H., Li, H., Song, S., Pang, K., Ai, D., Fan, J., Song, H., Yu, Y., & Yang, J. (2020). Motion-flow-guided recurrent network for respiratory signal estimation of x-ray angiographic image sequences. Physics in Medicine and Biology, 65(24), 文章 245020. https://doi.org/10.1088/1361-6560/aba087