Human-object interaction recognition by modeling context

Qun Zhang; Wei Liang; Xiabing Liu; Yumeng Wang

doi:10.1007/978-3-319-21963-9_35

Human-object interaction recognition by modeling context

Qun Zhang^*, Wei Liang, Xiabing Liu, Yumeng Wang

^*Corresponding author for this work

School of Computer Science and Technology

Beijing Institute of Technology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

In this paper, we present a new method to recognize humanobject interactions by modeling the context between human actions and manipulated objects. It is a challenging task due to severe occlusion between human and objects during the interacting process. While human actions and objects can provide strong context information, such as some action happening is usually related to a certain object, by which we can improve the accuracy of recognition for both of them. In this paper, we use global and local temporal features from skeleton sequences to model actions, and kernel features are applied to describe objects. We optimize all possible solutions from actions and objects by modeling the context between them. The results of experiments show the effectiveness of our method.

Original language	English
Title of host publication	Image and Graphics - 8th International Conference, ICIG 2015, Proceedings
Editors	Yu-Jin Zhang
Publisher	Springer Verlag
Pages	385-395
Number of pages	11
ISBN (Print)	9783319219622
DOIs	https://doi.org/10.1007/978-3-319-21963-9_35
Publication status	Published - 2015
Event	8th International Conference on Image and Graphics, ICIG 2015 - Tianjin, China Duration: 13 Aug 2015 → 16 Aug 2015

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	9218
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	8th International Conference on Image and Graphics, ICIG 2015
Country/Territory	China
City	Tianjin
Period	13/08/15 → 16/08/15

Keywords

Action recognition
Context
Human-object interaction
Object classification

Access to Document

10.1007/978-3-319-21963-9_35

Cite this

Zhang, Q., Liang, W., Liu, X., & Wang, Y. (2015). Human-object interaction recognition by modeling context. In Y.-J. Zhang (Ed.), Image and Graphics - 8th International Conference, ICIG 2015, Proceedings (pp. 385-395). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9218). Springer Verlag. https://doi.org/10.1007/978-3-319-21963-9_35

Zhang, Qun ; Liang, Wei ; Liu, Xiabing et al. / Human-object interaction recognition by modeling context. Image and Graphics - 8th International Conference, ICIG 2015, Proceedings. editor / Yu-Jin Zhang. Springer Verlag, 2015. pp. 385-395 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{57b15fe11c9a499b8e1a0e3a426b7c6e,

title = "Human-object interaction recognition by modeling context",

abstract = "In this paper, we present a new method to recognize humanobject interactions by modeling the context between human actions and manipulated objects. It is a challenging task due to severe occlusion between human and objects during the interacting process. While human actions and objects can provide strong context information, such as some action happening is usually related to a certain object, by which we can improve the accuracy of recognition for both of them. In this paper, we use global and local temporal features from skeleton sequences to model actions, and kernel features are applied to describe objects. We optimize all possible solutions from actions and objects by modeling the context between them. The results of experiments show the effectiveness of our method.",

keywords = "Action recognition, Context, Human-object interaction, Object classification",

author = "Qun Zhang and Wei Liang and Xiabing Liu and Yumeng Wang",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing Switzerland 2015.; 8th International Conference on Image and Graphics, ICIG 2015 ; Conference date: 13-08-2015 Through 16-08-2015",

year = "2015",

doi = "10.1007/978-3-319-21963-9_35",

language = "English",

isbn = "9783319219622",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "385--395",

editor = "Yu-Jin Zhang",

booktitle = "Image and Graphics - 8th International Conference, ICIG 2015, Proceedings",

address = "Germany",

}

Zhang, Q, Liang, W, Liu, X & Wang, Y 2015, Human-object interaction recognition by modeling context. in Y-J Zhang (ed.), Image and Graphics - 8th International Conference, ICIG 2015, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9218, Springer Verlag, pp. 385-395, 8th International Conference on Image and Graphics, ICIG 2015, Tianjin, China, 13/08/15. https://doi.org/10.1007/978-3-319-21963-9_35

Human-object interaction recognition by modeling context. / Zhang, Qun; Liang, Wei; Liu, Xiabing et al.
Image and Graphics - 8th International Conference, ICIG 2015, Proceedings. ed. / Yu-Jin Zhang. Springer Verlag, 2015. p. 385-395 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9218).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Human-object interaction recognition by modeling context

AU - Zhang, Qun

AU - Liang, Wei

AU - Liu, Xiabing

AU - Wang, Yumeng

N1 - Publisher Copyright: © Springer International Publishing Switzerland 2015.

PY - 2015

Y1 - 2015

N2 - In this paper, we present a new method to recognize humanobject interactions by modeling the context between human actions and manipulated objects. It is a challenging task due to severe occlusion between human and objects during the interacting process. While human actions and objects can provide strong context information, such as some action happening is usually related to a certain object, by which we can improve the accuracy of recognition for both of them. In this paper, we use global and local temporal features from skeleton sequences to model actions, and kernel features are applied to describe objects. We optimize all possible solutions from actions and objects by modeling the context between them. The results of experiments show the effectiveness of our method.

AB - In this paper, we present a new method to recognize humanobject interactions by modeling the context between human actions and manipulated objects. It is a challenging task due to severe occlusion between human and objects during the interacting process. While human actions and objects can provide strong context information, such as some action happening is usually related to a certain object, by which we can improve the accuracy of recognition for both of them. In this paper, we use global and local temporal features from skeleton sequences to model actions, and kernel features are applied to describe objects. We optimize all possible solutions from actions and objects by modeling the context between them. The results of experiments show the effectiveness of our method.

KW - Action recognition

KW - Context

KW - Human-object interaction

KW - Object classification

UR - http://www.scopus.com/inward/record.url?scp=84943644739&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-21963-9_35

DO - 10.1007/978-3-319-21963-9_35

M3 - Conference contribution

AN - SCOPUS:84943644739

SN - 9783319219622

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 385

EP - 395

BT - Image and Graphics - 8th International Conference, ICIG 2015, Proceedings

A2 - Zhang, Yu-Jin

PB - Springer Verlag

T2 - 8th International Conference on Image and Graphics, ICIG 2015

Y2 - 13 August 2015 through 16 August 2015

ER -

Zhang Q, Liang W, Liu X, Wang Y. Human-object interaction recognition by modeling context. In Zhang YJ, editor, Image and Graphics - 8th International Conference, ICIG 2015, Proceedings. Springer Verlag. 2015. p. 385-395. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-21963-9_35

Human-object interaction recognition by modeling context

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this